Utilizing SPB Benchmark from SPB
Software House, I compared similar devices on a common
testing software platform. Testing was done with a fresh unit
after a hard reset, Imaginet Pocket Arabizer Disabled, GSM/GPRS
module turned ON, and only SPB Benchmark loaded in Main Memory.
The results were then taken from the unit, and compared utilizing
SPB Benchmark's visualize capability. Anything you see in red
denotes that the particular unit won that specific test.
It is important to note that ActiveSync
speeds are directly dependent on how many USB devices you have
in the chain, if you have USB 1.1 or USB 2.0, and how fast your
particular PC is. Also SD/CF memory speed tests imbed the speed
of the SD/CF card itself.
Table of results
Asus
MyPal A716 (2003, 400MHz)
HP
iPAQ h4150 (2003, 400MHz)
Fujitsu-Siemens
Pocket LOOX 610 (2003, 400MHz)
T-Mobile
MDA (2002, 200Mhz)
Toshiba
e750 (2003, 400MHz)
i-Mate
PDA2K (2003 SE, 400MHz)
imate
(2003, 400MHz)
Everex
E500 (2003, 400MHz)
Spb
Benchmark index
1622
1606
1610
1062
1225
1342
1360
731
CPU
index
1796
1814
1813
1008
1838
1819
1864
1016
File
system index
1205
1171
1175
1037
1128
1056
1065
898
Graphics
index
3954
3858
3943
1734
688
1188
1190
258
ActiveSync
index
2192
2031
1775
1147
1751
-
-
-
Platform
index
1510
1290
1341
881
1085
1140
1159
838
Write
1 MB file (KB/sec)
1284
1270
1282
791
1221
1242
1255
729
Read
1 MB file (MB/sec)
27.8
27.1
27.4
19.6
26.8
26.3
26.3
17.5
Copy
1 MB file (KB/sec)
1279
1268
1279
790
1252
1252
1260
717
Write
10 KB x 100 files (KB/sec)
928
919
936
540
859
831
859
569
Read
10 KB x 100 files (MB/sec)
10.4
10.5
10.7
6.45
9.62
8.41
8.55
7.63
Copy
10 KB x 100 files (KB/sec)
820
809
830
461
757
717
756
548
Directory
list of 2000 files (thousands of files/sec)
22.2
20.9
20.4
118
20.5
18.6
18.3
25.8
Internal
database read (records/sec)
1539
1428
1518
608
1391
1372
1428
818
Graphics
test: DDB BitBlt (frames/sec)
309
271
305
204
68.4
121
122
67.6
Graphics
test: DIB BitBlt (frames/sec)
27.3
26.9
27.3
21.3
22.9
23
23.2
12.8
Graphics
test: GAPI BitBlt (frames/sec)
725
725
722
217
73.2
136
136
24.6
Pocket
Word document open (KB/sec)
105
39.3
41.6
32.2
37.7
38
38.5
39.2
Pocket
Internet Explorer HTML load (KB/sec)
9.27
8.8
9.49
7.19
7.28
7.56
7.64
7.51
Pocket
Internet Explorer JPEG load (KB/sec)
239
228
245
70.7
233
229
245
144
File
Explorer large folder list (files/sec)
598
592
625
311
569
565
589
560
Compress
1 MB file using ZIP (KB/sec)
241
245
249
107
243
238
248
204
Decompress
1024x768 JPEG file (KB/sec)
609
609
609
322
607
610
612
293
Arkaball
frames per second (frames/sec)
242
243
245
107
61
98.8
100
54.6
CPU
test: Whetstones MFLOPS (Mop/sec)
0.076
0.076
0.077
0.046
0.075
0.076
0.077
0.042
CPU
test: Whetstones MOPS (Mop/sec)
55.4
55.4
55.5
34.1
55.2
55
54.6
27.6
CPU
test: Whetstones MWIPS (Mop/sec)
5.02
5.01
5.03
2.98
4.99
4.97
5.03
2.71
Memory
test: copy 1 MB using memcpy (MB/sec)
98.4
101
99
71.3
106
104
108
52.2
ActiveSync:
upload 1 MB file (KB/sec)
203
190
158
109
157
-
-
-
ActiveSync:
download 1 MB file (KB/sec)
377
337
367
180
345
372
-
-
Those are not very impressive
results for i-Mate PDA2K. It can be ranked somewhere in the middle
in-between the devices in this test. Overall I would say this
is an average performance compared to high-end devices in this
list.
Spb Benchmark index reflects
the overall Pocket PC hardware performance. It depends on hardware
design of the Pocket PC device, taking into account the performance
of CPU, memory, file and video systems.
CPU index reflects the performance
of your Pocket PC processor. Both integer and floating-point
calculations performance is taken into account.
File system index reflects the
performance of the internal file system of your Pocket PC device.
It is not affected by storage card speed or by total amount of
memory installed on your device, only the speed of file manipulations
is taken into account.
This index reflects the performance
of your Pocket PC's video subsystem.
Platform index reflects the overall
performance of the operating system running on your Pocket PC.
It mainly depends on performance of the operating system itself,
performance of file manipulations and built-in applications such
as Pocket Word or Pocket Internet Explorer.
Click
here to view all graphs for performance test results
Storage Card Test
The following series of tests is
to measure the performance of the Storage Card file system. In
this test I used 256MB SD Card manufactured by SimpleTech. Also
in this test the flash ROM storage was also tested referred to
as Storage.
Copying
100 of 10 KB files to storage card (KB/sec)
276
13.5
23.3
13.5
387
13.3
49.8
13.6
55.9
13.4
73.7
361
Copying
100 of 10 KB files from storage card (KB/sec)
560
618
193
449
571
639
340
310
475
401
405
476
Directory
listing: 2000 files (thousands of files/sec)
14.5
14.2
0.58
12.9
13.2
14.2
8.88
8.92
13.3
13.2
12.8
12.7
Click
here to view all graphs for SD Card test results
Battery Test
This test was done also utilizing
SPB Benchmark. It provides a series of tests that maintain different
processes and states on a Pocket PC and monitor the discharge
of the battery. But please be aware that there is a big difference
in usage time while the screen is turned ON as opposed when it
is turned OFF. It's really important to note that these kinds
of tests really don't give you the full picture with regards
to real world battery life. Typical users will not be leaving
their Pocket PC on for hours at a time. Instead they will turn
it ON for a few minutes, do some work and then turn it OFF. This
type of usage will repeat throughout the day. Nevertheless I
wanted to actually know how well the 1490 mAh Lithium Polymer
Battery performed in these tests.
The following test results contains
lifetime result, the detailed chart of the discharge process
and test description. Let’s take a look then:
Note that in all of the following
tests Imaginet Pocket Arabizer was Disabled.
1. Battery test "Max backlight,
video playback"
Battery life time: 4 hours 33 min
This test measures the target Pocket
PC battery lifetime when a video clip is played with Windows
Media Player for Pocket PC and the screen backlight is set to
maximum.
2. Battery test "No display,
mp3 playback"
Battery life time: 11 hours 55 min
This test measures the target
Pocket PC battery lifetime when an MP3 sound is played with Windows
Media Player for Pocket PC and the screen is turned off.
3. Battery test "Max backlight, standard
using"
Battery life time: 5 hours 30 min
This test measures the target
Pocket PC battery lifetime when the device is used with normal
load and with the backlight set to maximum. Spb Benchmark periodically
opens Pocket Word, loads a document and closes Pocket Word to
emulate normal Pocket PC usage.
4. Battery test "Max backlight, GPRS"
Battery life time: 6 hours 41 min
This test measures the target
Pocket PC battery lifetime when the GPRS connection is enabled
and the screen backlight is set to maximum.
5. Battery test "Max backlight, Bluetooth"
Battery life time: 6 hours 18 min
This test measures the target
Pocket PC battery lifetime when Bluetooth is enabled and the
screen backlight is set to maximum.
6. Battery test "Maximum backlight, WiFi" *
Battery life time: 3 hours 55 min
This test measures the target Pocket PC battery
lifetime when the WiFi adapter is enabled and the screen backlight
is set to maximum.
* Note: When battery was almost at 10% and
the Benchmark test indicates approximately 20 minutes of estimated
time remaining the WLAN application forced the device to switch
OFF WiFi and I got this message: "The power is insufficient
to support your selected device, please close some functions
that have been enabled or plug in AC to recharge your battery
and then retry it." In this case we should exclude 20 or
30 minutes out of WiFi test result. You can see how the battery
drain curve changed after 3:00 hours.
One battery test was not done
is the "No backlight, zero utilization", this
test measures the target Pocket PC battery lifetime when the
device is not used at all. I didn't do it because I believe
people will be more interested to know how the devices performs
when it is in action not when it is left idle.
I would like to highlight again
that the tests were performed with "maximum backlight" which
should not give the ordinary Pocket PC user an indication of
the actual battery performance in standard usage in real life.
Obviously the power hungry screen drains the battery very fast
so to have a longer running device it is always expected to lower
the screen brightness as low as you can to a level where you
feel comfortable using the device on battery power. The best
way to utilize the full screen brightness is when the device
is connected to a power source.
On page 4 I have tested all
the wireless features including WiFi, Bluetooth and GSM
