Raspberry Pi3 shows benchmark results for TWO times less

[carter]

Hi everyone.

First one. I found this page in internet https://www.element14.com/community/com ... hmark-ever
And I was intrigued and wondered how my Pi 3 gonna run with this benchmark. Tried this benchmark and had surprised. For example you can test it as well.

Code: Select all

sudo apt-get install sysbench
sysbench --num-threads=4 --test=cpu --cpu-max-prime=20000 --validate run

After this test my Raspberry Pi 3 shows this result

Test execution summary:
total time: 242.0059s
total number of events: 10000
total time taken by event execution: 967.8505
per-request statistics:
min: 95.43ms
avg: 96.79ms
max: 155.89ms
approx. 95 percentile: 98.96ms

Threads fairness:
events (avg/stddev): 2500.0000/39.62
execution time (avg/stddev): 241.9626/0.03

I also have Raspberry Pi 2 and ran this benchmark as well

Test execution summary:
total time: 255.5132s
total number of events: 10000
total time taken by event execution: 1021.8823
per-request statistics:
min: 77.96ms
avg: 102.19ms
max: 168.08ms
approx. 95 percentile: 118.15ms

Threads fairness:
events (avg/stddev): 2500.0000/7.45
execution time (avg/stddev): 255.4706/0.02

Shocked! This test on Pi2 shows almost SAME result as on Pi3.

All the tests have given figures of two times worse than that of the author of the article. Not for 5-10% difference, but 100%. TWO TIMES! How it possible?

Bench test from article:

Total time 119.4716 !!!!

per request statistics
min 47.69 ms
avg 47.78 ms
max 59.04 ms

Okay. Probably this test is pretty subjective. Lets try another benchmark test.

For this test you need install pigz.

Code: Select all

sudo apt-get install pigz

And after this put command below to start this test

Code: Select all

dd bs=1k count=1M if=/dev/urandom |pigz -p 8 - > /dev/null

pi@raspberrypi:~ $ dd bs=1k count=1M if=/dev/urandom |pigz -p 8 - > /dev/null
1048576+0 records in
1048576+0 records out
1073741824 bytes (1.1 GB) copied, 458.207 s, 2.3 MB/s

I bought my Raspberries Pi3 on Amazon. My old friend from Europe bought Pi3 in the market in his country. And we started these tests on the same OS versions with same kernel and on the same boards. Everything was completely same.

His test shows different result with my Pi3. And his Pi3 two times faster than mine.

pi@raspberrypi:~/test $ dd bs=1k count=1M if=/dev/urandom |pigz -p 8 - > /dev/null
1048576+0 records in
1048576+0 records out
1073741824 bytes (1.1 GB) copied, 240.172 s, 4.5 MB/s !!!! TWO TIMES MORE !

His 'sysbench' test also shows better performance for TWO times! AGAIN FOR TWO TIMES!

total time: 112.6931s

And rest of other also same with article.

I have _four_(4) RPi3 and they show completely same results. All these Pi3 I bought on Amazon and Ebay in the USA.

I do not want to believe that I was cheated. And bought something for which I did not pay. But, seems that for the US market and European there different boards are made. I would like to hear the explanation from those who designed, produces and sells this boards. What do you think guys?

Probably I did somewhere incorrectly, or configured, or installed, or ran? Maybe. But I do not think so.

[ejolson]

Unless you install a heatsink with fan, the Pi 3B hardware will throttle down to 600 MHz from the standard speed of 1200 MHz almost as soon as the benchmark starts. This results in 1/2 the expected performance numbers.

[carter]

Thank you for your response. I installed cooper heat sink. Temperature never get high than 54C.
Check attach please. Also set the frequency to maximum 1.2Ghz and got completely same result.
Any ideas?

[jahboater]

Sysbench cpu is explicitly a 64-bit benchmark so I am not sure if its useful on the Pi running Raspbian. I would expect this to take about 7 - 8 seconds on a Pi3 with a 64-bit OS. That may be quick enough to avoid throttling.

Code: Select all

Test execution summary:
    total time:                          5.5439s
    total number of events:              10000
    total time taken by event execution: 22.1473
    per-request statistics:
         min:                                  2.18ms
         avg:                                  2.21ms
         max:                                 13.72ms
         approx.  95 percentile:               2.23ms

Threads fairness:
    events (avg/stddev):           2500.0000/21.15
    execution time (avg/stddev):   5.5368/0.01

for the same cpu (cortex-a53 in 64-bit mode at 1.7GHz).

[piuser72]

Results for my Pi 3 running following (prime to 20000, 4 threads, 110 seconds 40C (ambient 20C)):

sysbench --num-threads=4 --test=cpu --cpu-max-prime=20000 --validate run

Code: Select all

piuser72@raspberrypi:~ $ sysbench --num-threads=4 --test=cpu --cpu-max-prime=20000 --validate run
sysbench 0.4.12:  multi-threaded system evaluation benchmark

Running the test with following options:
Number of threads: 4
Additional request validation enabled.


Doing CPU performance benchmark

Threads started!
Done.

Maximum prime number checked in CPU test: 20000


Test execution summary:
    total time:                          110.5353s
    total number of events:              10000
    total time taken by event execution: 442.0022
    per-request statistics:
         min:                                 44.02ms
         avg:                                 44.20ms
         max:                                105.68ms
         approx.  95 percentile:              44.30ms

Threads fairness:
    events (avg/stddev):           2500.0000/8.77
    execution time (avg/stddev):   110.5006/0.02

while true; do vcgencmd measure_clock arm; vcgencmd measure_temp; sleep 10; done

Code: Select all

piuser72@raspberrypi:~ $ while true; do vcgencmd measure_clock arm; vcgencmd measure_temp; sleep 10; done
frequency(45)=1300136000
temp=30.6'C
frequency(45)=1300000000
temp=36.5'C
frequency(45)=1300000000
temp=37.6'C
frequency(45)=1300000000
temp=38.6'C
frequency(45)=1300000000
temp=39.2'C
frequency(45)=1300000000
temp=39.7'C
frequency(45)=1300000000
temp=39.7'C
frequency(45)=1300002000
temp=39.7'C
frequency(45)=1300000000
temp=40.8'C
frequency(45)=1300000000
temp=40.8'C
frequency(45)=1300000000
temp=40.8'C
frequency(45)=1300000000
temp=40.8'C
frequency(45)=1300000000
temp=35.4'C
frequency(45)=600000000
temp=31.6'C

[lumsdot]

my pi3 with no heat sink took 120 seconds, how certain are you that you have a PI3?

Test execution summary:
total time: 119.9304s
total number of events: 10000
total time taken by event execution: 479.5922
per-request statistics:
min: 47.69ms
avg: 47.96ms
max: 142.64ms
approx. 95 percentile: 48.29ms

Threads fairness:
events (avg/stddev): 2500.0000/5.24
execution time (avg/stddev): 119.8980/0.01

[RaTTuS]

cat /proc/cpuinfo

[jahboater]

Or this to give the Pi's name:

Code: Select all

cat /sys/firmware/devicetree/base/model

[carter]

Last login: Mon Dec 5 21:16:37 2016
pi@raspberrypi:~ $ cat /sys/firmware/devicetree/base/model
Raspberry Pi 3 Model B Rev 1.2
pi@raspberrypi:~ $

Can you send your model info please ?
I'm not sure that the heat sink or temperature is a reason why my Pi3 working slowly. But I will try install today more powerful heat sink just for sure.

[carter]

Sysbench cpu is explicitly a 64-bit benchmark so I am not sure if its useful on the Pi running Raspbian. I would expect this to take about 7 - 8 seconds on a Pi3 with a 64-bit OS. That may be quick enough to avoid throttling.

This is not about bits. Jessie is the 32-bit OS. As I wrote before we tested two completely same Pi3. Same board, OS, kernel version and even heat sinks almost same. Doesn't matter. My Pi3 working slowly for two times then being bought on the europe market.

I even tried overclock my Pi3 up to 1.3 Ghz

arm_freq=1300
over_voltage=5
gpu_freq=550

# sdram overclock
sdram_freq=550
sdram_schmoo=0x02000020
over_voltage_sdram_p=6
over_voltage_sdram_i=4
over_voltage_sdram_c=4

Same result again

total time: 234.5720s !!! WHY ??!
total number of events: 10000
total time taken by event execution: 938.1447
per-request statistics:
min: 44.02ms
avg: 93.81ms
max: 224.22ms
approx. 95 percentile: 99.02ms

Threads fairness:
events (avg/stddev): 2500.0000/34.34
execution time (avg/stddev): 234.5362/0.02

pi@raspberrypi:~ $ cpufreq-info -s -m
1.30 GHz:100.00%
pi@raspberrypi:~ $

I have no idea about why my Pi3 working slow.

[jahboater]

Can you send your model info please ?

Its the same as yours ....

pi@raspberrypi:~ $ cat /sys/firmware/devicetree/base/model
Raspberry Pi 3 Model B Rev 1.2
pi@raspberrypi:~ $

and like every one elses, it runs sysbench in 120 seconds at stock speed:

Code: Select all

Maximum prime number checked in CPU test: 20000

Test execution summary:
    total time:                          119.9203s
    total number of events:              10000
    total time taken by event execution: 479.5689
    per-request statistics:
         min:                                 47.69ms
         avg:                                 47.96ms
         max:                                 94.07ms
         approx.  95 percentile:              47.87ms

Threads fairness:
    events (avg/stddev):           2500.0000/4.53
    execution time (avg/stddev):   119.8922/0.01

Have you altered anything in /boot/config.txt?
Edit: sorry about crossed posts, I see you know about the settings in config.txt!

[jahboater]

Perhaps just quickly try a fresh install of Raspbian Lite on an old card.

I see you have cpufrequtils installed, hope that's not interfering with anything.

[carter]

Seems I found problem. Power source. Pi3 very sensitive for stable voltage. When voltage drop lower than 5.1v then performance also goes down. Connected to samsung genuine power source with 5.3 voltage output and got good results. Thanks to everyone for help.