jimlar
Posts: 4
Joined: Sun Aug 26, 2018 5:45 pm
Location: Sunriver, Oregon

Browser benchmarks

Sat Dec 28, 2019 1:18 am

I ran the speedometer https://browserbench.org/Speedometer2.0/ benchmark on Chromium, Firefox, and Vivaldi on my Raspberry Pi 3B+. Speedometer measures the responsiveness of Web applications simulating user actions such as adding to-do items. I was surprised that Vivaldi was much faster than Chromium.

Results
Chromium: 5.37 runs/minute
Firefox: 5.85 runs/minute
Vivaldi: 8.44 runs/minute

User avatar
HawaiianPi
Posts: 7905
Joined: Mon Apr 08, 2013 4:53 am
Location: Aloha, Oregon USA

Re: Browser benchmarks

Sat Dec 28, 2019 2:46 am

What OS, and how many times did you run the test?

Your results are odd, because the last time I ran such a comparison, Chromium browser had a much higher score than Firefox (something like 8.8 vs 5.4 on my 3B non-plus). That was with Raspbian, where Chromium browser has been optimized for better performance on the Pi.

On my Windows 10 laptop, Chrome also beats Firefox (although the difference is less, about 20%).

I might run some new comparisons later, when I have some time (it takes soooo long an a Pi3).
My mind is like a browser. 27 tabs are open, 9 aren't responding,
lots of pop-ups, and where is that annoying music coming from?

User avatar
HawaiianPi
Posts: 7905
Joined: Mon Apr 08, 2013 4:53 am
Location: Aloha, Oregon USA

Re: Browser benchmarks

Sun Dec 29, 2019 1:18 pm

Speedometer 2.0 (run 3 times and averaged).

Raspberry Pi 3B+ in Flirc heatsink case with official power supply.
Raspberry Pi 4B4 in Flirc heatsink case with official power supply.

Same SanDisk Ultra A1 32GB micro SD card used in both (Raspbian Buster with desktop, fully updated). I tested with 32-bit & 64-bit kernels. It's interesting that the 64-bit kernel results in lower scores on the 3B+ but doesn't affect the 4B (Firefox also crashed several times on the 3B+ with the 64-bit kernel, but not on the 4B, and Chromium didn't have any trouble at all).

3B+ Buster 32-bit kernel
9.49/9.66/9.46 = 9.54 Chromium (1.6X faster)
5.76/5.80/5.84 = 5.80 Firefox-ESR

3B+ Buster 64-bit kernel
8.80/8.80/8.87 = 8.82 Chromium (1.6X faster)
5.54/5.31/5.35 = 5.40 Firefox-ESR

4B4 Buster 32-bit kernel
17.1/17.1/17.2 = 17.1 Chromium (1.7X faster)
10.0/10.0/10.0 = 10.0 Firefox-ESR

4B4 Buster 64-bit kernel
17.2/17.0/17.1 = 17.1 Chromium (1.7X faser)
10.1/10.1/10.0 = 10.0 Firefox-ESR

Chromium browser beats Firefox handily (and even beat your Vivaldi scores).

What about other platforms?

Windows 10 gaming laptop
87.4/86.8/87.3 = 87.2 Chrome
70.6/68.8/70.1 = 69.8 Firefox

Not as dramatic a difference, but Firefox is still about 20% slower than Chrome.

And just for kicks we'll toss in results from my Chromebook with a dual core M3 processor.
HP Chromebook x2: 68.2/68.6/68.0 = 68.3
Which scores almost as high as the Firefox results on my much more powerful quad core i7 gaming laptop!

jimlar wrote: I ran the speedometer benchmark on Chromium, Firefox, and Vivaldi on my Raspberry Pi 3B+ ... I was surprised that Vivaldi was much faster than Chromium.

Results
Chromium: 5.37 runs/minute
Firefox: 5.85 runs/minute
Vivaldi: 8.44 runs/minute

Not sure how you got those test results, but my Chromium browser scores are much higher, and are higher than your Vivaldi scores.
My mind is like a browser. 27 tabs are open, 9 aren't responding,
lots of pop-ups, and where is that annoying music coming from?

jimlar
Posts: 4
Joined: Sun Aug 26, 2018 5:45 pm
Location: Sunriver, Oregon

Re: Browser benchmarks

Mon Dec 30, 2019 2:08 am

Thanks for your feedback!
HawaiianPi wrote:
Sun Dec 29, 2019 1:18 pm
Speedometer 2.0 (run 3 times and averaged).

Raspberry Pi 3B+ in Flirc heatsink case with official power supply.
Raspberry Pi 4B4 in Flirc heatsink case with official power supply.

Same SanDisk Ultra A1 32GB micro SD card used in both (Raspbian Buster with desktop, fully updated). I tested with 32-bit & 64-bit kernels. It's interesting that the 64-bit kernel results in lower scores on the 3B+ but doesn't affect the 4B (Firefox also crashed several times on the 3B+ with the 64-bit kernel, but not on the 4B, and Chromium didn't have any trouble at all).

3B+ Buster 32-bit kernel
9.49/9.66/9.46 = 9.54 Chromium (1.6X faster)
5.76/5.80/5.84 = 5.80 Firefox-ESR

My setup is equivalent to your 3B+ Buster 32-bit kernel and my results for Firefox-ESR are similar. I am using the standard Raspbian desktop image. There must be sorting wrong with my Chromium install or a background task taking CPU cycles.

Jim

jimlar
Posts: 4
Joined: Sun Aug 26, 2018 5:45 pm
Location: Sunriver, Oregon

Re: Browser benchmarks

Tue Dec 31, 2019 11:43 pm

I did a clean install of Raspbian Buster Desktop on my 3B+ and reran the Speedometer benchmark.

Chromium: 8.71, 8.84, 8.80 runs/minute
Firefox: 5.73, 5.78, 5.82 runs/minute
Vivaldi: 10,44, 10.40, 10.49 runs/minute

The Chromium performance now matches the results fromHawaiianPi, but Vivaldi is the fastest browser. You can download the Vivaldi armhf deb package here:
https://downloads.vivaldi.com/stable/vi ... _armhf.deb

Jim

Return to “Raspberry Pi OS”