Together we make EasyVFR
Share:
Notifications
Clear all

[Sticky] Device performance benchmark v1


a0794159f1cc2f4ea8c5e73830745f84?s=80&d=retro&r=g
Posts: 418
Admin
Topic starter
Prominent Member
Joined: 3 years ago

Hi all,

Since Apple is still dominating the tablet market but not everyone is feeling to join (fan of) the Apple ecosystem. We are working on a benchmark test setup to compare the most popular devices.

Based on using many different devices, it is safe to say that Apple is with the iPad still two or three years ahead of most Android tablet manufacturers. This is based on the processor, multitasking, screen techniques, and OS update support for older devices.
There are however some interesting Android tablets that can compete. Below the first devices, I have tested.

 

Benchmark of most popular devices

 

 

 

 Notes:
- All modern iOS devices are 64-bit. For Android, most of the latest midrange to high-end tablets have a 64-bit CPU as well. However, some manufacturers install a 32-bit Android operating system, this means that it can not run 64-bit only apps like EasyVFR 4. We have found a website where you can search for operating system architecture: https://browser.geekbench.com/v4/cpu/search
- Be aware that some tablets come without GPS. Often the model without GPS is called ... Wifi;, and the one with GPS is called ... LTE/4G. All models that are tested have a GPS build in.
- The lower the Total, View, Load and Start Scores are the faster EasyVFR 4 runs on that device.

 

Please let me know if you would like to see some other specifications and devices for comparison. What do you think of this benchmarking approach?

 

Cheers,
Tim

17 Replies
b8dbb9197cad09af82e5c283c29902da?s=80&d=retro&r=g
Posts: 68
Beta tester
Trusted Member
Joined: 3 years ago

Tim, at what point are you timing the start, load etc? Is it starting the device or app  when is load complete and when is view? I can send some data for the M5 Lite. 

Reply
1 Reply
a0794159f1cc2f4ea8c5e73830745f84?s=80&d=retro&r=g
Admin
Joined: 3 years ago

Prominent Member
Posts: 418

@bob-ivisonntlworld-com

Hi Bob,

Thank for your offer. The benchmark follows some strict steps in order to make it comparable and skip processes that are hard to compare. If you like to help to add the data for the M5 Lite, please make sure to precisely follow all the settings and steps.

Alternatively, I can do the test for you at a distance if you install the app AnyDesk and share me the address via [email protected]

AnyDesk in Google PlayStore: https://play.google.com/store/apps/details?id=com.anydesk.anydeskandroid

 

To do the test yourself, follow all the steps and make a screen recording from the whole process to share with me.

Settings:

  • Make sure you have only Germany activated.
  • Map Layers Menu:
      • Enable Weather, disable GAFOR.
    • Enable Notams, and un-hide all
    • Enable all geo layers
    • Enable Absolute Terrain and Hill Shading
    • Enable VPV
  • Create a new route: EDDH-EDOV-EDRK-EDNY and Save as Big Bench.
  • Stop route.
  • Create a new route: EDDH-EDOV and save as Small Bench.
  • Download menu:
    • Update all data in Aerodata validity info.
    • Update notams, metars, tafs, gafor, and advanced WX.
    • Pause airport Plates.
  • Restart the app.

The test:

Make sure you have the screen recording running the whole process so I can measure all the durations of the steps.

  1. Search -> view on Map. Time between tap View on Map until all layers visible on map (buttons, geo, airspace, weather, notams, terrain). (Especially the terrain can take some time.) Do this for the following airfields:
    1. EDDH
    2. EDOV
    3. EDRK
    4. EDNY
  2. Load the Big Bench route -> hit checkmark while loading. Time until all layers are visible (On map: buttons, geo, weather, notams, terrain. In VPV: airspace and weather)
  3. Restart with Big route active. Time until route in VPV is visible.
  4. Stop route.
  5. Restart without route. Time until all layers except airspace are visible.
  6. Load Big Bench route. Time until route in VPV is visible.
  7. Search EDQS and view on Map. Time between tap View on Map until all layers visible on map. (terrain can take a while)
  8. Insert EDQS to route and activate using route icon on quick-info-wheel. Time between accept new route (green checkmark) and VPV is rendered.
  9. Stop route.
  10. Load the Small Bench route -> hit checkmark while loading. Time until all layers are visible (On map: buttons, geo, airspaces, weather, notams, terrain. In VPV: airspace and weather)
  11. Restart with Small route active. Time until route in VPV is visible.
  12. Search EDNY and view on Map. Time between tap View on Map until all layers visible on map. (terrain can take a while)
  13. St
  14. Restart without route. Time until all layers except airspace are visible.
  15. Load Small Bench route. Time until route in VPV is visible.

 

If you like to do the measurement yourself you can use this excel sheet attached to this post to fill in the durations.

The scoring is as follows:

  • Total score: add up all eighteen steps.
  • View score: mean of all View on Maps
  • Load score: mean of all Load routes
  • Start score: mean of all Restarts

 

If anything isn't clear please let men know.

 

Cheers,
Tim

Reply
b8dbb9197cad09af82e5c283c29902da?s=80&d=retro&r=g
Posts: 68
Beta tester
Trusted Member
Joined: 3 years ago

Tim, we can have a go with Anydesk seems a bit easier! Can we do it on Tuesday? Tied up tomorrow  

 

 

Reply
2 Replies
a0794159f1cc2f4ea8c5e73830745f84?s=80&d=retro&r=g
Admin
Joined: 3 years ago

Prominent Member
Posts: 418

@bob-ivisonntlworld-com

Perfect! Any time on tuesday is fine. Let's discus the rest over email. [email protected]

Cheers,

Tim

Reply
a0794159f1cc2f4ea8c5e73830745f84?s=80&d=retro&r=g
Admin
Joined: 3 years ago

Prominent Member
Posts: 418

Well, that was interesting operating EasyVFR together over a wifi connection.

Thanks to Bob we now have the benchmark for the Huawei M5 Lite as well. The above table has been updated.

 

Cheers,
Tim

Reply
b8dbb9197cad09af82e5c283c29902da?s=80&d=retro&r=g
Posts: 68
Beta tester
Trusted Member
Joined: 3 years ago

?

Reply
727f4ba484fa4ea8eddb229f9f8c75dc?s=80&d=retro&r=g
Posts: 10
Beta tester
Active Member
Joined: 3 years ago

I've ordered a Xiaomi Mi Pad 4 with a 8'' screen. The availability of Xiaomi devices is better in some European counties than others, but it's always possible to order through Banggood, Aliexpress, Gearbest, etc. Price is around 190-230 EUR. Performance should be comparable to Huawei M5. I will try to benchmark it once it arrives.

Reply
4 Replies
a0794159f1cc2f4ea8c5e73830745f84?s=80&d=retro&r=g
Admin
Joined: 3 years ago

Prominent Member
Posts: 418

@m-milosme-com

Hi Michal,

That would be very interesting! I see that the Xiaomi Mi Pad 4 8" comes in many varieties. Wifi without GPS; LTE with GPS; 3 or 4GB RAM; and some have a Global ROM whatever that would be. Which one do you have?

Looking forward to the screen video of the testing, and if you want to let me do it over AnyDesk just let me know via email.

 

Cheers,
Tim

Reply
727f4ba484fa4ea8eddb229f9f8c75dc?s=80&d=retro&r=g
Beta tester
Joined: 3 years ago

Active Member
Posts: 10

@timpeter

I got a 8'' LTE version (which always comes with 4 GB of RAM as I believe). Global ROM means it is an "international" version of Android/MIUI containing Google Services and Play Store. Usually Chinese OS doesn't have anything from Google and contains a lot of Chinese apps. First thing I did was actually reflash the device with another OS called Pixel Experience, which is basically pure Android 9, similar to what Google installs on the Pixel line of phones. I then installed EasyVFR 4.0.647 and did the benchmark. Please check the recording.

Reply
a0794159f1cc2f4ea8c5e73830745f84?s=80&d=retro&r=g
Admin
Joined: 3 years ago

Prominent Member
Posts: 418

@m-milosme-com

That worked awesomely, thanks!

I have updated the table. Looks like the Xiaomi Mi Pad 4 is coming just before the Huawei M5. That's quite good for a 240 euro tablet 😀

It makes me even wonder more what the heck Samsung is doing... The S4 has a faster processor than in both the Mi Pad 4 and the M5 but is in fact slower. Also, Samsungs S6 has one of the latest CPU's but is only comparable to the Mi Pad 4 and M5 according to this benchmark, and that for "only" 2 to 3 times of the costs.

Thanks for sharing that you reflashed your Mi Pad to the other ROM. How is it running so far with other apps, and how is the screen visibility outside?

Cheers,
Tim

Reply
727f4ba484fa4ea8eddb229f9f8c75dc?s=80&d=retro&r=g
Beta tester
Joined: 3 years ago

Active Member
Posts: 10

@timpeter

So far running quite nicely, a bit slower than my Galaxy S8 phone but still responsive for a mid-range CPU. Screen is bright, but not as bright as AMOLED displays. Proper testing will have to wait for more sunny weather.

Reply
cca1ec2d8e09141715e056c14684db37?s=80&d=retro&r=g
Posts: 24
Beta tester
Eminent Member
Joined: 3 years ago

Just to let you know that i've a Huawei Mediap M5 wifi, there is a gps included in it although it is not a LTE version

Cheers

Didier 

Reply
1a61c5a7fe71aa83b837dd0098d7e3dc?s=80&d=retro&r=g
Posts: 1
New Member
Joined: 2 years ago

I would recommend testing on Samsung S2 8 inch tablet as well. In the 8 inch market this tablet has the very best screen (Apple comes close). Very relevant during flying. It has Android 7.

After 2 hours trying how EasyVFR4 works I had 3 application crashes. And it is slow.

Reply
edea88e0d5a8c51610f60ee8ff41c2e3?s=80&d=retro&r=g
Posts: 88
Beta tester
Estimable Member
Joined: 3 years ago

I found a Lenovo M8 FHD on Bangood for 150Eur 64 G storage 4G RAM. While the benchmarks say it's not very fast I just installed E4 and it's running fine. Takes app. 30 s to start E4 until the "loading map" box disappears. 

Tablet comes in Chinese, flashed Rest Of World ROM with Lenovo Rescue app.  It has a metal case, a bright full HD 8' screen, and long battery life. First time I see a GPS fix in the house.

Somehow the de-clutter and map appearance is way better than on the PC. Cool!

Cheers

Albrecht

Reply
c5f2a205df268d654f2ae0db9d225ec7?s=80&d=retro&r=g
Posts: 123
Beta tester
Reputable Member
Joined: 3 years ago

A quick note to confirm the issue with Android 11. My Samsung S10e used to work very well with EV4, but a 'security and GUI update' forgot to mention it was an update to Android 11, and now EV4 is unusable 😪 
So for all you Android users out there, be very careful before hitting OK on the next update of your device.

Reply
5c1242ce1c84de60ae1ea618ae44df33?s=80&d=retro&r=g
Posts: 911
Admin
Famed Member
Joined: 3 years ago

Just a small update on the Android 11 issue, we found a work arround that fixes the performance problems and hope to be able to provide a version to betatesters this weekend.

 

Reply
1 Reply
c5f2a205df268d654f2ae0db9d225ec7?s=80&d=retro&r=g
Beta tester
Joined: 3 years ago

Reputable Member
Posts: 123

@rob-weijers Just got 870 installed and the S10e is snappy as ever. Thank you!

Reply
Share:
My cart
Your cart is empty.

Looks like you haven't made a choice yet.