Together we make EasyVFR

Notifications
Clear all

[Sticky] Device performance benchmark v1

18 Posts
8 Users
7 Reactions
3,878 Views
Posts: 471
Admin
Topic starter
Noble Member
Joined: 6 years ago

Hi all,

Since Apple is still dominating the tablet market but not everyone is feeling to join (fan of) the Apple ecosystem. We are working on a benchmark test setup to compare the most popular devices.

Based on using many different devices, it is safe to say that Apple is with the iPad still two or three years ahead of most Android tablet manufacturers. This is based on the processor, multitasking, screen techniques, and OS update support for older devices.
There are however some interesting Android tablets that can compete. Below the first devices, I have tested.

 

Benchmark of most popular devices

 

 

 

 Notes:
- All modern iOS devices are 64-bit. For Android, most of the latest midrange to high-end tablets have a 64-bit CPU as well. However, some manufacturers install a 32-bit Android operating system, this means that it can not run 64-bit only apps like EasyVFR 4. We have found a website where you can search for operating system architecture: https://browser.geekbench.com/v4/cpu/search
- Be aware that some tablets come without GPS. Often the model without GPS is called ... Wifi;, and the one with GPS is called ... LTE/4G. All models that are tested have a GPS build in.
- The lower the Total, View, Load and Start Scores are the faster EasyVFR 4 runs on that device.

 

Please let me know if you would like to see some other specifications and devices for comparison. What do you think of this benchmarking approach?

 

Cheers,
Tim

17 Replies
Posts: 78
Beta tester
Reputable Member
Joined: 6 years ago

Tim, at what point are you timing the start, load etc? Is it starting the device or app  when is load complete and when is view? I can send some data for the M5 Lite. 

Reply
1 Reply
Admin
Joined: 6 years ago

Noble Member
Posts: 471

@bob-ivisonntlworld-com

Hi Bob,

Thank for your offer. The benchmark follows some strict steps in order to make it comparable and skip processes that are hard to compare. If you like to help to add the data for the M5 Lite, please make sure to precisely follow all the settings and steps.

Alternatively, I can do the test for you at a distance if you install the app AnyDesk and share me the address via helpdesk@pocketfms.com

AnyDesk in Google PlayStore: https://play.google.com/store/apps/details?id=com.anydesk.anydeskandroid

 

To do the test yourself, follow all the steps and make a screen recording from the whole process to share with me.

Settings:

  • Make sure you have only Germany activated.
  • Map Layers Menu:
      • Enable Weather, disable GAFOR.
    • Enable Notams, and un-hide all
    • Enable all geo layers
    • Enable Absolute Terrain and Hill Shading
    • Enable VPV
  • Create a new route: EDDH-EDOV-EDRK-EDNY and Save as Big Bench.
  • Stop route.
  • Create a new route: EDDH-EDOV and save as Small Bench.
  • Download menu:
    • Update all data in Aerodata validity info.
    • Update notams, metars, tafs, gafor, and advanced WX.
    • Pause airport Plates.
  • Restart the app.

The test:

Make sure you have the screen recording running the whole process so I can measure all the durations of the steps.

  1. Search -> view on Map. Time between tap View on Map until all layers visible on map (buttons, geo, airspace, weather, notams, terrain). (Especially the terrain can take some time.) Do this for the following airfields:
    1. EDDH
    2. EDOV
    3. EDRK
    4. EDNY
  2. Load the Big Bench route -> hit checkmark while loading. Time until all layers are visible (On map: buttons, geo, weather, notams, terrain. In VPV: airspace and weather)
  3. Restart with Big route active. Time until route in VPV is visible.
  4. Stop route.
  5. Restart without route. Time until all layers except airspace are visible.
  6. Load Big Bench route. Time until route in VPV is visible.
  7. Search EDQS and view on Map. Time between tap View on Map until all layers visible on map. (terrain can take a while)
  8. Insert EDQS to route and activate using route icon on quick-info-wheel. Time between accept new route (green checkmark) and VPV is rendered.
  9. Stop route.
  10. Load the Small Bench route -> hit checkmark while loading. Time until all layers are visible (On map: buttons, geo, airspaces, weather, notams, terrain. In VPV: airspace and weather)
  11. Restart with Small route active. Time until route in VPV is visible.
  12. Search EDNY and view on Map. Time between tap View on Map until all layers visible on map. (terrain can take a while)
  13. St
  14. Restart without route. Time until all layers except airspace are visible.
  15. Load Small Bench route. Time until route in VPV is visible.

 

If you like to do the measurement yourself you can use this excel sheet attached to this post to fill in the durations.

The scoring is as follows:

  • Total score: add up all eighteen steps.
  • View score: mean of all View on Maps
  • Load score: mean of all Load routes
  • Start score: mean of all Restarts

 

If anything isn't clear please let men know.

 

Cheers,
Tim

Reply
Posts: 78
Beta tester
Reputable Member
Joined: 6 years ago

Tim, we can have a go with Anydesk seems a bit easier! Can we do it on Tuesday? Tied up tomorrow  

 

 

Reply
2 Replies
Admin
Joined: 6 years ago

Noble Member
Posts: 471

@bob-ivisonntlworld-com

Perfect! Any time on tuesday is fine. Let's discus the rest over email. helpdesk@pocketfms.com

Cheers,

Tim

Reply
Admin
Joined: 6 years ago

Noble Member
Posts: 471

Well, that was interesting operating EasyVFR together over a wifi connection.

Thanks to Bob we now have the benchmark for the Huawei M5 Lite as well. The above table has been updated.

 

Cheers,
Tim

Reply
Posts: 78
Beta tester
Reputable Member
Joined: 6 years ago

?

Reply
Posts: 10
Beta tester
Eminent Member
Joined: 5 years ago

I've ordered a Xiaomi Mi Pad 4 with a 8'' screen. The availability of Xiaomi devices is better in some European counties than others, but it's always possible to order through Banggood, Aliexpress, Gearbest, etc. Price is around 190-230 EUR. Performance should be comparable to Huawei M5. I will try to benchmark it once it arrives.

Reply
4 Replies
Admin
Joined: 6 years ago

Noble Member
Posts: 471

@m-milosme-com

Hi Michal,

That would be very interesting! I see that the Xiaomi Mi Pad 4 8" comes in many varieties. Wifi without GPS; LTE with GPS; 3 or 4GB RAM; and some have a Global ROM whatever that would be. Which one do you have?

Looking forward to the screen video of the testing, and if you want to let me do it over AnyDesk just let me know via email.

 

Cheers,
Tim

Reply
Beta tester
Joined: 5 years ago

Eminent Member
Posts: 10

@timpeter

I got a 8'' LTE version (which always comes with 4 GB of RAM as I believe). Global ROM means it is an "international" version of Android/MIUI containing Google Services and Play Store. Usually Chinese OS doesn't have anything from Google and contains a lot of Chinese apps. First thing I did was actually reflash the device with another OS called Pixel Experience, which is basically pure Android 9, similar to what Google installs on the Pixel line of phones. I then installed EasyVFR 4.0.647 and did the benchmark. Please check the recording.

Reply
Admin
Joined: 6 years ago

Noble Member
Posts: 471

@m-milosme-com

That worked awesomely, thanks!

I have updated the table. Looks like the Xiaomi Mi Pad 4 is coming just before the Huawei M5. That's quite good for a 240 euro tablet 😀

It makes me even wonder more what the heck Samsung is doing... The S4 has a faster processor than in both the Mi Pad 4 and the M5 but is in fact slower. Also, Samsungs S6 has one of the latest CPU's but is only comparable to the Mi Pad 4 and M5 according to this benchmark, and that for "only" 2 to 3 times of the costs.

Thanks for sharing that you reflashed your Mi Pad to the other ROM. How is it running so far with other apps, and how is the screen visibility outside?

Cheers,
Tim

Reply
Beta tester
Joined: 5 years ago

Eminent Member
Posts: 10

@timpeter

So far running quite nicely, a bit slower than my Galaxy S8 phone but still responsive for a mid-range CPU. Screen is bright, but not as bright as AMOLED displays. Proper testing will have to wait for more sunny weather.

Reply
Posts: 23
Beta tester
Trusted Member
Joined: 5 years ago

Just to let you know that i've a Huawei Mediap M5 wifi, there is a gps included in it although it is not a LTE version

Cheers

Didier 

Reply
Posts: 1
New Member
Joined: 5 years ago

I would recommend testing on Samsung S2 8 inch tablet as well. In the 8 inch market this tablet has the very best screen (Apple comes close). Very relevant during flying. It has Android 7.

After 2 hours trying how EasyVFR4 works I had 3 application crashes. And it is slow.

Reply
Posts: 88
Beta tester
Reputable Member
Joined: 6 years ago

I found a Lenovo M8 FHD on Bangood for 150Eur 64 G storage 4G RAM. While the benchmarks say it's not very fast I just installed E4 and it's running fine. Takes app. 30 s to start E4 until the "loading map" box disappears. 

Tablet comes in Chinese, flashed Rest Of World ROM with Lenovo Rescue app.  It has a metal case, a bright full HD 8' screen, and long battery life. First time I see a GPS fix in the house.

Somehow the de-clutter and map appearance is way better than on the PC. Cool!

Cheers

Albrecht

Reply
Posts: 131
Beta tester
Honorable Member
Joined: 6 years ago

A quick note to confirm the issue with Android 11. My Samsung S10e used to work very well with EV4, but a 'security and GUI update' forgot to mention it was an update to Android 11, and now EV4 is unusable ? 
So for all you Android users out there, be very careful before hitting OK on the next update of your device.

Reply
Posts: 1033
Admin
Famed Member
Joined: 6 years ago

Just a small update on the Android 11 issue, we found a work arround that fixes the performance problems and hope to be able to provide a version to betatesters this weekend.

 

Reply
1 Reply
Beta tester
Joined: 6 years ago

Honorable Member
Posts: 131

@rob-weijers Just got 870 installed and the S10e is snappy as ever. Thank you!

Reply
My cart
Your cart is empty.

Looks like you haven't made a choice yet.