AnTuTu, Geekbench and Vellamo give comparable readings. But what benchmarks really tell us? We want to revise the performance section of our tests. Now we invite you to join: help us in finding the best benchmark Apps and practices.
Also Read:
The computing power of modern smartphones now ranges from for amazing tasks: 3D games VR Head Mount, image processing in real-time, video-recording in 4K resolution, parallel analysis of several sensors, multitasking between complex applications without loading times, downloading large amounts of data from the mobile data network with 300 Mbit / s.
However, in order to reliably tell if a smartphone is faster than another, it needs standardized tests. These are issued in the form of benchmarks of different developers forge. One of the better known is AnTuTu. Your Money Chinese developer with stress tests, which they sell to smart phone manufacturers.
The normal user knows the AnTuTu benchmark. The Play Store app is perhaps the best known yardstick for comparing the performance of Android and iOS devices. Unfortunately we had to decide to remove them from the benchmark suite. While the data thanks to the online database promised good comparability, the frequent app updates ran exactly counter to this advantage. Again and again postponed the scale, so that deviated the measured values of a test device from one day to the next by 50 percent because AnTuTu has been updated.
This led us in a tight spot and we went on a search for alternative methods for measuring the performance of the test equipment. Fundamental questions were opened: What we want to know? What makes a good benchmark app? We identified the following main criteria:
- The measured values must remain comparable long-term
- The app needs to readers for free available
In addition, important sub-criteria are emerging that reflect benchmark details. This I would like to explain the example PCMark for Android. For each benchmark app responds to specific indicators and strip out other important values.
PCMark benchmark for Android
The benchmark PCMark for Android will cover a wide range of realistic applications. He simulates image editing, video playback, Internet browsing and word processing. Each category is evaluated individually with points and it is a similar total score calculated, to your aligns in the online database with other devices.
PC Mark for Android delivers normalized scores. / © EnTech
PC Mark also includes a battery test. For this lets the app run the Work test in loop until the battery level falls from 80 to 20 percent. The result is output in hours and minutes. Unfortunately, I need you then even take care that the display is controlled to a normalized brightness. Incoming calls can abort the test, background apps, temperature, age of the equipment or signals from Wi-Fi or LTE may influence the outcome chaotic.
PC Mark can stress also test your battery. / © EnTech
A new part of the test, you can to download it separately, is the memory benchmark. This measures the speed of the internal memory. Right here, there are often significant differences in performance between two otherwise similarly equipped smartphones. In particular, the HTC 10 here has disappointed compared to about Galaxy S7, since HTC built slow memory. So you have indeed in both devices perform well in games, have previously but long loading times when HTC 10th
PCMark benchmark for Android Install on Google Play
What we learn and what is missing
The PC Mark for Android provides with its components useful insights, based smartphones which can be compared with each other. Thanks to the points results results in a fast, easy comparison that everyone can understand easily from you. The problem: The benchmark is a little too easy.
In the benchmark details, there are not all the info we need: How many cores are used? How fast is the RAM? How fast works the graphics chip? If the Browsing benchmark also depends on your Internet speed?
Many of those details can be found among others in Vellamo benchmark of processor company that says Qualcomm. Those App in turn has the disadvantage that their tests only solve math problems and deal with everyday tasks purely theoretical.
Gaming performance is more visible than measurable
Game Benchmarks have prepared an entirely different concern. Their disadvantage is that they do not reflect what happens in real gaming apps and with real 3D engines. For games like Real Racing not scale with the frequency of drawn per second frames (fps). To scale with the level of detail of the material on the screen to reach a certain target fps.
So apps know the specifications of your smartphone and will change accordingly. So on the Facebook app in some of our test equipment from the 360-degree feature. Blow your on such a picture in your timeline, it can not be regarded as a spherical panorama.
These subjective trifles falling everyday on disruptive and are not covered by a benchmark app. So we have to think of something new.
What we need from you
And now you come in. Which test apps or scripts you discovered? Which provide a good comparable base for permanent, large-scale tests? What pitfalls have you done with different smartphones noticed in everyday life, on the one very simple stumble? Just leave like a tip and a more detailed explanation in the comment field, so that we can come to terms with the exact subject benchmarks and performance measurement.
Google Translate fo