App Test white paper for the first half of 2016: There are 41 issues on average for each app

More than half of the 2016, at present, after several years of rapid development in the domestic market mobile internet users have become saturated, which makes the desire to pre-emptive in the industry, the opportunity has gone. What are some of the quality issues that the app has today, and whether the different categories of apps need to focus on the same content? What seems like a common compatibility test and what are the key points that are overlooked but critical? These questions are the key to holding you back in this fierce business Red Sea.

Following the2016 first half-year test data analysis report, Testbird again launched the first half of the 2016 app Test white Paper (hereinafter referred to as the White paper), hoping to pass the first half of the total testing of 20,806 app data, Visually demonstrate the current quality profile of the app industry to provide some help in your future market development and trend judgments.

20,806 App Data application, in-depth analysis of app problem distribution

a long-standing market application must ensure quality and perform a large number of performance optimizations, but different types of there are different quality issues with the app, and it's important to understand the key issues of each type of app that we're able to successfully build a successful product.

in the first half of the year, Testbird tested 20,806 apps, covering "System tools, communication social, audio-visual, news reading, Life and leisure, office business, photography and video, shopping preferences, map tourism, education and learning, financial management, health care , game entertainment, and other " applications.

The white Paper makes A detailed analysis of the test data of these apps , such as game Entertainment, audio-visual applications, which have higher performance requirements than other applications; The UI that occurs in a photographic camera application The exception problem, the program exception problem is also the most serious and so on.

Four-angle definition test standard, detailed analysis of application quality

In the first half of 2016, Testbird tested 20,806 apps and found that app quality issues focused on app-to-terminal compatibility, app functionality, and terminal performance in three ways, as apps use mobile networks, and mobile networks are complex and changeable, Customers often face the problem of network switching when they use the app, and have an important impact on the app experience. Therefore, the white Paper makes a detailed study of the application quality problem from the four aspects of function test, compatibility test, network test and performance test which affect the most critical and high frequency.

first, in the context of compatibility testing, the white paper divides the compatibility issues in detail into installation failures, startup failures, flashback, lag, deadlock, black screen, data anomalies, There are 10 categories of UI exceptions, connection exceptions, and program exceptions, and standard definitions are made for each type of problem. At the same time, combined with the CPU brand, memory size and the Android version of the terminal angle, the compatibility problem model of cross-analysis.

Second, The use of the APP function is normal, is one of the most important factors affecting the user experience, for functional testing, the white paper from the registration login module, location service module, social module, personal information Management module and other modules 5 dimensions are analyzed and categorized. At the same time, the impact of functional issues on the user experience is also graded in detail.

and for In the context of APP network testing, the white Paper classifies common network transitions and explains in detail the issues that arise in each of these situations. At the same time, from the perspective of the app type, the different types of apps are under the weak network conditions of the test and problem occurred in the classification analysis, complete display of the network environment to the app the impact of quality.

The performance of an application is good, mainly from the application running process of CPU utilization , memory consumption, temperature, start time delay, traffic data, and so on, through these five data can be a good response to the performance of an application. Therefore, the white Paper provides a standardized definition of 5 angles and detailed data analysis.

average per section App 41 questions, program Flash back up to 51%

In the first half of 2016,Testbird found 864,578 questions in the 20,806 apps tested, with an average of 41 questions per app, and in 14 apps, map tours, game Entertainment, two types of The average number of apps checked in the app was up to 63 and 61, respectively.

▲ number of average problems detected per class of application

in the analysis of various compatibility issues, the White Paper statistics show that flash-back, UI Exceptions, program exceptions are the top 3 categories of compatibility issues, with the highest percentage of flash-back issues, reaching 51.65%.

▲ The detection rate of all kinds of compatibility problems

in the research and development of functional issues, the White Paper analysis shows that 1/4 of the problems occur in the registration login module, focusing on the third-party account login failure. From the point of view of the severity of the problem, a large number of bugs, will affect the normal operation of the user A, B, C-level problems will be nearly 80%, so functional testing issues need to be highly valued by developers.

▲ Problem Module distribution statistics

in the In the app network problem analysis, the white paper shows that server interaction failures, drop-off, data acquisition anomalies and so on are easy to happen in the communication social, map tourism and life and leisure apps. and the screen time delay, screen lag and non-responsive situation often occurs in the game entertainment applications.

in the App performance analysis, white Paper statistics found that in the CPU occupancy rate, the highest game entertainment category, the lowest health care category, start-up time, the largest shopping concessions, other types of minimum, memory consumption, shopping preferential class, the lowest financial management category, and in the average traffic consumption, photographic camera class application of the largest, Health care application is the smallest, the average temperature of the mobile phone is the highest category of shopping preferences, the lowest system tool class

4,000 end data cross-analysis, Xiaomi terminal problem least

at present, the market of Android terminal fragmentation is extremely serious, and the corresponding compatibility problems have increased, Testbird through the 4,000 test phones, after 20,000 of the balance of the app test, through the depth of cross-analysis for everyone to summarize the resolution, CPU, memory and other aspects of the impact on the quality of the app, and expect developers to use these data to the test model to filter the corresponding Do a targeted test.

From the white Paper data, in many end brands, most of the mainstream brand compatibility overall better, relatively speaking, the minimum number of millet problems . From the system version of the analysis, thecompatibility of Android 5.1 is the best, 4.1 of the most serious compatibility problems ; in memory,4GB memory is a watershed, 4GB or more memory capacity problem detection rate is stable at about 8.44% , less than 4G of mobile phones, the problem caused by insufficient memory, and in the CPU brand, Spreadtrum has more compatibility problems, the problem detection rate of up to 32%, we are familiar with MediaTek and Qualcomm two major categories CPU brand compatibility issues were detected at a rate of 9.6% and 9.2%, respectively.

in the iOS system, the white paper also carried out a special study, found in the first half of 2016 years each program iOS compatibility test detected more than 8 issues, which at the system level, the IOS7 problem detection rate reached 22.84%, generally higher than IOS8 and IOS9, on theaircraft,the iphone6 problem detection rate reached 12.59%, after iphone4 and iphone4s, higher than other models. In addition, the detection rate of iphone,ipad problem is obviously improved , among which the MINI1 and Mini2 compatibility problems are most prominent.

the detection rate of the iphone hand-trip test

The detection rate of the ipad test problem

each intelligent hardware problem, hardware and software links most prominent

at present, the intelligent hardware market ushered in an explosion of growth, intelligent hardware testing and quality issues are increasingly valued by producers, the white paper summarizes Testbird has tested 151 intelligent Hardware in the first half of the year , and has made a systematic analysis of intelligent hardware testing.

The white paper divides smart hardware into smart wearable devices, smart home, healthcare, telematics, artificial intelligence, sports and entertainment, AV and other 8 categories, of which the smart home market accounts for the most, reaching 22.15%.

▲ Intelligent hardware of various types of proportion

at the same time, the quality of intelligent hardware problems are more prominent, the first half Testbird on the intelligent hardware found a total of 15925 problems, the average number of intelligent hardware problems reached more than one, which also found that hardware itself problem accounted for the least, but the most hardware and software link problems , which undoubtedly need to cause the vast number of intelligent hardware manufacturers attention and attention.

▲ The proportion of intelligent hardware problem

new practical case, full dry guide App Quality Improvements

the app test white Paper not only brings some testing experience and dry content to the industry, but also helps developers to make app testing more purposeful, Targeted to start, but also new compatibility testing, functional testing and intelligent hardware testing, and many different types of practical cases and test log Q&a, and hope that through more intuitive description, for the vast number of developers to provide some reference.

also, at the end of the white paper, Testbird still has an exhaustive solution to the app's Test questions. For example, in the case of the most serious program flashback in the compatibility issue, the paper summarizes the causes of the problem and gives the corresponding solutions:

we found in our tests APP Flash issue is the most problems in all compatibility issues, the scene of the flashback problem is different, the common reason because of memory shortage, temperature is too high, the system is not compatible,theCPU is incompatible and so on. The developer can analyze the location reason according to these phenomena, find out the reason of the flash back and optimize according to the demand.

is because testbird steady, in possession 70% After the market, with its testing technology accumulated and testing experience of the rich, smoothly expand the business to the entire app field, and by 2016 first half tested up to 20806 app 864578 2016 first half app test white paper, a full and intuitive display of the The app industry's current quality profile, and hope to share with the vast number of test compatriots  

To Download thefull version of the APP Test white paper for the first half of the year , please click:https://jinshuju.net/f/6fxt2F

App Test white paper for the first half of 2016: There are 41 issues on average for each app