15 Quiz for Professional testers to uncover the veil of "precision testing"

15 Quiz for Professional testers to uncover the veil of "precision testing"

What is precision testing? is software testing necessary to achieve accuracy? Does the accuracy increase the cost of testing? How does precision testing affect ordinary test engineers and even the testing industry? Let's take this series of questions to focus on the 15 questions and answers of precision testing, and uncover the veil of precision testing.

1. What exactly is a precision test? The difference and connection between it and the traditional test

Compared to the ordinary test, the precision test is in the traditional test process, through the technical means to the test program 360 degree panoramic test, the testing process visualization, digitization, standardization, so that the program is tested on-line stability, no risk, low maintenance cost advantages.

Compared with the traditional test, the precision test can automatically generate a large amount of original ecological test data that can not be tampered with, through the collection of these data, analysis of the test with intelligent guidance, to avoid the traditional testing process of human record time cost and authenticity of the problem.

The link between precision testing and traditional testing is that the actual operation of the entire test process is based solely on traditional testing and that the original ecological test data is automatically generated by technical means in the traditional testing process.

2. Precision testing technology to improve the efficiency of black box manual testing

Certainly a lot of people want to ask, precision testing more accurate, the higher the quality of the need to spend a lot of time, in today's internet era, the version of the high-speed iteration, led to a large number of black box manual testing, whether this and precision testing proposed quality assurance contradictions, we use the following diagram to analyze:

Traditional black box testing in the 70% phase, the search for bugs is very rapid, but then the discovery of defects will be a sharp decline in efficiency.

Precision testing is a combination of traditional black-box testing and white-box testing, it can be in the black box testing process, through the program to automatically generate white-box-level running logic data, based on the visibility of the shortcomings and vulnerabilities, to guide the development and testing of targeted and efficient supplementary use cases.

3. What are the impact of precision testing on the testing industry? Impact on the general testing staff

Precision testing is a major breakthrough for the testing industry, using the original ecological test data to ensure the quality of the program being tested, thus improving the stability and maintainability of the program.

For the average tester, the precision test is equivalent to a "transparent" test, in the late test, the precision test can greatly improve the quality of the test staff and control the direction of testing, black box manual testing can easily break the bottleneck of the position.

4. Why precision testing can facilitate the interaction of testing and development, as well as the rapport between the two

Precision testing in the test process will generate a large number of original ecological test data, and precision testing in the test process can directly locate the function of the tester to the code's running logic, so that developers easily in the code to locate the problem caused by the test, This allows the development and testing of a layer of communication channels to achieve interaction.

5. A new interpretation of coverage technology for precision testing

In the case of white-box testing, the technical staff may ask, the precision test is still a lot of use of coverage technology, these are not open source tools? Let's compare the following:

Open-Source Coverage tools:

1, the coverage of all the testing to mix together, do not have rapid positioning defects and auxiliary error, analysis and testing efficiency and management characteristics and so on.

2, single-machine operation, a team under the results of multi-person testing can not be effectively integrated, and can not be accumulated by date.

3, unable to achieve MC/DC these higher requirements of the coverage calculation.

4, unable to provide the cumulative coverage after version change, can not adapt to high-speed iterations of the application scenario.

5, the biggest problem is that the common open source products must face the code to cover the statistics, and most of the occasions Test engineers do not have access to the code.

Precision Testing:

1, analysis and calculation of coverage accuracy to each test case against the function, each code block, each line of code

2, multi-site testing, data integration to calculate the coverage of this version, according to the Daily Growth trend analysis

3, the coverage of different grades, the highest support MC/DC conditional combination coverage analysis, can be customized requirements

4, version iteration, multi-version coverage analysis and comparison, adapt to high-speed iterative application scenarios

5, the initial compilation requires code (can be isolated compilation to ensure source code security), the entire test and coverage analysis process without the

6. The relationship between precision testing and manual, automated testing, and their respective orientation to the testing industry

Precision testing because it does not change the original test process, which makes it available in manual or automated testing, for example: the digital test data generated by the precision test can be carried out in-depth tracking and analysis of the entire automated testing process, the analysis of accurate testing reduces the human intervention of automated testing, making automated testing more intelligent.

Future test and analysis systems like precision testing technology will really lead the test out of the open new situation. Because the test and analysis system is a professional category of testing, it is more suitable for the professional characteristics of testers. Automated testing, innate scripting features, and complex control features are a significant disadvantage for most general test engineers.

7. Precision testing emphasizes the original nature of the test data and the impact on the test organization form

The original nature also represents the fairness, authenticity, precision testing to promote the original purpose is to pass the raw digital information to test the industry results more just, true, credible. Avoid artificial causes of the acceptance of the blind zone.

Almost 100% of the domestic testing outsourcing is in the field, the resident outsourcing will generate a lot of unnecessary expenses. And the accurate test uses the non-manual input data of the original ecological data source technology, can be realized in real-time report calculation and test tracking functions, both parties can use different identities to login to the corresponding system, real-time view of their rights relative to the measured application of the various data, indicators, the team to complete the quality and progress information. As a result, precision testing is inherently an internet-accurate test gene that will significantly alter the shape of the test tissue.

8. Core features of precision testing in the field of software quality analysis

The core features of precision testing are: accurate equivalence class partitioning, crash capture, path analysis, all-in-one visual testing each step, real-time reception of test data, bidirectional correlation and traceability of test cases and code, comprehensive documentation of test equipment and testers in the testing process, and links between test cases and code. and demonstrated through a wealth of reporting and technical debt and risk indicators.

Precision testing results in an indicator of the data obtained from the test process, which results in accurate quality analysis reports such as coverage, complexity, code repetition rate, test vulnerability calculation, Crash Analysis, test adequacy analysis, test contribution analysis, technical debt calculation, device and defect correlation analysis, and analysis of test and project quality.

9. Precision testing in the design of the common Manual test engineer to consider

Precision testing is designed to be a priority for common manual test engineers. It can be used in the case of completely unchanged test flow, the use of black box simple point measurement method, through the precise testing of the core algorithm, to produce the original ecological test data. Then use coverage to calculate the visualization, Control flow chart, bidirectional tracing technology, with detailed pattern analysis (rather than just a figure) and other series of methods, so that the General manual test with the ability to understand the test results, and the development engineer to test the results of the digital analysis and interaction capabilities.

10. The important contribution of precision testing to code preservation and software engineering

Precision testing in the actual operation of the test will be recorded every step of the footprint, which also indirectly preserves the implementation of the logic of the function, precision testing by technical means to the test case and code docking, which allows the development of the code can be changed by the tester to the test case to know the scope of their changes in the image, In order to facilitate consistency modification, and the replacement of new developers can also use this function to understand the code running logic of the program under test, so as to facilitate the development of understanding the internal structure of the program quickly.

11. No source code can be accurately tested

The main reason why traditional white-box testing does not go into popularity is because of the difficulty of learning and the security of the code. Precision testing in order to ensure the security of the source code, the use of the technology of inserting and inserting piles, the application of the post-insertion pile to the tester, completely eliminate the opportunity of the tester or the user to touch the code, in the test analysis process if the need for source, only in the local source of the environment with the test data recorded database matching, To achieve seamless docking.

Precision testing This technology is more perfect for industries such as mobile Internet.

Testers can even operate the intelligent driving system while driving, and get the test data and test results in real-time with a software oscilloscope that is precisely tested. After testing on a moving vehicle, the testers take the test data obtained throughout the day to the software platform for analysis. The whole test can not contact the source code, to ensure the source code security.

12. How to understand technical debt analysis in precision testing

The code of a program, the complexity of the code, as well as the development of personnel, testers, later maintenance, etc. will have a potential damage to the program, also known as technical debt. In the precision test, the software can be analyzed and calculated by various indicators, the less debt indicates that the program is more fully tested, more stable, and better maintainability. It can also be used to pre-contract inputs that may be needed later. Precision testing Each indicator has a detailed source of data, and by analyzing these indicators, users can learn how to repay these technical debts, and the process of repaying technical debt is the process of software quality approaching perfection.

13. Accurate testing the future direction of development

The direction of the future development of precision testing is mainly aimed at the quality of test procedures and the establishment of a good testing system, for today's rise of Internet enterprises, version of the high-speed iteration and the quality of the program affect the development of Internet enterprises, precision testing in this respect by virtue of their own technical advantages, in the case of not adding extra burden for enterprises, Gradually improve the quality of the program and set up a sound test system.

14. Precision testing for software delivery, software, the meaning of the public test

In the development of the Internet today, software customization has become a popular industry, but how to keep the software to meet the expectations of the requirements of party a? It is clear that the use of in-the-field outsourcing takes a lot of manpower management and other expense costs. Accurate testing of the original ecological data just solves these concerns, it through the technical means, can adopt the distributed Internet Management test method, party a only through this accurate test platform can observe the whole program test quality, let party A in the acceptance of a more impartial data support.

Currently on the market software is based on a large number of testing personnel, due to the individual capacity of the recipient of a large gap, so the description of various bug, problem expression, as well as the scope of testing, these can not be considered and unified. The precision test mode can not only combine to calculate the complete test coverage range, but also directly show the popularity of the program module by tracking the operation track and running result of different testers, and its excellent function greatly solves the problem that the tester submits or describes the bug because of the ability difference. In this way, party A can also get a very powerful digital report of the original ecology under the environment of public testing.

15. Precision testing How to reduce the difficulty and cost of the Enterprise Test team

Precision testing can quickly improve the management of enterprise testers, the testing efficiency in the middle and later, greatly reducing the cost of enterprise testing team. Through a series of technical means without changing the original test process on the basis, can reduce the requirements of testers, and in the middle and late test efficiency to give a substantial help, which makes the core of the cost of the calculation of the formula has changed. Precision testing brings clarity and digital management to the enterprise, not based on the team's vague experience.

The design of the precision test was largely the thread testing concept and product extension released at the 2014 Nanjing Software Testing conference. After more than a year of development, precision testing has also been the first to meet the commercial standards of the software platform, the Nebula test online cloud testing platform. It is dominated by precision testing, although internal calculations and logic are complex, but are presented to users in a very concise application pattern. It can be used in the process of artificial point measurement application, generate a large number of application execution logic of the original ecological data, and uploaded to the cloud platform, through the cloud platform for the real-time calculation and analysis of these data, output a series of indicators for the test application to provide quality reference. To put it simply, the nebula test is an X-ray scanner that provides an objective and impartial full-body scan of the software, breaks the diagnosis, gives detailed medical reports, and offers operational guidelines for software optimization performance or bug fixes.

Nebula testing is currently free for individual test developers and development engineers, can log in to www.teststars.cc, sign up and apply for activation, and can actually experience accurate testing techniques at work.

Precision testing is also a new software testing method, its commercial implementation is only a nebula testing a platform, I believe that with the future of enterprise for efficiency, high-quality pursuit and test practitioners of the strong demand for professional development, precision testing will become a pearl of the field of software testing.

Copyright NOTICE: This article for Bo Master original article, without Bo Master permission not reproduced.

15 Quiz for Professional testers to uncover the veil of "precision testing"