Automated Testing (i): Automated test theory

What is automated testing:

Automated testing is the process of translating a man-driven test behavior into a machine execution. Typically, after a test case has been designed and reviewed, the tester performs the test step-by-stage according to the procedures described in the test case to obtain a comparison between the actual result and the desired result. In this process, the concept of automated testing is introduced in order to save manpower, time or hardware resources and improve testing efficiency.

Common pitfalls of automated testing:

1. Think recording playback is automated testing (different levels of automated testing)

2. Verify the information on the interface only

3. Free organization of test-related materials and proper management of test-related documentation and outputs

4. Premature or excessive automation

Advantages and disadvantages of automated testing

Advantage:

1. Regression testing is more convenient and reliable

2. Can be used for monotonous, more repetitive test

3. Perform some tests that are difficult or impossible for manual testing

4. Better use of resources, save time (7x24), liberate manpower

5. Consistent and repeatable

6. Full multiplexing between different versions of the software

7. Make software more trusted

8. Multi-Environment testing

Disadvantage:

1. Can never replace manual testing

2. Cannot fully guarantee the correctness of the test

3. Automated testing can hardly detect new defects

4. Highly dependent on the quality of the test

5. Test automation may restrict software development

6. Lack of flexibility and creativity in automated testing tools

7. High cost investment, high risk

8. High technical requirements for testers and high requirements for testing tools

Principles of automated testing

When it is appropriate to use automation:

1. Long project cycle, system version constantly

2. Changes in requirements are infrequent

3. The test object in the system can be recognized normally.

4. There are no large quantities of third-party controls in the system

5. Repeated tests are required, such as reliability tests that require thousands of system tests

When you are not suitable to use automated tests:

1. Short project cycle, frequent changes in requirements

2. Introduce automation when software is not yet stable

3. No clear Project Test automation plan, measures and management

4. The leader does not support

5. Most objects are not recognized

6. Frequent and difficult script maintenance

Common GUI Automated test tools: WinRunner QTP Selenium Robot Framework Rational functional Tester silktest Sikuli

the two main points of automation test tool selection: 1. Objects and Management 2. Object manipulation

The process of automated testing:

personnel for automated testing: Test lead, advanced Test development Engineer, automated test case designer, scripting developer, Project library Manager

Automated test Case Design 5 Major principle:

1. The scope of automated test cases is often a core business process or a high rate of repeat execution

2. Automated test cases are generally "forward" oriented

3. Not all manual test cases can be implemented using automation

4. Manual test cases do not have to return to the origin, and automated test cases must return to the origin to ensure the independence of the use case

5. Automated test cases must be designed with reasonable sequence of operations and verification points

Identifying objects

1. Correct: has and only one to object of the mandatory recognition property and Ro exactly match

2. Error: ① 0, the report cannot find the object < mismatch >② multiple, there are multiple to the mandatory recognition property and Ro exactly the same

Automated Testing (i): Automated test theory