Anatomy of an automatic testing framework
Http://www.pragmaticsw.com/Newsletters/newsletter_2009_07_SP.htm
This article describes the main components and features of a successful automated testing framework.
Why automate your test cases?(Why Automate Test Cases)
Compile companies run their regression test cases manually, So when does it make sense to begin automating your regression test cases? It makes sense to automate your test cases when you can no longer run the regression test cases on each build created. for example, if you are doing daily or weekly builds of your code to quality assurance and you cannot quickly run your regression test cases with each build, it is time to consider automating them. automating your test cases provide these benefits:
- Quicker releases(Quick release)-by having your regression test cases run automatically, your software quality team can concentrate on testing new features of your software and less time regressing existing features.
- Higher quality releases(Higher quality version release) -Your software releases will have fewer bugs and require less customer support because they will be of higher quality.
- Happier MERs(More satisfied customers)-Your MERs will be happier and more willing to serve as testimonials for future prospects.
What is an automatic testing framework?(Why use the automated testing framework)
Most automated tools require the test engineer to understand a scripting language (VB script, Java Script, etc .) to write their automation test cases. these tools usually have the ability to create the scripts using record and playback, but this does not always write the most efficient scripting code and is not as re-usable and maintainable. anAutomatic Testing FrameworkIs a set of assumptions, concepts, and practices that provide support for automatic software testing, allowing you to re-use automatic ed test cases, reduce maintenance, and enhance maintainability.
Anatomy of a successful automated testing framework(Components of a successful automated testing framework)
When designing your automated testing framework, consider these features, as they can dramatically improve success and reduce the chance of Abandonment:
- Keyword Driven Testing(Keyword-Driven Testing)-If your test engineers are not experts at scripting ages, consider replacing your automatic scripts with Keyword Driven Testing. this approach allows a tester (or even a subject matter expert) to create automatic tests by describing each step of the automation. for example, if you are automating the login process of your application, your user will access your application, type in their user-ID and password and press a button to login. traditionally, testers wocould do this by writing VB script that will navigate to your application, identify each object on the screen (User-ID, password and login button ), then write script to enter in the user-ID, password and to press the login button. with Keyword Driven Testing, the tester does not need to understand the scripting language to make this happen, they can simply describe the event (navigate to your application, enter in "ABC" for the user-ID, enter in "XXX" for the password, press the login button when done ). as you can imagine, this is a much simpler approach to automated testing than scripting.
- Allow data iterations(Supports data-driven testing)-It is good practice to allow your testers to re-use automation test cases, but allow them to run them with different sets of data. for example, you might use the same automatic test case for logging into your software, but allow the test case to be run multiple times with different user-ID and password combinations to test different scenarios. if your automated testing framework is flexible enough to allow your testers to define different data iterations, it will reduce time spent creating automatic test cases.
- Allow running on multiple hosts(Supports multi-host Operation)-When designing your automated testing framework, consider multiple hosts. for example, as your quality assurance demands grow, you may need to setup a QA Lab with multiple servers. once that is done, you will need a way to launch your automation test cases on multiple servers, so consider building that into your automation framework.
- Allow scheduling of automation runs(Supports timed Automatic Operation)-Once you have developed your automation test cases, you will want to schedule them so that they can run unattended. when designing your automation framework, build in the capabilities to schedule automation runs at different intervals (days of the week), allow recurrence (run every day at 6 p. M ., etc .), and allow them to be scheduled on different hosts.
- Reporting run results(Report running results)-When developing your automation framework, consider how you will report on the run activity of your automation effort. if you are using an existing test management solution for your manual test effort, consider integrating your automatic test result data in with the reporting of your test management solution, that way you can analyze your manual and automatic test effort in a pair lidated fashion.
