44 criteria for test case review effectiveness

Chen nengtech
2007-9-20

Original article:
"44" metrics for test case review without tiveness-http://davidfrico.com/roi-metrics-f.htm

1. Major defects per test case review
Major defects found in each reviewed test case
2. minor defects per test case review
Secondary defects discovered in each reviewed test case

3. Total defects per test case review
Total number of defects discovered in each reviewed test case

4. Ratio of major to minor defects per test case review
Ratio of primary and secondary defects discovered in each reviewed test case

5. Total defects per test case review hour
Total number of defects found in the testing case reviewed per hour

6. Major defects per test case review hour
Major defects found in testing cases reviewed every hour

7. Ratio of major to minor defects per test case review hour
Secondary defects discovered by testing cases reviewed every hour

8. Number of open defects per test review
Number of open defects discovered in each reviewed test case

9. Number of closed defects per test case review
Number of defects found in the closed state in each reviewed test case

10. Ratio of closed to open defects per test case review
Ratio of the number of defects in the closed state discovered by each reviewed test case to the number of defects in the open state

11. Number of major open defects per test case review
Number of major open defects discovered in each reviewed test case

12. Number of major closed defects per test case review
Number of major closed defects discovered in each reviewed test case

13. Ratio of major closed to open defects per test case review
Ratio of major closed defects found in each reviewed test case to those in open state

14. Number of minor open defects per test case review
Number of secondary defects found in the open state in each reviewed test case

15. Number of minor closed defects per test case review
Number of secondary defects found in the closed state in each reviewed test case

16. Ratio of minor closed to open defects per test case review
Ratio of secondary defects in the closed state discovered by each reviewed test case to secondary defects in the open state

17. percent of total defects captured per test case review
Percentage of total defects found in each reviewed test case to the total number of defects

18. percent of major defects captured per test case review
Percentage of the number of major defects found in each reviewed test case to the total number of defects

19. percent of minor defects captured per test case review
Percentage of secondary defects discovered in each reviewed test case to the total number of defects

20. Ratio of percent major to minor defects captured per test case review
The ratio between the percentage of primary defects found in each reviewed test case and the percentage of secondary defects.

21. percent of total defects captured per test case review hour
Percentage of defects found in test cases reviewed per hour to total Defects

22. percent of major defects captured per test case review hour
Percentage of major defects found in test cases reviewed per hour to total Defects

23. percent of minor defects captured per test case review hour
Percentage of secondary defects found in test cases reviewed per hour to total Defects

24. Ratio of percent major to minor defects captured per test case review hour
Percentage of major defects found in the test case reviewed per hour to the percentage of secondary defects

25. percent of total defect residual per test case review
Percentage of defects not found in each reviewed test case

26. percent of major defect residual per test case review
Percentage of major defects not found in each reviewed test case

27. percent of minor defect residual per test case review
Percentage of secondary defects not found in each reviewed test case

28. Ratio of percent major to minor defect residual per test case review
Percentage of major defects not found in each reviewed test case to the percentage of secondary defects

29. percent of total defect residual per test case review hour
Percentage of defects not found in test cases reviewed per hour

30. percent of major defect residual per test case review hour
Percentage of major defects not found in test cases reviewed per hour

31. percent of minor defect residual per test case review hour
Percentage of secondary defects not found in test cases reviewed per hour

32. Ratio of percent major to minor defect residual per test case review hour
Percentage of major defects not found in test cases reviewed per hour to the percentage of secondary defects

33. Number of planned test case reviews
Number of test cases to be reviewed

34. Number of held test case reviews
Number of test cases to be reviewed but not reviewed

35. Ratio of planned to held test case reviews
Ratio of the number of test cases to be reviewed and the number of test cases to be reviewed but not reviewed

36. Number of reviewed Test Cases
Number of reviewed Test Cases

37. Number of unreviewed Test Cases
Number of unreviewed Test Cases

38. Ratio of reviewed to unreviewed Test Cases
Ratio of the number of reviewed test cases to the number of unreviewed Test Cases

39. Number of compliant test case reviews
Number of reviewed Test Cases

40. Number of non-compliant test case reviews
Number of test cases that fail Review

41. Ratio of compliant to non-compliant test case reviews
Ratio of the number of tested test cases passed by the review to the number of tested cases not passed by the review

42. Compliance of test case reviews
Number of reviews passed

43. Non-compliance of test case reviews
No. of reviews passed

44. Ratio of compliance to non-compliance of test case reviews
Proportion between the number of reviews passed and the number of missed reviews