Empirical Software Engineering, International Symposium on (2005)
Noosa Heads, Qld.
Nov. 18, 2005 to Nov. 18, 2005
pp: 10 pp.
H. Srikanth , Dept. of Comput. Sci., North Carolina State Univ., Raleigh, NC, USA
L. Williams , Dept. of Comput. Sci., North Carolina State Univ., Raleigh, NC, USA
Test case prioritization techniques have been shown to be beneficial for improving regression-testing activities. With prioritization, the rate of fault detection is improved, thus allowing testers to detect faults earlier in the system-testing phase. Most of the prioritization techniques to date have been code coverage-based. These techniques may treat all faults equally. We build upon prior test case prioritization research with two main goals: (1) to improve user-perceived software quality in a cost effective way by considering potential defect severity and (2) to improve the rate of detection of severe faults during system-level testing of new code and regression testing of existing code. We present a value-driven approach to system-level test case prioritization called the prioritization of requirements for test (PORT). PORT prioritizes system test cases based upon four factors: requirements volatility, customer priority, implementation complexity, and fault proneness of the requirements. We conducted a PORT case study on four projects developed by students in advanced graduate software testing class. Our results show that PORT prioritization at the system level improves the rate of detection of severe faults. Additionally, customer priority was shown to be one of the most important prioritization factors contributing to the improved rate of fault detection.
software testing, system-level test case prioritization, regression test case, fault detection, code coverage-based prioritization technique, software quality, software defect severity, value-driven approach, prioritization of requirements for test, PORT, requirements volatility, customer priority, implementation complexity, fault proneness
H. Srikanth, J. Osborne and L. Williams, "System test case prioritization of new and regression test cases," 2005 International Symposium on Empirical Software Engineering(ISESE), Noosa Heads, Qld., 2005, pp. 10 pp..