2012 Eighth International Conference on the Quality of Information and Communications Technology (2012)
Lisbon, TBD, Portugal Portugal
Sept. 3, 2012 to Sept. 6, 2012
Test-driven development is an essential part of Extreme Programming approach with the preference of being followed in other Agile methods as well. For several years, researchers are performing empirical investigations to evaluate quality improvements in the resulting code when test-driven development is being used. However, very little had been reported into investigating the quality of the testing performed in conjunction with test-driven development. In this paper we present results from an experiment specifically designed to evaluate the quality of test cases created by developers who used the test-first and the traditional test-last approaches. On an average, the quality of testing in test-driven development was almost the same as the quality of testing using test-last approach. However, detailed analysis of test cases, created by test-driven development group, revealed that 29% of test cases were "negative" test cases (based on non-specified requirements) but contributing as much as 65% to the overall tests quality score of test-first developers. We are currently investigating the possibility of extending testdriven development to facilitate non-specified requirements to a higher extent and thus minimise the impact of a potentially inherent effect of positive test bias.
experiment, software testing, test case quality, test driven development
Adnan Cauevic, Sasikumar Punnekkat, Daniel Sundmark, "Quality of Testing in Test Driven Development", 2012 Eighth International Conference on the Quality of Information and Communications Technology, vol. 00, no. , pp. 266-271, 2012, doi:10.1109/QUATIC.2012.49