The Community for Technology Leaders
2018 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW) (2018)
Västerås, Sweden
Apr 9, 2018 to Apr 13, 2018
ISBN: 978-1-5386-6352-3
pp: 18-24
ABSTRACT
Quality of software test suites can be effectively and accurately measured using mutation analysis. Traditional mutation involves seeding first and sometimes higher order faults into the program, and evaluating each for detection. However, traditional mutants are often heavily redundant, and it is desirable to produce the complete matrix of test cases vs mutants detected by each. Unfortunately, even the traditional mutation analysis has a heavy computational footprint due to the requirement of independent evaluation of each mutant by the complete test suite, and consequently the cost of evaluation of complete kill matrix is exorbitant. We present a novel approach of combinatorial evaluation of multiple mutants at the same time that can generate the complete mutant kill matrix with lower computational requirements. Our approach also has the potential to reduce the cost of execution of traditional mutation analysis especially for test suites with weak oracles such as machine-generated test suites, while at the same time liable to only a linear increase in the time taken for mutation analysis in the worst case.
INDEX TERMS
computational complexity, matrix algebra, program testing, software quality
CITATION

R. Gopinath, B. Mathis and A. Zeller, "If You Can't Kill a Supermutant, You Have a Problem," 2018 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW), Västerås, Sweden, 2018, pp. 18-24.
doi:10.1109/ICSTW.2018.00023
174 ms
(Ver 3.3 (11022016))