This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Mutation Sensitivity Testing
November/December 2009 (vol. 11 no. 6)
pp. 40-47
Daniel Hook, Engineering Seismology Group Solutions
Diane Kelly, Royal Military College of Canada

Computational scientists often encounter code-testing challenges not typically faced by software engineers who develop testing techniques. Mutation sensitivity testing addresses these challenges, showing that a few well-designed tests can detect many code faults and that reducing error tolerances is often more effective than running additional tests.

1. P.F. Dubois, Object Technology for Scientific Computing: Object-Oriented Numerical Software in Eiffel and C, Prentice-Hall, 1997.
2. G. Miller, "Scientific Publishing: A Scientist's Nightmare: Software Problem Leads to Five Retractions," Science, vol. 314, no. 5807, 2006, pp. 1856–1857.
3. L. Hatton and A. Roberts, "How Accurate is Scientific Software?" IEEE Trans. Software Eng., vol. 20, no. 10, 1994, pp. 785–797.
4. L. Hatton, "The Chimera of Software Quality," Computer, vol. 40, no. 8, 2007, pp. 104, 102–103.
5. L. Hatton, "The T Experiments: Errors in Scientific Software," Computational Science &Eng., vol. 4, no. 2, 1997, pp. 27–38.
6. W.L. Oberkampf, T.G. Trucano, and C. Hirsch, "Verification, Validation, and Predictive Capability in Computational Engineering and Physics," Applied Mechanics Rev., vol. 57, no. 5, 2004, pp. 345–384.
7. D.F. Kelly, "A Software Chasm: Software Engineering and Scientific Computing," IEEE Software, vol. 24, no. 6, 2007, pp. 120–119.
8. A.J. Offutt and R.H. Untch, Mutation 2000: Uniting the Orthogonal, Kluwer Academic, 2001, pp. 34–44.
9. J.H. Andrews, L.C. Briand, and Y. Labiche, "Is Mutation an Appropriate Tool for Testing Experiments?" Proc. 27th Int'l Conf. Software Eng., ACM Press, 2005, pp. 402–411.
10. D. Kelly, N. Cote, and T. Shepard, "Software Engineers and Nuclear Engineers: Teaming Up to Do Testing," Proc. Canadian Nuclear Soc. Conf., Canadian Nuclear Soc., 2007.
11. P.C. Jorgensen, Software Testing: A Craftman's Approach, CRC Press, 2001.
12. D. Hamlet, "When Only Random Testing Will Do," Proc. Int'l Workshop Random Testing, ACM Press, 2006, pp. 1–9.

Index Terms:
Mutation Sensitivity Testing, code faults, software testing, scientific software, oracle problem, tolerance problem
Citation:
Daniel Hook, Diane Kelly, "Mutation Sensitivity Testing," Computing in Science and Engineering, vol. 11, no. 6, pp. 40-47, Nov.-Dec. 2009, doi:10.1109/MCSE.2009.200
Usage of this product signifies your acceptance of the Terms of Use.