This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
System Testing a Scientific Framework Using a Regression-Test Environment
March-April 2012 (vol. 14 no. 2)
pp. 38-45
Hanna Remmel, University of Heidelberg
Barbara Paech, University of Heidelberg
Peter Bastian, University of Heidelberg
Christian Engwer, University of Münster

Testing a scientific framework is a challenging task, given the framework's large variability. The approach taken here is to apply software product line engineering, using variability modeling to support the selection of test applications and test cases. Specifically, regression testing is used for a complex scientific framework called the Distributed and Unified Numerics Environment (DUNE).

1. J.C. Carver, "Report: The Second International Workshop on Software Engineering for CSE," Computing in Science & Eng., vol. 11, no. 6, 2009, pp. 14–19.
2. R. Baxter, "Software Engineering Is Software Engineering," Proc. 1st Int'l Workshop Software Eng. for High Performance Computing System Applications, IEEE CS, 2004, pp. 14–18.
3. P. Bastian et al., "A Generic Grid Interface for Parallel and Adaptive Scientific Computing. Part I: Abstract Framework," Computing, vol. 82, no. 2, 2008, pp. 103–119.
4. P. Bastian et al., "A Generic Grid Interface for Parallel and Adaptive Scientific Computing. Part II: Implementation and Tests in DUNE," Computing, vol. 82, no. 2, 2008, pp. 121–138.
5. H. Remmel et al., "Supporting the Testing of Scientific Frameworks with Software Product Line Engineering: A Proposed Approach," Proc. 4th Int'l Workshop Software Eng. for Computational Science and Eng., ACM Press, 2011, pp. 10–18.
6. K. Pohl et al., Software Product Line Engineering—Foundations, Principles, and Techniques, Springer, 2005.
7. T. Xie and D. Notkin, "Checking Inside the Black Box: Regression Testing by Comparing Value Spectra," IEEE Trans. Software Eng., vol. 31, no. 10, 2005, pp. 869–883.
8. W.L. Oberkampf et al., "Verification, Validation, and Predictive Capability in Computational Engineering and Physics," Applied Mechanics Rev., vol. 57, no. 5, 2004, pp. 345–384.
1. D. Hook and D. Kelly, "Testing for Trustworthiness in Scientific Software," Proc. Workshop Software Eng. for Computational Science and Eng., IEEE CS, 2009, pp. 59–64.
2. W.L. Oberkampf et al., "Verification, Validation, and Predictive Capability in Computational Engineering and Physics," Applied Mechanics Rev., vol. 57, no. 5, 2004, pp. 345–384.
3. A. Pasetti, Software Frameworks and Embedded Control Systems, Springer, 2002.
4. K. Pohl et al., Software Product Line Engineering—Foundations, Principles, and Techniques, Springer, 2005.
5. E. Engström and P. Runeson, "Decision Support for Test Management and Scope Selection in a Software Product Line Context," Proc. 4th Int'l Conf. Software Testing, Verification and Validation Workshops, IEEE CS Press, 2011, pp. 262–265.
6. K.S. Ackroyd et al., "Scientific Software Development at a Research Facility," IEEE Software, vol. 25, no. 4, 2008, pp. 44–51.

Index Terms:
Test execution, methods for SQA, methods for verification and validation, scientific computing
Citation:
Hanna Remmel, Barbara Paech, Peter Bastian, Christian Engwer, "System Testing a Scientific Framework Using a Regression-Test Environment," Computing in Science and Engineering, vol. 14, no. 2, pp. 38-45, March-April 2012, doi:10.1109/MCSE.2011.115
Usage of this product signifies your acceptance of the Terms of Use.