loading...
 This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
2008 International Conference on Software Testing, Verification, and Validation
On the Predictability of Random Tests for Object-Oriented Software
April 09-April 11
ISBN: 978-0-7695-3127-4
Intuition suggests that random testing of object-oriented programs should exhibit a significant difference in the number of faults detected by two different runs of equal duration. As a consequence, random testing would be rather unpredictable. We evaluate the variance of the number of faults detected by random testing over time. We present the results of an empirical study that is based on 1215 hours of randomly testing 27 Eiffel classes, each with 30 seeds ofthe random number generator. Analyzing over 6 million failures triggered during the experiments, the study provides evidence that the relative number of faults detected by random testing over time is predictable but that different runs of the random test case generator detect different faults. The study also shows that random testing quickly finds faults: the first failure is likely to be triggered within 30 seconds.
Index Terms:
random testing, predictability, fault, failure
Citation:
Ilinca Ciupa, Alexander Pretschner, Andreas Leitner, Manuel Oriol, Bertrand Meyer, "On the Predictability of Random Tests for Object-Oriented Software," icst, pp.72-81, 2008 International Conference on Software Testing, Verification, and Validation, 2008
Usage of this product signifies your acceptance of the Terms of Use.