This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
The Role of the Tester's Knowledge in Exploratory Software Testing
May 2013 (vol. 39 no. 5)
pp. 707-724
Juha Itkonen, Aalto University School of Science, Espoo
Mika V. Mäntylä, Aalto University School of Science, Espoo
Casper Lassenius, Aalto University School of Science, Espoo
We present a field study on how testers use knowledge while performing exploratory software testing (ET) in industrial settings. We video recorded 12 testing sessions in four industrial organizations, having our subjects think aloud while performing their usual functional testing work. Using applied grounded theory, we analyzed how the subjects performed tests and what type of knowledge they utilized. We discuss how testers recognize failures based on their personal knowledge without detailed test case descriptions. The knowledge is classified under the categories of domain knowledge, system knowledge, and general software engineering knowledge. We found that testers applied their knowledge either as a test oracle to determine whether a result was correct or not, or for test design, to guide them in selecting objects for test and designing tests. Interestingly, a large number of failures, windfall failures, were found outside the actual focus areas of testing as a result of exploratory investigation. We conclude that the way exploratory testers apply their knowledge for test design and failure recognition differs clearly from the test-case-based paradigm and is one of the explanatory factors of the effectiveness of the exploratory testing approach.
Index Terms:
Software testing,Context,Software,Knowledge engineering,Observers,Organizations,and V&V,Software testing,exploratory testing,validation,test execution,test design,human factors,methods for SQA
Citation:
Juha Itkonen, Mika V. Mäntylä, Casper Lassenius, "The Role of the Tester's Knowledge in Exploratory Software Testing," IEEE Transactions on Software Engineering, vol. 39, no. 5, pp. 707-724, May 2013, doi:10.1109/TSE.2012.55
Usage of this product signifies your acceptance of the Terms of Use.