This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
A Formal Analysis of the Fault-Detecting Ability of Testing Methods
March 1993 (vol. 19 no. 3)
pp. 202-213

Several relationships between software testing criteria, each induced by a relation between the corresponding multisets of subdomains, are examined. The authors discuss whether for each relation R and each pair of criteria, C/sub 1/ and C/sub 2/, R(C/sub 1/, C/sub 2/) guarantees that C/sub 1/ is better at detecting faults than C/sub 2/ according to various probabilistic measures of fault-detecting ability. It is shown that the fact that C/sub 1/ subsumes C/sub 2/ does not guarantee that C/sub 1/ is better at detecting faults. Relations that strengthen the subsumption relation and that have more bearing on fault-detecting ability are introduced.

[1] J. W. Duran and S. C. Ntafos, "An evaluation of random testing,"IEEE Trans. Software Eng., vol. SE-10, no. 7, pp. 438-444, July 1984.
[2] P. G. Frankl and S. N. Weiss, "An experimental comparison of the effectiveness of the all-uses and all-edges adequacy criteria," inProc. 4th Symp. Software Testing, Analysis, and Verification, ACM Press, Oct. 1991, pp. 154-164.
[3] P. G. Frankl and E. J. Weyuker, "An applicable family of data flow testing criteria,"IEEE Trans. Software Eng., vol. 14, no. 10, pp. 1483-1498, Oct. 1988.
[4] P. G. Frankl and E. J. Weyuker, "Assessing the fault-detecting ability of testing methods," inACM SIGSOFT'91 Conf. Software for Critical Systems, ACM Press, Dec. 1991, pp. 77-91.
[5] P. G. Frankl and E. J. Weyuker, "Analytical comparison of several testing strategies," Tech. Rep. PUCS-100-92, Polytechnic University Computer Science Dept., Brooklyn, NY, July 1992.
[6] J. S. Gourlay, "A mathematical framework for the investigation of testing,"IEEE Trans. Software Eng., vol. SE-9, no. 6, pp. 686-709, Nov. 1983.
[7] D. Hamlet and R. Taylor, "Partition testing does not inspire confidence,"IEEE Trans. Software Eng., vol. 16, no. 12, pp. 1402-1411, Dec. 1990.
[8] P. Herman, "A data flow analysis approach to program testing,"Austral. Computer J., vol. 8, no. 3, pp. 92-96, Nov. 1976.
[9] B. Jeng and E. Weyuker, "Some observations on partition testing," inProc. ACM SIGSOFT'89: 3rd Symp. on Software Testing, Analysis, and Verification (TAV3), Dec. 1989, pp. 38-47.
[10] J. W. Laski and B. Korel, "A data flow oriented program testing strategy,"IEEE Trans. Software Eng., vol. SE-9, no. 3, pp. 347-354, May 1983.
[11] S. Ntafos, "On required element testing,"IEEE Trans. Software Eng., vol. SE-10, no. 6, pp. 795-803, Nov. 1984.
[12] S. Rapps and E. J. Weyuker, "Data flow analysis techniques for program test data selection," inProc. 6th Int. Conf. Software Eng., Sept. 1982, pp. 272-278.
[13] S. Rapps and E. J. Weyuker, "Selecting software test data using data flow information,"IEEE Trans. Software Eng., vol. SE-11, no. 4, pp. 367-375, Apr. 1985.
[14] E. J. Weyuker and B. Jeng, "Analyzing partition testing strategies,"IEEE Trans. Software Eng., vol. 17, no. 7, pp. 703-711, July 1991.
[15] E. J. Weyuker, S. N. Weiss, and D. Hamlet, "Comparison of program testing strategies," inProc. 4th Symp. Software Testing, Analysis, and Verification, ACM Press, Oct. 1991, pp. 1-10.

Index Terms:
formal analysis; software testing criteria; multisets; subdomains; probabilistic measures; fault-detecting ability; subsumption relation; program testing; system recovery
Citation:
P.G. Frankl, E.J. Weyuker, "A Formal Analysis of the Fault-Detecting Ability of Testing Methods," IEEE Transactions on Software Engineering, vol. 19, no. 3, pp. 202-213, March 1993, doi:10.1109/32.221133
Usage of this product signifies your acceptance of the Terms of Use.