This Article 
 Bibliographic References 
 Add to: 
Assessing Software Designs Using Capture-Recapture Methods
November 1993 (vol. 19 no. 11)
pp. 1045-1054

The number of faults not discovered by the design review can be estimated by using capture-recapture methods. Since these methods were developed for wildlife population estimation, the assumptions used to derive them do not match design review applications. The authors report on a Monte Carlo simulation to study the effects of broken assumptions on maximum likelihood estimators (MLEs) and jackknife estimators (JEs) of faults remaining. It is found that the MLE performs satisfactorily if faults are classified into a small number of homogeneous groups. Without grouping, the MLE can perform poorly, but it generally does better than the JE.

[1] B. W. Boehm,Software Engineering Economics. Englewood Cliffs, NJ: Prentice-Hall, 1981.
[2] K. P. Burnham and W. S. Overton, "Estimation of the size of a closed population when capture probabilities vary among animals,"Biometrika, vol. 65, pp. 625-633, 1978.
[3] S. G. Eick, C. R. Loader, M. D. Long, S. A. Vander Wiel, and L. G. Votta, "Estimating software fault content before coding, inProc. 14th Int. Conf. Software Eng., pp. 59-65, May 1992.
[4] S. G. Eick, C. R. Loader, M. D. Long, S. A. Vander Wiel, and L. G. Votta, "Capture-recapture and other statistical methods for software inspection data," inComputing Science and Statistics: Proc. 25 Symp. Interface, 1993, to be published.
[5] W. S. Humphrey,Managing the Software Process. Reading, MA: Addison-Wesley, 1989.
[6] G. A. Miller, "The magic number seven, plus or minus two: Some limits on our capacity for processing information,"Psychol. Rev., vol. 63, pp. 81-97, 1956.
[7] D. L. Otis, K. P. Burnham, G. C. White, and D. R. Anderson,Statistical Inference from Capture Data on Closed Animal Populations(Wildlife Monographs). Bethesda, MD: The Wildlife Society, 1978.
[8] G. C. White, D. R. Anderson, K. P. Burnham, and D. L. Otis, "Capture-recapture and removal methods for sampling closed populations," Tech. Rep., Los Alamos National Lab., Los Alamos, NM, 1982.

Index Terms:
software designs; capture-recapture methods; wildlife population estimation; Monte Carlo simulation; broken assumptions; maximum likelihood estimators; jackknife estimators; software quality assurance; statistical estimation; design reviews; maximum likelihood estimation; software quality; software reliability; statistical analysis
S.A. Vander Wiel, L.G. Votta, "Assessing Software Designs Using Capture-Recapture Methods," IEEE Transactions on Software Engineering, vol. 19, no. 11, pp. 1045-1054, Nov. 1993, doi:10.1109/32.256852
Usage of this product signifies your acceptance of the Terms of Use.