This Article 
 Bibliographic References 
 Add to: 
Modular Operational Test Plans for Inferences on Software Reliability Based on a Markov Model
April 2002 (vol. 28 no. 4)
pp. 358-363

This paper considers the problem of assessing the reliability of a software system that can be decomposed into a finite number of modules. It uses a Markovian model for the transfer of control between modules in order to develop the system reliability expression in terms of the module reliabilities. An operational test procedure is considered in which only the individual modules are tested and the system is considered acceptable if, and only if, no failures are observed. The minimum number of tests required of each module is determined such that the probability of accepting a system whose reliability falls below a specified value R_0 is less than a specified small fraction beta. This sample size determination problem is formulated as a two-stage mathematical program and an algorithm is developed for solving this problem. Two examples from the literature are considered to demonstrate the procedure.

[1] P. Frankl et al., "Evaluating Testing Methods by Delivered Reliability," IEEE Trans. Software Eng., Aug. 1998, pp. 586-602.
[2] C. Smidts and D. Sova, “An Architectural Model for Software Reliability Quantification: Sources of Data,” Reliability Eng. and System Safety, vol. 64, pp. 279-290, 1999.
[3] R.C. Cheung, “A User-Oriented Software Reliability Model,” IEEE Trans. Software Eng., vol. 6, pp. 118-125, 1980.
[4] J.H. Poore,H.D. Mills,, and D. Mutcher,“Planning and certifying software system reliability,” IEEE Software, pp. 88-99, Jan. 1993.
[5] J. Rajgopal and M. Mazumdar, “Designing Component Test Plans for Series System Reliability via Mathematical Programming,” Technometrics, vol. 37, pp. 195-212, 1995.
[6] J. Rajgopal and M. Mazumdar, “A System Based Component Test Plan for a Series System, with Type-II Censoring,” IEEE Trans. Reliability, vol. 45, pp. 375-378, 1996.
[7] J. Rajgopal and M. Mazumdar, “Minimum Cost Component Test Plans for Evaluating Reliability of a Highly Reliable Parallel System,” Naval Research Logistics, vol. 44, pp. 401-418, 1997.
[8] W.I. Zangwill, Nonlinear Programming: A Unified Approach. Englewood Cliffs, N.J.: Prentice-Hall, 1969.
[9] J.D. Musa, A. Iannino, and K. Okumoto, Software Reliability. New York: McGraw-Hill Publishing Co., 1990.
[10] W.C. Hetzel, The Complete Guide to Software Testing. Wellesley, Mass.: QED Information Sciences, Inc., 1988.
[11] B. Littlewood, “A Reliability Model for Systems with Markov Structure,” J. Royal Statistical Soc., Series C (Applied Statistics), vol. 24, pp. 172-177, 1975.
[12] J.F. Meyer, B. Littlewood, and D.R. Wright, “Dependability of Modular Software in a Multiuser Operational Environment,” Proc. Sixth Int'l Symp. Software Reliability Eng., pp. 170-179, 1995.
[13] S. Kuball, J. May, and G. Hughes, “Building a System Failure Rate Estimator by Identifying Component Failure Rates,” Proc. 10th Int'l Symp. Software Reliability Eng., pp. 32-41, 1999.
[14] J. Rajgopal, M. Mazumdar, and S.V. Majety, “Optimum Combined Test Plans for Systems and Components,” IIE Transactions, vol. 31, pp. 481-490, 1999.
[15] R.G. Easterling, M. Mazumdar, F.W. Spencer, and K.V. Diegert, “System Based Component Test Plans and Operating Characteristics: Binomial Data,” Technometrics, vol. 33, pp. 287-298, 1991.
[16] S. Gal, “Optimal Test Design for Reliability Demonstration,” Operations Research, vol. 22, pp. 1236-1242, 1974.
[17] E. Cinlar, Introduction to Stochastic Processes. Englewood Cliffs, N.J.: Prentice-Hall, Inc., 1975.
[18] K. Siegrist, “Reliability of Systems with Markov Transfer of Control,” IEEE Trans. Software Eng., vol. 14, pp. 1049-1053, 1988.
[19] S. Wolfram, The Mathematica Book, Wolfram Media, Cambridge Univ. Press, Cambridge, U.K., 1996.
[20] C. Beightler and D.T. Phillips, Applied Geometric Programming. New York: John Wiley&Sons, Inc., 1976.
[21] J. Rajgopal and D.L. Bricker, “An Algorithm for Solving the Posynomial GP Problem, Based on Generalized Programming,” Technical Report No. TR95-10, Dept. Industrial Eng., Univ. of Pittsburgh, 1995, to appear in Computational Optimization and Applications.
[22] M. Avriel, R.S. Dembo, and U. Passy, “Solution of Generalized Geometric Programs,” Int'l J. Numerical Methods in Eng., vol. 9, pp. 149-168, 1975.
[23] E.C. Soistman and K.B. Ragsdale, “Combined Hardware/Software Reliability Prediction Methodology,” Rome Air Development Center Contract Report OR-18-173, vol. II, 1984.

Index Terms:
survey, software reuse, empirical study
J. Rajgopal, M. Mazumdar, "Modular Operational Test Plans for Inferences on Software Reliability Based on a Markov Model," IEEE Transactions on Software Engineering, vol. 28, no. 4, pp. 358-363, April 2002, doi:10.1109/TSE.2002.995424
Usage of this product signifies your acceptance of the Terms of Use.