This Article 
 Bibliographic References 
 Add to: 
System Test Planning of Software: An Optimization Approach
July 2006 (vol. 32 no. 7)
pp. 503-5099
This paper extends an exponential reliability growth model to determine the optimal number of test cases to be executed for various use case scenarios during the system testing of software. An example demonstrates a practical application of the optimization model for system test planning.

[1] A. Bertolino and M. Marre, “Automatic Generation of Path Covers Based on the Control Flow Analysis of Computer Programs,” IEEE Trans. Software Eng., vol. 20, no. 12, pp. 855-899, Dec. 1994.
[2] K. Chari, J. Fisher, and A. Hevner, “Software Integration Test Planning: An Optimization Model,” Proc. Workshop Information Technologies and Systems (WITS), Dec. 2000.
[3] K. Chari and A. Hevner, “Integration Test Planning of Object-Oriented Software,” Proc. Eighth INFORMS Conf. Information Systems and Technology (CIST 2003), Oct. 2003.
[4] T. Chavez, “A Decision-Analytic Stopping Rule for Validation of Commercial Software Systems,” IEEE Trans. Software Eng., vol. 26, no. 9, pp. 907-918, Sept. 2000.
[5] L.A. Clarke, “A System to Generate Test Data and Symbolically Execute Programs,” IEEE Trans. Software Eng., vol. 2, no. 3, pp. 215-222, Sept. 1976.
[6] S.R. Dalal and A.A. McIntosh, “When to Stop Testing for Large Software Systems with Changing Code,” IEEE Trans. Software Testing, vol. 20, no. 4, pp. 318-323, Apr. 1994.
[7] I. Forgacs and A. Bertolino, “Feasible Test Path Selection by Principal Slicing,” Proc. Sixth European Software Eng. Conf., pp. 378-394, Sept. 1997.
[8] A.L. Goel, “Software Reliability Models: Assumptions, Limitations, and Applicability,” IEEE Trans. Software Eng., vol. 11, no. 12, pp. 1411-1423, Dec. 1985.
[9] A.L. Goel and K. Okumoto, “Time-Dependent Error-Detection Rate Model for Software Reliability and Other Performance Measures,” IEEE Trans. Reliability, vol. 28, no. 3, pp. 206-211, Aug. 1979.
[10] S.S. Gokhale and K.S. Trivedi, “Dependency Characterization in Path-Based Approaches to Architecture-Based Software Reliability Prediction,” Proc. First Workshop Application-Specific Software Eng. and Technology (ASSET '98), pp. 86-89, 1998.
[11] J. Hartman, C. Imoberdorf, and M. Meisinger, “UML-Based Integration Testing,” Proc. Int'l Symp. Software Testing and Analysis, pp. 60-70, 2000.
[12] M. Helander, M. Zhao, and N. Ohlsson, “Planning Models for Software Reliability and Cost,” IEEE Trans. Software Eng., vol. 24, no. 6, pp. 420-434, June 1998,
[13] R. Hou, S. Kuo, and Y. Chang, “Needed Resources for Software Module Test Using the Hyper-Geometric Software Reliability Growth Model,” IEEE Trans. Reliability, vol. 45, no. 4, pp. 541-549, 1996.
[14] R. Hou, S. Kuo, and Y. Chang, “Optimal Release Times for Software Systems with Scheduled Delivery Time Based on the HGDM,” IEEE Trans. Computers, vol. 46, no. 2, pp. 216-221, Feb. 1997.
[15] W.E. Howden, “Symbolic Testing and the DISSECT Symbolic Evaluation System,” IEEE Trans. Software Eng., vol. 4, no. 4, pp. 266-278, 1977.
[16] P.C. Jorgensen and C. Erickson, “Object-Oriented Integration Testing,” Comm. ACM, vol. 37, no. 9, pp. 30-38, 1994.
[17] H. Koch and P. Kubat, “Optimal Release Time of Computer Software,” IEEE Trans. Software Eng., vol. 9, pp. 323-327, 1983.
[18] B. Korel, “Automated Software Test Data Generation,” IEEE Trans. Software Eng., vol. 16, no. 8, pp. 870-879, Aug. 1990.
[19] P. Kubat, “Assessing Reliability of Modular Software,” Operations Research Letters, vol. 8, no. 1, pp. 35-41, 1989.
[20] Y. Leung, “Optimum Software Release Time with a Given Cost Budget,” J. System Software, vol. 17, pp. 233-242, 1992.
[21] Y. Leung, “Optimal Reliability Allocation for Modular Software System Designed for Multiple Customers,” IEICE Trans. Information and Systems, vol. E-79-D, no. 12, pp. 1655-1662, 1996.
[22] M. Marre and A. Bertolino, “Using Spanning Sets for Coverage Testing,” IEEE Trans. Software Eng., vol. 29, no. 11, pp. 974-984, Nov. 2003.
[23] A.M. Memon, “Hierarchical GUI Test Case Generation Using Automated Planning,” IEEE Trans. Software Eng., vol. 27, no. 2, pp. 144-154, Feb. 2001.
[24] S.C. Natafos and S.L. Hakimi, “On Path Cover Problems in Digraphs and Applications to Program Testing,” IEEE Trans. Software Eng., vol. 5, pp. 520-529, 1979.
[25] G. Rothermel, R.H. Untch, C. Chu, and M.J. Harrold, “Prioritizing Test Cases for Regression Testing,” IEEE Trans. Software Eng., vol. 27, no. 10, pp. 929-948, Oct. 2001.
[26] H.S. Wang, S.R. Hsu, and J.C. Lin, “A Generalized Optimal Path Selection Model for Structural Program Testing,” J. System and Software, vol. 10, pp. 55-63, 1989.
[27] S. Yamada, H. Narihisa, and S. Osaki, “Optimal Release Policies for a Software System with a Scheduled Software Time,” Int'l J. Systems Sciences, vol. 15, pp. 905-914, 1984.
[28] S. Yamada and S. Osaki, “Software Reliability Growth Modeling: Models and Applications,” IEEE Trans. Software Eng., vol. 11, pp. 1431-1437, 1985.
[29] D.F. Yates and N. Malevris, “Reducing the Effects of Infeasible Paths in Branch Testing,” Proc. Third Symp. Software Testing, Analysis and Verification (TAV3), pp. 48-56, 1989.
[30] F. Zahedi and N. Ashrafi, “Software Reliability Allocation Based on Structure, Utility, Price, and Cost,” IEEE Trans. Software Eng., vol. 17, no. 4, pp. 345-356, Apr. 1991.

Index Terms:
Nonlinear programming, reliability, test management.
Kaushal Chari, Alan Hevner, "System Test Planning of Software: An Optimization Approach," IEEE Transactions on Software Engineering, vol. 32, no. 7, pp. 503-5099, July 2006, doi:10.1109/TSE.2006.70
Usage of this product signifies your acceptance of the Terms of Use.