This Article 
 Bibliographic References 
 Add to: 
The Automatic Generation of Load Test Suites and the Assessment of the Resulting Software
September 1995 (vol. 21 no. 9)
pp. 705-716
Three automatic test case generation algorithms intended to test the resource allocation mechanisms of telecommunications software systems are introduced. Although these techniques were specifically designed for testing telecommunications software, they can be used to generate test cases for any software system that is modelable by a Markov chain provided operational profile data can either be collected or estimated. These algorithms have been used successfully to perform load testing for several real industrial software systems. Experience generating test suites for five such systems is presented. Early experience with the algorithms indicate that they are highly effective at detecting subtle faults that would have been likely to be missed if load testing had been done in the more traditional way, using hand-crafted test cases. A domain-based reliability measure is applied to systems after the load testing algorithms have been used to generate test data. Data are presented for the same five industrial telecommunications systems in order to track the reliability as a function of the degree of system degradation experienced.

[1] A. Avritzer and B. Larson,“Load testing software using deterministic state testing,” T. Ostrand and E. Weyuker, eds., Proc. of the 1993 Int’l Symp. on Software Testing and Analysis (ISSTA). ACM Press, June 1993, pp. 82-88.
[2] J.W. Duran and S.C. Ntafos,“An evaluation of random testing.” IEEE Transactions on Software Engineering, vol. 10, no. 4, July 1984, pp. 438-444.
[3] P.G. Frankl and E.J. Weyuker,“Provable improvements on branch testing,” IEEE Transactions on Software Engineering, vol. 19, no. 10, Oct. 1993, pp. 962-975.
[4] R. Hamlet and R. Taylor,“Partition testing does not inspire confidence,” Proc. Second Workshop on Software Testing, Verification, and Analysis,Banff, Canada, July 1988, pp. 206-215.
[5] L. Kleinrock,Queueing Systems, Volume 1: Theory.New York: Wiley-Interscience, 1975.
[6] J.D. Musa,A. Iannino,, and K. Okumoto,Software Reliability: Measurement, Prediction and Application.New York: McGraw-Hill, 1987.
[7] J.D. Musa, "Operational Profiles in Software Reliability Engineering," IEEE Software, vol. 10, no. 2, pp. 14-32, 1993.
[8] T.A. Thayer,M. Lipow,, and E.C. Nelson,Software Reliability.New York: North-Holland, 1978.
[9] S.N. Weiss and E. Weyuker,“An extended domain-based model of software reliability,” IEEE Transactions on Software Engineering, vol. 14, no. 10, Oct. 1988, pp. 1,512-1,524.
[10] E.J. Weyuker and B. Jeng,“Analyzing partition testing strategies,” IEEE Trans. Software Engineering, vol. 17, pp. 703-711, 1991.
[11] E.J. Weyuker and T.J. Ostrand,“Theories of program testing and the application of revealing subdomains,” IEEE Transactions on Software Engineering, vol. 6, no. 3, Mar. 1980, pp. 236-245.

Index Terms:
Automatic test case generation, software testing, reliability assessment, Markov chains.
Alberto Avritzer, Elaine J. Weyuker, "The Automatic Generation of Load Test Suites and the Assessment of the Resulting Software," IEEE Transactions on Software Engineering, vol. 21, no. 9, pp. 705-716, Sept. 1995, doi:10.1109/32.464549
Usage of this product signifies your acceptance of the Terms of Use.