This Article 
 Bibliographic References 
 Add to: 
The Role of Modeling in the Performance Testing of E-Commerce Applications
December 2004 (vol. 30 no. 12)
pp. 1072-1083
An e-commerce scalability case study is presented in which both traditional performance testing and performance modeling were used to help tune the application for high performance. This involved the creation of a system simulation model as well as the development of an approach for test case generation and execution. We describe our experience using a simulation model to help diagnose production system problems, and discuss ways that the effectiveness of performance testing efforts were improved by its use.

[1] A. Avritzer, J. Ros, and E.J. Weyuker, “Reliability Testing of Rule-Based Systems,” IEEE Software, pp. 76-82, Sept. 1996.
[2] A. Avritzer and E.J. Weyuker, “The Automatic Generation of Load Test Suites and the Assessment of the Resulting Software,” IEEE Trans. Software Eng., vol. 21, no. 9, pp. 705-716, Sept. 1995.
[3] A. Avritzer and E.J. Weyuker, “Quality of Service Enforcement for Distributed Objects,” IEE/Proc. Software, vol. 146, no. 5, pp. 232-244, Oct. 1999.
[4] A. Avritzer, J. Ros, and E.J. Weyuker, “Estimating the CPU Utilization of a Rule-Based System,” Proc. ACM Fourth Int'l Workshop Software and Performance, pp. 1-12, Jan. 2004.
[5] V. Cortlelessa and A. Pompei, “Towards a UML Profile for QoS: A Contribution in the Reliability Domain,” Proc. ACM Fourth Int'l Workshop Software and Performance, pp. 197-206, Jan. 2004.
[6] M. Gerla and L. Kleinrock, “Flow Control Protocols,” Computer Network Architectures and Protocols, Paul Green ed., pp. 361-411, 1982.
[7] L. Hohwiller and S. Wending, “Fieldbus Network Simulation using a Time Extended Estelle Formalism,” Proc. IEEE Eighth Int'l Symp. Modeling, Analysis, and Simulation of Computer and Telecomm. System, Aug. 2000.
[8] A.R. Larzelere II, “Creating Simulation Capabilities,” IEEE Computer Science and Eng., pp. 27-35, Jan. 1998.
[9] S.S. Lavenberg, Computer Performance Modeling Handbook. New York: Academic Press, 1983.
[10] D. Mackay, Information Theory, Inference and Learning Algorithms. Cambridge Univ. Press, 2003.
[11] D.A. Menacé, H. Ruan, and H. Gomaa, “A Framework for QoS-Aware Software Components,” Proc. ACM Fourth Int'l Workshop Software and Performance, pp. 186-196, Jan. 2004.
[12] T.D. Nadeau, MPLS Network Management. Morgan Kauffman, 2003.
[13] G.W. Snedecor and W.G. Cochran, Statistical Methods. Iowa State Press, 1989.
[14] S. Vekkataraman, W.K. Fuchs, and J.H. Patel, “Diagnostic Simulation of Sequential Circuits Using Fault Sampling,” Proc. IEEE 11th Int'l Conf. VLSI Design: VLSI for Signal Processing, Jan. 1998
[15] B. Kataoka, D. Ramirez, and A. Sit, WebSphere Application Server Bible. p. 828, Wiley, 2002.

Index Terms:
Software performance testing, software testing, performance modeling, simulation, workload characterization.
Alberto Avritzer, Elaine J. Weyuker, "The Role of Modeling in the Performance Testing of E-Commerce Applications," IEEE Transactions on Software Engineering, vol. 30, no. 12, pp. 1072-1083, Dec. 2004, doi:10.1109/TSE.2004.107
Usage of this product signifies your acceptance of the Terms of Use.