This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Using Sensitivity Analysis to Validate a State Variable Model of the Software Test Process
May 2003 (vol. 29 no. 5)
pp. 430-443

Abstract—We report on the sensitivity analysis of a state variable model (Model S) proposed earlier. Model S captures the dominant behavior of the system test phase of the software test process. Sensitivity analysis is a mathematical methodology to compute changes in the system behavior due to changes in system parameters or variables. This is particularly important when parameters are calibrated using noisy or small data sets. Nevertheless, by mathematically quantifying the effects of parameter variations on the behavior of the model, and thereby the STP, one can easily and quickly evaluate the effect of such variations on the process performance without having to perform extensive simulations. In all cases studied, Model S behaved according to empirical observations which serves to validate the model. It is also shown that sensitivity analysis can suggest structural improvements in a model when the model does not behave as expected.

[1] J.W. Cangussu, R.A. DeCarlo, and A.P. Mathur, “A Formal Model for the Software Test Process,” IEEE Trans. Software Eng., vol. 28, pp. 782-796, Aug. 2002.
[2] J.W. Cangussu, R.A. DeCarlo, and A.P. Mathur, “A Formal Model for the Software Test Process,” Technical Report SERC-TR-176-P, Purdue Univ. -SERC, Mar. 2001.
[3] J.W. Cangussu, R.A. DeCarlo, and A.P. Mathur, “A State Variable Model for the Software Test Process,” Proc. 13th Int'l Conf. Software&Systems Eng. and Their Applications (ICSSEA), Dec. 2000.
[4] D.G. Luenberger, Introduction to Dynamic Systems: Theory, models and applications. John Wiley&Sons, 1979.
[5] R.A. DeCarlo, Linear Systems: A State Variable Approach with Numerical Implementation. New York: Prentice-Hall, 1989.
[6] J.W. Cangussu, “A Mathematical Foundation for Software Process Control,” PhD thesis, Purdue Univ., Apr. 2002.
[7] Encyclopedia of Software Engineering, J.J. Marciniak, ed. vol. 2, pp. 1359-1376, Wiley Interscience, 1994.
[8] Encyclopedia of Software Engineering, J.J. Marciniak, ed. vol. 2, pp. 1409-1433, 1994.
[9] J.W. Cangussu, R.A. DeCarlo, and A.P. Mathur, “A State Model for the Software Test Process with Automated Parameter Identification,” Proc. 2001 IEEE Systems, Man, and Cybernetics Conf. (SMC 2001), pp. 706-711, Oct. 2001.
[10] J. W. Brewer, “Kronecker Products and Matrix Calculus in System Theory,” IEEE Trans. Circuits and Systems, vol. 25, pp. 772-781, Sept. 1978.
[11] Sensitivity Analysis, A. Saltelli, K. Chan, and E. M. Scott, eds. Chichester, N.Y.: John Wiley&Sons, 2000.
[12] B.W. Boehm et al., Software Cost Estimation with COCOMO II, Prentice-Hall, Upper Saddle River, N.J., 2000.
[13] F.P. Brooks Jr., The Mythical Man-Month (20th Anniversary Edition).Reading, Mass.: Addison-Wesley, 1995.
[14] J.W. Cangussu, R.A. DeCarlo, and A.P. Mathur, “Feedback Control of the Software Test Process through Measurements of Software Reliability,” Proc. 12th Int'l Symp. Software Reliability Eng., Nov. 2001.
[15] S. Biffl, “Using Inspection Data for Defect Estimation,” IEEE Software, vol. 17, pp. 36-43, Nov./Dec. 2000.
[16] C. Wohlin and P. Runeson, “Defect Content Estimations from Review Data,” Proc. 1998 Int'l Conf. Software Eng., pp. 400-409, 1998.
[17] G. Fulford, P. Forrester, and A. Jone, Modeling with Differential and Difference Equations. Cambridge Univ. Press, 1997.
[18] B. Boehm, Software Engineering Economics, Prentice Hall, Upper Saddle River, N.J., 1981, pp. 533-535.
[19] S.R. Lay, Convex Sets and their Applications. New York: John Wiley&Sons Inc., 1982.
[20] L. Ljung, System Identification: Theory for the User. Prentice Hall, 1987.
[21] G. Cugola and C. Ghezzi, “Software Processes: A Retrospective and a Path to the Future,” Software Process Improvement and Practice. 1999.
[22] W.A. Florac and A.D. Carleton, Measuring the Software Process: Statistical Process Control for Software Process Improvement, Addison-Wesley, Reading, Mass., 1999.
[23] T. Abdel-Hamid and S.E. Madnick, Software Project Dynamics: An Integrated Approach. Prentice Hall, 1991.
[24] G.A. Hansen, “Simulating Software Development Processes,” Computer, vol. 29, no. 1, pp. 73–77, Jan. 1996.
[25] D.J. Wheeler and D.S. Chambers, Understanding Statistical Process Control. SPC Press, 1992.
[26] J.W. Brewer, “Matrix Calculus and the Sensitivity Analysis of Linear Dynamic Systems,” IEEE Trans. Automatic Control, vol. 23, pp. 748-751, Aug. 1978.
[27] T.H. McCabe, “A Complexity Measure,” IEEE Trans. Software Eng., vol. 2, no. 6, pp. 308-320, 1976.
[28] B. Boehm, “Safe and Simple Software Cost Analysis,” IEEE Software, vol. 17, pp. 14-17, Sept./Oct. 2000.
[29] C.L. Lawson and R.J. Hanson, Solving Least Squares Problems. Soc. for Industrial and Applied Math. (SIAM), 1995.
[30] G.C. Goodwin, S.F. Graebe, and M.E. Salgado, Control System Design. Upper Saddle River, N.J.: Prentice Hall, 2001.
[31] W. Gander, J.H. Masaryk, and J. Hrebicek, Solving Problems in Scientific Computing Using Maple and MATLAB. Springer-Verlag, 1997.

Index Terms:
Software process, feedback control, sensitivity analysis, modeling, software test process, state model.
Citation:
Jo?o W. Cangussu, Raymond A. DeCarlo, Aditya P. Mathur, "Using Sensitivity Analysis to Validate a State Variable Model of the Software Test Process," IEEE Transactions on Software Engineering, vol. 29, no. 5, pp. 430-443, May 2003, doi:10.1109/TSE.2003.1199072
Usage of this product signifies your acceptance of the Terms of Use.