The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.03 - May/June (2008 vol.34)
pp: 391-406
C. Murray Woodside , Carleton University, Ottawa
Tao Zheng , Carleton University, Ottawa
Marin Litoiu , IBM Centre for Advanced Studeis, Toronto
ABSTRACT
To update a performance model, its parameter values must be updated, and in some applications (such as autonomic systems) tracked continuously over time. Direct measurement of many parameters during system operation requires instrumentation which is impractical. Kalman filter estimators can track such parameters using other data such as response times and utilizations, which are readily observable. This paper adapts Kalman filter estimators for performance model parameters, evaluates the approximations which must be made, and develops a systematic approach to setting up an estimator. The estimator converges under easily verified conditions. Different queueing-based models are considered here, and the extension for state-based models (such as stochastic Petri nets) is straightforward.
INDEX TERMS
Modeling techniques, Measurement, Performance model, Kalman filtering, Parameter tracking
CITATION
C. Murray Woodside, Tao Zheng, Marin Litoiu, "Performance Model Estimation and Tracking Using Optimal Filters", IEEE Transactions on Software Engineering, vol.34, no. 3, pp. 391-406, May/June 2008, doi:10.1109/TSE.2008.30
REFERENCES
[1] A.O. Allen, Probability, Statistics and Queueing Theory with Computer Science Applications, second ed. Academic Press, 1990.
[2] S. Balsamo, A. DiMarco, P. Inverardi, and M. Simeoni, “Model-Based Performance Prediction in Software Development,” IEEE Trans. Software Eng., vol. 30, no. 5, pp. 295-310, May 2004.
[3] G. Bolch, S. Greiner, H. De Meer, and K.S. Trivedi, Queueing Networks and Markov Chains. Wiley-Interscience, 1998.
[4] E. Brookner, Tracking and Kalman Filtering Made Easy. Wiley Interscience, 1998.
[5] N. Gandhi, J.L. Hellerstein, S. Parekh, and D.M. Tilbury, “Managing the Performance of Lotus Notes: A Control Theoretic Approach,” Proc. Computer Measurement Group, 2001.
[6] G. Franks, S. Majumdar, J.E. Neilson, D.C. Petriu, J.A. Rolia, and C.M. Woodside, “Performance Analysis of Distributed Server Systems,” Proc. Sixth Int'l Conf. Software Quality, pp. 15-26, Oct. 1996.
[7] G. Franks, “Performance Analysis of Distributed Server Systems,” PhD thesis, Carleton Univ., Jan. 2000.
[8] G. Franks and M. Woodside, “Multiclass Multiservers with Deferred Operations in Layered Queueing Networks, with Software System Applications,” Proc 12th IEEE/ACM Int'l Symp. Modeling, Analysis, and Simulation of Computer and Telecomm. Systems, Oct. 2004.
[9] G. Franks, M. Woodside, and J. Rolia, “Multi-Threaded Servers with High Service Time Variation for Layered Queueing Networks,” Computer System Performance Modeling in Perspective: A Tribute to the Work of Prof. Kenneth C. Sevcik, E. Gelenbe, ed., World Scientific Publishing, 2006.
[10] A.C. Harvey, Forecasting, Structural Time Series Models and the Kalman Filter. Cambridge Univ. Press, 1989.
[11] D.J. Holtschlag, C.T. Parker, and M.S. Grewal, “Projecting Ice-Affected Streamflow by Extended Kalman Filtering,” US Geological Survey, Lansing Mich., Report No. A822533, Dec. 1997.
[12] R. Jain, The Art of Computer Systems Performance Analysis. Wiley, 1991.
[13] A.H. Jazwinski, Stochastic Processes and Filtering Theory. Academic Press, 1970.
[14] S. Julier and J. Uhlmann, “A New Extension of the Kalman Filter to Nonlinear Systems,” Signal Processing, Sensor Fusion, and Target Recognition VI, vol. 3068, no. 1, pp. 182-193, 1997.
[15] S. Julier, J. Uhlmann, and H.F. Durant-Whyte, “A New Method for Approximating Nonlinear Transformations of Means and Covariances in Filters and Estimators,” IEEE Trans. Automatic Control, vol. 45, pp. 477-482, 2000.
[16] R.E. Kalman, “A New Approach to Linear Filtering and Prediction Problems,” Trans. ASME, J. Basic Eng., vol. 82, pp. 34-45, Mar. 1960.
[17] A.M. Law and W.D. Kelton, Simulation Modeling and Analysis, third ed. McGraw-Hill, 2000.
[18] T. Lefebvre, H. Bruyninckx, and J. De Schutter, “Kalman Filters for Nonlinear Systems: A Comparison of Performance,” Internal Report 01R033, KU Leuven, http://people.mech.kuleuven.ac.be/~tlefebvr publicatie.htm, 2001.
[19] M. Litoiu, M. Woodside, and T. Zheng, “Hierarchical Model Based Autonomic Control of Software Systems,” Proc. Design and Evolution of Autonomic Software Workshop, May 2005.
[20] P. Maly and C.M. Woodside, “Layered Modeling of Hardware and Software, with Application to a LAN Extension Router,” Proc. 11th Int'l Conf. Computer Performance Evaluation Techniques and Tools, pp. 10-24, Mar. 2000.
[21] R.K. Mehra, “Approaches to Adaptive Filtering,” IEEE Trans. Automatic Control, pp. 693-698, 1972.
[22] A. Moghaddamjoo and R.L. Kirlin, “Robust Adaptive Kalman Filtering with Unknown Inputs,” IEEE Trans. Signal Processing, vol. 37, pp. 1166-1175, 1989.
[23] M. Norgaard, N.K. Poulsen, and O. Ravn, “New Developments in State Estimations for Nonlinear Systems,” Automatica, vol. 36, pp.1627-1638, 2000.
[24] J.R. Rolia and K. Sevcik, “The Method of Layers,” IEEE Trans. Software Eng., vol. 21, no. 8, pp. 689-700, Aug. 1995.
[25] F. Sheikh and C.M. Woodside, “Layered Analytic Performance Modelling of Distributed Database Systems,” Proc. Int'l Conf. Distributed Computer Systems, pp. 482-490, May 1997.
[26] F.E. Schneider and D. Wildermuth, “Using an Extended Kalman Filter for Relative Localisation in a Moving Robot Formation,” Proc. Fourth Int'l Workshop Robot Motion and Control, pp. 85-90, 2004.
[27] H. Tanizaki, Nonlinear Filters: Estimation and Applications, second ed. Springer, 1996.
[28] T. Verdickt, B. Dhoedt, F. Gielen, and P. Demeester, “Automatic Inclusion of Middleware Performance Attributes into Architectural UML Software Models,” IEEE Trans. Software Eng., vol. 31, no. 8, pp. 695-711, Aug. 2005.
[29] H. Wang and K.C. Sevcik, “Experiments with Improved Approximate Mean Value Analysis Algorithms,” Performance Evaluation, vol. 39, pp. 189-206, Feb. 2000.
[30] C.M. Woodside, “Software Resource Architecture,” Int'l J. Software Eng. and Knowledge Eng., vol. 11, no. 4, pp. 407-429, 2001.
[31] M. Woodside, T. Zheng, and M. Litoiu, “The Use of Optimal Filters to Track Parameters of Performance Models,” Proc. Second Int'l Conf. Quantitative Evaluation of Systems, Sept. 2005.
[32] M. Woodside, T. Zheng, and M. Litoiu, “Service System Resource Management Based on a Tracked Layered Performance Model,” Proc. Third IEEE Int'l Conf. Autonomic Computing, June 2006.
[33] T. Zheng, J. Yang, M. Woodside, M. Litoiu, and G. Iszlai, “Tracking Time-Varying Parameters in Software Systems with Ex-tended Kalman Filters,” Proc. CASCON '05, Oct. 2005.
[34] http://www.mesquite.com/productscsim19.htm , 2008.
24 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool