The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.02 - February (2010 vol.59)
pp: 272-282
Ruhi Sarikaya , IBM T.J. Watson Research Center, Yorktown Heights
Alper Buyuktosunoglu , IBM T. J. Watson Research Center, Yorktown Heights
ABSTRACT
Dynamic management of computer resources is essential for adaptive computing. Adaptive computing systems rely on accurate and robust metric predictors to exploit runtime behavior of programs. In this study, we propose the Unified Prediction Method (UPM) that is system and metric independent for predicting computer metrics. Unlike ad hoc predictors, UPM uses a parametric model and is entirely statistical and data-driven. The parameters of the model are estimated by minimizing an objective function. Choice of the objective function and the model type determine the form of the solution whether it is closed form or numerically determined through optimization. In this study, two specific realizations of UPM are presented. The first realization uses mean squared error (MSE) objective function and the second realization uses accumulated squared error (ASE) objective function, in conjunction with autoregressive models. The former objective function leads to Linear Prediction and the latter leads to Predictive Least Square (PLS) prediction. The model parameters for these predictors can be estimated analytically. The prediction is optimal with respect to the chosen objective function. An extensive and rigorous series of prediction experiments for the instruction per cycle (IPC) and L1 cache miss (L1-miss) rate metrics demonstrate superior performance for the proposed predictors over the last-value predictor and table-based predictor on SPECCPU 2000 benchmarks.
INDEX TERMS
Microprocessor performance phase prediction, adaptive dynamic management, application program phase prediction.
CITATION
Ruhi Sarikaya, Alper Buyuktosunoglu, "A Unified Prediction Method for Predicting Program Behavior", IEEE Transactions on Computers, vol.59, no. 2, pp. 272-282, February 2010, doi:10.1109/TC.2009.122
REFERENCES
[1] H. Akaike, “A New Look at the Statistical Model Identification,” IEEE Trans. Automatic Control, vol. 19, no. 6, pp. 716-723, Dec. 1974.
[2] D. Albonesi, R. Balasubramonian, S. Dropsho, S. Dwarkadas, E. Friedman, M. Huang, V. Kursun, G. Magklis, M. Scott, G. Semeraro, P. Bose, A. Buyuktosunoglu, P. Cook, and S. Schuster, “Dynamically Tuning Processor Resources with Adaptive Processing,” Computer, vol. 36, no. 12, pp. 49-58, Dec. 2003.
[3] R. Balasubramonian, D. Albonesi, A. Buyuktosunoglu, and S. Dwarkadas, “Memory Hierarchy Reconfiguration for Energy and Performance in General-Purpose Processor Architectures,” Proc. Int'l Symp. Microarchitecture, Dec. 2000.
[4] F. Bellosa, A. Weissel, M. Waitz, and S. Kellner, “Event-Driven Energy Accounting for Dynamic Thermal Management,” Proc. Workshop Compilers and Operating Systems for Low Power, Sept. 2003.
[5] K. Choi, R. Soma, and M. Pedram, “Dynamic Voltage and Frequency Scaling Based on Workload Decomposition,” Proc. Int'l Symp. Low Power Electronics and Design, Aug. 2004.
[6] R. Sarikaya and A. Buyuktosunoglu, “Predicting Program Behavior Based on Objective Function Minimization,” Proc. IEEE Int'l Symp. Workload Characterization, Sept. 2007.
[7] A. Dhodapkar and J. Smith, “Managing Multi-Configurable Hardware via Dynamic Working Set Analysis,” Proc. Int'l Symp. Computer Architecture, June 2002.
[8] E. Duesterwald, C. Cascaval, and S. Dwarkadas, “Characterizing and Predicting Program Behavior and Its Variability,” Proc. Int'l Conf. Parallel Architectures and Compilation Techniques, Mar. 2003.
[9] M. Huang, J. Renau, and J. Torrellas, “Positional Adaptation of Processors: Application to Energy Reduction,” Proc. Int'l Symp. Computer Architecture, June 2003.
[10] C. Isci and M. Martonosi, “Identifying Program Power Phase Behavior Using Power Vectors,” Proc. IEEE Int'l Workshop Workload Characterization, Oct. 2003.
[11] C. Isci and M. Martonosi, “Runtime Power Monitoring in High-End Processors: Methodology and Empirical Data,” Proc. Int'l Symp. Microarchitecture, Dec. 2003.
[12] C. Isci, M. Martonosi, and A. Buyuktosunoglu, “Long-term Workload Phases: Duration Predictions and Applications to DVFS,” IEEE Micro, special issue on energy efficient design, vol.25, no. 5, pp. 39-51, Sept./Oct. 2005.
[13] C. Isci, G. Contreras, and M. Martonosi, “Live, Runtime Phase Monitoring and Prediction on Real Systems with Application to Dynamic Power Management,” Proc. Int'l Symp. Microarchitecture, Dec. 2006.
[14] D.T.L. Lee, M. Morf, and B. Friedlander, “Recursive Least-Squares Ladder Estimation Algorithms,” IEEE Trans. Circuits and Systems, vol. 28, no. 6, pp. 467-481, June 1981.
[15] J. Makhoul, “Linear Prediction: A Tutorial Review,” Proc. IEEE, vol. 63, no. 4, pp. 561-580, Apr. 1975.
[16] R.L. Plackett, “The Discovery of the Method of Least Squares,” Biometrica, vol. 59, pp. 239-251, 1972.
[17] J. Rissanen, “Modeling by Shortest Data Description,” Automatica, vol. 14, pp. 465-471, 1978.
[18] J. Rissanen, “A Predictive Least-Squares Principle,” IMA J. Math. Control and Information, vol. 3, pp. 211-222, 1986.
[19] T.-J. Shan, “On the Predictive Least Squares Filtering,” Proc. Int'l Conf. Audio Speech and Signal Processing, pp. 1312-1315, 1987.
[20] T. Sherwood, E. Perelman, G. Hamerly, and B. Calder, “Automatically Characterizing Large Scale Program Behavior,” Proc. Int'l Conf. Architectural Support for Programming Languages and Operating Systems, Oct. 2002.
[21] T. Sherwood, S. Sair, and B. Calder, “Phase Tracking and Prediction,” Proc. Int'l Symp. Computer Architecture, June 2003.
[22] J.M. Tendler, J.S. Dodson, S. Fields, H. Le, and B. Sinharoy, “POWER4 System Microarchitecture,” IBM J. Research and Development, vol. 46, no. 1, pp. 5-25, 2002.
[23] A. Weissel and F. Bellosa, “Process Cruise Control: Event-Driven Clock Scaling for Dynamic Power Management,” Proc. Int'l Conf. Compilers, Architecture and Synthesis for Embedded Systems, Aug. 2002.
[24] G.U. Yule, “On a Method of Investigating Periodicities in Disturbed Series with Special Reference to Wolfer's Sunpot Numbers,” Philosophical Trans. Royal Soc., vol. 226, pp. 267-298, 1927.
[25] M. Wax, “Order Selection for AR Models by Predictive Least Squares,” IEEE Trans. Acoustic, Speech, and Signal Processing, vol. 36, no. 4, pp. 581-588, Apr. 1988.
[26] T.Y. Yeh and Y.N. Patt, “Alternative Implementations of Two-Level Adaptive Branch Prediction,” Proc. Int'l Symp. Computer Architecture, May 1992.
25 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool