This Article 
 Bibliographic References 
 Add to: 
Statistical Prediction of Task Execution Times through Analytic Benchmarking for Scheduling in a Heterogeneous Environment
December 1999 (vol. 48 no. 12)
pp. 1374-1379

Abstract—In this paper, a method for estimating task execution times is presented in order to facilitate dynamic scheduling in a heterogeneous metacomputing environment. Execution time is treated as a random variable and is statistically estimated from past observations. This method predicts the execution time as a function of several parameters of the input data and does not require any direct information about the algorithms used by the tasks or the architecture of the machines. Techniques based upon the concept of analytic benchmarking/code profiling [1] are used to characterize the performance differences between machines, allowing observations from dissimilar machines to be used when making a prediction. Experimental results are presented which use actual execution time data gathered from $16$ heterogeneous machines.

[1] R.F. Freund, "Optimal Selection Theory for Superconcurrency," Proc. Supercomputing '89, pp. 699-703, 1989.
[2] R.F. Freund and H.J. Siegel, "Heterogeneous Processing," Computer, vol. 26, no. 6, pp. 13-17, June 1993.
[3] M.M. Eshaghian, Heterogeneous Computing. Prentice Hall, 1996.
[4] D. Pease et al., "PAWS (Parallel Assessment Window System): A Performance Assessment Tool for Parallel Computing Systems," Computer, Vol. 24, No. 1, Jan. 1991, pp. 18-29.
[5] J. Yang, I. Ahmad, and A. Ghafoor, “Estimation of Execution Times on Heterogeneous Supercomputer Architectures,” Proc. 1993 Int'l Conf. Parallel Processing, vol. 1, pp. 219-226, Aug. 1993.
[6] J. Yang, A. Khokhar, S. Sheikh, and A. Ghafoor, "Estimating Execution Time for Parallel Tasks in Heterogeneous Processing (HP) Environment," Proc. Heterogeneous Computing Workshop, pp. 23-28, Apr. 1994.
[7] A. Khokhar, V.K. Prasanna, M. Shaaban, and C.L. Wang, "Heterogeneous Supercomputing: Problems and Issues," Proc. Workshop Heterogeneous Processing, pp. 3-12, Mar. 1992.
[8] A.A. Khokhar, V.K. Prasanna, M.E. Shaaban,, and C.L. Wang, “Heterogeneous Computing: Challenges and Opportunities,” Computer, pp. 18-27, June 1993.
[9] M.A. Iverson, F. Özgüner, and G. Follen, “Run-Time Statistical Estimation of Task Execution Times for Heterogeneous Distributed Computing,” Proc. 1996 High Performance Distributed Computing Conf., pp. 263-270, Syracuse, N.Y., Aug. 1996.
[10] T. Kidd, D. Hensgen, L. Moore, R. Freund, D. Charley, M. Halderman, and M. Janakiraman, “Studies in the Useful Predictability of Programs in a Distributed and Homogeneous Environment,” The Smartnet Home Page,, 1995.
[11] M.V. Devarakonda and R.K. Iyer, “Predictability of Process Resource Usage: A Measurement-Based Study on UNIX,” IEEE Trans. Software Eng., vol. 15, no. 12, pp. 1,579-1,586, Dec. 1989.
[12] W. Härdle, Applied Nonparametric Regression. Cambridge Univ. Press, 1990.
[13] H. Stark and J.W. Woods, Probability, Random Processes, and Estimation Theory for Engineers. Prentice Hall, 1994.
[14] L.P. Devroye, “The Uniform Convergence of Nearest Neighbor Regression Function Estimators and Their Application in Optimization,” IEEE Trans. Information Theory, vol. 24, pp. 142-151, Mar. 1978.
[15] W.K. Härdle and D.W. Scott, “Smoothing by Weighted Averaging of Rounded Points,” Computational Statistics Quarterly, vol. 7, no. 2, pp. 97-128, 1992.
[16] R.L. Eubank, Spline Smoothing and Nonparametric Regression. M. Dekker, 1988.
[17] L.C. Potter and D. Chiang, “Distance Matrices and Modified Cyclic Projections for Molecular Conformations,” Proc. 1992 Int'l Conf. Acoustics, Speech, and Signal Processing, pp. 173-176, 1992.
[18] A nonymous, “BYTEmark Benchmark Documentation,” BYTE Magazine Web Page,, 1998.

Index Terms:
Heterogeneous distributed computing, execution time estimation, analytic benchmarking, nonparametric regression, distance matrices.
Michael A. Iverson, Füsun Özgüner, Lee Potter, "Statistical Prediction of Task Execution Times through Analytic Benchmarking for Scheduling in a Heterogeneous Environment," IEEE Transactions on Computers, vol. 48, no. 12, pp. 1374-1379, Dec. 1999, doi:10.1109/12.817403
Usage of this product signifies your acceptance of the Terms of Use.