Issue No.11 - Nov. (2012 vol.23)
pp: 2024-2032
Junqing Sun , Marvell Semiconductor, Santa Clara
Gregory D. Peterson , University of Tennessee, Knoxville
In performance modeling of parallel synchronous iterative applications, the longest individual execution time among parallel processors determines the iteration time and often must be estimated for performance analysis. This involves the mean maximum calculation which has been a challenge in computer modeling for a long time. For large systems, numerical methods are not suitable because of heavy computation requirements and inaccuracy caused by rounding. On the other hand, previous approximation methods face challenges of accuracy and generality, especially for heterogeneous computing environments. This paper presents an interesting property of extreme values to enable Effective Mean Maximum Approximation (EMMA). Compared to previous mean maximum execution time approximation methods, this method is more accurate and general to different computational environments.
Program processors, Random variables, Approximation methods, Computational modeling, Mathematical model, Distribution functions, Shape, heterogeneous computing, Performance modeling, extreme value, mean maximum, execution time
Junqing Sun, Gregory D. Peterson, "An Effective Execution Time Approximation Method for Parallel Computing", IEEE Transactions on Parallel & Distributed Systems, vol.23, no. 11, pp. 2024-2032, Nov. 2012, doi:10.1109/TPDS.2012.21
[1] G.D. Peterson and R.D. Chamberlain, "Parallel Application Performance in a Shared Resource Environment," IEE Distributed Systems Eng. J., vol. 3, no. 1, pp. 9-19, Aug. 1996.
[2] G.D. Peterson and R.D. Chamberlain, "Beyond Execution Time: Expanding the Use of Performance Models," IEEE Parallel and Distributed Technology: Systems and Technology, vol. 2, no. 2, pp. 37-49, Summer 1994.
[3] G. Fox, M. Johnson, G. Lyzenga, S. Otto, J. Salmon, and D. Walker, Solving Problems on Concurrent Processors, vol. 1. Prentice Hall, 1988.
[4] M.L. BaileyJr, J.V. Briner, and R.D. Chamberlain, "Parallel Logic Simulation of VLSI Systems," ACM Computing Surveys, vol. 26, no. 3, pp. 255-294, Sept. 1994.
[5] V.D. Agrawal and S.T. Chakraadhar, "Performance Analysis of Synchronized Iterative Algorithm on Multiprocessor Systems," IEEE Trans. Parallel and Distributed Systems, vol. 3, no. 6, pp. 739-745, Nov. 1992.
[6] J. Jacod and P. Protter, Probability Essentials. Springer, 2000.
[7] R.D. Reiss, Approximate Distributions of Order Statistics with Applications to Nonparametric Statistics. Springer, 1989.
[8] S.S. Gupta, "Selection and Ranking Procedures and Order Statistics for the Binomial Distribution," Classical and Contagious Discrete Distributions, G.P. Patil, ed., pp. 219-230, Statistical Publishing Soc., 1965.
[9] K.T. Cheng and V.D. Agrawal, Unified Methods for VLSI Simulation and Test Generation. Kluwer Academic, 1989.
[10] P. Agrawal, "Concurrency and Communication in Hardware Simulators," IEEE Trans. Computer-Aided Design of Integrated Circuits and Systems, vol. CAD-5, no. 4, pp. 617-623, Oct. 1986.
[11] L. Soule and T. Blank, "Statistics for Parallelism and Abstraction Level in Digital Simulation," Proc. 24th ACM/IEEE Design Automation Conf., pp. 588-591, 1987.
[12] G.D. Peterson and R.D. Chamberlain, "Sharing Networked Workstations: A Performance Model," Proc. IEEE Sixth Symp. Parallel and Distributed Processing, pp. 308-315, Oct. 1994.
[13] B.W. Weide, "Analytic Models to Explain the Anomalous Behavior of Parallel Programs," Proc. Int'l Conf. Parallel Processing, pp. 183-187, 1981.
[14] A.H.S. Ang and W.H. Tang, Probability Concepts in Engineering Planning and Design, vol. 2. Rainbow Bridge, 1984.
[15] S. Madala and J.B. Sinclair, "Performance of Synchronous Parallel Algorithms with Regular Structures," IEEE Trans. Parallel and Distributed Systems, vol. 2, no. 1, pp. 105-116, Jan. 1991.
[16] J.T. Robinson, "Some Analysis Techniques for Asynchronous Multiprocessor Algorithms," IEEE Trans. Software Eng., vol. SE-5, no. 1, pp. 24-31, Jan. 1979.
[17] H.A. David, Order Statistics. Wiley, 1981.
[18] R.E. Barlow and F. Proschan, Statistical Theory of Reliability and Life Testing. Holt, Rinehart and Winston, 1975.
[19] N.Y. Pekergin and J.M. Vincent, "Stochastic Bounds on Execution Times of Parallel Programs," IEEE Trans. Software Eng., vol. 17, no. 10, pp. 1005-1012, Oct. 1991.
[20] J. Sun and G.D. Peterson, "Effective Execution Time Estimation of Heterogeneous Parallel Computing," Proc. ISCA 19th Int'l Conf. Parallel and Distributed Computing Systems (PDCS), Sept. 2006.
[21] M.A. Driscoll and W.R. Daasch, "Accurate Predictions of Parallel Program Execution Time," J. Parallel and Distributed Computing, vol. 25, no. 1, pp. 16-30, Feb. 1995.
[22] M.J. Atallah, C.L. Black, D.C. Marinescu, H.J. Siegel, and T.L. Casavant, "Models and Algorithms for Coscheduling Compute-Intensive Tasks on a Network of Workstations," J. Parallel and Distributed Computing, vol. 16, no. 4, pp. 319-327, 1992.
[23] P.G. Harrison and S. Zertal, "Queueing Models with Maxima of Service Times," Proc. TOOLS Conf., 2003.
[24] P.G. Harrison and S. Zertal, "Bus Modelling in Zoned Disks RAID Storage Systems," Electronic Notes in Theoretical Computer Science, vol. 232, pp. 5-16, 2009.
[25] B. Ucar, C. Aykanat, K. Kaya, and M. Ikinci, "Task Assignment in Heterogeneous Systems," J. Parallel and Distributed Computing, vol. 66, pp. 32-46, 2006.
[26] A. Azaron, H. Katagiri, K. Kato, and M. Sakawa, "Longest Path Analysis in Networks of Queues: Dynamic Scheduling Problems," European J. Operational Research, vol. 174, pp. 132-149, Oct. 2006.
[27] L.G. Valiant, "A Bridging Model for Parallel Computation," Comm. ACM, vol. 33, no. 8, pp. 103-111, 1990.
[28] M.C. Smith and G.D. Peterson, "Parallel Application Performance on Shared High Performance Reconfigurable Computing Resources," Performance Evaluation, vol. 60, nos. 1-4, pp. 107-125, 2005.
[29] M. Fard and B. Holmquist, "First Moment Approximations for Order Statistics from the Extreme Value Distribution," Statistical Methodology, vol. 4, no. 2, pp. 196-203, 2007.
[30] G. Blom, Statistical Estimates and Transformed Beta-Variables. Almqvist and Wiksell, 1958.
[31] J.J. Filliben, "The Probability Plot Correlation Coefficient Test for Normality," Technometrics, vol. 17, no. 1, pp. 111-117, 1975.