This Article 
 Bibliographic References 
 Add to: 
Software Support for Multiprocessor Latency Measurement and Evaluation
January 1997 (vol. 23 no. 1)
pp. 4-16

Abstract—Parallel computing scalability evaluates the extent to which parallel programs and architectures can effectively utilize increasing numbers of processors. In this paper, we compare a group of existing scalability metrics and evaluation models with an experimental metric which uses network latency to measure and evaluate the scalability of parallel programs and architectures. To provide insight into dynamic system performance, we have developed an integrated software environment prototype for measuring and evaluating multiprocessor scalability performance, called Scale-Graph. Scale-Graph uses a graphical instrumentation monitor to collect, measure and analyze latency-related data, and to display scalability performance based on various program execution patterns. The graphical software tool is X-window based and currently implemented on standard workstations to analyze performance data of the KSR-1, a hierarchical ring-based shared-memory architecture.

[1] A. Beguelin, "Xab: A Tool for Monitoring PVM Programs," Proc. Workshop Heterogeneous Processing, pp. 92-97. IEEE CS Press, Apr. 1993.
[2] A. Beguelin, J.J. Dongarra, G.A. Geist, and V.S. Sunderam, "Visualization and Debugging in a Heterogeneous Environment," Computer, vol. 26, no. 6, pp. 88-95, June 1993.
[3] A. Beguelin et al., "Recent Enhancements to PVM," Int'l J. Supercomputer Applications and High Performance Computing, vol. 9, no. 2, pp. 108-127, 1995.
[4] S. Brawer, Introduction to Parallel Programming. Academic Press, 1989.
[5] S.G. Dykes, X. Zhang, Y. Shen, C.L. Jeffrey, and D.W. Dean, "*Graph: A Tool for Visualizing Communication and Optimizing Memory Layout in Data-Parallel Programs," Proc. Int'l Conf. Parallel Processing, vol. II, pp. 121-129. CRC Press, Aug. 1995.
[6] A. Grama, A. Gupta, and V. Kumar, “Isoefficiency Function: A Scalability Metric for Parallel Algorithms and Architectures,” IEEE Trans. Parallel and Distributed Technology, vol. 1, no. 3, pp. 12-21, 1993.
[7] J.L. Gustafson, G.R. Montry, and R.E. Brenner, "Development of Parallel Methods for a 1,024-Processor Hypercube," SIAM J. Scientific and Statistical Computing, vol. 9, no. 4, pp. 522-533, 1988.
[8] M.T. Heath and J.A. Etheridge, "Visualizing the Performance of Parallel Programs," IEEE Software, Vol. 8, No. 5, Sept. 1991, pp. 29-39.
[9] Kendall Square Research, KSR-1 Technology Background.
[10] D.A. Reed et al., "An Overview of the Pablo Performance Analysis Environment," Proc. Scalable Parallel Libraries Conf., IEEE Computer Society Press, Los Alamitos, Calif., Oct. 1994, pp. 104-113.
[11] X.-H. Sun and D. Rover, “Scalability of Parallel Algorithm-Machine Combinations,” IEEE Trans. Parallel and Distributed Systems, vol. 5, no. 6, pp. 599-613, June 1994.
[12] Z. Xu, X. Zhang, and L. Sun, "Semi-Empirical Multiprocessor Performance Predictions," J. Parallel and Distributed Computing, vol. 39, no. 1, pp. 14-28, 1996.
[13] Y. Yan, X. Zhang, and Y. Song, "An Effective and Practical Performance Prediction Model for Parallel Computing on Nondedicated Heterogeneous NOW," J. Parallel and Distributed Computing, vol. 38, no. 1, pp. 63-80, 1996.
[14] X. Zhang, N. Nalluri, and X. Qin, "MIN-Graph: A Tool for Monitoring and Visualizing MIN-Based Multiprocessor Performance," J. Parallel and Distributed Computing, vol. 18, no. 2, pp. 231-241, 1993.
[15] X. Zhang and Y. Yan, "Modeling and Characterizing Parallel Computing Performance on Heterogeneous Networks of Workstations," Proc. Seventh IEEE Symp. Parallel and Distributed Processing, pp. 25-34, Oct. 1995.
[16] X. Zhang, Y. Yan, and K. He, "Latency Metric: An Experimental Method for Measuring and Evaluating Program and Architecture Scalability," J. Parallel and Distributed Computing, Vol. 22, No. 3, Sept. 1994, pp. 392-410.

Index Terms:
Latency analysis, parallel computing scalability, performance graphical presentation, software tools, KSR multiprocessors.
Yong Yan, Xiaodong Zhang, Qian Ma, "Software Support for Multiprocessor Latency Measurement and Evaluation," IEEE Transactions on Software Engineering, vol. 23, no. 1, pp. 4-16, Jan. 1997, doi:10.1109/32.581326
Usage of this product signifies your acceptance of the Terms of Use.