This Article 
 Bibliographic References 
 Add to: 
A Novel Data Distribution Technique for Host-Client Type Parallel Applications
February 2002 (vol. 13 no. 2)
pp. 97-110

Abstract—This paper considers an analytic data distribution for improving the performance of host-client type parallel applications which exhibit serialized communication patterns. The technique involves assuming the serialized communications is enforced, which simplifies data analysis and can provide the basis for real-time dynamic load balancing. This distribution has been tested using a parallel matrix multiplication implementation and a parallel MPEG compression implementation. The key results of this paper are that analytic distribution can reduce execution time and increase scalability of certain parallel applications over typical equal data distributions.

[1] J.T. Pfenning and C. Moll, “Optimized Communication Patterns on Workstation Clusters,” Parallel Computing, vol. 21, no. 3, pp. 373-388, Mar. 1995.
[2] D.J. Le Gall, “The MPEG Video Compression Algorithm,” Signal Processing: Image Comm., vol. 4, pp. 129-140, 1992.
[3] L. Chiariglione, “Development of an Integrated Audiovisual Coding Standard: MPEG,” Proc. IEEE, vol. 83, no. 2, pp. 151-157, Feb. 1995.
[4] S.H. Choi and K.T. Park, “High-Speed Moving Picture Coding Using Adaptively Load Balanced Multiprocessor System,” Signal Processing: Image Comm., vol. 8, no. 2, pp. 113-130, Mar. 1996.
[5] E. Chan and S. Panchanathan, “Motion Estimation Architecture for Video Compression,” IEEE Trans. Consumer Electronics, vol. 39, no. 3, pp. 292-297, Aug. 1993.
[6] J. Normile and D. Wright, “Image Compression Using Coarse Grain Parallel Processing,” Proc. Int'l Conf. Acoustics, Speech, and Signal Processing, pp. 1121-1124, 1991.
[7] S.M. Akramullah, I. Ahmad, and M.L. Liou, “Parallelization of MPEG-2 Video Encoder for Parallel and Distributed Computing Systems,” Proc. IEEE 38th Midwest Symp. Circuits and Systems, pp. 834-837, Aug. 1995.
[8] B. Quandt and C.L. Sabharwal, “MPEG Video Encoding—Parallelization and Optimal Performance,” Society of Motion Picture and Television Engineers J. vol. 105, no. 6, pp. 345-350, June 1996.
[9] A. Bilas, J. Fritts, and J.P. Singh, “Real-Time Parallel MPEG-2 Decoding in Software,” Technical Report TR-516-96, Princeton Univ., Computer Science Technical Report Library, Mar. 1996.
[10] P. Tiwari and E. Viscito, “A Parallel MPEG-2 Video Encoder with Look-Ahead Rate-Control,” Research Report RC 20234, IBM Research Division, Oct. 1995.
[11] E. Kreyszig, Advanced Engineering Mathematics, John Wiley&Sons, New York, 1983.
[12] R.K. Ghosh, R. Moona, and P. Gupta, Foundations of Parallel Processing. Narosa Publishing House, 1995.
[13] V. Kumar, A. Grama, A. Gupta, and G. Karypis, Introduction to Parallel Computing: Design and Analysis of Algorithms. Benjamin Cummings, 1994.
[14] M.J. Quinn, Designing Efficient Algorithms for Parallel Computers. McGraw-Hill, 1987.
[15] S.A. Rees and J.P. Black, “An Experimental Investigation of Distributed Matrix Multiplication Techniques,” Software—Practice and Experience, vol. 21, no. 10, pp. 1,041-1,063, 1991.
[16] A. Symons, “Performance Metamodels of Parallel Computers,” PhD thesis, Dept. of Electrical and Computer Eng., Univ. of Queensland, 1996.
[17] A. Symons and V.L. Narasimhan, “Development of a Method of Optimising Data Distribution on Loosely Coupled Systems,” IEE Proc. Computers and Digital Techniques, vol. 143, no. 4, pp. 239-245, July 1996.
[18] D. Levine, Users Guide to the PGAPack, Parallel Genetic Algorithm Library. Argonne Nat'l Laboratory ANL-95/18, 1996.
[19] V.M. Lo, "Heuristic Algorithms for Task Assignment in Distributed Systems," IEEE Trans. Computers, vol. 37, no. 11, pp. 1,384-1,397, Nov. 1988.
[20] Plateau Research Group Computer Science Division, Univ. of California, Berkeley, MPEG-1 Video Encoder User's Guide. Jan. 1995.
[21] M. Lauria, A. Chien, “MPI FM: High Performance MPI on Workstation Clusters,” J. Parallel and Distributed Computing, vol. 40, no. 1, pp. 4-18, Jan. 1997.
[22] V. Vapnik, Estimation of Dependencies Based on Empirical Data (in Russian). Nauka, Moscow, 1979 (English translation: New York: Springer-Verlag, 1982).

Index Terms:
Parallel algorithms, analytic distribution, host-client communication.
Nicholas Comino, V. Lakshmi Narasimhan, "A Novel Data Distribution Technique for Host-Client Type Parallel Applications," IEEE Transactions on Parallel and Distributed Systems, vol. 13, no. 2, pp. 97-110, Feb. 2002, doi:10.1109/71.983939
Usage of this product signifies your acceptance of the Terms of Use.