This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Experimental Application-Driven Architecture Analysis of an SIMD/MIMD Parallel Processing System
April 1990 (vol. 1 no. 2)
pp. 195-205

An experimental analysis of the architecture of an SIMD/MIMD parallel processing system is presented. Detailed implementations of parallel fast Fourier transform (FFT) programs were used to examine the performance of the prototype of the PASM (PartitionableSIMD/MIMD) parallel processing system. Detailed execution-time measurements using specialized timing hardware were made for the complete FFT and for components of SIMD, MIMD, and barrier-synchronized MIMD implementations. The component measurements isolated the effects of floating-point arithmetic operations, interconnection network transfer operations, and program control overhead. The measurements allow an accurate extrapolation of the execution time, speedup, and efficiency of the MIMD, SIMD, and barrier-synchronized MIMD programs to a full 1024-processor PASM system. This constitutes one of the first results of this kind, in which controlled experiments on fixed hardware were used to make comparisons of these fundamental modes of computing. Overall, the experimental results demonstrate the value of mixed-mode SIMD/MIMD computing and its suitability for computational intensive algorithms such as the FET.

[1] G. B. Adams III and H. J. Siegel, "The extra stage cube: A fault-tolerant interconnection network for supersystems,"IEEE Trans. Comput., vol. C-31, pp. 443-454, May 1982.
[2] G. D. Bergland, "Fast Fourier transform hardware implementations-An overview,"IEEE Trans. Audio Electroacoust., vol. AU-17, pp. 104-108, June 1969.
[3] E. C. Bronson, T. L. Casavant, and L. H. Jamieson, "Experimental analysis of multi-mode fast Fourier transforms on the PASM parallel processing system prototype," Tech. Rep. EE 88-27, Purdue Univ., West Lafayette, IN, May-1988.
[4] E. C. Bronson, T. L. Casavant, and L. H. Jamieson, "Experimental analysis of multi-mode fast Fourier transforms on the PASM parallel processing system," inProc. 1989 IEEE Int. Conf. Acoust., Speech, Signal Processing, May 1989, pp. 2540-2543.
[5] E. C. Bronson, T. L. Casavant, and L. H. Jamieson, "Experimental application-driven architecture analysis of an SIMD/MIMD parallel processing system," inProc. 1989 Int. Conf. Parallel Processing, Aug. 1989, pp. 159-167.
[6] T. L. Casavant, H. J. Siegel, T. Schwederski, L. H. Jamieson, S. A. Fineberg, M. J. McPheters, E. C. Bronson, W. Disch, K. Schurecht, E. H. Loh, C. Ringer, B. Cox, and C. A. Toomey, "Experimental benchmarks and initial evaluation of the performance of the PASM system prototype," Tech. Rep. EE 88-2, Purdue Univ., West Lafayette, IN, Jan. 1988.
[7] J. L. Gustafson, G. R. Montry, and R. E. Benner, "Development of parallel methods for a 1024-processor hypercube,"SIAM J. Scientif. Statist. Comput., vol. 9, pp. 609-638, July 1988.
[8] L.H. Jamieson, P. Mueller, and H.J. Siegel, "FFT Algorithms for SIMD Parallel Processing Systems,"J. Parallel and Distributed Computation, Vol. 3, No. 1, Mar. 1986, pp. 48-71.
[9] S. F. Lundstrom and G. H. Barnes, "A controllable MIMD architecture," inProc. 1980 Int. Conf. Parallel Processing, Aug. 1980, pp. 165-173.
[10] Motorola,MC68000 16/32-Bit Microprocessor Programmer's Reference Manual, 4th ed., Englewood Cliffs, NJ: Prentice-Hall, 1984.
[11] MC68881/MC68882 Floating-Point Coprocessor User's Manual, Publication No. MC68881UM/AD, Motorola, Inc., Austin, Texas, 1987.
[12] M. O'Keefe and H. Dietz, "Performance analysis of hardware barrier synchronization, Tech. Rep. EE 89-51, Purdue University, West Lafayette, IN, Aug. 1989.
[13] M. C. Pease, "The indirect binaryn-cube microprocessor array,"IEEE Trans. Comput., vol. C-26, pp. 458-473, May 1977.
[14] L. R. Rabiner and B. Gold,Theory and Application of Digital Signal Processing. Englewood Cliffs, NJ: Prentice-Hall, 1975.
[15] H. J. Siegel,Interconnection Networks for Large-Scale Parallel Processing: Theory and Case Studies. Lexington, MA: Lexington Books, 1985.
[16] H. J. Siegel, L. J. Siegel, F. C. Kemmerer, P. T. Mueller, Jr., H. E. Smalley, Jr., and S. D. Smith, "PASM: A partionable SIMD/MIMD system for image processing and pattern recognition,"IEEE Trans. Comput., vol. C-30, pp. 934-947, Dec. 1981.
[17] H. J.Siegel, T. Schwederski, J. T. Kuehn, and N. J. Davis IV, "An overview of the PASM parallel processing system," inComputer Architecture, D. D. Gajski, V. M. Milutinovic, H. J. Siegel, and B. P. Furht, Eds. Washington, DC: IEEE Comput. Soc. Press, 1987, pp. 387-407.
[18] H. S. Stone, "Parallel processing with the perfect shuffle,"IEEE Trans. Comput., vol. C-20, pp. 153-161, Feb. 1971.

Index Terms:
Index Termsapplication-driven architecture analysis; SIMD/MIMD parallel processing system; parallel fast Fourier transform; PASM; execution-time measurements; barrier-synchronized MIMD; floating-point arithmetic operations; interconnection network transfer operations; program control overhead; controlled experiments; computational intensive algorithms; fast Fourier transforms; multiprocessor interconnection networks; parallel architectures; parallel machines; performance evaluation; synchronisation
Citation:
E.C. Bronson, T.L. Casavant, L.H. Jamieson, "Experimental Application-Driven Architecture Analysis of an SIMD/MIMD Parallel Processing System," IEEE Transactions on Parallel and Distributed Systems, vol. 1, no. 2, pp. 195-205, April 1990, doi:10.1109/71.80147
Usage of this product signifies your acceptance of the Terms of Use.