Parallel Computing in Electrical Engineering, 2004. International Conference on (2006)
Sept. 13, 2006 to Sept. 17, 2006
Torsten Hoefler , Technical University of Chemnitz, Germany
Carsten Viertel , Technical University of Chemnitz, Germany
Torsten Mehlan , Technical University of Chemnitz, Germany
Frank Mietke , Technical University of Chemnitz, Germany
Wolfgang Rehm , Technical University of Chemnitz, Germany
We present a micro benchmark suite to evaluate InfiniBandTM implementations with regards to single message performance and the addressing of many hosts. We use a 1:n communication pattern to assess the latency and bandwidth for all different combinations of InfiniBandsTM transport services and functions. The results gathered in this study are used to optimize MPI collective communication operations where 1:n communication schemes are not used widely today. We show that applications as well as collective algorithms can benefit from sending multiple messages in a single round. Moreover, the results will be used to choose the transport service and function to develop InfiniBandTM optimized collective communication functions. Our study compares all available transport options and shows that single packet sends can be very expensive compared to multi packet sends.
F. Mietke, T. Hoefler, W. Rehm, T. Mehlan and C. Viertel, "Assessing Single-Message and Multi-Node Communication Performance of InfiniBand," International Symposium on Parallel Computing in Electrical Engineering(PARELEC), Bialystok, 2006, pp. 227-232.