21st International Symposium on High Performance Computing Systems and Applications (HPCS'07)
High Performance RDMA-based Multi-port All-gather on Multi-rail QsNet II
Saskatoon, Saskatchewan, Canada
May 13-May 16
ISBN: 0-7695-2813-9
Scientific applications written in MPI use collective communications intensively. Efficient and scalable implementation of such collective operations is therefore crucial to the performance of MPI applications running on clusters. Quadrics QsNetII is a high-performance network that implements some collectives at its Elan user-level library. Its MPI implementation uses such primitives directly. Quadrics communication software supports pointto- point message striping over multi-rail QsNetII networks. However, multi-rail collectives, other than broadcast, are not supported. In this work, we propose, design and implement a number of RDMAbased multi-port algorithms for the all-gather operation over multi-rail QsNetII clusters directly at the Elan level. Our performance results indicate that the proposed multi-port all-gather Direct algorithm gains an improvement of up to 1.49 for 32KB messages over the native elan_gather() collective.
Citation:
Ying Qian, Ahmad Afsahi, "High Performance RDMA-based Multi-port All-gather on Multi-rail QsNet II," hpcs, pp.3, 21st International Symposium on High Performance Computing Systems and Applications (HPCS'07), 2007