Nov. 15, 2003 to Nov. 21, 2003
Philip C. Roth , University of Wisconsin, Madison
Dorian C. Arnold , University of Wisconsin, Madison
Barton P. Miller , University of Wisconsin, Madison
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/SC.2003.10039
We present MRNet, a software-based multicast/reduction network for building scalable performance and system administration tools. MRNet supports multiple simultaneous, asynchronous collective communication operations. MRNet is flexible, allowing tool builders to tailor its process network topology to suit their tool's requirements and the underlying system's capabilities. MRNet is extensible, allowing tool builders to incorporate custom data reductions to augment its collection of built-in reductions. We evaluated MRNet in a simple test tool and also integrated into an existing, real-world performance tool with up to 512 tool back-ends. In the real-world tool, we used MRNet not only for multicast and simple data reductions but also with custom histogram and clock skew detection reductions. In our experiments, the MRNet-based tools showed significantly better performance than the tools without MRNet for average message latency and throughput, overall tool start-up latency, and performance data processing throughput.
Scalability, tools, multicast, reduction, aggregation
Philip C. Roth, Dorian C. Arnold, Barton P. Miller, "MRNet: A Software-Based Multicast/Reduction Network for Scalable Tools", SC, 2003, SC Conference, SC Conference 2003, pp. 21, doi:10.1109/SC.2003.10039