2008 Eighth IEEE International Symposium on Cluster Computing and the Grid (CCGRID)
Experiences with Fine-Grained Distributed Supercomputing on a 10G Testbed
May 19-May 22
ISBN: 978-0-7695-3156-4
This paper shows how lightpath-based networks can allow challenging,fine-grained parallel supercomputing applications to be run on a grid,using parallel retrograde analysis on DAS-3 as a case study. Detailed performance analysis shows that several problems arise that are not present on tightly-coupled systems like clusters. In particular, flow control, asynchronous communication,and host-level communication overheads become new obstacles. By optimizing these aspects, however, a 10G grid can obtainhigh performance for this type of communication-intensive application. The class of large-scale distributed applications suitable for running on a grid is therefore larger than previously thought realistic.
Index Terms:
distributed supercomputing, grid computing, optical networks, retrograde analysis, Awari
Citation:
Kees Verstoep, Jason Maassen, Henri E. Bal, John W. Romein, "Experiences with Fine-Grained Distributed Supercomputing on a 10G Testbed," ccgrid, pp.376-383, 2008 Eighth IEEE International Symposium on Cluster Computing and the Grid (CCGRID), 2008