Second International Workshop on Challenges of Large Applications in Distributed Environments
FastMap: A Distributed Scheme for Mapping Large Scale Applications onto Computational Grids
Honolulu, Hawaii
June 07-June 07
ISBN: 0-7695-2115-0
Many large and complex computational applications can be modeled as irregular graphs and are typically characterized by a large number of vertices and edges. This paper proposes a new and fast mapping heuristic, called FastMap, to map this class of applications onto heterogeneous metacomputing platforms such as computational grids. While previous approaches have delved into graph partitioning of the application, we attempt to solve this problem from the clustering perspective. We exploit a hierarchical resource management infrastructure on the grid to distribute the overhead of mapping among a tree of schedulers and develop a scheme that proves to be almost linear in its scalability. Furthermore, we optimize on the result of the mapping with the help of a genetic algorithm at each scheduler node. Our experiments include a 50,000-node application graph from NASA and several other synthetically-generated graphs with as many as 100,000 vertices. Comparisons with another heterogeneous partitioner, MiniMax, show an improvement factor of over 100 on the mapping time, yet with superior quality mapping.
Citation:
Amit Jain, Soumya Sanyal, Sajal K. Das, Rupak Biswas, "FastMap: A Distributed Scheme for Mapping Large Scale Applications onto Computational Grids," clade, pp.118, Second International Workshop on Challenges of Large Applications in Distributed Environments, 2004