The Community for Technology Leaders
Cluster Computing and the Grid, IEEE International Symposium on (2012)
Ottawa, Canada
May 13, 2012 to May 16, 2012
ISBN: 978-0-7695-4691-9
pp: 769-774
ABSTRACT
We present a Hierarchical MapReduce framework that gathers computation resources from different clusters and runs MapReduce jobs across them. The applications implemented in this framework adopt the Map-Reduce-Global Reduce model where computations are expressed as three functions: Map, Reduce, and Global Reduce. Two scheduling algorithms are introduced: Compute Capacity Aware Scheduling for compute-intensive jobs and Data Location Aware Scheduling for data-intensive jobs. Experimental evaluations using a molecule binding prediction tool, Auto Dock, and grep demonstrate promising results for our framework.
INDEX TERMS
MapReduce, Cross Domain, Multi-Cluster, Data Intensive
CITATION

Y. Luo and B. Plale, "Hierarchical MapReduce Programming Model and Scheduling Algorithms," Cluster Computing and the Grid, IEEE International Symposium on(CCGRID), Ottawa, Canada, 2012, pp. 769-774.
doi:10.1109/CCGrid.2012.132
97 ms
(Ver 3.3 (11022016))