Cluster Computing and the Grid, IEEE International Symposium on (2006)
May 16, 2006 to May 19, 2006
Huadong Liu , The University of Tennessee, USA
Micah Beck , The University of Tennessee, USA
Jian Huang , University of Tennessee, USA
We are interested in developing the infrastructural tools that allow a distributed data intensive computing environment to be shared by a group of collaborating but geographically separated researchers in an interactive manner, as opposed to a batch mode of operation. However, without advanced reservation, it is difficult to assure a certain level of performance on a large number of shared and heterogeneous servers. To achieve scalable parallel speedups in this scenario, we must closely integrate the management of computation and runtime data movement. In this paper, we first define the canonical scheduling problem for datasets distributed with k-way replication in the wide area. We then develop a dynamic coscheduling algorithm that integrates the scheduling of computation and data movement. Using time-varying visualization as the driving application, we demonstrate that our co-scheduling approach improves not only application performance but also server utilization at a very reasonable cost.
M. Beck, J. Huang and H. Liu, "Dynamic Co-Scheduling of Distributed Computation and Replication," Cluster Computing and the Grid, IEEE International Symposium on(CCGRID), Singapore, 2006, pp. 592-600.