Parallel and Distributed Processing Symposium, International (2009)
May 23, 2009 to May 29, 2009
Rajesh Sudarsan , Department of Computer Science, Virginia Tech, Blacksburg, 24061-0106, USA
Calvin J. Ribbens , Department of Computer Science, Virginia Tech, Blacksburg, 24061-0106, USA
Most conventional parallel job schedulers only support static scheduling thereby restricting schedulers from being able to modify the number of processors allocated to parallel applications at runtime. The drawbacks of static scheduling can be overcome by using scheduling policies that can exploit dynamic resizability in distributed-memory parallel applications and a scheduler that supports these policies. The scheduler must be capable of adding and removing processors from a parallel application at runtime. This ability of a scheduler to resize parallel applications increases the possibilities for parallel schedulers to manage a large cluster. Our ReSHAPE framework includes an application scheduler that supports dynamic resizing of parallel applications. In this paper, we illustrate the impact of dynamic resizability on parallel scheduling. We propose and evaluate new scheduling policies made possible by our ReSHAPE framework. Experimental results show that these scheduling policies significantly improve individual application turn around time as well as overall cluster utilization.
C. J. Ribbens and R. Sudarsan, "Scheduling resizable parallel applications," 2009 IEEE International Symposium on Parallel & Distributed Processing (IPDPS), Rome, 2009, pp. 1-10.