The Community for Technology Leaders
Parallel and Distributed Processing Symposium, International (2008)
Miami, FL, USA
Apr. 14, 2008 to Apr. 18, 2008
ISBN: 978-1-4244-1693-6
pp: 1-7
Rich Wolski , University of California, Santa Barbara, USA
Daniel Nurmi , University of California, Santa Barbara, USA
Carl Kesselman , Information Sciences Institute, University of Southern California, USA
Yang-Suk Kee , Information Sciences Institute, University of Southern California, USA
ABSTRACT
Providing QoS (Quality of Service) in batch resources against the uncertainty of resource availability due to the space-sharing nature of scheduling policies is a critical capability required for high-performance computing. This paper introduces a technique called personal cluster which reserves a partition of batch resources on user’s demand in a best-effort manner. A personal cluster provides a private cluster dedicated to the user during a user-specified time period by installing a user-level resource manager on the resource partition. This technique not only enables cost-effective resource utilization and efficient task management but also provides the user a uniform interface to heterogeneous resources regardless of local resource management software. A prototype implementation using a PBS batch resource manager and Globus Toolkits based on Web Services shows that the overhead of instantiating a personal cluster of medium size is small, which is just about 1 minute for a personal cluster having 32 processors.
INDEX TERMS
CITATION
Rich Wolski, Daniel Nurmi, Carl Kesselman, Yang-Suk Kee, "Enabling personal clusters on demand for batch resources using commodity software", Parallel and Distributed Processing Symposium, International, vol. 00, no. , pp. 1-7, 2008, doi:10.1109/IPDPS.2008.4536167
89 ms
(Ver 3.3 (11022016))