Cluster Computing and the Grid, IEEE International Symposium on (2006)
May 16, 2006 to May 19, 2006
Gene Cooperman , Northeastern University, USA
Jason Ansel , Northeastern University, USA
Xiaoqin Ma , Northeastern University, USA
We present a transparent, system-level checkpointing solution for master-worker parallelism that automatically adapts, upon restart, to the number of processor nodes available. This is important, since nodes in a cluster fail. It also allows one to adapt to using multiple cluster partitions and multiple resources from the Computational Grid, as they become available. Checkpointing a master-worker computation has the additional advantage of needing to checkpoint only the master process. This is both fast and more economical of disk space. This has been demonstrated by checkpointing Geant4, a million line C++ program. Our solution has been implemented in the context of TOP-C (Task Oriented Parallel C/C++), a free, open-source parallel package, although it can easily be ported to additional master-worker packages.
J. Ansel, G. Cooperman and X. Ma, "Transparent Adaptive Library-Based Checkpointing for Master-Worker Style Parallelism," Cluster Computing and the Grid, IEEE International Symposium on(CCGRID), Singapore, 2006, pp. 283-291.