The Community for Technology Leaders
2008 3rd Petascale Data Storage Workshop. (PDSW '08) (2008)
Austin, TX
Nov. 17, 2008 to Nov. 17, 2008
ISSN: 2157-7242
ISBN: 978-1-4244-4208-9
pp: 1-4
Milo Polte , School of Computer Science, Carnegie Mellon University, Pittsburgh, PA, 15213, USA
Jiri Simsa , School of Computer Science, Carnegie Mellon University, Pittsburgh, PA, 15213, USA
Wittawat Tantisiriroj , School of Computer Science, Carnegie Mellon University, Pittsburgh, PA, 15213, USA
Garth Gibson , School of Computer Science, Carnegie Mellon University, Pittsburgh, PA, 15213, USA
Shobhit Dayal , School of Computer Science, Carnegie Mellon University, Pittsburgh, PA, 15213, USA
Mikhail Chainani , School of Computer Science, Carnegie Mellon University, Pittsburgh, PA, 15213, USA
Dilip Kumar Uppugandla , School of Computer Science, Carnegie Mellon University, Pittsburgh, PA, 15213, USA
ABSTRACT
This report describes how a file system level log-based technique can improve the write performance of many-to-one write checkpoint workload typical for high performance computations. It is shown that a simple log-based organization can provide for substantial improvements in the write performance while retaining the convenience of a single flat file abstraction. The improvement of the write performance comes at the cost of degraded read performance however. Techniques to alleviate the read performance penalty, such as file reconstruction on the first read, are discussed.
INDEX TERMS
checkpointing, file organisation, parallel processing
CITATION

M. Polte et al., "Fast log-based concurrent writing of checkpoints," 2008 3rd Petascale Data Storage Workshop. (PDSW '08)(PDSW), Austin, TX, 2009, pp. 1-4.
doi:10.1109/PDSW.2008.4811882
95 ms
(Ver 3.1 (10032016))