Flexible and Efficient Parallel I/O for Large-Scale Multi-Component Simulations

	This Article
	Subscribers, please Login Purchase article: $19 PDF IEEE Xplore Subscribers RSS feed
	Share
	Email this Article to a friend
	Bibliographic References
	ASCII Text BibTex RefWorks Procite/RefMan/Endnote
	Add to:
	Digg Furl Spurl Blink Simpy Google Del.icio.us Y!MyWeb
	Search
	Similar Articles Articles by Xiaosong Ma Articles by Xiangmin Jiao Articles by Michael Campbell Articles by Marianne Winslett

International Parallel and Distributed Processing Symposium (IPDPS'03)

Nice, France

April 22-April 26

ISBN: 0-7695-1926-1

	ASCII Text	x
	Xiaosong Ma, Xiangmin Jiao, Michael Campbell, Marianne Winslett, "Flexible and Efficient Parallel I/O for Large-Scale Multi-Component Simulations," Parallel and Distributed Processing Symposium, International, pp. 255a, International Parallel and Distributed Processing Symposium (IPDPS'03), 2003.

	BibTex	x
	@article{ 10.1109/IPDPS.2003.1213462, author = {Xiaosong Ma and Xiangmin Jiao and Michael Campbell and Marianne Winslett}, title = {Flexible and Efficient Parallel I/O for Large-Scale Multi-Component Simulations}, journal ={Parallel and Distributed Processing Symposium, International}, volume = {0}, year = {2003}, issn = {1530-2075}, pages = {255a}, doi = {http://doi.ieeecomputersociety.org/10.1109/IPDPS.2003.1213462}, publisher = {IEEE Computer Society}, address = {Los Alamitos, CA, USA}, }

	RefWorks Procite/RefMan/Endnote	x
	TY - CONF JO - Parallel and Distributed Processing Symposium, International TI - Flexible and Efficient Parallel I/O for Large-Scale Multi-Component Simulations SN - 1530-2075 SP EP A1 - Xiaosong Ma, A1 - Xiangmin Jiao, A1 - Michael Campbell, A1 - Marianne Winslett, PY - 2003 KW - parallel I/O KW - I/O performance optimization KW - multi-component simulations KW - irregular data distribution KW - scientific data management VL - 0 JA - Parallel and Distributed Processing Symposium, International ER -

DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/IPDPS.2003.1213462

In this paper, we discuss our experience of providing high performance parallel I/O for a large-scale, on-going, multi-disciplinary simulation project for solid propellant rockets. We describe the performance and data management issues observed in this project and present our solutions, including (1) support for relatively fine-grained distribution of irregular datasets in parallel I/O, (2) a flexible data management facility for inter-module communication, and (3) two schemes to overlap computation with I/O. Performance results obtained from both development and production platforms show that our I/O optimizations can dramatically reduce the simulation?s visible I/O cost, as well as the number of disk files, and significantly improve the overall performance. Meanwhile, our data management facility helps to provide simulation developers with simple user interfaces for parallel I/O.

Index Terms:

parallel I/O, I/O performance optimization, multi-component simulations, irregular data distribution, scientific data management

Citation:

Xiaosong Ma, Xiangmin Jiao, Michael Campbell, Marianne Winslett, "Flexible and Efficient Parallel I/O for Large-Scale Multi-Component Simulations," ipdps, pp.255a, International Parallel and Distributed Processing Symposium (IPDPS'03), 2003

Peer Review Notice | Give Us Feedback

Usage of this product signifies your acceptance of the Terms of Use.