Grid Datafarm Architecture for Petascale Data Intensive Computing

CC
CCGRID
2002
Second IEEE International Symposium on Cluster Computing and the Grid (CCGRID'02)
Abstract - Grid Datafarm Architecture for Petascale Data Intensive Computing

	This Article
	Subscribers, please Login Purchase article: $19 PDF IEEE Xplore Subscribers RSS feed
	Share
	Email this Article to a friend
	Bibliographic References
	ASCII Text BibTex RefWorks Procite/RefMan
	Add to:
	Digg Furl Spurl Blink Simpy Google Del.icio.us Y!MyWeb
	Search
	Similar Articles Articles by Osamu Tatebe Articles by Youhei Morita Articles by Satoshi Matsuoka Articles by Noriyuki Soda Articles by Satoshi Sekiguchi

Second IEEE International Symposium on Cluster Computing and the Grid (CCGRID'02)

Berlin, Germany

May 21-May 24

ISBN: 0-7695-1582-7

	ASCII Text	x
	Osamu Tatebe, Youhei Morita, Satoshi Matsuoka, Noriyuki Soda, Satoshi Sekiguchi, "Grid Datafarm Architecture for Petascale Data Intensive Computing," Cluster Computing and the Grid, IEEE International Symposium on, pp. 102, Second IEEE International Symposium on Cluster Computing and the Grid (CCGRID'02), 2002.

	BibTex	x
	@article{ 10.1109/CCGRID.2002.1017117, author = {Osamu Tatebe and Youhei Morita and Satoshi Matsuoka and Noriyuki Soda and Satoshi Sekiguchi}, title = {Grid Datafarm Architecture for Petascale Data Intensive Computing}, journal ={Cluster Computing and the Grid, IEEE International Symposium on}, volume = {0}, year = {2002}, isbn = {0-7695-1582-7}, pages = {102}, doi = {http://doi.ieeecomputersociety.org/10.1109/CCGRID.2002.1017117}, publisher = {IEEE Computer Society}, address = {Los Alamitos, CA, USA}, }

	RefWorks Procite/RefMan/Endnote	x
	TY - CONF JO - Cluster Computing and the Grid, IEEE International Symposium on TI - Grid Datafarm Architecture for Petascale Data Intensive Computing SN - 0-7695-1582-7 SP EP A1 - Osamu Tatebe, A1 - Youhei Morita, A1 - Satoshi Matsuoka, A1 - Noriyuki Soda, A1 - Satoshi Sekiguchi, PY - 2002 VL - 0 JA - Cluster Computing and the Grid, IEEE International Symposium on ER -

DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/CCGRID.2002.1017117

The Grid Datafarm (Gfarm) architecture is designed for global petascale data-intensive computing. It provides a global parallel filesystem with online petascale storage, scalable I/O bandwidth, and scalable parallel processing, and it can exploit local I/O in a grid of clusters with tens of thousands of nodes. Gfarm parallel I/O APIs and commands provide a single filesystem image and manipulate filesystem metadata consistently. Fault tolerance and load balancing are automatically managed by file duplication or recomputation using a command history log. Preliminary performance evaluation has shown scalable disk I/O and network bandwidth on 64 nodes of the Presto III Athlon cluster. The Gfarm parallel I/O write and read operations has achieved data transfer rates of 1.74 GB/s and 1.97 GB/s, respectively, using 64 cluster nodes. The Gfarm parallel file copy reached 443 MB/s with 23 parallel streams on the Myrinet 2000. The Gfarm architecture is expected to enable petascale data-intensive Grid computing with an I/O bandwidth scales to the TB/s range and scalable computational power.

Citation:

Osamu Tatebe, Youhei Morita, Satoshi Matsuoka, Noriyuki Soda, Satoshi Sekiguchi, "Grid Datafarm Architecture for Petascale Data Intensive Computing," ccgrid, pp.102, Second IEEE International Symposium on Cluster Computing and the Grid (CCGRID'02), 2002

Peer Review Notice | Give Us Feedback

Usage of this product signifies your acceptance of the Terms of Use.