|
| This Article | ||
| ||
| Share | ||
| Bibliographic References | ||
| Add to: | ||
 Digg  Furl  Spurl  Blink  Simpy  Google  Del.icio.us  Y!MyWeb | ||
| Search | ||
| ||
Second IEEE International Symposium on Cluster Computing and the Grid (CCGRID'02)
Grid Datafarm Architecture for Petascale Data Intensive Computing
Berlin, Germany
May 21-May 24
ISBN: 0-7695-1582-7
| ASCII Text | x | ||
| Osamu Tatebe, Youhei Morita, Satoshi Matsuoka, Noriyuki Soda, Satoshi Sekiguchi, "Grid Datafarm Architecture for Petascale Data Intensive Computing," Cluster Computing and the Grid, IEEE International Symposium on, pp. 102, Second IEEE International Symposium on Cluster Computing and the Grid (CCGRID'02), 2002. | |||
| BibTex | x | ||
| @article{ 10.1109/CCGRID.2002.1017117, author = {Osamu Tatebe and Youhei Morita and Satoshi Matsuoka and Noriyuki Soda and Satoshi Sekiguchi}, title = {Grid Datafarm Architecture for Petascale Data Intensive Computing}, journal ={Cluster Computing and the Grid, IEEE International Symposium on}, volume = {0}, year = {2002}, isbn = {0-7695-1582-7}, pages = {102}, doi = {http://doi.ieeecomputersociety.org/10.1109/CCGRID.2002.1017117}, publisher = {IEEE Computer Society}, address = {Los Alamitos, CA, USA}, } | |||
| RefWorks Procite/RefMan/Endnote | x | ||
| TY - CONF JO - Cluster Computing and the Grid, IEEE International Symposium on TI - Grid Datafarm Architecture for Petascale Data Intensive Computing SN - 0-7695-1582-7 SP EP A1 - Osamu Tatebe, A1 - Youhei Morita, A1 - Satoshi Matsuoka, A1 - Noriyuki Soda, A1 - Satoshi Sekiguchi, PY - 2002 VL - 0 JA - Cluster Computing and the Grid, IEEE International Symposium on ER - | |||
The Grid Datafarm (Gfarm) architecture is designed for global petascale data-intensive computing. It provides a global parallel filesystem with online petascale storage, scalable I/O bandwidth, and scalable parallel processing, and it can exploit local I/O in a grid of clusters with tens of thousands of nodes. Gfarm parallel I/O APIs and commands provide a single filesystem image and manipulate filesystem metadata consistently. Fault tolerance and load balancing are automatically managed by file duplication or recomputation using a command history log. Preliminary performance evaluation has shown scalable disk I/O and network bandwidth on 64 nodes of the Presto III Athlon cluster. The Gfarm parallel I/O write and read operations has achieved data transfer rates of 1.74 GB/s and 1.97 GB/s, respectively, using 64 cluster nodes. The Gfarm parallel file copy reached 443 MB/s with 23 parallel streams on the Myrinet 2000. The Gfarm architecture is expected to enable petascale data-intensive Grid computing with an I/O bandwidth scales to the TB/s range and scalable computational power.
Citation:
Osamu Tatebe, Youhei Morita, Satoshi Matsuoka, Noriyuki Soda, Satoshi Sekiguchi, "Grid Datafarm Architecture for Petascale Data Intensive Computing," ccgrid, pp.102, Second IEEE International Symposium on Cluster Computing and the Grid (CCGRID'02), 2002
Usage of this product signifies your acceptance of the Terms of Use.