The Community for Technology Leaders
2004 International Symposium on Applications and the Internet Workshops. 2004 Workshops. (2004)
Tokyo, Japan
Jan. 26, 2004 to Jan. 30, 2004
ISBN: 0-7695-2050-2
pp: 602
Osamu Tatebe , National Institute of Advanced Industrial Science and Technology
Hirotaka Ogawa , National Institute of Advanced Industrial Science and Technology
Yuetsu Kodama , National Institute of Advanced Industrial Science and Technology
Tomohiro Kudoh , National Institute of Advanced Industrial Science and Technology
Satoshi Sekiguchi , National Institute of Advanced Industrial Science and Technology
Satoshi Matsuoka , Tokyo Institute of Technology and National Institute of Informatics
Kento Aida , Tokyo Institute of Technology
Taisuke Boku , University of Tsukuba
Mitsuhisa Sato , University of Tsukuba
Youhei Morita , High Energy Accelerator Research Organization
Yoshinori Kitatsuji , APAN Tokyo XP
Jim Williams , TransPAC/Indiana University
John Hicks , TransPAC/Indiana University
ABSTRACT
The Grid Datafarm architecture is designed for global petascale data-intensive computing. It provides a global parallel file system (Gfarm file system) with online petascale storage, scalable I/O bandwidth, and scalable parallel processing by federating thousands of local file systems in a grid of clusters securely using Grid security infrastructure. One of features is that it manages file replicas in filesystem metadata for fault tolerance and load balancing. Here, we present an overview of our planned experiment to be performed as the SC2003 Bandwidth Challenge at the Supercomputing 2003 site in Phoenix, Arizona, USA. In the experiment, five clusters in Japan and three clusters in US will comprise a Gfarm file system, on which world-wide largescale data analysis will be performed. In the Gfarm file system, a file is dispersed in several cluster nodes, each of which is replicated independently and in parallel by multiple third-party transfers between multiple cluster nodes. For the Challenge, terabyte-scale experimental data will be replicated between US and Japan via APAN/TransPAC and SuperSINET (about 10,000 km or 6,000 miles). At the workshop we expect to present the full detail of the experiment.
INDEX TERMS
null
CITATION

S. Matsuoka et al., "The Second Trans-Pacific Grid Datafarm Testbed and Experiments for SC2003," 2004 International Symposium on Applications and the Internet Workshops. 2004 Workshops.(SAINT-W), Tokyo, Japan, 2004, pp. 602.
doi:10.1109/SAINTW.2004.1268694
97 ms
(Ver 3.3 (11022016))