The Community for Technology Leaders
SC Conference (2003)
Phoenix, Arizona
Nov. 15, 2003 to Nov. 21, 2003
ISBN: 1-58113-695-1
pp: 24
S. Ethier , Princeton University, NJ
D. McCune , Princeton University, NJ
K. Martins , Princeton University, NJ
S. Klasky , Princeton University, NJ
Z. Lin , University of California, Irvine
R. Samtaney , Princeton University, NJ
We have developed a threaded parallel data streaming approach using Globus to transfer multi-terabyte simulation data from a remote supercomputer to the scientist's home analysis/visualization cluster, as the simulation executes, with negligible overhead. Data transfer experiments show that this concurrent data transfer approach is more favorable compared with writing to local disk and then transferring this data to be post-processed. The present approach is conducive to using the grid to pipeline the simulation with post-processing and visualization. We have applied this method to the Gyrokinetic Toroidal Code (GTC), a 3-dimensional particle-in-cell code used to study micro-turbulence in magnetic confinement fusion from first principles plasma theory.
S. Ethier, D. McCune, K. Martins, S. Klasky, Z. Lin, R. Samtaney, "Grid -Based Parallel Data Streaming implemented for the Gyrokinetic Toroidal Code", SC Conference, vol. 00, no. , pp. 24, 2003, doi:10.1109/SC.2003.10041
80 ms
(Ver 3.3 (11022016))