The Community for Technology Leaders
Mass Storage Systems and Technologies, IEEE / NASA Goddard Conference on (2007)
San Diego, California, USA
Sept. 24, 2007 to Sept. 27, 2007
ISBN: 0-7695-3025-7
pp: 47-59
Gilbert Grosdidier , LAL/IN2P3/CNRS, France
Flavia Donno , European Organization for Nuclear Research, Switzerland
Remi Mollon , European Organization for Nuclear Research, Switzerland
Matt Crawford , Fermi National Accelerator Laboratory, USA
Junmin Gu , Lawrence Berkeley National Laboratory, USA
Sophie Lemaitre , European Organization for Nuclear Research, Switzerland
Riccardo Zappi , INFN/CNAF, Italy
Birger Koblitz , European Organization for Nuclear Research, Switzerland
Paolo Badino , European Organization for Nuclear Research, Switzerland
David Smith , European Organization for Nuclear Research, Switzerland
Patrick Fuhrmann , Deutsches Elektronen-Synchroton, Germany
Timur Perelmutov , Fermi National Accelerator Laboratory, USA
Arie Shoshani , Lawrence Berkeley National Laboratory, USA
Paolo Tedesco , European Organization for Nuclear Research, Switzerland
Giuseppe Lo Presti , European Organization for Nuclear Research, Switzerland
Massimo Sponza , ICTP/EGRID, Italy
Jean-Philippe Baud , European Organization for Nuclear Research, Switzerland
Jens Jensen , Rutherford Appleton Laboratory, England
Ezio Corso , ICTP/EGRID, Italy
Alberto Forti , INFN/CNAF, Italy
Luca Magnoni , INFN/CNAF, Italy
Dmitry Litvinsev , Ferni National Accelerator Laboratory, USA
Shaun De Witt , Rutherford Appleton Laboratory, England
Akos Frohner , European Organization for Nuclear Research, Switzerland
Don Petravick , Fermi National Accelerator Laboratory, USA
Lana Abadie , European Organization for Nuclear Research, Switzerland
Alex Sim , Lawrence Berkeley National Laboratory, USA
Vijaya Natarajan , Lawrence Berkeley National Laboratory, USA
Alexander Moibenko , Fermi National Acclerator Laboratory, USA
Maarten Litmaath , European Organization for Nuclear Research, Switzerland
Tigran Mkrtchan , Deutsches Elektronen-Synchrotron, Germany
Gene Oleynik , Fermi National Accelerator Laboratory, USA
ABSTRACT
Storage management is one of the most important enabling technologies for large-scale scientific investigations. Having to deal with multiple heterogeneous storage and file systems is one of the major bottlenecks in managing, replicating, and accessing files in distributed environments. Storage Resource Managers (SRMs), named after their web services control protocol, provide the technology needed to manage the rapidly growing distributed data volumes, as a result of faster and larger computational facilities. SRMs are Grid storage services providing interfaces to storage resources, as well as advanced functionality such as dynamic space allocation and file management on shared storage systems. They call on transport services to bring files into their space transparently and provide effective sharing of files. SRMs are based on a common specification that emerged over time and evolved into an international collaboration. This approach of an open specification that can be used by various institutions to adapt to their own storage systems has proven to be a remarkable success -- the challenge has been to provide a consistent homogeneous interface to the Grid, while allowing sites to have diverse infrastructures. In particular, supporting optional features while preserving interoperability is one of the main challenges we describe in this paper. We also describe using SRM in a large international High Energy Physics collaboration, called WLCG, to prepare to handle the large volume of data expected when the Large Hadron Collider (LHC) goes online at CERN. This intense collaboration led to refinements and additional functionality in the SRM specification, and the development of multiple interoperating implementations of SRM for various complex multi-component storage systems.
INDEX TERMS
null
CITATION
Gilbert Grosdidier, Flavia Donno, Remi Mollon, Matt Crawford, Junmin Gu, Sophie Lemaitre, Riccardo Zappi, Birger Koblitz, Paolo Badino, David Smith, Patrick Fuhrmann, Timur Perelmutov, Arie Shoshani, Paolo Tedesco, Giuseppe Lo Presti, Massimo Sponza, Jean-Philippe Baud, Jens Jensen, Ezio Corso, Alberto Forti, Luca Magnoni, Dmitry Litvinsev, Shaun De Witt, Akos Frohner, Don Petravick, Lana Abadie, Alex Sim, Vijaya Natarajan, Alexander Moibenko, Maarten Litmaath, Tigran Mkrtchan, Gene Oleynik, "Storage Resource Managers: Recent International Experience on Requirements and Multiple Co-Operating Implementations", Mass Storage Systems and Technologies, IEEE / NASA Goddard Conference on, vol. 00, no. , pp. 47-59, 2007, doi:10.1109/MSST.2007.31
185 ms
(Ver )