The Community for Technology Leaders
Mass Storage Systems and Technologies, IEEE / NASA Goddard Conference on (2005)
Monterey, California
Apr. 11, 2005 to Apr. 14, 2005
ISBN: 0-7695-2318-8
pp: 160-168
Jim Rubas , IBM Watson Research
Marc Kaplan , IBM Watson Research
Murthy Devarakonda , IBM Watson Research
Mandis Beigi , IBM Watson Research
David Pease , IBM Almaden Research
Akshat Verma , IBM India Research Lab
Upendra Sharma , IBM India Research Lab
Rohit Jain , IBM India Research Lab
We present a policy-based architecture STEPS for lifecycle management (LCM) in a mass scale distributed file system. The STEPS architecture is designed in the context of IBM's SAN File System (SFS) and leverages the parallelism and scalability offered by SFS, while providing a centralized point of control for policy-based management. The architecture uses novel concepts like Policy Cache and Rate-Controlled Migration for efficient and non-intrusive execution of the LCM functions, while ensuring that the architecture scales with very large number of files.<div></div> The architecture has been implemented and used for lifecycle management in a distributed deployment of SFS with heterogeneous data. We conduct experiments on the implementation to study the performance of the architecture. We observed that STEPS is highly scalable with increase in the number as well as the size of the file objects hosted by SFS. The performance study also demonstrated that most of the efficiency of policy execution is derived from Policy Cache. Further, a ratecontrol mechanism is necessary to ensure that users are isolated from LCM operations.
Jim Rubas, Marc Kaplan, Murthy Devarakonda, Mandis Beigi, David Pease, Akshat Verma, Upendra Sharma, Rohit Jain, "An Architecture for Lifecycle Management in Very Large File Systems", Mass Storage Systems and Technologies, IEEE / NASA Goddard Conference on, vol. 00, no. , pp. 160-168, 2005, doi:10.1109/MSST.2005.4
97 ms
(Ver )