The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.05 - May (2014 vol.25)
pp: 1328-1338
Yu Hua , Wuhan National Lab for Optoelectronics, School of Computer Science and Technology, Huazhong University of Science and Technology, Wuhan, China
Hong jiang , Department of Computer Science and Engineering, University of Nebraska-Lincoln, Lincoln,
Yifeng Zhu , Department of Electrical and Computer Engineering, University of Maine, Orono,
Dan Feng , Wuhan National Lab for Optoelectronics, School of Computer Science and Technology, Huazhong University of Science and Technology, Wuhan, China
Lei Xu , Department of Computer Science and Engineering, University of Nebraska-Lincoln, Lincoln,
ABSTRACT
The explosive growth in data volume and complexity imposes great challenges for file systems. To address these challenges, an innovative namespace management scheme is in desperate need to provide both the ease and efficiency of data access. In almost all today’s file systems, the namespace management is based on hierarchical directory trees. This tree-based namespace scheme is prone to severe performance bottlenecks and often fails to provide real-time response to complex data lookups. This paper proposes a Semantic-Aware Namespace scheme, called SANE, which provides dynamic and adaptive namespace management for ultra-large storage systems with billions of files. SANE introduces a new naming methodology based on the notion of semantic-aware per-file namespace, which exploits semantic correlations among files, to dynamically aggregate correlated files into small, flat but readily manageable groups to achieve fast and accurate lookups. SANE is implemented as a middleware in conventional file systems and works orthogonally with hierarchical directory trees. The semantic correlations and file groups identified in SANE can also be used to facilitate file prefetching and data de-duplication, among other system-level optimizations. Extensive trace-driven experiments on our prototype implementation validate the efficacy and efficiency of SANE.
INDEX TERMS
namespace management, File systems, storage systems, semantic awareness,
CITATION
Yu Hua, Hong jiang, Yifeng Zhu, Dan Feng, Lei Xu, "SANE: Semantic-Aware Namespacein Ultra-Large-Scale File Systems", IEEE Transactions on Parallel & Distributed Systems, vol.25, no. 5, pp. 1328-1338, May 2014, doi:10.1109/TPDS.2013.140
30 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool