This Article 
 Bibliographic References 
 Add to: 
SANE: Semantic-Aware Namespacein Ultra-Large-Scale File Systems
May 2014 (vol. 25 no. 5)
pp. 1328-1338
Hong jiang, Department of Computer Science and Engineering, University of Nebraska-Lincoln, Lincoln,
Yifeng Zhu, Department of Electrical and Computer Engineering, University of Maine, Orono,
Lei Xu, Department of Computer Science and Engineering, University of Nebraska-Lincoln, Lincoln,
The explosive growth in data volume and complexity imposes great challenges for file systems. To address these challenges, an innovative namespace management scheme is in desperate need to provide both the ease and efficiency of data access. In almost all today’s file systems, the namespace management is based on hierarchical directory trees. This tree-based namespace scheme is prone to severe performance bottlenecks and often fails to provide real-time response to complex data lookups. This paper proposes a Semantic-Aware Namespace scheme, called SANE, which provides dynamic and adaptive namespace management for ultra-large storage systems with billions of files. SANE introduces a new naming methodology based on the notion of semantic-aware per-file namespace, which exploits semantic correlations among files, to dynamically aggregate correlated files into small, flat but readily manageable groups to achieve fast and accurate lookups. SANE is implemented as a middleware in conventional file systems and works orthogonally with hierarchical directory trees. The semantic correlations and file groups identified in SANE can also be used to facilitate file prefetching and data de-duplication, among other system-level optimizations. Extensive trace-driven experiments on our prototype implementation validate the efficacy and efficiency of SANE.
Index Terms:
namespace management,File systems,storage systems,semantic awareness
Yu Hua, Hong jiang, Yifeng Zhu, Dan Feng, Lei Xu, "SANE: Semantic-Aware Namespacein Ultra-Large-Scale File Systems," IEEE Transactions on Parallel and Distributed Systems, vol. 25, no. 5, pp. 1328-1338, May 2014, doi:10.1109/TPDS.2013.140
Usage of this product signifies your acceptance of the Terms of Use.