2018 26th Euromicro International Conference on Parallel, Distributed and Network-based Processing (PDP) (2018)
Cambridge, United Kingdom
Mar 21, 2018 to Mar 23, 2018
As the Energy Wall and the Reliability Wall become unavoidable, it is a demanding and challenging task to reduce energy consumption in large-scale storage systems in modern data centers while retaining acceptable systems reliability. We propose a reliable energy-efficient storage system called DuoFS, which aims at balancing the energy efficiency, the reliability and the performance of parallel storage systems by seamlessly integrating one HDD-based file system and one SSD-based file system. At the heart of the DuoFS is a transformative middleware layer that dispatches files to the one of the two independent parallel file systems based on the files' I/O access popularity. By replicating popular files to the SSD-based file system and pushing the HDD-based file system into the low-power mode under light workload conditions, DuoFS can reduce significant energy consumption, avoid major factors that harm the storage systems reliability, and extract SSDs good I/O performance. Experimental results show that the DuoFS system saves up to 40% of energy, achieves up to 50% better I/O performance while only sacrificing less than 15% of the system's reliability.
energy conservation, parallel processing, power aware computing, storage management
S. Yin, B. Jiao, X. Zhu, X. Ruan, S. Chen and Z. Tang, "DuoFS: A Hybrid Storage System Balancing Energy-Efficiency, Reliability, and Performance," 2018 26th Euromicro International Conference on Parallel, Distributed and Network-based Processing (PDP), Cambridge, United Kingdom, 2018, pp. 478-485.