This Article 
 Bibliographic References 
 Add to: 
A Novel Reordering Write Buffer to Improve Write Performance of Log-Structured File Systems
December 2003 (vol. 52 no. 12)
pp. 1559-1572
Jun Wang, IEEE
Yiming Hu, IEEE

Abstract—This paper presents a novel reordering write buffer which improves the performance of Log-structured File Systems (LFS). While LFS has a good write performance, high garbage-collection overhead degrades its performance under high disk space utilization. Previous research concentrated on how to improve the efficiency of the garbage collector after data is written to disk. We propose a new method that reduces the amount of work the garbage collector would do before data reaches disk. By classifying active and inactive data in memory into different segment buffers and then writing them to different disk segments, we force the disk segments to form a bimodal distribution. Most data blocks in active segments are quickly invalidated, while inactive segments remain mostly intact. Simulation results based on a wide range of both real-world and synthetic traces show that our method significantly reduces the garbage collection overhead, slashing the overall write cost of LFS by up to 53 percent, improving the write performance of LFS by up to 26 percent, and the overall system performance by up to 21 percent.

[1] J. Ousterhout and F. Douglis, Beating the I/O Bottleneck: A Case for Log-Structured File Systems Operating Systems Rev., vol. 23, no. 1, pp. 11-28, 1989.
[2] M. Rosenblum and J.K. Ousterhout, "The Design and Implementation of a Log-Structured File System," ACM Trans. Computer Systems, vol. 10, no. 1, Feb. 1992.
[3] M. Seltzer, K. Bostic, M.K. McKusick, and C. Staelin, An Implementation of a Log-Structured File System for UNIX Proc. Winter 1993 USENIX, pp. 307-326, Jan. 1993.
[4] M. Seltzer, K.A. Smith, H. Balakrishnan, J. Chang, S. McMains, and V. Padmanabhan, File System Logging versus Clustering: A Performance Comparison Proc. 1995 USENIX, pp. 249-264, Jan. 1995.
[5] J. Wilkes, R. Golding, C. Staelin, and T. Sullivan, The HP Auto RAID Hierarchical Storage System ACM Trans. Computer Systems, vol. 14, pp. 108-136, Feb. 1996.
[6] J. Menon, A Performance Comparison of RAID-5 and Log-Structured Arrays Proc. Fourth IEEE Int'l Symp. High Performance Distributed Computing, pp. 167-178, Aug. 1995.
[7] J.N. Matthews, D. Roselli, A.M. Costello, R.Y. Wang, and T.E. Anderson, Improving the Performance of Log-Structured File Systems with Adaptive Methods Proc. 16th ACM Symp. Operating System Principles (SOSP '97), pp. 238-251, Oct. 1997.
[8] J.H. Hartman and J.K. Ousterhout, Letter to the Editor Operating Systems Rev., vol. 27, no. 1, pp. 7-9, 1993.
[9] D. Roselli, J.R. Lorch, and T.E. Anderson, A Comparison of File System Workloads Proc. 2000 USENIX Conf., pp. 41-54, June 2000.
[10] T. Blackwell, J. Harris, and M. Seltzer, Heuristic Cleaning Algorithms in Log-Structured File Systems Proc. 1995 USENIX Technical Conf., pp. 277-288, Jan. 1995.
[11] J. Wang and Y. Hu, PROFS Performance-Oriented Data Reorganization for Log-Structured File Systems on Multi-Zone Disks Proc. Ninth Int'l Symp. Modeling, Analysis and Simulation of Computer and Telecomm. Systems (MASCOTS 2001), pp. 285-292, Aug. 2001.
[12] M. Baker, J.H. Hartman, M.D. Kupfer, K.W. Shirriff, and J. Ousterhout, "Measurements of a Distributed File System," Proc. 13th ACM Symp. Operating Systems Principles, pp. 198-211, Oct. 1991.
[13] G.R. Ganger and Y.N. Patt, “Using System-Level Models to Evaluate I/O Subsystem Designs,” IEEE Trans. Computers, vol. 47, no. 6, pp. 667-678, June 1998.
[14] J. Griffioen and R. Appleton, The Design, Implementation, and Evaluation of a Predictive Caching File System Technical Report CS-264-96, Dept. of Computer Science, Univ. of Kentucky, June 1996.
[15] Transaction Processing Performance Council, TPC Benchmark D Standard Specification. Fremont, Calif.: Waterside Assoc., Apr. 1995.
[16] Y. Endo, Z. Wang, J.B. Chen, and M. Seltzer, Using Latency to Evaluate Interactive System Performance Operating Systems Rev., vol. 30, pp. 185-199, Oct. 1996.

Index Terms:
Log-structured File Systems, storage systems, file systems, write performance.
Jun Wang, Yiming Hu, "A Novel Reordering Write Buffer to Improve Write Performance of Log-Structured File Systems," IEEE Transactions on Computers, vol. 52, no. 12, pp. 1559-1572, Dec. 2003, doi:10.1109/TC.2003.1252852
Usage of this product signifies your acceptance of the Terms of Use.