This Article 
 Bibliographic References 
 Add to: 
Flexible and Adaptable Buffer Management Techniques for Database Management Systems
April 1995 (vol. 44 no. 4)
pp. 546-560

Abstract—The problem of buffer management in database management systems is concerned with the efficient main memory allocation and management for answering database queries. Previous works on buffer allocation are based either exclusively on the availability of buffers at runtime or on the access patterns of queries. In this paper, we first propose a unified approach for buffer allocation in which both of these considerations are taken into account. Our approach is based on the notion of marginal gains which specify the expected reduction in page faults by allocating extra buffers to a query. Then, we extend this approach to support adaptable buffer allocation. An adaptable buffer allocation algorithm automatically optimizes itself for the specific query workload. To achieve this adaptability, we propose using run-time information, such as the load of the system, in buffer allocation decisions. Our approach is to use a simple queuing model to predict whether a buffer allocation will improve the performance of the system. Thus, this paper provides a more theoretical basis for buffer allocation. Simulation results show that our methods based on marginal gains and our predictive methods consistently outperform existing allocation strategies. In addition, the predictive methods have the added advantage of adjusting their allocation to changing workloads.

[1] A.F. Cardenas, "Analysis and Performance of Inverted Data Base Structures," Comm. ACM, vol. 18, no. 5, pp. 253-263, May 1975.
[2] H. Chou,“Buffer management of database systems,” Computer Sciences Technical Report 597, Univ. of Wisconsin, Madison, 1985.
[3] H. Chou and D. DeWitt,“An evaluation of buffer management strategies forrelational database systems,” Proc. 11thInt’l Conf. Very Large Data Bases, 1985.
[4] S. Christodoulakis,“Implications of certain assumptions in database performance evaluation,” ACM Trans. on Database Systems, vol. 9, no. 2, pp. 163-186, June 1984.
[5] D. Cornell and P. Yu,“Integration of buffer management and query optimization in a relational database environment,” Proc. 15th Int’l Conf. Very Large Data Bases, Aug. 1989.
[6] W. Effelsberg, "Principles of Database Buffer Management," ACM Trans. Database Systems, Vol.9, No. 4, Dec. 1984, pp. 560-595.
[7] C. Faloutsos,R. Ng,, and T. Sellis,., “Predictive load control for Flexiblebuffer allocation,” Proc. 17thInt’l Conf. Very Large Data Bases, pp. 265-274, 1991.
[8] J. Kaplan,“Buffer management policies in a database environment,” Master thesis, Univ. of California, Berkeley, 1980.
[9] E. Kauder, History of Marginal Utility Theory, Princeton, NJ: Princeton Univ. Press, 1965.
[10] T. Lang,C. Wood,, and E. Fernandez,“Database buffer paging in virtualstorage systems,” ACM Trans. Database Systems, vol. 2, no. 4, 1977.
[11] R. Mattson,J. Gecsei,D. Slutz,, and I. Traiger,“Evaluation techniques forstorage hierarchies,” IBM Systems Journal, vol. 9, no. 2, 1970.
[12] R. Ng,C. Faloutsos,, and T. Sellis,“Flexible buffer allocation based on marginal gains,” Proc. 1991 ACM SIGMOD Conf.,Denver, 1991.
[13] G.M. Sacco and M. Schkolnick, “A Mechanism for Managing the Buffer Pool in a Relational Database System Using the Hot Set Model,” Proc. Eighth Int'l Conf. Very Large Data Bases, pp. 257-262, Sept. 1982.
[14] G. Sacca and M. Schkolnick,“Buffer Management in Relational Database Systems,” ACM Trans. Database Systems, vol. 11, no. 4, 1986.
[15] S. Sherman and R. Brice,“Performance of a database manager in a virtualmemory system,” ACM Trans. Database Systems, vol. 1, no. 4, 1976.
[16] M. Stonebraker, P. Kreps, and G. Held, "The Design and Implementation of INGRES," ACM Trans. Database Systems vol. 1 no. 3, 1976.
[17] K.S. Trivedi, Probability and Statistics with Reliability, Queuing, and Computer Science Applications. Prentice Hall, 1982.
[18] S.B. Yao, "Approximating Block Accesses in Database Organizations," Comm. ACM, vol. 20, no. 4, pp. 260-261, Apr. 1977.

Index Terms:
Buffer management, performance analysis, relational databases.
Raymond Ng, Christos Faloutsos, Timos Sellis, "Flexible and Adaptable Buffer Management Techniques for Database Management Systems," IEEE Transactions on Computers, vol. 44, no. 4, pp. 546-560, April 1995, doi:10.1109/12.376169
Usage of this product signifies your acceptance of the Terms of Use.