The Community for Technology Leaders
2013 IEEE 29th International Conference on Data Engineering (ICDE) (2006)
Atlanta, Georgia
Apr. 3, 2006 to Apr. 7, 2006
ISBN: 0-7695-2570-9
pp: 60
Bianca Schroeder , Carnegie Mellon University
Erich Nahum , IBM T.J. Watson Research Center
Adam Wierman , IBM T.J. Watson Research Center
Arun Iyengar , IBM T.J. Watson Research Center
Mor Harchol-Balter , Carnegie Mellon University
ABSTRACT
Scheduling/prioritization of DBMS transactions is important for many applications that rely on database backends. A convenient way to achieve scheduling is to limit the number of transactions within the database, maintaining most of the transactions in an external queue, which can be ordered as desired by the application. While external scheduling has many advantages in that it doesn?t require changes to internal resources, it is also difficult to get right in that its performance depends critically on the particular multiprogramming limit used (the MPL), i.e. the number of transactions allowed into the database. If the MPL is too low, throughput will suffer, since not all DBMS resources will be utilized. On the other hand, if the MPL is too high, there is insufficient control on scheduling. The question of how to adjust theMPL to achieve both goals simultaneously is an open problem, not just for databases but in system design in general. Herein we study this problem in the context of transactional workloads, both via extensive experimentation and queueing theoretic analysis. <p>We find that the two most critical factors in adjusting the MPL are the number of resources that the workload utilizes and the variability of the transactions? service demands. We develop a feedback based controller, augmented by queueing theoretic models for automatically adjusting the MPL. Finally, we apply our methods to the specific problem of external prioritization of transactions. We find that external prioritization can be nearly as effective as internal prioritization, without any negative consequences, when the MPL is set appropriately.</p>
INDEX TERMS
null
CITATION
Bianca Schroeder, Erich Nahum, Adam Wierman, Arun Iyengar, Mor Harchol-Balter, "How to Determine a Good Multi-Programming Level for External Scheduling", 2013 IEEE 29th International Conference on Data Engineering (ICDE), vol. 00, no. , pp. 60, 2006, doi:10.1109/ICDE.2006.78
96 ms
(Ver 3.1 (10032016))