The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.05 - Sept.-Oct. (2013 vol.10)
pp: 273-286
Fabien Hermenier , University of Nice Sophia-Antipolis, INRIA - CNRS
Julia Lawall , INRIA/LIP6-Regal, Paris
Gilles Muller , INRIA/LIP6-Regal, Paris
ABSTRACT
The massive amount of resources found in data centers makes it possible to provide high availability to multitier applications. Virtualizing these applications makes it possible to consolidate them on servers, reducing runtime costs. Nevertheless, replicated VMs have to be carefully placed within the data center to provide high availability and good performance. This requires resolving potentially conflicting application and data center requirements, while scaling up to the size of modern data centers. We present BtrPlace, a flexible consolidation manager that is customized through configuration scripts written by the application and data center administrators. BtrPlace relies on constraint programming and an extensible library of placement constraints. The present library of 14 constraints subsumes and extends the capabilities of existing commercial consolidation managers. Scalability is achieved by splitting the data center into partitions and computing placements in parallel. Overall, BtrPlace repairs a nonviable placement after a major load increase or a maintenance operation for a 5,000 server data center hosting 30,000 VMs and involving thousands of constraints in 3 minutes. Using partitions of 2,500 servers, placement computing is reduced to under 30 seconds.
INDEX TERMS
Servers, Planning, Maintenance engineering, Computational modeling, Programming, Availability, Monitoring, reconfiguration, Virtualization, data center, resource management, service-level agreements
CITATION
Fabien Hermenier, Julia Lawall, Gilles Muller, "BtrPlace: A Flexible Consolidation Manager for Highly Available Applications", IEEE Transactions on Dependable and Secure Computing, vol.10, no. 5, pp. 273-286, Sept.-Oct. 2013, doi:10.1109/TDSC.2013.5
REFERENCES
[1] Amazon EC2, http://aws.amazon.com/ec2, 2013.
[2] E. Anderson, J. Hall, J. Hartline, M. Hobbes, A. Karlin, J. Saia, R. Swaminathan, and J. Wilkes, "Algorithms for Data Migration," Algorithmica, vol. 57, pp. 349-380, 2010.
[3] P. Barham, B. Dragovic, K. Fraser, S. Hand, T. Harris, A. Ho, R. Neugebauer, I. Pratt, and A. Warfield, "Xen and the Art of Virtualization," Proc. 19th Symp. Operating Systems Principles (SOSP), pp. 164-177, 2003.
[4] N. Beldiceanu, M. Carlsson, and J.-X. Rampon, "Global Constraint Catalog," Technical Report T2005-08, Swedish Inst. of Computer Science, 2005.
[5] E. Bin, O. Biran, O. Boni, E. Hadad, E. Kolodner, Y. Moatti, and D. Lorenz, "Guaranteeing High Availability Goals for Virtual Machine Placement," Proc. 31th Int'l Conf. Distributed Computing Systems (ICDCS), June 2011.
[6] N. Bobroff, A. Kochut, and K. Beaty, "Dynamic Placement of Virtual Machines for Managing SLA Violations," Proc. IFIP/IEEE 10th Int'l Symp. Integrated Network Management (IM '07), pp. 119-128, May 2007.
[7] F. Cappello, E. Caron, M. Dayde, F. Desprez, Y. Jegou, P. Primet, E. Jeannot, S. Lanteri, J. Leduc, N. Melab, G. Mornet, R. Namyst, B. Quetier, and O. Richard, "Grid '5000: A Large Scale and Highly Reconfigurable Grid Experimental Testbed," Proc. IEEE/ACM Int'l Workshop Grid Computing, 2005.
[8] E. Cecchet, A. Chanda, S. Elnikety, J. Marguerite, and W. Zwaenepoel, "Performance Comparison of Middleware Architectures for Generating Dynamic Web Content," Proc. Int'l Conf. Middleware, 2003.
[9] C. Clark, K. Fraser, S. Hand, J.G. Hansen, E. Jul, C. Limpach, I. Pratt, and A. Warfield, "Live Migration of Virtual Machines," Proc. Second Conf. Symp. Networked Systems Design and Implementation (NSDI), pp. 273-286, 2005.
[10] J. Dean, "Designs Lessons and Advice from Building Large Distributed Systems," Proc. Keynote of the Int'l Conf. Large-Scale Distributed Systems and Middleware Conf., 2009.
[11] C. Dupont, G. Giuliani, F. Hermenier, T. Schulze, and A. Somov, "An Energy Aware Framework for Virtual Machine Placement in Cloud Federated Data Centres," Proc. IEEE/ACM Third Int'l Conf. Future Energy Systems, (e-Energy), 2012.
[12] E. Duncan and D. Frank, VMware vSphere 4.1 HA and DRS Technical Deepdive. CreateSpace, 2010.
[13] A. Greenberg, J. Hamilton, N. Jain, S. Kandula, C. Kim, P. Lahiri, D. Maltz, P. Patel, and S. Sengupta, "Vl2: A Scalable and Flexible Data Center Network," Proc. ACM SIGCOMM, vol. 39, pp. 51-62, 2009.
[14] C. Guo, G. Lu, D. Li, H. Wu, X. Zhang, Y. Shi, C. Tian, Y. Zhang, and S. Lu, "BCube: A High Performance, Server-Centric Network Architecture for Modular Data Centers," Proc. ACM SIGCOMM, vol. 39, no. 4, pp. 63-74, 2009.
[15] F. Hermenier, S. Demassey, and X. Lorca, "Bin Repacking Scheduling in Virtualized Datacenters," Principles and Practice of Constraint Programming--CP 2011, pp. 27-41, Springer, 2011.
[16] F. Hermenier, A. Lèbre, and J.-M. Menaud, "Cluster-Wide Context Switch of Virtualized Jobs," Proc. Fourth Int'l Workshop Virtualization Technologies in Distributed Computing, 2010.
[17] F. Hermenier, X. Lorca, J.-M. Menaud, G. Muller, and J. Lawall, "Entropy: A Consolidation Manager for Clusters," Proc. Int'l Conf. Virtual Execution Environments (VEE), 2009.
[18] G. Jung, K.R. Joshi, M.A. Hiltunen, R.D. Schlichting, and C. Pu, "Performance and Availability Aware Regeneration for Cloud Based Multitier Applications," Proc. IEEE Conf. Dependable Systems and Networks (DSN), 2010.
[19] C.E. Leiserson, "Fat-Trees: Universal Networks for Hardware-Efficient Supercomputing," IEEE Trans. Computers, vol. C-34, no. 10, pp. 892-901, Oct. 1985.
[20] F. Rossi, P.van Beek, and T. Walsh, Handbook of Constraint Programming. Elsevier Science, 2006.
[21] P. Ruth, J. Rhee, D. Xu, R. Kennell, and S. Goasguen, "Autonomic Live Adaptation of Virtual Computational Environments in a Multi-Domain Infrastructure," Proc. IEEE Int'l Conf. Autonomic Computing, 2006.
[22] U. Sharma, P. Shenoy, S. Sahu, and A. Shaikh, "Kingfisher: Cost-Aware Elasticity in the Cloud," Proc. IEEE INFOCOM, pp. 206-210, 2011.
[23] "Virtualization Penetration Rate in the Enterprise," technical report, Veeam Software, 2011.
[24] A. Verma, P. Ahuja, and A. Neogi, "pMapper: Power and Migration Cost Aware Application Placement in Virtualized Systems," Proc. Ninth ACM/IFIP/USENIX Int'l Conf. Middleware (Middleware '08), 2008.
[25] M. Wang, X. Meng, and L. Zhang, "Consolidating Virtual Machines with Dynamic Bandwidth Demand in Data Centers," Proc. IEEE INFOCOM, pp. 71-75, 2011.
[26] Y. Yazir, C. Matthews, R. Farahbod, S. Neville, A. Guitouni, S. Ganti, and Y. Coady, "Dynamic Resource Allocation in Computing Clouds Using Distributed Multiple Criteria Decision Analysis," Proc. IEEE Third Int'l Conf. Cloud Computing, 2010.
7 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool