The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.01 - First Quarter (2013 vol.6)
pp: 48-63
Yiduo Mei , Xi'An Jiaotong University, Xi'An and Georgia Institute of Technology, Atlanta
Ling Liu , Georgia Institute of Technology, Atlanta
Xing Pu , Georgia Institute of Technology, Atlanta
Sankaran Sivathanu , Georgia Institute of Technology, Atlanta
Xiaoshe Dong , Xi'An Jiaotong University, Xi'An
ABSTRACT
Server consolidation and application consolidation through virtualization are key performance optimizations in cloud-based service delivery industry. In this paper, we argue that it is important for both cloud consumers and cloud providers to understand the various factors that may have significant impact on the performance of applications running in a virtualized cloud. This paper presents an extensive performance study of network I/O workloads in a virtualized cloud environment. We first show that current implementation of virtual machine monitor (VMM) does not provide sufficient performance isolation to guarantee the effectiveness of resource sharing across multiple virtual machine instances (VMs) running on a single physical host machine, especially when applications running on neighboring VMs are competing for computing and communication resources. Then we study a set of representative workloads in cloud-based data centers, which compete for either CPU or network I/O resources, and present the detailed analysis on different factors that can impact the throughput performance and resource sharing effectiveness. For example, we analyze the cost and the benefit of running idle VM instances on a physical host where some applications are hosted concurrently. We also present an in-depth discussion on the performance impact of colocating applications that compete for either CPU or network I/O resources. Finally, we analyze the impact of different CPU resource scheduling strategies and different workload rates on the performance of applications running on different VMs hosted by the same physical machine.
INDEX TERMS
Throughput, Driver circuits, Measurement, Virtual machining, Resource management, Web servers, resource scheduling, Cloud computing, performance measurement, virtualization
CITATION
Yiduo Mei, Ling Liu, Xing Pu, Sankaran Sivathanu, Xiaoshe Dong, "Performance Analysis of Network I/O Workloads in Virtualized Data Centers", IEEE Transactions on Services Computing, vol.6, no. 1, pp. 48-63, First Quarter 2013, doi:10.1109/TSC.2011.36
REFERENCES
[1] P. Apparao, R. Iyer, X. Zhang, D. Newell, and T. Adelmeyer, "Characterization & Analysis of a Server Consolidation Benchmark," Proc. ACM/USENIX Int'l Conf. Virtual Execution Environments, pp. 21-29, 2008.
[2] M. Armbrust, A. Fox, R. Griffith, A.D. Joseph, R.H. Katz, A. Konwinski, G. Lee, D.A. Patterson, A. Rabkin, I. Stoica, and M. Zaharia, "Above the Clouds: A Berkeley View of Cloud Computing," Technical Report UCB/EECS-2009-28, http://www.eecs. berkeley.edu/Pubs/TechRpts/ 2009EECS-2009-28.html, 2010.
[3] P. Barham, B. Dragovic, K. Fraser, S. Hand, T. Harris, A. Ho, R. Neugebauer, I. Pratt, and A. Warfield, "Xen and the Art of Virtualization," Proc. ACM Symp. Operating Systems Principles (SOSP), pp. 164-177, 2003.
[4] Z. Chen, D. Kaeli, and K. Murphy, "Performance Evaluation of Virtual Appliances," Proc. First Int'l Workshop Virtualization Performance: Analysis, Characterization, and Tools, Apr. 2008.
[5] L. Cherkasova and R. Gardner, "Measuring CPU Overhead for I/O Processing in the Xen Virtual Machine Monitor," Proc. USENIX Ann. Technical Conf. (ATC), p. 24, 2005.
[6] L. Cherkasova, D. Gupta, and A. Vahdat, "Comparison of the Three CPU Schedulers in Xen," ACM Sigmetrics Performance Evaluation Rev., vol. 35, no. 2, pp. 42-51, Sept. 2007.
[7] B. Clark, T. Deshane, E. Dow, S. Evanchik, M. Finlayson, J. Herne, and J.N. Matthews, "Xen and the Art of Repeated Research," Proc. USENIX Ann. Technical Conf. (ATC), pp. 135-144, 2004.
[8] C. Clark, K. Fraser, S. Hand, J. Hansen, E. Jul, C. Limpach, I. Pratt, and A. Warfiel, "Live Migration of Virtual Machines," Proc. USENIX Symp. Network Systems Design and Implementation (NSDI), pp. 273-286, 2005.
[9] Credit Based CPU Scheduler, http://wiki.xensource.com/ xenwikiCreditScheduler , 2010.
[10] T. Deshane, Z. Shepherd, J.N. Matthews, M. Ben-Yehuda, A. Shah, and B. Rao, "Quantitative Comparison of Xen and KVM," Xen Summit Boston 2008, http://xen.org/xensummitxensummit_ summer_2008.html , 2010.
[11] Y. Dong, X. Yang, X. Li, J. Li, K. Tian, and H. Guan, "High Performance Network Virtualization with SR-IOV," Proc. IEEE 16th Int'l Symp. High Performance Computer Architecture (HPCA), pp. 1-10, 2010.
[12] S. Govindan, A.R. Nath, A. Das, B. Urgaonkar, and A. Sivasubramaniam, "Xen and Co.: Communication-Aware CPU Scheduling for Consolidated Xen-Based Hosting Platforms," Proc. ACM/USENIX Int'l Conf. Virtual Execution Environments, pp. 126-136, 2007.
[13] A. Gulati, A. Merchant, and P. Varman, "mClock: Handling throughput Variability for Hypervisor IO Scheduling," Proc. Ninth USENIX Symp. Operating System Design and Implementation (OSDI), 2010.
[14] D. Gupta, L. Cherkasova, R. Gardner, and A. Vahdat, "Enforcing Performance Isolation across Virtual Machines in Xen," Proc. ACM/IFIP/USENIX Seventh Int'l Conf. Middleware (Middleware), pp. 342-362, 2006.
[15] D. Gupta, R. Gardner, and L. Cherkasova, "XenMon: QoS Monitoring and Performance Profiling Tool," Technical Report HPL-2005-187, http://www.hpl.hp.com/techreports/2005 HPL-2005-187.html , 2010.
[16] M. Hines and K. Gopalan, "Post-Copy Based Live Virtual Machine Migration Using Adaptive Pre-Paging and Dynamic Self-Ballooning," Proc. ACM/USENIX Int'l Conf. Virtual Execution Environments, pp. 51-60, 2009.
[17] M. Kesavan, A. Gavrilovska, and K. Schwan, "Differential Virtual Time (DVT): Rethinking I/O Service Differentiation for Virtual Machines," Proc. ACM Symp. Cloud Computing (SOCC), pp. 27-38, 2010.
[18] H. Kim, H. Lim, J. Jeong, H. Jo, and J. Lee, "Task-Aware Virtual Machine Scheduling for I/O Performance," Proc. ACM/USENIX Int'l Conf. Virtual Execution Environments, pp. 101-110, 2009.
[19] Y. Koh, R. Knauerhase, P. Brett, M. Bowman, Z. Wen, and C. Pu, "An Analysis of Performance Interference Effects in Virtual Environments," Proc. IEEE Int'l Symp. Performance Analysis of Systems and Software (ISPASS), pp. 200-209, 2007.
[20] KVM, http://www.linux-kvm.org/pageMain_Page, 2012.
[21] M. Lee, A.S. Krishnakumar, P. Krishnan, N. Singh, and S. Yajnik, "Supporting Soft Real-Time Tasks in the Xen Hypervisor," Proc. ACM/USENIX Int'l Conf. Virtual Execution Environments, pp. 97-108, 2010.
[22] J.N. Matthews, W. Hu, M. Hapuarachchi, T. Deshane, D. Dimatos, G. Hamilton, M. McCabe, and J. Owens, "Quantifying the Performance Isolation Properties of Virtualization Systems," Proc. Workshop Experimental Computer Science, article 6, 2007.
[23] Y. Mei, L. Liu, X. Pu, and S. Sivathanu, "Performance Measurements and Analysis of Network I/O Applications in Virtualized Cloud," Proc. IEEE Int'l Conf. Cloud Computing, pp. 59-66, 2010.
[24] S. Meng, T. Wang, and L. Liu, "Monitoring Continuous State Violation in Datacenters: Exploring the Time Dimension," Proc. IEEE 26th Int'l Conf. Data Eng. (ICDE), pp. 968-979, 2010.
[25] A. Menon, A.L. Cox, and W. Zwaenepoel, "Optimizing Network Virtualization in Xen," Proc. USENIX Ann. Technical Conf. (ATC), pp. 15-28, 2006.
[26] A. Menon, J.R. Santos, Y. Turner, G.J. Janakiraman, and W. Zwaenepoel, "Diagnosing Performance Overheads in the Xen Virtual Machine Environment," Proc. ACM/USENIX Int'l Conf. Virtual Execution Environments (VEE), pp. 13-23, 2005.
[27] D. Mosberger and T. Jin, "Httperf-A Tool for Measuring Web Server Performance," ACM Sigmetrics Performance Evaluation Rev., vol. 26, no. 3, pp. 31-37, Dec. 1998.
[28] N. Nishiguchi, "Evaluation and Consideration of the Credit Scheduler for Client Virtualization," Xen Summit Asia, http://www.xen.org/xensummitxensummit_fall_2008.html , 2010.
[29] D. Ongaro, A.L. Cox, and S. Rixner, "Scheduling I/O in Virtual Machine Monitors," Proc. ACM/USENIX Int'l Conf. Virtual Execution Environments, pp. 1-10, 2008.
[30] P. Padala, X. Zhu, Z. Wang, S. Singhal, and K.G. Shin, "Performance Evaluation of Virtualization Technologies for Server Consolidation," Technical Report HPL-2007-59R1, http://www.hpl.hp.com/techreports/2007HPL-2007-59R1.html , 2010.
[31] F. Prefect, L. Doan, S. Gold, and W. Wilcke, "Performance Limiting Factors in Http (Web) Server Operations," Proc. IEEE 41st Int'l Computer Conf. (COMPCON '96), pp. 267-273, 1996.
[32] K.K. Ram, J.R. Santos, Y. Turner, A.L. Cox, and S. Rixner, "Achieving 10 Gb/s Using Safe and Transparent Network Interface Virtualization," Proc. ACM/USENIX Int'l Conf. Virtual Execution Environments, pp. 61-70, 2009.
[33] K.K. Ram, J.R. Santos, and Y. Turner, "Redesigning Xen's Memory Sharing Mechanism for Safe and Efficient I/O Virtualization," Technical Report HPL-2010-39, http://www.hpl.hp.com/ techreports/2010HPL-2010-39.html , 2010.
[34] A. Ranadive, M. Kesavan, A. Gavrilovska, and K. Schwan, "Performance Implications of Virtualizing Multicore Cluster Machines," Proc. Workshop System-Level Virtualization for High Performance Computing, pp. 1-8, 2008.
[35] C.P. Sapuntzakis, R. Chandra, B. Pfaff, J. Chow, M.S. Lam, and M. Rosenblum, "Optimizing the Migration of Virtual Computers," Proc. Fifth USENIX Symp. Operating Systems Design and Implementation (OSDI), pp. 377-390, 2002.
[36] S. Sivathanu, L. Liu, Y. Mei, and X. Pu, "Storage Management in Virtualized Cloud Environment," Proc. IEEE Int'l Conf. Cloud Computing, pp. 204-211, 2010.
[37] G. Somani and S. Chaudhary, "Application Performance Isolation in Virtualization," Proc. IEEE Int'l Conf. Cloud Computing, pp. 41-48, 2009.
[38] VMware, http:/www.vmware.com, 2012.
[39] J. Wang, K. Wright, and K. Gopalan, "XenLoop: A Transparent High Performance Inter-VM Network Loopback," Proc. 17th Int'l Symp. High Performance Distributed Computing (HPDC), pp. 109-118, 2008.
[40] T. Wood, L. Cherkasova, K. Ozonat, and P. Shenoy, "Profiling and Modeling Resource Usage of Virtualized Applications," Proc. ACM/IFIP/USENIX Ninth Int'l Conf. Middleware (Middleware), pp. 366-387, 2008.
[41] T. Wood, P.J. Shenoy, A. Venkataramani, and M.S. Yousif, "Black-Box and Gray-Box Strategies for Virtual Machine Migration," Proc. USENIX Symp. Networked Systems Design and Implementation (NSDI), pp. 229-242, 2007.
[42] D. Yixin, N. Gandhi, J.L. Hellerstein, S. Parekh, and D.M. Tilbury, "Using MIMO Feedback Control to Enforce Policies for Interrelated Metrics with Application to the Apache Web Server," Proc. IEEE/IFIP Network Operations and Management Symp. (NOMS), pp. 219-234, 2002.
5 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool