Issue No. 02 - July-December (2013 vol. 1)
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/TCC.2013.12
Zhonghong Ou , Aalto University, Espoo
Hao Zhuang , EPFL, Lausanne
Andrey Lukyanenko , Aalto University, Espoo
Jukka K. Nurminen , Aalto University, Espoo
Pan Hui , The Hong Kong University of Science and Technology, Hong Kong and Telekom Innovation Laboratories, Berlin
Vladimir Mazalov , KRC of Russian Academy of Sciences, Karelia
Antti Yla-Jaaski , Alato University, Espoo
Public cloud platforms might start with homogeneous hardware; nevertheless, because of inevitable hardware upgrades, or adding more capacity, the initial homogeneous platform will gradually evolve into heterogeneous as time passes by. The consequent performance heterogeneity is of concern to cloud users. In this paper, we evaluate performance variations from hardware heterogeneity and scheduling mechanisms of public clouds. Amazon Elastic Compute Cloud (Amazon EC2) and Rackspace Cloud are used as the representatives because of their relatively long record and wide usage among small and medium enterprises (SMEs). A comprehensive set of microbenchmarks and application-level macrobenchmarks have been used to investigate performance variation. Several major contributions have been made. First, we find out that heterogeneous hardware is a commonality among the relatively long-lasting cloud platforms, although the level of heterogeneity varies. Second, we observe that heterogeneous hardware is the primary culprit of performance variation of cloud platforms. Third, we discover that varied CPU acquisition percentages and different virtual machine scheduling mechanisms exacerbate the performance variation problem, especially for network related operations. Finally, based on the observations, we propose cost-saving approaches and analyze Nash equilibrium from cloud user perspective. By using a simple "trial-and-betterâ' approach, i.e., keep good-performing instances and discard bad-performing instances, cloud users can achieve up to 30 percent cost saving.
Hardware, Central Processing Unit, Servers, Virtual machine monitors, Benchmark testing, Cloud computing
Z. Ou et al., "Is the Same Instance Type Created Equal? Exploiting Heterogeneity of Public Clouds," in IEEE Transactions on Cloud Computing, vol. 1, no. 2, pp. 201-214, 2013.