This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Cashing in on the Cache in the Cloud
Aug. 2012 (vol. 23 no. 8)
pp. 1387-1399
ASCII Text
x 
 
Hyuck Han, Young Choon Lee, Woong Shin, Hyungsoo Jung, Heon Y. Yeom, Albert Y. Zomaya, "Cashing in on the Cache in the Cloud," IEEE Transactions on Parallel and Distributed Systems, vol. 23, no. 8, pp. 1387-1399, Aug., 2012.
 
 
BibTex
x
 
@article{ 10.1109/TPDS.2011.297,
author = {Hyuck Han and Young Choon Lee and Woong Shin and Hyungsoo Jung and Heon Y. Yeom and Albert Y. Zomaya},
title = {Cashing in on the Cache in the Cloud},
journal ={IEEE Transactions on Parallel and Distributed Systems},
volume = {23},
number = {8},
issn = {1045-9219},
year = {2012},
pages = {1387-1399},
doi = {http://doi.ieeecomputersociety.org/10.1109/TPDS.2011.297},
publisher = {IEEE Computer Society},
address = {Los Alamitos, CA, USA},
}
 
 
RefWorks Procite/RefMan/Endnote
x 
 
TY - JOUR
JO - IEEE Transactions on Parallel and Distributed Systems
TI - Cashing in on the Cache in the Cloud
IS - 8
SN - 1045-9219
SP1387
EP1399
EPD - 1387-1399
A1 - Hyuck Han,
A1 - Young Choon Lee,
A1 - Woong Shin,
A1 - Hyungsoo Jung,
A1 - Heon Y. Yeom,
A1 - Albert Y. Zomaya,
PY - 2012
KW - Cloud computing
KW - cache as a service
KW - remote memory
KW - cost efficiency.
VL - 23
JA - IEEE Transactions on Parallel and Distributed Systems
ER -
 
Hyuck Han, Seoul National University, Seoul
Young Choon Lee, University of Sydney, Sydney
Woong Shin, Seoul National University, Seoul
Hyungsoo Jung, University of Sydney, Sydney
Heon Y. Yeom, Seoul National University, Seoul
Albert Y. Zomaya, University of Sydney, Sydney
Over the past decades, caching has become the key technology used for bridging the performance gap across memory hierarchies via temporal or spatial localities; in particular, the effect is prominent in disk storage systems. Applications that involve heavy I/O activities, which are common in the cloud, probably benefit the most from caching. The use of local volatile memory as cache might be a natural alternative, but many well-known restrictions, such as capacity and the utilization of host machines, hinder its effective use. In addition to technical challenges, providing cache services in clouds encounters a major practical issue (quality of service or service level agreement issue) of pricing. Currently, (public) cloud users are limited to a small set of uniform and coarse-grained service offerings, such as High-Memory and High-CPU in Amazon EC2. In this paper, we present the cache as a service (CaaS) model as an optional service to typical infrastructure service offerings. Specifically, the cloud provider sets aside a large pool of memory that can be dynamically partitioned and allocated to standard infrastructure services as disk cache. We first investigate the feasibility of providing CaaS with the proof-of-concept elastic cache system (using dedicated remote memory servers) built and validated on the actual system, and practical benefits of CaaS for both users and providers (i.e., performance and profit, respectively) are thoroughly studied with a novel pricing scheme. Our CaaS model helps to leverage the cloud economy greatly in that 1) the extra user cost for I/O performance gain is minimal if ever exists, and 2) the provider's profit increases due to improvements in server consolidation resulting from that performance gain. Through extensive experiments with eight resource allocation strategies, we demonstrate that our CaaS model can be a promising cost-efficient solution for both users and providers.

[1] L. Wang, J. Zhan, and W. Shi, "In Cloud, Can Scientific Communities Benefit from the Economies of Scale?," IEEE Trans. Parallel and Distributed Systems, vol. 23, no. 2, pp. 296-303, Feb. 2012.
[2] M.D. Dahlin, R.Y. Wang, T.E. Anderson, and D.A. Patterson, "Cooperative Caching: Using Remote Client Memory to Improve File System Performance," Proc. First USENIX Conf. Operating Systems Design and Implementation (OSDI '94), 1994.
[3] T.E. Anderson, M.D. Dahlin, J.M. Neefe, D.A. Patterson, D.S. Roselli, and R.Y. Wang, "Serverless Network File Systems," ACM Trans. Computer Systems, vol. 14, pp. 41-79, Feb. 1996.
[4] S. Jiang, K. Davis, and X. Zhang, "Coordinated Multilevel Buffer Cache Management with Consistent Access Locality Quantification," IEEE Trans. Computers, vol. 56, no. 1, pp. 95-108, Jan. 2007.
[5] H. Kim, H. Jo, and J. Lee, "XHive: Efficient Cooperative Caching for Virtual Machines," IEEE Trans. Computers, vol. 60, no. 1, pp. 106-119, Jan. 2011.
[6] A. Menon, J.R. Santos, Y. Turner, G.J. Janakiraman, and W. Zwaenepoel, "Diagnosing Performance Overheads in the Xen Virtual Machine Environment," Proc. First ACM/USENIX Int'l Conf. Virtual Execution Environments (VEE '05), 2005.
[7] L. Cherkasova and R. Gardner, "Measuring CPU Overhead for I/O Processing in the Xen Virtual Machine Monitor," Proc. Ann. Conf. USENIX Ann. Technical Conf. (ATC '05), 2005.
[8] J. Liu, W. Huang, B. Abali, and D.K. Panda, "High Performance VMM-Bypass I/O in Virtual Machines," Proc. Ann. Conf. USENIX Ann. Technical Conf. (ATC '06), 2006.
[9] A. Menon, A.L. Cox, and W. Zwaenepoel, "Optimizing Network Virtualization in Xen," Proc. Ann. Conf. USENIX Ann. Technical Conf. (ATC '06), 2006.
[10] P. Barham, B. Dragovic, K. Fraser, S. Hand, T. Harris, A. Ho, R. Neugebauer, I. Pratt, and A. Warfield, "Xen and the Art of Virtualization," Proc. 19th ACM Symp. Operating Systems Principles (SOSP '03), 2003.
[11] X. Zhang and Y. Dong, "Optimizing Xen VMM Based on Intel Virtualization Technology," Proc. IEEE Int'l Conf. Internet Computing in Science and Eng. (ICICSE '08), 2008.
[12] P. Willmann, J. Shafer, D. Carr, A. Menon, S. Rixner, A.L. Cox, and W. Zwaenepoel, "Concurrent Direct Network Access for Virtual Machine Monitors," Proc. IEEE 13th Int'l Symp. High Performance Computer Architecture (HPCA '07), 2007.
[13] Y. Dong, J. Dai, Z. Huang, H. Guan, K. Tian, and Y. Jiang, "Towards High-Quality I/O Virtualization," SYSTOR '09: Proc. Israeli Experimental Systems Conf., 2009.
[14] J.R. Santos, Y. Turner, G. Janakiraman, and I. Pratt, "Bridging the Gap Between Software and Hardware Techniques for I/O Virtualization," Proc. Ann. Conf. USENIX Ann. Technical Conf. (ATC '08), 2008.
[15] K. Lim, J. Chang, T. Mudge, P. Ranganathan, S.K. Reinhardt, and T.F. Wenisch, "Disaggregated Memory for Expansion and Sharing in Blade Servers," Proc. 36th Ann. Int'l Symp. Computer Architecture (ISCA '09), 2009.
[16] M. Marazakis, K. Xinidis, V. Papaefstathiou, and A. Bilas, "Efficient Remote Block-Level I/O over an RDMA-Capable NIC," Proc. 20th Ann. Int'l Conf. Supercomputing (ICS '06), 2006.
[17] J. Creasey, "Hybrid Hard Drives with Non-Volatile Flash and Longhorn," Proc. Windows Hardware Eng. Conf. (WinHEC), 2005.
[18] R. Harris, "Hybrid Drives: Not So Fast," ZDNet, CBS Interactive, 2007.
[19] E.R. Reid, "Drupal Performance Improvement via SSD Technology," technical report, Sun Microsystems, Inc., 2009.
[20] S.-W. Lee and B. Moon, "Design of Flash-Based DBMS: An In-Page Logging Approach," Proc. ACM SIGMOD Int'l Conf. Management of Data (SIGMOD '07), 2007.
[21] T. Makatos, Y. Klonatos, M. Marazakis, M.D. Flouris, and A. Bilas, "Using Transparent Compression to Improve SSD-Based I/O Caches," Proc. Fifth European Conf. Computer Systems (EuroSys '10), 2010.
[22] J.-U. Kang, J.-S. Kim, C. Park, H. Park, and J. Lee, "A Multi-Channel Architecture for High-Performance NAND Flash-Based Storage System," J. Systems Architecture, vol. 53, pp. 644-658, Sept. 2007.
[23] C. Park, P. Talawar, D. Won, M. Jung, J. Im, S. Kim, and Y. Choi, "A High Performance Controller for NAND Flash-Based Solid State Disk (NSSD)," Proc. IEEE Non-Volatile Semiconductor Memory Workshop (NVSMW '06), 2006.
[24] S. Kang, S. Park, H. Jung, H. Shim, and J. Cha, "Performance Trade-Offs in Using NVRAM Write Buffer for Flash Memory-Based Storage Devices," IEEE Trans. Computers, vol. 58, no. 6, pp. 744-758, June 2009.
[25] J. Ousterhout, P. Agrawal, D. Erickson, C. Kozyrakis, J. Leverich, D. Mazières, S. Mitra, A. Narayanan, G. Parulkar, M. Rosenblum, S.M. Rumble, E. Stratmann, and R. Stutsman, "The Case for RAMClouds: Scalable High-Performance Storage Entirely in DRAM," ACM SIGOPS Operating Systems Rev., vol. 43, pp. 92-105, Jan. 2010.
[26] R.P. Goldberg and R. Hassinger, "The Double Paging Anomaly," Proc. Int'l Computer Conf. and Exposition (AFIPS '74), 1974.
[27] C.A. Waldspurger, "Memory Resource Management in VMware ESX Server," Proc. Fifth USENIX Conf. Operating Systems Design and Implementation (OSDI '02), 2002.
[28] B. Urgaonkar, P.J. Shenoy, and T. Roscoe, "Resource Overbooking and Application Profiling in Shared Hosting Platforms," Proc. Fifth USENIX Conf. Operating Systems Design and Implementation (OSDI '02), 2002.
[29] A.V. Do, J. Chen, C. Wang, Y.C. Lee, A.Y. Zomaya, and B.B. Zhou, "Profiling Applications for Virtual Machine Placement in Clouds," Proc. IEEE Int'l Conf. Cloud Computing, 2011.
[30] S. Chen, A. Ailamaki, M. Athanassoulis, P.B. Gibbons, R. Johnson, I. Pandis, and R. Stoica, "TPC-E vs. TPC-C: Characterizing the New TPC-E Benchmark via an I/O Comparison Study," ACM SIGMOD Record, vol. 39, pp. 5-10, Feb. 2011.
[31] H. Liu, H. Jin, X. Liao, C. Yu, and C.-Z. Xu, "Live Virtual Machine Migration via Asynchronous Replication and State Synchronization," IEEE Trans. Parallel and Distributed Systems, vol. 22, no. 12, pp. 1986-1999, Dec. 2011.
[32] G. Jung, M. Hiltunen, K. Joshi, R. Schlichting, and C. Pu, "Mistral: Dynamically Managing Power, Performance, and Adaptation Cost in Cloud Infrastructures," Proc. IEEE 30th Int'l Conf. Distributed Computing Systems (ICDCS '10), pp. 62-73, 2010.

Index Terms:
Cloud computing, cache as a service, remote memory, cost efficiency.
Citation:
Hyuck Han, Young Choon Lee, Woong Shin, Hyungsoo Jung, Heon Y. Yeom, Albert Y. Zomaya, "Cashing in on the Cache in the Cloud," IEEE Transactions on Parallel and Distributed Systems, vol. 23, no. 8, pp. 1387-1399, Aug. 2012, doi:10.1109/TPDS.2011.297
Usage of this product signifies your acceptance of the Terms of Use.