This Article 
 Bibliographic References 
 Add to: 
Scalable Consistency Maintenance in Content Distribution Networks Using Cooperative Leases
July/August 2003 (vol. 15 no. 4)
pp. 813-828

Abstract—In this paper, we argue that cache consistency mechanisms designed for stand-alone proxies do not scale to the large number of proxies in a content distribution network and are not flexible enough to allow consistency guarantees to be tailored to object needs. To meet the twin challenges of scalability and flexibility, we introduce the notion of cooperative consistency along with a mechanism, called cooperative leases, to achieve it. By supporting \Delta{\hbox{-}}{\rm{consistency}} semantics and by using a single lease for multiple proxies, cooperative leases allow the notion of leases to be applied in a flexible, scalable manner to CDNs. Further, the approach employs application-level multicast to propagate server notifications to proxies in a scalable manner. We implement our approach in the Apache Web server and the Squid proxy cache and demonstrate its efficacy using a detailed experimental evaluation. Our results show a factor of 2.5 reduction in server message overhead and a 20 percent reduction in server state space overhead when compared to original leases albeit at an increased interproxy communication overhead.

[1] Akamai Technologies, Inc.,http:/, 2003.
[2] L. Breslau, P. Cao, L. Fan, G. Phillips, and S. Shenker, Web Caching and Zipf-Like Distributions: Evidence and Implications Proc. Infocom '99, Mar. 1999.
[3] M. Busari and C. Williamson, On the Sensitivity of Web Proxy Cache Performance to Workload Characteristics Proc. IEEE Infocom '01, Apr. 2001.
[4] P. Cao and C. Liu, Maintaining Strong Cache Consistency in the World-Wide Web Proc. 17th Int'l Conf. Distributed Computing Systems, May 1997.
[5] V. Cate, Alex: A Global File System Proc. 1992 USENIX File System Workshop, pp. 1-12, May 1992.
[6] J. Dilley, M. Arlitt, S. Perret, and T. Jin, The Distributed Object Consistency Protocol technical report, Hewlett-Packard Labs Technical Reports, 1999.
[7] V. Duvvuri, P. Shenoy, and R. Tewari, Adaptive Leases: A Strong Consistency Mechanism for the World Wide Web Proc. IEEE Infocom '00, Mar. 2000.
[8] L. Fan, P. Cao, J. Almeida, and A.Z. Broder, Summary Cache: A Scalable Wide-Area Web Cache Sharing Protocol Proc. ACM SIGCOMM '98, pp. 254-265, Sept. 1998.
[9] Z. Fei, A Novel Approach to Managing Consistency in Content Distribution Networks Proc. Sixth Workshop Web Caching and Content Distribution, June 2001.
[10] P. Francis, Yoid: Extending the Internet Multicast Architecture technical report, AT&T Center for Internet Research at ICSI (ACIRI), Apr. 2000.
[11] S. Gadde, J. Chase, and M Rabinovich, Web Caching and Content Distribution: A View From the Interior Proc. Fifth Int'l Web Caching and Content Delivery Workshop, 2000.
[12] C. Gray and D. Cheriton, Leases: An Efficient Fault-Tolerant Mechanism for Distributed File Cache Consistency Proc. 12th ACM Symp. Operating Systems Principles, pp. 202-210, 1989.
[13] M. Gritter and D.R. Cheriton, An Architecture for Content Routing Support in the Internet Proc. USENIX Symp. Internet Technologies, Mar. 2001.
[14] J. Gwertzman and M. Seltzer, World-Wide Web Cache Consistency Proc. 1996 USENIX Technical Conf., Jan. 1996.
[15] D. Karger, E. Lehman, T. Leighton, M. Levine, D. Lewin, and R. Panigrahy, Consistent Hashing and Random Trees: Distributed Caching Protocols for Relieving Hot Spots on the World Wide Web Proc. 29th ACM Symp. Theory of Computing, 1997.
[16] D. Katabi and J. Wroclawski, A Framework for Scalable Global IP-Anycast Proc. ACM SIGCOMM, pp. 3-15, Aug. 2000.
[17] B. Krishnamurthy and C. Wills, Study of Piggyback Cache Validation for Proxy Caches in the WWW Proc. 1997 USENIX Symp. Internet Technology and Systems, pp. 1-12, Dec. 1997.
[18] D. Li, P. Cao, and M. Dahlin, WCIP: Web Cache Invalidation Protocol IETF Internet Draft, Nov. 2000.
[19] J.C. Mogul, F. Douglis, A. Feldmann, and B. Krishnamurthy, Potential Benefits of Delta Encoding and Data Compression for HTTP Proc. ACM SIGCOMM Conf., 1997.
[20] A. Ninan, Maintaining Cache Consistency in Content Distribution Networks master's thesis, Dept. of Computer Science, Univ. of Massachusetts, June 2001.
[21] G. Pierre, M. van Steen, and A. Tanenbaum, Dynamically Selecting Optimal Distribution Strategies for Web Documents IEEE Trans. Computers, vol. 51, no. 6, pp. 637-651, June 2002.
[22] A. Shaikh, R. Tewari, and M. Agrawal, On the Effectveness of DNS-Based Server Selection Proc. IEEE Infocom, Apr. 2001.
[23] R. Srinivasan, C. Liang, and K. Ramamritham, Maintaining Temporal Coherency of Virtual Warehouses Proc. 19th IEEE Real-Time Systems Symp. (RTSS '98), Dec. 1998.
[24] R. Tewari, M. Dahlin, H.M. Vin, and J. Kay, Beyond Hierarchies: Design Considerations for Distributed Caching on the Internet Proc. 19th Int'l Conf. Distributed Computing Systems (ICDCS), June 1999.
[25] B. Urgaonkar, A. Ninan, M. Raunak, P. Shenoy, and K. Ramamritham, Maintaining Mutual Consistency for Cached Web Objects Proc. 21st Int'l Conf. Distributed Computing Systems (ICDCS-21), pp. 371-380, Apr. 2001.
[26] A. Venkataramani, P. Yalagandula, R. Kokku, S. Sharif, and M. Dahlin, Potential Costs and Benefits of Long-Term Prefetching for Content Distribution Proc. Web Caching Worskhop, June 2001.
[27] J. Yin, L. Alvisi, M. Dahlin, and A. Iyengar, Engineering Server-Driven Consistency for Large-Scale Dynamic Web Services Proc. 10th World Wide Web Conf., May 2001.
[28] J. Yin, L. Alvisi, M. Dahlin, and C. Lin, Volume Leases for Consistency in Large-Scale Systems IEEE Trans. Knowledge and Data Eng., Jan. 1999.
[29] J. Yin, L. Alvisi, M. Dahlin, and C. Lin, Hierarchical Cache Consistency in a WAN Proc. USENIX Symp. Internet Technologies and Systems, Oct. 1999.
[30] H. Yu, L. Breslau, and S. Shenker, A Scalable Web Cache Consistency Architecture Proc. ACM SIGCOMM '99, Sept. 1999.

Index Terms:
Dynamic data, data consistency, data dissemination, World Wide Web, scalability, leases, push, pull, content distribution networks.
Anoop George Ninan, Purushottam Kulkarni, Prashant Shenoy, Krithi Ramamritham, Renu Tewari, "Scalable Consistency Maintenance in Content Distribution Networks Using Cooperative Leases," IEEE Transactions on Knowledge and Data Engineering, vol. 15, no. 4, pp. 813-828, July-Aug. 2003, doi:10.1109/TKDE.2003.1209001
Usage of this product signifies your acceptance of the Terms of Use.