This Article 
 Bibliographic References 
 Add to: 
Resilient and Coherence Preserving Dissemination of Dynamic Data Using Cooperating Peers
July 2004 (vol. 16 no. 7)
pp. 799-812

Abstract—The focus of our work is to design and build a dynamic data distribution system that is coherence-preserving, i.e., the delivered data must preserve associated coherence requirements (the user-specified bound on tolerable imprecision) and resilient to failures. To this end, we consider a system in which a set of repositories cooperate with each other and the sources, forming a peer-to-peer network. In this system, necessary changes are pushed to the users so that they are automatically informed about changes of interest. We present techniques 1) to determine when to push an update from one repository to another for coherence maintenance, 2) to construct an efficient dissemination tree for propagating changes from sources to cooperating repositories, and 3) to make the system resilient to failures. An experimental evaluation using real world traces of dynamically changing data demonstrates that 1) careful dissemination of updates through a network of cooperating repositories can substantially lower the cost of coherence maintenance, 2) unless designed carefully, even push-based systems experience considerable loss in fidelity due to message delays and processing costs, 3) the computational and communication cost of achieving resiliency can be made to be low, and 4) surprisingly, adding resiliency can actually improve fidelity even in the absence of failures.

[1] G. Banavar, T. Chandra, B. Mukherjee, J. Nagarajarao, R.E. Strom, and D.C. Sturman, “An Efficient Multicast Protocol for Content-Based Publish-Subscribe Systems,” Proc. Int'l Conf. Distributed Computing Systems, 1999.
[2] A. Bestavros, “Speculative Data Dissemination and Service to Reduce Server Load, Network Traffic and Service Time in Distributed Information Systems,” Proc. Int'l Conf. Data Eng., Mar. 1996.
[3] M. Bhide, P. Deolasse, A. Katker, A. Panchgupte, K. Ramamritham, and P. Shenoy, Adaptive Push Pull: Disseminating Dynamic Web Data IEEE Trans. Computers, special issue on quality of service, 2002.
[4] P. Cao and S. Irani, Cost-Aware WWW Proxy Caching Algorithms Proc. USENIX Symp. Internet Technologies and Systems, Dec. 1997.
[5] A. Chankhunthod, P.B. Danzig, C. Neerdaels, M.F. Schwartz, and K.J. Worell, A Hierarchical Internet Object Cache Proc. 1996 USENIX Technical Conf., Jan. 1996.
[6] J. Chen, D. Dewitt, F. Tian, and Y. Wang, NiagraCQ: A Scalable Continuous Query System for Internet Databases Proc. 2000 ACM SIGMOD Int'l Conf. Management of Data, 2000.
[7] V. Duvvuri, P. Shenoy, and R. Tewari, Adaptive Leases: A Strong Consistency Mechanism for the World Wide Web Proc. InfoCom, Mar. 2000.
[8] A. Fei, G. Pei, R. Liu, and L. Zhang, Measurements on Delay and Hop-Count of the Internet Proc. IEEE GLOBECOM '98 Internet Mini-Conf., 1998.
[9] Z. Fei, A Novel Approach to Managing Consistency in Content Distribution Networks Proc. Sixth Int'l Workshop Web Caching and Content Distribution, 2001.
[10] A. Fox et al., "Adapting to Network and Client Variation Using Active Proxies: Lessons and Perspectives," IEEE Personal Comm., Aug. 1998, pp. 10-19.
[11] J. Gwertzman and M. Seltzer, "The Case for Geographical Push Caching," Proc. Workshop Hot Operating Systems, 1995.
[12] G. Iannaccone, C. Chuah, R. Mortier, S. Bhattacharya, and C. Diot, Analysis of Link Failures in an IP Backbone Proc. Internet Measurement Workshop, 2002.
[13] A. Iyengar and J. Challenger, Improving Web Server Performance by Caching Dynamic Data Proc. USENIX Symp. Internet Technologies and Systems, 1997.
[14] D. Li and D. Cheriton, Scalable Web Caching of Frequently Updated Objects Using Reliable Multicast Proc. USENIX Symp. Internet Technologies and Systems, 1999.
[15] C. Liu and P. Cao, "Maintaining Strong Cache Consistency in the World-Wide Web," Proc. Int'l Conf. Distributed Computing Systems, 1997.
[16] L. Liu, C. Pu, and W. Tang, “Continual Queries for Internet Scale Event-Driven Information Delivery,” IEEE Trans. Knowledge and Data Eng., July/Aug. 1999.
[17] G.R. Malan, F. Jahanian, and S. Subramanian, Salamander: A Push Based Distribution Substrate for Internet Applications Proc. USENIX Symp. Internet Technologies and Systems, Dec. 1997.
[18] http://www.openclinical.orgaispi_neoganesh.html , 2003.
[19] A. Ninan, P. Kulkarni, P. Shenoy, K. Ramamritham, and R. Tewari, Cooperative Leases: Scalable Consistency Maintenance in Content Distribution Networks Proc. Proc. World Wide Web Conf. (WWW10), May 2002.
[20] C. Olston and J. Widom, Best Effort Cache Synchronization with Source Cooperation Proc. ACM SIGMOD Conf., June 2002.
[21] C. Olston, B.T. Loo, and J. Widom, Adaptive Precision Setting for Cached Approximate Values Proc. ACM SIGMOD Conf., May 2001.
[22] M.S. Raunak, P.J. Shenoy, P. Goyal, and K. Ramamritham, Implications of Proxy Caching for Provisioning Networks and Servers Proc. ACM SiGMETRICS Conf., pp. 66-77, 2000.
[23] P. Rodriguez, K.W. Ross, and E.W. Biersack, Improving the WWW: Caching or Multicast? Computer Networks and ISDN Systems, 1998.
[24] S. Shah, K. Ramamritham, and P. Shenoy, Maintaining Coherency of Dynamic Data in Cooperating Repositories Proc. 28th Conf. Very Large Data Bases, Aug. 2002.
[25] S. Shah, S. Dharmarajan, and K. Ramamritham, An Efficient and Resilient Approach to Filtering and Disseminating Dynamic Data Proc. 29th Conf. Very Large Data Bases, Sept. 2003.
[26] R. Tewari, M. Dahlin, H. Vin, and J. Kay, Beyond Hierarchies: Design Considerations for Distributed Caching on the Internet Proc. IEEE Int'l Conf. Distributed Computing Systems, 1999.
[27] J. Yin, L. Alvisi, M. Dahlin, C. Lin, and A. Iyengar, Engineering Server Driven Consistency for Large Scale Dynamic Web Services Proc. World Wide Web Conf. (WWW10), 2001.
[28] J. Yin, L. Alvisi, M. Dahlin, and C. Lin, Hierarchical Cache Consistency in a WAN Proc. USENIX Symp. Internet Technologies and Systems, 1999.
[29] H. Yu and A. Vahdat, Design and Evaluation of a Continuous Consistency Model for Replicated Services Proc. Fourth Symp. Operating Systems Design and Implementation (OSDI), Oct. 2000.

Index Terms:
Resiliency, dynamic data dissemination, data coherence, cooperation.
Shetal Shah, Krithi Ramamritham, Prashant Shenoy, "Resilient and Coherence Preserving Dissemination of Dynamic Data Using Cooperating Peers," IEEE Transactions on Knowledge and Data Engineering, vol. 16, no. 7, pp. 799-812, July 2004, doi:10.1109/TKDE.2004.1318563
Usage of this product signifies your acceptance of the Terms of Use.