The Community for Technology Leaders
RSS Icon
Subscribe
Atlanta, GA, USA
April 3, 2006 to April 7, 2006
ISBN: 0-7695-2570-9
pp: 57
Graham Cormode , Bell Laboratories
S. Muthukrishnan , Rutgers University
Wei Zhuang , Rutgers University
ABSTRACT
Emerging applications in sensor systems and network-wide IP traffic analysis present many technical challenges. They need distributed monitoring and continuous tracking of events. They have severe resource constraints not only at each site in terms of per-update processing time and archival space for highspeed streams of observations, but also crucially, communication constraints for collaborating on the monitoring task. These elements have been addressed in a series of recent works. <p>A fundamental issue that arises is that one cannot make the "uniqueness" assumption on observed events which is present in previous works, since widescale monitoring invariably encounters the same events at different points. For example, within the network of an Internet Service Provider packets of the same flow will be observed in different routers; similarly, the same individual will be observed by multiple mobile sensors in monitoring wild animals. Aggregates of interest on such distributed environments must be resilient to duplicate observations.</p> <p>We study such duplicate-resilient aggregates that measure the extent of the duplication―how many unique observations are there, how many observations are unique―as well as standard holistic aggregates such as quantiles and heavy hitters over the unique items. We present accuracy guaranteed, highly communication-efficient algorithms for these aggregates that work within the time and space constraints of high speed streams. We also present results of a detailed experimental study on both real-life and synthetic data.</p>
INDEX TERMS
null
CITATION
Graham Cormode, S. Muthukrishnan, Wei Zhuang, "What?s Different: Distributed, Continuous Monitoring of Duplicate-Resilient Aggregates on Data Streams", ICDE, 2006, 22nd International Conference on Data Engineering, 22nd International Conference on Data Engineering 2006, pp. 57, doi:10.1109/ICDE.2006.173
15 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool