This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
2009 International Conference on Scalable Computing and Communications; Eighth International Conference on Embedded Computing
Towards Generic and Efficient Distributed Top-k Monitoring
Dalian, China
September 25-September 27
ISBN: 978-0-7695-3825-9
Monitoring data streams in a distributed system is the focus of much research in recent years. This paper addresses the generic and efficient processing of distributed top-k monitoring, which is continuously reporting the k largest values according to a user-specified aggregation function over distributed data streams. In practice, the user-specified aggregation function would be arbitrary function. Unfortunately, state-of-art distributed top-k monitoring approaches only support the sum function as the aggregation function. In this paper, we present a generic algorithm for distributed top-k monitoring, which supports not only the sum function but also min, max, count, average, and their compounds. These functions are the most general aggregation functions. In our algorithm, two kinds of arithmetic constraints are maintained at remote stream sources to ensure that the most recently provided top-k answer remains valid to within a user-specified error tolerance. Theoretical analyses results show that, in our algorithm, distributed communication is only necessary on occasion and few objects are necessary transmitted, when constraints are violated, and the communication cost is independent of k.
Index Terms:
top-k, data streams, monitoring, distributed system
Citation:
Biao Shi, Bo Deng, Li-mei Liu, Xian-cheng Zhou, "Towards Generic and Efficient Distributed Top-k Monitoring," scalcom-embeddedcom, pp.257-262, 2009 International Conference on Scalable Computing and Communications; Eighth International Conference on Embedded Computing, 2009
Usage of this product signifies your acceptance of the Terms of Use.