2009 Tenth International Conference on Mobile Data Management: Systems, Services and Middleware Knowing When to Slide - Efficient Scheduling for Sliding Window Processing Taipei, Taiwan May 18-May 20 ISBN: 978-0-7695-3650-7
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/MDM.2009.31
We consider sliding window query execution scheduling in stream processing engines. Sliding windows are an essential building block to limit the query focus at a particular part of the stream, based either on value count or time ranges. These so called sliding window predicates specify the execution condition for the query. Due to the often massive amount of registered queries, efficient algorithms to check these predicates are essential. While there exists a comprehensive set of works on the stream processing techniques, the actual algorithms to intelligently decide on the sliding behaviors is not extensively addressed in the existing works. In this paper we propose a set of algorithms for managing and sharing sliding decisions. This work introduces the concept of the batch sliding and sliding graphs to improve the sliding decision of the stream processing engines. Our algorithms can be efficiently used in large-scale stream processing systems where data arrives at high rates and a large number of user queries are registered to these data streams. Our evaluation results show the suitability of this approach in the real world applications.
Index Terms:
Middleware, Stream Processing, Environmental Science, Financial Markets, Optimization
Citation:
Ali Salehi, Mehdi Riahi, Sebastian Michel, Karl Aberer, "Knowing When to Slide - Efficient Scheduling for Sliding Window Processing," mdm, pp.202-211, 2009 Tenth International Conference on Mobile Data Management: Systems, Services and Middleware, 2009 Usage of this product signifies your acceptance of the Terms of Use. | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||