loading...
 This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
19th International Conference on Scientific and Statistical Database Management (SSDBM 2007)
Window-Oblivious Join: A Data-Driven Memory Management Scheme for Stream Join
Banff, Alberta, Canada
July 09-July 11
ISBN: 0-7695-2868-6
Ji Wu, National University of Singapore, Singapore
Kian-Lee Tan, National University of Singapore, Singapore
Yongluan Zhou, National University of Singapore, Singapore
Memory management is a critical issue in stream processing involving stateful operators such as join. Traditionally, the memory requirement for a stream join is query-driven: a query has to explicitly define a window for each (potentially unbounded) input. The window essentially bounds the size of the buffer allocated for that stream. However, outputs produced by such approach may not be desirable (if the window size is not part of the intended query semantic) due to the volatile input characteristics. We discover that when streams are ordered or partially ordered, it is possible to use a data-driven memory management scheme for improved performance. In this work, we present a novel data-driven memory management scheme, called Window-Oblivious Join (WO-Join), which adaptively adjusts the state buffer size according to the input characteristics. Our performance study shows that, compared to traditional Window-Join (W-Join), WO-Join is more robust with respect to the dynamic inputs and therefore produces higher quality results with lower memory costs.
Citation:
Ji Wu, Kian-Lee Tan, Yongluan Zhou, "Window-Oblivious Join: A Data-Driven Memory Management Scheme for Stream Join," ssdbm, pp.21, 19th International Conference on Scientific and Statistical Database Management (SSDBM 2007), 2007
Usage of this product signifies your acceptance of the Terms of Use.