This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Time-Stamp Management and Query Execution in Data Stream Management Systems
November/December 2008 (vol. 12 no. 6)
pp. 13-21
Yijian Bai, Google
Hetal Thakkar, University of California, Los Angeles
Haixun Wang, IBM T.J. Watson Research Center
Carlo Zaniolo, University of California, Los Angeles
Relational query languages can effectively express continuous queries on data streams after modest extensions. However, implementing such queries efficiently in data stream management systems requires major changes in execution models and optimization techniques. In particular, finer-granularity execution models that are conducive to effective time-stamp management and response-time optimization must replace databases' relational algebra schemes. This article introduces such a model and uses it to solve the idle-waiting problems of data stream operators, such as unions, joins, and aggregates over windows with slides.

1. B. Babcock et al., "Models and Issues in Data Stream Systems," Proc. 21st ACM Symp. Principles of Database Systems (PODS 02), ACM Press, 2002, pp. 1–16.
2. Y.-N. Law, H. Wang, and C. Zaniolo, "Query Languages and Data Models for Database Sequences and Data Streams," Proc. 30th Int'l Conf. Very Large Databases (VLDB 04), VLDB Endowment, 2004, pp. 492–503.
3. T. Johnson et al., "A Heartbeat Mechanism and its Application in Gigascope," Proc. 31st Conf. Very Large Databases (VLDB 05), VLDB Endowment, 2005, pp. 1079–1088.
4. Y. Bai et al., "A Data Stream Language and System Designed for Power and Extensibility," Proc. 15th ACM Int'l Conf. Information and Knowledge Management, (CIKM 06), ACM Press, 2006, pp. 337–346.
5. J. Kang, J.F. Naughton, and S. Viglas, "Evaluating Window Joins over Unbounded Streams," Proc. IEEE Int'l Conf. Data Eng. (ICDE 03), IEEE CS Press, 2003, pp. 341–352.
6. J. Li et al., "Semantics and Evaluation Techniques for Window Aggregates in Data Streams," Proc. 2005 ACM SIGMOD Int'l Conf. Management of Data, (SIGMOD 05), ACM Press, 2005, pp. 311–322.
7. S. Roger et al., "Consistent Streaming through Time: A Vision for Event Stream Processing," Proc. 3rd Biennial Conf. Innovative Data Systems Research (CIDR 07), 2007, pp. 363–374; www-db.cs.wisc.edu/cidr/cidr2007/paperscidr07p42.pdf .
1. T. Johnson et al., "A Heartbeat Mechanism and Its Application in Gigascope," Proc. 31st Conf. Very Large Databases (VLDB 05), VLDB Endowment, 2005, pp. 1079–1088.
2. P.A. Tucker et al., "Exploiting Punctuation Semantics in Continuous Data Streams," IEEE Trans. Knowledge and Data Eng., vol. 15, no. 3, 2003, pp. 555–568.
3. L. Ding and E.A. Rundensteiner, "Evaluating Window Joins Over Punctuated Streams," Proc. 13th ACM Int'l Conf. Information and Knowledge Management, (CIKM 04), ACM Press, 2004, pp. 98–107.
4. U. Srivastava and J. Widom, "Flexible Time Management in Data Stream Systems," Proc. 23rd ACM SIGMOD-SIGACT-SIGART Symp. Principles of Database Systems, (PODS 04), ACM Press, 2004, pp. 263–274.
5. H. Balakrishnan et al., "Retrospective on Aurora," Very Large Databases J., vol. 13, no. 4, 2004, pp. 370–383.
6. Y. Bai et al., "Optimizing Time Stamp Management in Data Stream Management Systems," Proc. 23rd IEEE Int'l Conf. Data Eng., (ICDE 07), IEEE CS Press, 2007, pp. 1334–1338.
7. S. Chakravarthy and D. Mishra, "Snoop: An Expressive Event Specification Language for Active Databases," Data Knowledge Eng., vol. 14, no. 1, 1994, pp. 1–26.
8. Y. Bai et al., "A Flexible Query Graph-Based Model for the Efficient Execution of Continuous Queries," Proc. 23rd IEEE Int'l Conf. Data Eng., (ICDE 07), IEEE CS Press, 2007, pp. 634–643.
9. Y. Bai et al., "RFID Data Processing with a Data Stream Query Language," Proc. 23rd IEEE Int'l Conf. Data Eng., (ICDE 07), IEEE CS Press, 2007, pp. 1184–1193.

Index Terms:
continuous queries, relational data streams, response time optimization, data stream management
Citation:
Yijian Bai, Hetal Thakkar, Haixun Wang, Carlo Zaniolo, "Time-Stamp Management and Query Execution in Data Stream Management Systems," IEEE Internet Computing, vol. 12, no. 6, pp. 13-21, Nov.-Dec. 2008, doi:10.1109/MIC.2008.133
Usage of this product signifies your acceptance of the Terms of Use.