The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.02 - February (2009 vol.21)
pp: 234-252
Jinwon Lee , KAIST, Daejeon
Seungwoo Kang , KAIST, Deajeon
Youngki Lee , KAIST, Daejeon
Sang Jeong Lee , KAIST, Daejeon
Junehwa Song , KAIST, Daejeon
ABSTRACT
In this paper, we present BMQ-Processor, a high-performance Border-Crossing Event (BCE) detection framework for large-scale monitoring applications. We first characterize a new query semantics, namely, Border Monitoring Query (BMQ), which is useful for BCE detection in many monitoring applications. It monitors the values of data streams and reports them only when data streams cross the borders of its range. We then propose BMQ-Processor to efficiently handle a large number of BMQs over a high volume of data streams. BMQ-Processor efficiently processes BMQs in a shared and incremental manner. It develops and operates over a novel stateful query index, achieving a high level of scalability over continuous data updates. Also, it utilizes the locality embedded in data streams and greatly accelerates successive BMQ evaluations. We present data structures and algorithms to support 1D as well as multidimensional BMQs. We show that the semantics of border monitoring can be extended toward more advanced ones and build region transition monitoring as a sample case. Lastly, we demonstrate excellent processing performance and low storage cost of BMQ-Processor through extensive analysis and experiments.
INDEX TERMS
Data stream processing, event-based system, stateful query index, BMQ-Index, incremental processing, border monitoring, region transition monitoring, mobile environment, sensor network.
CITATION
Jinwon Lee, Seungwoo Kang, Youngki Lee, Sang Jeong Lee, Junehwa Song, "BMQ-Processor: A High-Performance Border-Crossing Event Detection Framework for Large-Scale Monitoring Applications", IEEE Transactions on Knowledge & Data Engineering, vol.21, no. 2, pp. 234-252, February 2009, doi:10.1109/TKDE.2008.140
REFERENCES
[1] D.J. Abadi, S. Madden, and W. Lindner, “REED: Robust, Efficient Filtering and Event Detection in Sensor Networks,” Proc. 31st Int'l Conf. Very Large Data Bases (VLDB), 2005.
[2] D.J. Abadi, D. Carney, U. Cetintemel, M. Cherniack, C. Convey, S. Lee, M. Stonebraker, N. Tatbul, and S. Zdonik, “Aurora: A New Model and Architecture for Data Stream Management,” The VLDB J., vol. 12, no. 2, pp. 120-139, Aug. 2003.
[3] I.F. Akyildiz, W. Su, Y. Sankarasubramaniam, and E. Cayirci, “A Survey on Sensor Networks,” IEEE Comm. Magazine, vol. 40, no. 8, pp. 102-114, Aug. 2002.
[4] A. Arasu, S. Babu, and J. Widom, “The CQL Continuous Query Language: Semantic Foundations and Query Execution,” The VLDB J., vol. 15, no. 2, pp. 121-142, June 2006.
[5] I. Biswas, “A Composite Event Definition Language and Detection System for the Integration Rules Environment,” master's thesis, Arizona State Univ., May 2005.
[6] A. Carzaniga, D.S. Rosenblum, and A.L. Wolf, “Design and Evaluation of a Wide-Area Event Notification Service,” ACM Trans. Computer Systems, vol. 19, no. 3, pp. 332-383, 2001.
[7] S. Chakravarthy and R. Adaikkalavan, “Ubiquitous Nature of Event-Driven Approaches: A Retrospective View,” position paper, Proc. Dagstuhl Seminar 07191, 2007.
[8] S. Chakravarthy, V. Krishnaprasad, E. Anwar, and S.-K. Kim, “Composite Events for Active Databases: Semantics, Contexts and Detection,” Proc. 20th Int'l Conf. Very Large Data Bases (VLDB), 1994.
[9] S. Chakravarthy, E. Anwar, L. Maugis, and D. Mishra, “Design of Sentinel: An Object-Oriented DBMS with Event-Based Rules,” Information and Software Technology, vol. 36, no. 9, pp. 559-568, 1994.
[10] S. Chandrasekaran and M.J. Franklin, “Streaming Queries over Streaming Data,” Proc. 28th Int'l Conf. Very Large Data Bases (VLDB), 2002.
[11] J. Chen, D. DeWitt, F. Tian, and Y. Wang, “NiagaraCQ: A Scalable Continuous Query System for Internet Databases,” Proc. ACM SIGMOD, 2000.
[12] K. Cho, I. Hwang, S. Kang, B. Kim, J. Lee, S. Lee, S. Park, Y. Rhee, and J. Song, “HiCon: A Hierarchical Context Monitoring and Composition Framework for Next Generation Context-Aware Services,” IEEE Network, July 2008.
[13] A. Demers, J. Gehrke, and B. Panda, “Cayuga: A General Purpose Event Monitoring System,” Proc. Third Biennial Conf. Innovative Data Systems Research (CIDR), 2007.
[14] L. Elkhalifa, R. Adaikkalavan, and S. Chakravarthy, “InfoFilter: A System for Expressive Pattern Specification and Detection over Text Streams,” Proc. ACM Symp. Applied Computing (SAC), 2005.
[15] C.L. Forgy, “Rete: A Fast Algorithm for the Many Pattern/Many Object Pattern Match Problem,” Artificial Intelligence, vol. 19, no. 1, pp. 17-37, Sept. 1982.
[16] V. Garg, R. Adaikkalavan, and S. Chakravarthy, “Extensions to Stream Processing Architecture for Supporting Event Processing,” Proc. 17th Int'l Workshop Database and Expert Systems Applications (DEXA), 2006.
[17] S. Gatziu and K.R. Dittrich, “SAMOS: An Active Object-Oriented Database System,” IEEE Quarterly Bull. Data Eng., vol. 15, nos. 1-4, Dec. 1992.
[18] N. Gehani and H.V. Jagadish, “Ode as an Active Database: Constraints and Triggers,” Proc. 17th Int'l Conf. Very Large Data Bases (VLDB), 1991.
[19] L. Golab and M. Tamer Ozsu, “Data Stream Management Issues—A Survey,” ACM SIGMOD Record, 2003.
[20] R.E. Gruber, B. Krishnamurthy, and E. Panagos, “The Architecture of the READY Event Notification Service,” Proc. ICDCS Workshop Electronic Commerce and Web-Based Applications, 1999.
[21] E.N. Hanson and T. Johnson, “Selection Predicate Indexing for Active Databases Using Interval Skip Lists,” Information Systems, vol. 21, no. 3, pp. 269-298, 1996.
[22] E.N. Hanson, M. Chaabouni, C. Kim, and Y. Wang, “A Predicate Matching Algorithm for Database Rule Systems,” Proc. ACM SIGMOD, 1990.
[23] E.N. Hanson, C. Carnes, L. Huang, M. Konyala, and L. Noronha, “Scalable Trigger Processing,” Proc. 15th Int'l Conf. Data Eng. (ICDE), 1999.
[24] E.N. Hanson, “The Design and Implementation of the Ariel Active Database Rule System,” IEEE Trans. Knowledge and Data Eng., vol. 8, no. 1, Feb. 1996.
[25] J.M. Hellerstein, W. Hong, S. Madden, and K. Stanek, “Beyond Average: Towards Sophisticated Sensing with Queries,” Proc. Second Int'l Workshop Information Processing in Sensor Networks (IPSN), 2003.
[26] A. Hinze and S. Bittner, “Efficient Distribution-Based Event Filtering,” Proc. First Int'l Workshop Distributed Event-Based Systems (DEBS), 2002.
[27] A. Hinze, “Efficient Filtering of Composite Events,” Proc. 20th British Nat'l Conf. Databases (BNCD), 2003.
[28] H. Hu, J. Xu, and D. Lee, “A Generic Framework for Monitoring Continuous Spatial Queries over Moving Objects,” Proc. ACM SIGMOD, 2005.
[29] D.V. Kalashnikov, S. Prabhakar, W.G. Aref, and S.E. Hambrusch, “Efficient Evaluation of Continuous Range Queries on Moving Objects,” Proc. 13th Int'l Conf. Database and Expert Systems Applications (DEXA), 2002.
[30] S. Kang, J. Lee, H. Jang, H. Lee, Y. Lee, S. Park, T. Park, and J. Song, “SeeMon: Scalable and Energy-Efficient Context Monitoring Framework for Sensor-Rich Mobile Environments,” Proc. Sixth Int'l Conf. Mobile Systems, Applications, and Services (MobiSys), 2008.
[31] J. Kang, J.F. Naughton, and S.D. Viglas, “Evaluating Window Joins over Unbounded Streams,” Proc. 19th IEEE Int'l Conf. Data Eng. (ICDE), 2003.
[32] Korea Stock Exchange, http:/www.kse.or.kr, 2008.
[33] J. Lee, Y. Lee, S. Kang, S. Lee, H. Jin, B. Kim, and J. Song, “BMQ-Index: Shared and Incremental Processing of Border Monitoring Queries over Data Streams,” Proc. Seventh Int'l Conf. Mobile Data Management (MDM), 2006.
[34] G. Li and H. Jacobsen, “Composite Subscriptions in Content-Based Publish/Subscribe Systems,” Proc. Sixth ACM/IFIP/USENIX Int'l Middleware Conf. (Middleware), 2005.
[35] J. Liu, M. Chu, J. Liu, J. Reich, and F. Zhao, “State-Centric Programming for Sensor-Actuator Network Systems,” IEEE Pervasive Computing, pp. 50-62, Oct. 2003.
[36] C. Ma and J. Bacon, “COBEA: A CORBA-Based Event Architecture,” Proc. Fourth Conf. Object-Oriented Technologies and Systems (COOTS), 1998.
[37] S.R. Madden, M.A. Shah, J.M. Hellerstein, and V. Raman, “Continuously Adaptive Continuous Queries over Streams,” Proc. ACM SIGMOD, 2002.
[38] S.R. Madden, M.J. Franklin, J.M. Hellerstein, and W. Hong, “The Design of an Acquisitional Query Processor for Sensor Networks,” Proc. ACM SIGMOD, 2003.
[39] M.F. Mokbel, X. Xiong, and W.G. Aref, “SINA: Scalable Incremental Processing of Continuous Queries in Spatio-Temporal Database,” Proc. ACM SIGMOD, 2004.
[40] M.F. Mokbel and W.G. Aref, “Generic and Progressive Processing of Mobile Queries over Mobile Data,” Proc. Sixth Int'l Conf. Mobile Data Management (MDM), 2005.
[41] R. Motwani, J. Widom, A. Arasu, B. Babcock, S. Babu, M. Datar, G. Manku, C. Olston, J. Rosenstein, and R. Varma, “Query Processing, Resource Management, and Approximation in a Data Stream Management System,” Proc. First Biennial Conf. Innovative Data Systems Research (CIDR), 2003.
[42] Network-Based Generator of Moving Objects, http://www.fh-oow. de/institute/iapg/personen brinkhoffgenerator/, 2008.
[43] N.W. Paton and O. Diaz, “Active Database Systems,” ACM Computing Surveys, vol. 31, no. 1, pp. 63-103, Mar. 1999.
[44] P.R. Pietzuch and J. Bacon, “Hermes: A Distributed Event-Based Middleware Architecture,” Proc. First Int'l Workshop Distributed Event-Based Systems (DEBS), 2002.
[45] P.R. Pietzuch, B. Shand, and J. Bacon, “A Framework for Event Composition in Distributed Systems,” Proc. Fourth ACM/IFIP/USENIX Int'l Middleware Conf. (Middleware), 2003.
[46] M.A. Sharaf, J. Beaver, A. Labrinidis, and P.K. Chrysanthis, “TiNA: A Scheme for Temporal Coherency-Aware in-Network Aggregation,” Proc. Third ACM Int'l Workshop Data Eng. for Wireless and Mobile Access (MobiDE), 2003.
[47] M. Srivastava, “Wireless Sensor and Actuator Networks,” tutorial, Proc. ACM MobiCom, 2005.
[48] K. Terfloth, G. Wittenburg, and J. Schiller, “FACTS—A Rule-Based Middleware Architecture for Wireless Sensor Network,” Proc.First Int'l Conf. Comm. System Software and Middleware (COMSWARE), 2006.
[49] Univ. of Washington, Live from Earth and Mars, http://www-k12. atmos.washington.edu/k12/ grayskiesnw_weather.html, 2008.
[50] S. Urban, I. Biswas, and S.W. Dietrich, “Filtering Features for a Composite Event Definition Language,” Proc. Int'l Symp. Applications on Internet (SAINT), 2006.
[51] J. Widom, “The Starburst Active Database Rule System,” IEEE Trans. Knowledge and Data Eng., vol. 8, no. 4, Aug. 1996.
[52] G. Wittenburg, K. Terfloth, F.L. Villafuerte, T. Naumowicz, H. Ritter, and J. Schiller, “Fence Monitoring—Experimental Evaluation of a Use Case for Wireless Sensor Networks,” Proc. Fourth European Conf. Wireless Sensor Networks (EWSN), 2007.
[53] K.L. Wu, S. Chen, and P.S. Yu, “On Incremental Processing of Continual Range Queries for Location-Aware Services and Applications,” Proc. Second Int'l Conf. Mobile and Ubiquitous Systems (MobiQuitous), 2005.
[54] K.L. Wu and P.S. Yu, “Interval Query Indexing for Efficient Stream Processing,” Proc. 13th ACM Int'l Conf. Information and Knowledge Management (CIKM), 2004.
[55] E. Wu, Y. Diao, and S. Rizvi, “High-Performance Complex Event Processing over Streams,” Proc. ACM SIGMOD, 2006.
[56] S. Yoon and C. Shahabi, “The Clustered AGgregation (CAG) Techniques Leveraging Spatial and Temporal Correlations in Wireless Sensor Networks,” ACM Trans. Sensor Networks, vol. 3, no. 1, Mar. 2007.
58 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool