The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.01 - January (2012 vol.24)
pp: 45-58
Segev Wasserkrug , IBM Haifa Research Lab, Haifa
Avigdor Gal , Technion - Israel Institute of Technology, Haifa
Opher Etzion , IBM Haifa Research Lab, Haifa
Yulia Turchin , Technion - Israel Institute of Technology, Haifa
ABSTRACT
There is a growing need for systems that react automatically to events. While some events are generated externally and deliver data across distributed systems, others need to be derived by the system itself based on available information. Event derivation is hampered by uncertainty attributed to causes such as unreliable data sources or the inability to determine with certainty whether an event has actually occurred, given available information. Two main challenges exist when designing a solution for event derivation under uncertainty. First, event derivation should scale under heavy loads of incoming events. Second, the associated probabilities must be correctly captured and represented. We present a solution to both problems by introducing a novel generic and formal mechanism and framework for managing event derivation under uncertainty. We also provide empirical evidence demonstrating the scalability and accuracy of our approach.
INDEX TERMS
Complex event processing, rule-based reasoning with uncertain information.
CITATION
Segev Wasserkrug, Avigdor Gal, Opher Etzion, Yulia Turchin, "Efficient Processing of Uncertain Events in Rule-Based Systems", IEEE Transactions on Knowledge & Data Engineering, vol.24, no. 1, pp. 45-58, January 2012, doi:10.1109/TKDE.2010.204
REFERENCES
[1] A. Adi, "A Language and an Execution Model for the Detection of Reactive Situations," PhD thesis, Technion—Israel Inst. of Tech nology, 2003.
[2] A. Adi and O. Etzion, "Amit—The Situation Manager," Int'l J. Very Large Data Bases, vol. 13, no. 5, pp. 177-203, 2004.
[3] R. Ammon, C. Emmersberger, T. Greiner, A. Paschke, F. Springer, and C. Wolff, "Event-Driven Business Process Management," Proc. Second Int'l Conf. Distributed Event-Based Systems (DEBS '08), July 2008.
[4] M. Balazinska, N. Khoussainova, and D. Suciu, "PEEX: Extracting Probabilistic Events from Rfid Data," Proc. Int'l Conf. Data Eng. (ICDE), 2008.
[5] C. Beeri, A. Eyal, T. Milo, and A. Pilberg, "Query-Based Monitoring of BPEL Business Processes," Proc. ACM SIGMOD Int'l Conf. Management of Data, pp. 1122-1124, 2007.
[6] R. Blanco, J. Wang, and P. Alencar, "A Metamodel for Distributed Event Based Systems," Proc. Second Int'l Conf. Distributed Event-Based Systems (DEBS '08), pp. 221-232, 2008.
[7] M. Bauer and K. Rothermel, "An Architecture for Observing Physical World Events," Proc. 11th Int'l Conf. Parallel and Distributed Systems (ICPADS '05), pp. 377-383, July 2005.
[8] J.S. Breese, R.P. Goldman, and M.P. Wellman, "Introduction to the Special Section on Knowledge-Based Construction of Probabilistic and Decision Models," IEEE Trans. Systems, Man and Cybernetics, vol. 24, no. 11, pp. 1577-1579, Nov. 1994.
[9] M. Campbell, C.-S. Li, C. Aggarwal, M. Naphade, K.-L. Wu, and T. Zhang, "An Evaluation of over-the-Counter Medication Sales for Syndromic Surveillance," Proc. IEEE Int'l Conf. Data Mining—Life Sciences Data Mining Workshop, 2004.
[10] S. Chakravarthy and D. Mishra, "Snoop: An Expressive Event Specification Language for Active Databases," Data and Knowledge Eng., vol. 14, no. 1, pp. 1-26, 1994.
[11] D. Chu, A. Deshpande, J. Hellerstein, and W. Hong, "Approximate Data Collection in Sensor Networks Using Probabilistic Models," Proc. 22nd Int'l Conf. Data Eng. (ICDE), p. 48, 2006.
[12] J. Cowie, A.T. Ogielski, B. Premore, and Y. Yuanb, "Internet Worms and Global Routing Instabilities," Proc. SPIE, vol. 125, p. 4868, 2002.
[13] H. Chen, J. Yin, L. Jin, Y. Li, and J. Dong, "Jtang Synergy: A Service Oriented Architecture for Enterprise Application Integration," Proc. 11th Int'l Conf. Computer Supported Cooperative Work in Design (CSCWD '07), pp. 502-507, Apr. 2007.
[14] M. Cilia, C. Bornhövd, and A. Buchmann, "Event Handling for the Universal Enterprise," Information Technology and Management— Special Issue on Universal Enterprise Integration, vol. 5, no. 1, pp. 123-148, Jan. 2005.
[15] G. Cugola, E.D. Nitto, and A. Fuggetta, "The Jedi Event-Based Infrastructure and its Application to the Development of the OPSS WFMS," IEEE Trans. Software Eng., vol. 27, no. 9, pp. 827-850, Sept. 2001.
[16] U. Dayal et al., "The HiPAC Project: Combining Active Databases and Timing Constraints," ACM SIGMOD Record, vol. 17, no. 1, pp. 51-70, 1988.
[17] A. Demers, J. Gehrke, M. Hong, M. Riedewald, and W. White, "Towards Expressive Publish/Subscribe Systems," Proc. Int'l Conf. Advances in Database Technology—Extending Database Technology (EDBT '06), pp. 627-644, 2006.
[18] A. Demers, J. Gehrke, B. Panda, M. Riedewald, V. Sharma, and W. White, "Cayuga a General Purpose Event Monitoring System," Proc. Third Biennial Conf. Innovative Data Systems Research (IDR '07), pp. 412-422, 2007.
[19] O. Diaz, A. Jaime, and N. Paton, "Dear: A Debugger for Active Rules in an Object-Oriented Context," Proc. First Int'l Workshop Rules in Database Systems, pp. 180-193, 1993.
[20] C.L. Forgy, "Rete: A Fast Algorithm for the Many Pattern/Many Object Pattern Match Problem," Artificial Intelligence, vol. 19, pp. 17-37, 1982.
[21] A. Gal and E. Hadar, "Generic Architecture of Complex Event Processing Systems," Handbook of Research on Advanced Distributed Event-Based Systems, Publish/Subscribe and Message Filtering Technologies, A. Hinze and A. Buchmann, eds., IGI Global, 2009.
[22] H.N. Gehani, H.N. Jagadish, and O. Shmueli, "Composite Event Specification in Active Databases: Model and Implementation," Proc. 18th Int'l Conf. Very Large Data Bases (VLDB), pp. 23-27, 1992.
[23] L. Girod, Y. Mei, R. Newton, S. Rost, A. Thiagarajan, H. Balakrishnan, and S. Madden, "The Case for a Signal-Oriented Data Stream Management System," Proc. Conf. Innovative Data Systems Research (CIDR), pp. 397-406, 2007.
[24] K. Gomadam, A. Ranabahu, L. Ramaswamy, A. Sheth, and K. Verma, "A Semantic Framework for Identifying Events in a Service Oriented Architecture," Proc. IEEE Int'l Conf. Web Services (ICWS '07), pp. 545-552, July 2007.
[25] T. Green and V. Tannen, "Models for Incomplete and Probabilistic Information," IEEE Data Eng. Bull., vol. 29, no. 1 pp. 17-24, Mar. 2006.
[26] J.Y. Halpern, Reasoning about Uncertainty. MIT Press 2003.
[27] Principles and Applications of Distributed Event-Based Systems, A. Hinze and A. Buchmann, eds. IGI Global, 2010.
[28] K. Kersting and L. De Readt, "Bayesian Logic Programming," An Introduction to Statistical Relational Learning, pp. 291-322, MIT Press, 2007.
[29] C.-S. Li, C. Aggarwal, M. Campbell, Y.-C. Chang, G. Glass, V. Iyengar, M. Joshi, C.-Y. Lin, M. Naphade, and J.R. Smith, "Epi-Spire: A System for Environmental and Public Health Activity Monitoring," Proc. IEEE Int'l Conf. Multimedia and Expo, 2003.
[30] D. Luckham, The Power of Events: An Introduction to Complex Event Processing in Distributed Enterprise Systems. Addison-Wesley, 2002.
[31] N.W. Paton, Active Rules in Database Systems. Springer, 1999.
[32] J. Pearl, Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. Morgan Kaufmann, 1988.
[33] P.R. Pietzuch, B. Shand, and J. Bacon, "Composite Event Detection as a Generic Middleware Extension," IEEE Network, vol. 18, no. 1, pp. 44-55, Jan./Feb. 2004.
[34] C. Re, N. Dalvi, and D. Suciu, "Query Evaluation on Probabilistic Databases," IEEE Data Eng. Bull., vol. 29, no. 1, pp. 25-31, Mar. 2006.
[35] G. Shmueli and S. Fienberg, "Current and Potential Statistical Methods for Monitoring Multiple Data Streams for Biosurveillance," Statistical Methods in Counterterrorism, pp. 109-140, Springer Verlag, 2006.
[36] Y. Turchin, A. Gal, and S. Wasserkrug, "Tuning Complex Event Processing Rules Using the Prediction-Correction Paradigm," Proc. Third ACM Int'l Conf. Distributed Event-Based Systems (DEBS '09), 2009.
[37] S. Wasserkrug, A. Gal, and O. Etzion, "A Model for Reasoning with Uncertain Rules in Event Composition Systems," Proc. 21st Conf. Uncertainty in Artificial Intelligence (UAI '05), pp. 599-606, 2005.
[38] S. Wasserkrug, A. Gal, and O. Etzion, A. Taxonomy, "Representation of Sources of Uncertainty in Active Systems," Proc. Sixth Int'l Conf. Next Generation Information Technologies and Systems (NGITS '06), pp. 174-185, 2006.
[39] S. Wasserkrug, A. Gal, O. Etzion, and Y. Turchin, "Complex Event Processing over Uncertain Data," Proc. Second Int'l Conf. Distributed Event-Based Systems (DEBS '08), pp. 253-264, 2008.
[40] S. White, A. Alves, and D. Rorke, "Weblogic Event Server: A Lightweight, Modular Application Server for Event Processing," Proc. Second Int'l Conf. Distributed Event-Based Systems (DEBS '08), pp. 193-200, 2008.
[41] J. Widom, "Trio: A System for Integrated Management of Data, Accuracy, and Lineage," Proc. Conf. Innovative Data Systems Research (CIDR), pp. 262-276, 2005.
[42] Active Database Systems: Triggers and Rules for Advanced Database Processing, J. Widom, and S. Ceri, eds. Morgan-Kaufmann, 1996.
15 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool