The Community for Technology Leaders
RSS Icon
Subscribe
Philadelphia, Pennsylvania
June 25, 2006 to June 28, 2006
ISBN: 0-7695-2607-1
pp: 259-268
Zhen Guo , New Jersey Institute of Technology
Guofei Jiang , NEC Laboratories America, Princeton, NJ
Haifeng Chen , NEC Laboratories America, Princeton, NJ
Kenji Yoshihira , NEC Laboratories America, Princeton, NJ
ABSTRACT
Due to their growing complexity, it becomes extremely difficult to detect and isolate faults in complex systems. While large amount of monitoring data can be collected from such systems for fault analysis, one challenge is how to correlate the data effectively across distributed systems and observation time. Much of the internal monitoring data reacts to the volume of user requests accordingly when user requests flow through distributed systems. In this paper, we use Gaussian mixture models to characterize probabilistic correlation between flow-intensities measured at multiple points. A novel algorithm derived from Expectation-Maximization (EM) algorithm is proposed to learn the "likely" boundary of normal data relationship, which is further used as an oracle in anomaly detection. Our recursive algorithm can adaptively estimate the boundary of dynamic data relationship and detect faults in real time. Our approach is tested in a real system with injected faults and the results demonstrate its feasibility.
INDEX TERMS
null
CITATION
Zhen Guo, Guofei Jiang, Haifeng Chen, Kenji Yoshihira, "Tracking Probabilistic Correlation of Monitoring Data for Fault Detection in Complex Systems", DSN, 2006, 2013 43rd Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN), 2013 43rd Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN) 2006, pp. 259-268, doi:10.1109/DSN.2006.70
28 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool