Efficient Fault Detection and Diagnosis in Complex Software Systems with Information-Theoretic Monitoring
Issue No. 04 - July/August (2011 vol. 8)
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/TDSC.2011.16
Paul A.S. Ward , University of Waterloo, Waterloo
Miao Jiang , University of Waterloo, Waterloo
Mohammad A. Munawar , University of Waterloo, Waterloo
Thomas Reidemeister , University of Waterloo, Waterloo
Management metrics of complex software systems exhibit stable correlations which can enable fault detection and diagnosis. Current approaches use specific analytic forms, typically linear, for modeling correlations. In practice, more complex nonlinear relationships exist between metrics. Moreover, most intermetric correlations form clusters rather than simple pairwise correlations. These clusters provide additional information and offer the possibility for optimization. In this paper, we address these issues by using Normalized Mutual Information (NMI) as a similarity measure to identify clusters of correlated metrics, without assuming any specific form for the metric relationships. We show how to apply the Wilcoxon Rank-Sum test on the entropy measures to detect errors in the system. We also present three diagnosis algorithms to locate faulty components: RatioScore, based on the Jaccard coefficient, SigScore, which incorporates knowledge of component dependencies, and BayesianScore, which uses Bayesian inference to assign a fault probability to each component. We evaluate our approach in the context of a complex enterprise application, and show that 1) stable, nonlinear correlations exist and can be captured with our approach; 2) we can detect a large fraction of faults with a low false positive rate (we detect up to 18 of the 22 faults we injected); and 3) we improve the diagnosis with our new diagnosis algorithms.
Self-managing systems, fault detection, fault diagnosis, information theory, mutual information, autonomic systems.
Paul A.S. Ward, Miao Jiang, Mohammad A. Munawar, Thomas Reidemeister, "Efficient Fault Detection and Diagnosis in Complex Software Systems with Information-Theoretic Monitoring", IEEE Transactions on Dependable and Secure Computing, vol. 8, no. , pp. 510-522, July/August 2011, doi:10.1109/TDSC.2011.16