This Article 
 Bibliographic References 
 Add to: 
Approximating Bayesian Belief Networks by Arc Removal
August 1997 (vol. 19 no. 8)
pp. 916-920

Abstract—I propose a general framework for approximating Bayesian belief networks through model simplification by arc removal. Given an upper bound on the absolute error allowed on the prior and posterior probability distributions of the approximated network, a subset of arcs is removed, thereby speeding up probabilistic inference.

[1] S. Andreassen, M. Woldbye, B. Falck, and S.K. Andersen, "MUNIN—A Causal Probabilistic Network for Interpretation of Electromyographic Findings," Proc. 10th Int'l Joint Conf. Artificial Intelligence, pp. 366-372, 1987.
[2] P.D. Bruza and L.C. van der Gaag, "Index Expression Belief Networks for Information Disclosure," J. Expert Systems: Research and Applications, vol. 7, pp. 107-138, 1994.
[3] G.F. Cooper, "The Computational Complexity of Probabilistic Inference Using Bayesian Belief Networks," Artificial Intelligence, vol. 42, pp. 393-405, 1990.
[4] S.B. Cousins, W. Chen, and M.E. Frisse, "A Tutorial to Stochastic Simulation Algorithms for Belief Networks," Artificial Intelligence in Medicine, vol. 5, pp. 315-340, 1993.
[5] P. Dagum and M. Luby, "Approximating Probabilistic Inference in Bayesian Belief Networks is NP-Hard," Artificial Intelligence, vol. 60, pp. 141-153, 1993.
[6] R.A. van Engelen, "Approximating Bayesian Belief Networks by Arc Removal," Technical Report TR-96-15, Dept. Computer Science, Leiden University, The Netherlands, June 1996. Available from
[7] D. Geiger, T. Verma, and J. Pearl, "d-Separation: From Theorems to Algorithms," Technical Report R-130, Computer Science Dept., Univ. of California, Los Angeles, 1989.
[8] M. Henrion, "Propagating Uncertainty in Bayesian Networks by Probabilistic Logic Sampling," Proc. Uncertainty in Artificial Intelligence, pp. 149-163, 1988.
[9] F.V. Jensen and S.K. Andersen, "Approximations in Bayesian Belief Universes for Knowledge-Based Systems," Proc. Sixth Workshop Uncertainty in Artificial Intelligence,Cambridge, Mass., 1990.
[10] F.V. Jensen, S.L. Lauritzen, and K.G. Olesen, "Bayesian Updating in Causal Probabilistic Networks by Local Computations," Comput. Statistics Quarterly, vol. 4, pp. 269-282, 1990.
[11] F.V. Jensen, J. Nielsen, and H.I. Christensen, "Use of Causal Probabilistic Networks as High Level Models in Computer Vision," Technical Report R-90-39, Univ. of Aalborg, Denmark, 1990.
[12] H. Kiiveri, T.P. Speed, and J.B. Carlin, "Recursive Causal Models," J. Australian Mathematical Soc., vol. A, pp. 30-52, 1984.
[13] S. Kirkpatrick, C.D. Gelatt, Jr., and M.P. Vecchi, "Optimization by Simulated Annealing," Science, vol. 220, pp. 671-680, 1983.
[14] U. Kjaerulff, "Reduction of Computational Complexity in Bayesian Networks Through Removal of Weak Dependencies," Proc. 10th Conf. Uncertainty in Artificial Intelligence, pp. 374-382, 1994.
[15] S. Kullback, Information Theory and Statistics.New York: John Wiley, 1959.
[16] S. Kullback, "A Lower Bound for Discriminating Information in Terms of Variation," IEEE Trans. Information Theory, vol. 13, pp. 126-127, 1967.
[17] S.L. Lauritzen and D.J. Spiegelhalter, "Local Computations with Probabilities on Graphical Structures and Their Application to Expert Systems," J. Royal Statistical Soc., Series B, vol. 50, pp. 157-224, 1988.
[18] Z. Michalewicz, Genetic Algorithms + Data Structures = Evolution Programs, 2nd ed. New York: Springer-Verlag, 1994.
[19] J. Pearl, Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference.San Mateo, Calif.: Morgan Kaufmann, 1988.
[20] H.J. Suermondt and G.F. Cooper, "Probabilistic Inference in Multiply Connected Belief Networks Using Loop Cutsets," J. Approximate Reasoning, vol. 4, pp. 283-306, 1990.
[21] H.J. Suermondt and G.F. Cooper, "A Combination of Exact Algorithms for Inference on Bayesian Belief Networks," J. Approximate Reasoning, vol. 5, pp. 521-542, 1991.
[22] N. Wermuth and S.L. Lauritzen, "On Substantive Research Hypothesis, Conditional Independence Graphs and Graphical Chain Models," J. Royal Statistical Soc., vol. B, pp. 21-50, 1990.
[23] J. Whittaker, Graphical Models in Applied Multivariate Statistics.Chichester, England: John Wiley&Sons, Inc., 1990.

Index Terms:
Bayesian belief networks, belief network approximation, model simplification, approximate probabilistic inference, information theory.
Robert A van Engelen, "Approximating Bayesian Belief Networks by Arc Removal," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 19, no. 8, pp. 916-920, Aug. 1997, doi:10.1109/34.608295
Usage of this product signifies your acceptance of the Terms of Use.