This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
A Language for Construction of Belief Networks
March 1993 (vol. 15 no. 3)
pp. 196-208

A method for incrementally constructing belief networks, which are directed acyclic graph representations for probability distributions, is described. A network-construction language, FRAIL3, which is similar to a forward-chaining language using data dependencies but has additional features for specifying distributions, was developed. A particularly important feature of this language is that is allows the user to conveniently specify conditional probability matrices using stereotyped models of intercausal interaction. Using FRAIL3, one can define parmeterized classes of probabilistic models. These parameterized models make it possible to apply probabilistic reasoning to problems for which it is impractical to have a single large, static model.

[1] S. K. Andersen, K. G. Oleson, Kristian F. V. Jensen, and F. Jensen, "HUGIN--A shell for building Bayesian belief universes for expert systems," inProc. 11th Int. Joint Conf. Artificial Intell., 1989.
[2] J. S. Breese, "Construction of belief and decision networks,"Comput. Intell., vol. 8, no. 4, pp. 624-647, 1992.
[3] Th. M. Schwair and H. C. Ritter, "Complete self-test architecture for a coprocessor," inProc. Int. Test Conf., Washington, DC, Aug. 1990, pp. 886-890.
[4] E. Charniak, "Bayesian networks without tears,"AI Mag., vol. 12, no. 4, pp. 50-63, 1992.
[5] E. Charniak and R. P. Goldman, "A Bayesian model of plan recognition," to be published inArtifical Intell.
[6] E. Charniak and R. P. Goldman, "Probabilistic abduction for plan-recognition," inProc. Ninth Nat. Conf. Artificial Intell., 1991, pp. 160-165.
[7] E. Charniak and R. P. Goldman, "A logic for semantic interpretation," inProc. Ann. Mtg. Assoc. Comput. Linguistics, 1988, pp. 87-94.
[8] E. Charniak and R. P. Goldman, "A semantics for probabilistic quantifier-free first-order languages, with particular application to story understanding," inProc. 11th Int. Joint Conf. Artificial Intell.(Los Altos, CA), 1989, pp. 1074-1079.
[9] E. Charniak and R. P. Goldman, "Plan recognition in stories and in life,"Uncertainty in Artificial Intelligence 5(M. Henrion, R. D. Schachter, and J. F. Lemmer, Eds.). New York: Elsevier, 1990, pp. 343-351.
[10] E. Charniak and S. Husain, "A new admissible heuristic for minimal-cost proofs," inProc. Ninth Nat. Conf. Artificial Intell., 1991, pp. 446-451.
[11] E. Charniak and D. McDermott,Introduction to Artificial Intelligence. Reading, MA: Addison-Wesley, 1985, p. 147.
[12] R. M. Chavez and G. F. Cooper, "An empirical evaluation of a randomized algorithm for probabilistic inference,"Proc. Fifth Workshop Uncertainty Artificial Intell.(Los Altos, CA), 1989, pp. 60-70.
[13] H. L. Chin and G. F. Cooper, "Stochastic simulation of Bayesian belief networks," inProc. Workshop Uncertainty Probability Artificial Intell., 1987, pp. 106-113.
[14] G. F. Cooper, "The computational complexity of probabilistic inference using Bayesian belief networks,"Artificial Intell., vol. 42, nos. 2-3, pp. 393-405, 1990.
[15] G. F. Cooper, "NESTOR: A computer-based medical diagnosis aid that integrates causal and probabilistic knowledge," Ph.D. thesis, Stanford Univ., 1984.
[16] S. B. Cousins, W. Chen, and M. E. Frisse,CABeN: A Collection of Algorithms for Belief Networks, unpublished manual.
[17] B. D'Ambrosio, "A hybrid approach to reasoning under uncertainty,"Int. J. Approx. Rea., vol. 2, pp. 29-45, 1988.
[18] B. D'Ambrosio, "Process, structure, and modularity in reasoning with uncertainty,",Uncertainty in Artificial Intelligence 4(R. Shachter, T. Levitt, L. Kanal, and J. Lemmer, Eds.). Amsterdam: North Holland, 1990, pp. 15-25.
[19] J. de Kleer, "An assumption-based TMS,"Artificial Intell., vol. 28, pp. 127-162, 1986.
[20] J. Doyle, "A truth maintenance system,"Artificial Intell., vol. 12, no. 3, pp. 231-272, 1979.
[21] E. Santos, Jr., "On the generation of alternative explanations with implications for belief revision," inProc. Seventh Conf. Uncertainty Artificial Intell.(Los Altos, CA), 1991, pp. 339-347.
[22] M. Frydenberg, "The chain graph Markov property," Tech. Rep. 186, Dept. of Theoretical Stat., Inst. of Math., Univ. of Aarhus, 1989.
[23] S. Geman and D. Geman, "Stochastic relaxation, Gibbs distributions and the Bayesian restoration of images,"IEEE Trans. Patt. Anal. Machine Intell., vol. PAMI-6, pp. 721-741, 1984; republished in [42].
[24] R. P. Goldman, "A probabilistic approach to language understanding," Tech. Rep. CS-90-34, Comput. Sci. Dept., Brown Univ., 1990.
[25] R. P. Goldman and J. S. Breese, "Integrating model construction and evaluation," inUncertainty Artificial Intell. Proc. Eighth Conf., July 1992, pp. 104-111.
[26] R. P. Goldman and E. Charniak, "Probabilistic text understanding,"Stat. Comput., vol. 2, pp. 105-114, 1992.
[27] U. Grenander, "Tutorial in pattern theory," Tech. Rep., Div. of Applied Math., Brown Univ., Providence, RI, Dec. 1983.
[28] M. Henrion, "Propagating uncertainty by logic sampling in Bayes' networks,"Uncertainty in Artificial Intelligence(J. F. Lemmer and L. F. Kanal, Eds.). Amsterdam: North-Holland, 1988, pp. 149-163, vol. 2.
[29] M. C. Horsch and D. A. Poole, "A dynamic approach to probabilistic inference using Bayesian networks," inProc. Sixth Conf. Uncertainty Artificial Intell., 1990, pp. 155-161.
[30] F. V. Jensen, "Bayesian updating, in recursive graphical models by local computations," Tech. Rep. R 89-15, Inst. for Electron. Syst., Dept. of Math. Comput. Sci., Univ. of Aalborg, Aalborg, Denmark, 1989.
[31] F. V. Jensen, K. G. Oleson, and S. Anderson, "An algebra of Bayesian belief universes for knowledge-based systems," Tech. Rep. R 88-25, Inst. Electron. Syst., Dept. Math. Comput. Sci., Univ. of Aalborg, Aalborg, Denmark, 1988.
[32] J. H. Kim and J. Pearl, "A computation model for causal and diagnostic reasoning in inference systems," inProc. 6th Int. Joint Conf. Artificial Intell.(Los Altos, CA), 1983, pp. 190-193.
[33] K. B. Laskey and P. E. Lehner, "Belief maintenance: An integrated approach to uncertainty management," inProc. Seventh Nat. Conf. Artificial Intell., 1988, pp. 210-214.
[34] S. L. Lauritzen and D. L. Spiegelhalter, "Local computations with probabilities on graphical structures and their application to expert systems,"J. Royal Stat. Soc., vol. 50, pp. 157-224, 1988; republished in [42].
[35] S. L. Lauritzen, "Mixed graphical association models," Tech. Rep. R 88-21, Inst. for Electron. Systems, Dept. of Math. Comput. Sci., Univ. of Aalborg, Aalbora, Denmark, 1988.
[36] D. McAllester, "Reasoning utility package user's manual, Version one," Tech. Rep., Mass. Inst. Technol., Artificial Intell. Lab., 1982.
[37] R. E. Neapolitan,Probabilistic Reasoning in Expert Systems. New York: Wiley, 1990.
[38] P. Norvig,Paradigms of Artificial Intelligence Programming: Case Studies in Common Lisp. Los Altos, CA: Morgan Kaufmann, 1991.
[39] J. Pearl,Probabilistic Reasoning in Intelligent Systems. San Mateo, CA: Morgan Kaufmann, 1988.
[40] R. D. Shachter, "Evaluating influence diagrams,"Oper. Res., vol. 34, no. 6, pp. 871-882, 1986; reprinted in [42].
[41] R. D. Shachter and M. A. Peot, "Simulation approaches to general probabilistic inference on belief networks," inProc. Fifth Workshop Uncertainty Artificial Intell.(Los Altos, CA), 1989, pp. 311-318.
[42] G. Shafer and J. Pearl, Eds.,Readings in Uncertain Reasoning. Los Altos, CA: Morgan Kaufmann, 1990.
[43] S. Shimony, "Algorithms for irrelevance-based partial MAPS," inProc. Seventh Conf. Uncertainty Artificial Intell. (Los Altos, CA), 1991, pp. 370-377.
[44] S. Shimony and E. Charniak, "A new algorithm for finding MAP assignments to belief networks," inProc. Sixth Conf. Uncertainty Artificial Intell., 1990, pp. 98-103.
[45] D. J. Spiegelhalter, "Fast algorithms for probabilistic reasoning in influence diagrams with application in genetics and expert systems,"Influence Diagrams, Belief Nets and Decision Analysis(R. M. Oliver and J. Q. Smith, Eds.). New York: Wiley, 1990, pp. 361-384, ch. 16 (Wiley Series on Probability and Mathematical Statistics); also inProc. Conf. Influence Diagrams Decision Anal. Inference Prediction(Univ. of California, Berkeley), May 9-11, 1988.
[46] S. Srinivas and J. Breese,IDEAL: Influence Diagram Evaluation and Analysis in Lisp. Palo Alto, CA: Rockwell Int. Sci. Cent., May 1989.
[47] S. Srinivas and J. Breese, "IDEAL: A software package for analysis of influence diagrams,"Proc. Sixth Conf. Uncertainty Artificial Intell., 1990, pp. 212-219.
[48] M. P. Wellman, J. S. Breese, and R. P. Goldman, "From knowledge bases to decision models,"Knowledge Eng. Rev., vol. 7, no. 1, pp. 35-53, 1992.

Index Terms:
belief network construction language; directed acyclic graph representations; probability distributions; FRAIL3; forward-chaining language; conditional probability matrices; probabilistic reasoning; deductive databases; directed graphs; inference mechanisms; logic programming languages; probabilistic logic
Citation:
R.P. Goldman, E. Cherniak, "A Language for Construction of Belief Networks," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 15, no. 3, pp. 196-208, March 1993, doi:10.1109/34.204902
Usage of this product signifies your acceptance of the Terms of Use.