This Article 
 Bibliographic References 
 Add to: 
Towards an Art and Science of Knowledge Engineering: A Case for Belief Networks
August 1993 (vol. 5 no. 4)
pp. 705-712

The knowledge engineering of belief networks is discussed. Several design issues that arose during the construction of two belief network-based systems, Pathfinder and ARCO1, are described. The issues of accuracy, consistency, and calibration as they emerged during the design of these systems are addressed, and the ways in which compatibility of all networks designed for the same domain suggests an architecture for combining the recommendations of independently designed knowledge bases into a single, consensus recommendation are discussed.

[1] B. Abramson, "On learning and testing evaluation functions,"J. Experimental and Theoretical Artificial Intelligence, vol. 2, pp. 241-251, 1990.
[2] B. Abramson and A. J. Finizza, "A belief network implementation of target capacity utilization," inProc. 13th North American Conf. Int. Association for Energy Economics, pp. 93-104, 1991.
[3] B. Abramson and A. J. Finizza, "Using belief networks to forecast oil prices,"Int. J. Forecasting, vol. 7, pp. 299-316, 1991.
[4] R. W. Blanning, "Sensitivity analysis in logic-based models,"Decision Support Systems, vol. 3, pp. 343-349, 1987.
[5] J. H. Boose, "A survey of knowledge acquisition techniques and tools,"Knowledge Acquisition, vol. 1, no. 1, pp. 3-37, 1989.
[6] B. G. Buchanan and E. H. Shortliffe, Eds.,Rule-based Expert Systems: The MYCIN Experiments of the Stanford Heuristic Programming Project. Reading, MA: Addison-Wesley, 1984.
[7] B. Chandrasekaran, "Generic tasks in knowledge-based reasoning: High-level building blocks for expert system design,"IEEE Expert, pp. 23-30, Fall 1986.
[8] P. Cheeseman, "An inquiry into computer understanding,"Computational Intelligence, vol. 4, pp. 58-66, 129-142, 1988.
[9] R. Dawes, "The robust beauty of improper linear models,"American Psychologist, vol. 34, pp. 571-582, 1979.
[10] W. Edwards, "Dynamic decision theory and probabilistic information processing,"Human Factors, vol. 4, pp. 59-73, 1962.
[11] E. A. Feigenbaum, "The art of artificial intelligence: Themes and case studies of knowledge engineering," inProc. Fifth Int. Joint Conf. Artificial Intelligence, pp. 1014-1029, 1977.
[12] D. E. Heckerman, "An empirical comparison of three inference methods," inProc. Fourth Workshop on Uncertainty in Artificial Intelligence, pp. 158-169, 1988.
[13] D. E. Heckerman, "Probabilistic similarity networks," Ph.D. dissertation, Stanford University, 1990.
[14] D. E. Heckerman, E. J. Horvitz, and B. N. Nathwani, "Toward normative expert systems: Part I--The Pathfinder Project,"Methods of Information in Medicine, to be published.
[15] R. R. Hoffman, "The problem of extracting the knowledge of experts from the perspective of experimental psychology,"AI Magazine, Summer 1987.
[16] E.J. Horvitz, J.S. Breese, and M. Henrion, "Decision Theory in Expert Systems and AI,"Int'l J. Approximate Reasoning, Vol. 2, No. 3, 1988, pp. 247-302.
[17] R. A. Howard and J. E. Matheson, "Influence diagrams," in R.A. Howard and J. E. Matheson, Eds.,Readings on the Principles and Applications of Decision Analysis, vol. II. Strategic Decisions Group: pp. 721-762, 1984.
[18] D. Kahneman, P. Slovic, and A. Tversky, Eds.,Judgement Under Uncertainty: Heuristics and Biases. Cambridge, UK: Cambridge University Press, 1982.
[19] P. E. Lehner and L. Adelman, "Perspectives in knowledge engineering,"IEEE Trans. Syst., Man, Cybern., vol. 19, pp. 433-434, May/June 1989.
[20] J. McCarthy and P. Hayes, "Some philosophical problems from the standpoint of artificial intelligence," in B. Meltzer and D. Michie, Eds.,Machine Intelligence 4, pp. 463-502, Edinburgh University Press, 1969.
[21] S. Mittal and C. L. Dym, "Knowledge acquisition from multiple exports,"AI Magazine, vol. 6, pp. 32-36, 1985.
[22] K-C. Ng, "Probabilistic multi-knowledge-base systems: Automated group decision making in expert systems," Ph.D. dissertation, University of Southern California, 1990.
[23] K.-C. Ng and B. Abramson, "A model for using multiple knowledge bases in an expert system," inProc. Ninth Int. Workshop on Expert Systems and their Applications: Second Generation Expert Systems, pp. 269-280, May/June 1989.
[24] K.-C. Ng and B. Abramson, "A sensitivity analysis of Pathfinder," inProc. Sixth Conf. Uncertainty in Artificial Intelligence, July 1990.
[25] K.-C. Ng and B. Abramson, "Consensus in a multi-expert system," inProc. 1990 ACM Computer Science Conf., pp. 351-357, Feb. 1990.
[26] K.-C. Ng and B. Abramson, "Uncertainty management in expert systems,"IEEE Expert, vol. 5, pp. 29-48, 1990.
[27] K.-C. Ng and B. Abramson, "A sensitivity analysis of Pathfinder: A follow-up study," inProc. Seventh Conf. Uncertainty in Artificial Intelligence, pp. 242-248, July 1991.
[28] J. Pearl,Probabilistic Reasoning in Intelligent Systems. San Mateo, CA: Morgan Kaufmann, 1988.
[29] E. C. Poulton, "Models for biases in judging sensory magnitude,"Psychological Bulletin, vol. 86, pp. 777-803, 1979.
[30] C. S. Spetzler and C.-A. S. Stael von Holstein, "Probability encoding in decision analysis,"Management Science, vol. 22, 1975.
[31] D. von Winterfeldt and W. Edwards,Decision Analysis and Behavioral Research. Cambridge, UK: Cambridge Univ. Press, 1986.

Index Terms:
knowledge engineering; belief networks; Pathfinder; ARCO1; consistency; calibration; compatibility; independently designed knowledge bases; consensus recommendation; belief maintenance
B. Abramson, K.-C. Ng, "Towards an Art and Science of Knowledge Engineering: A Case for Belief Networks," IEEE Transactions on Knowledge and Data Engineering, vol. 5, no. 4, pp. 705-712, Aug. 1993, doi:10.1109/69.234781
Usage of this product signifies your acceptance of the Terms of Use.