This Article 
 Bibliographic References 
 Add to: 
ERNEST: A Semantic Network System for Pattern Understanding
September 1990 (vol. 12 no. 9)
pp. 883-905

The authors give a detailed account of a system environment for treating general problems of image and speech understanding. A framework for representing declarative and procedural knowledge based on a suitable definition of a semantic network is provided. The syntax and semantics of the network are clearly defined. The pragmatics of the network in its use for pattern understanding are defined by several rules which are problem-independent. This allows one to formulate problem-independent control algorithms. Complete software environments are available to handle the described structures. The general applicability of the network system is demonstrated by short descriptions of three applications from different task domains.

[1] D. H. Ballard and C. M. Brown,Computer Vision. Englewood Cliffs, NJ: Prentice-Hall, 1982.
[2] R. J. Brachman, "On the epistemological status of semantic networks," in N. V. Findler, Ed.,Associative Networks. New York: Academic, 1979.
[3] R. J. Brachman and I. A. Schmolze, "An overview of the KL-ONE knowledge representation language,"Cognitive Sci., vol. 9, pp. 171- 216, 1985.
[4] R. Brooks, "Symbolic reasoning among 3-D models and 2-D images,"Artificial Intell., vol. 17, pp. 285-341, 1981.
[5] R. De Mori,Computer Models of Speech Using Fuzzy Algorithms. New York: Plenum, 1983.
[6] W. Eichhorn and H. Niemann, "A bidirectional control strategy in a hierarchical knowledge structure," inProc. 8th Int. Conf. Pattern Recognition, Paris, France, 1986, pp. 181-183.
[7] W. Eichhorn, "Eine aktive hierarchische Wissensstruktur für die Musteranalyse," dissertation, Lehrstuhl für Informatik 5 (Mustererkennung), Universität Erlangen-Nürnberg, Erlangen, W. Germany, 1988.
[8] L. D. Erman and V. R. Lesser, "The Hearsay-II speech understanding system: A tutorial," in W. A. Lea,Trends in Speech Recognition. Englewood Cliffs, NJ: Prentice-Hall, 1980, pp. 361-381.
[9] C. J. Fillmore, inThe Case for Case. Universals in Linguistic Theory, E. Bach and R. T. Harms, Eds. New York: Holt, Rinehart, and Winston, pp. 1-88.
[10] N. V. Findler, Ed.,Associative Networks. New York: Academic, 1979.
[11] A. R. Hanson and E. M. Riseman, Eds.,Computer Vision Systems. New York: Academic, 1978.
[12] J. P. Hayes, "The logic of frames," in D. Metzing, Ed., FrameConceptions and Text Understanding. Berlin: de Gruyter, 1979, pp. 46- 61.
[13] F. Hayes-Rothet al., Building Expert Systems. New York: Addison Wesley, 1983.
[14] C. Hewitt, "PLANNER: A language for proving theorems in robots," inProc. IJCAI 2, 1971.
[15] C. Hewitt, "Viewing control structures as patterns of passing messages,"Artificial Intell., vol. 8, pp. 323-364, 1977.
[16] I. Hofmann, R. Gämlich, and H. Niemann, "A human interface for control of an image processing system," inProc. 8th Int. Conf. Pattern Recognition, Paris, France, 1986, pp. 1256-1258.
[17] R. Kowalski, "Predicate logic as a programming language," inInformation Processing 74. Amsterdam: North-Holland, 1974, pp. 569-574.
[18] F. Kummert, H. Niemann, G. Sagerer, and S. Schröder, "Werkzeuge zur modellgesteuerten Bildanalyse und Wissensakqusition--Das System ERNEST," in M. Paul (Hrsg.),GI-17. Jahrestagung Computerintegrierter Arbeitsplatz im Büro. Berlin: Springer-Verlag, 1987, pp. 556-570.
[19] W.A. Lea, ed.,Trends in Speech Recognition, Prentice-Hall, Englewood Cliffs, N.J., 1980.
[20] H. Levesque and J. Mylopoulos, "A procedural semantics for semantic networks," in N. V. Findler, Ed., Associative Networks. New York: Academic, 1979, pp. 93-121.
[21] Z. Manna,Mathematical Theory of Computation. New York: McGraw-Hill, 1974.
[22] J. McCarthy and P. J. Hayes, "Some philosophical problems from the standpoint of artificial intelligence," in B. Meltzer and D. Ritchie, Eds.,Machine Intelligence 4. Edinburgh, Scotland: Edinburgh Univ. Press, 1969, pp. 463-502.
[23] D. McDermott, "The last survey of representation of knowledge," inProc. AISB Conf., Hamburg, W. Germany, 1978, pp. 206-221.
[24] R. S. Michalski, J. G. Carbonell, and T. M. Mitchell, Eds.,Machine Learning: An Artificial Intelligence Approach, vol. 2. Los Altos, CA: Morgan Kaufmann, 1986.
[25] M. Minsky, "A framework for representing knowledge," in P. H. Winston, Ed.,The Psychology of Computer Vision. New York: McGraw-Hill, 1975, pp. 211-277.
[26] J. Mylopoulos and H. Levesque, "An overview of knowledge representation," in M. Brodie, J. Mylopoulos, and J. V. Schmidt, Eds.,On Conceptual Modelling: Perspectives from Artificial Intelligence, Databases, and Programming Languages. New York: Springer-Verlag, 1983.
[27] M. Nagao and T. Matsuyama,A Structural Analysis of Complex Aerial Photographs. New York: Plenum, 1980.
[28] A. M. Nazif and M. D. Levine, "Low level image segmentation: An expert system,"IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-6, pp. 555-577, 1984.
[29] H. Niemann,Pattern Analysis. Berlin: Springer, 1981.
[30] H. Niemann and G. Sagerer, "Semantische Netze als Ansatz zur Repräsentation von Wissen für die automatische Bildanalyse,"Robotersysteme I, pp. 139-150, 1985.
[31] H. Niemann, H. Bunke, I. Hofmann, G. Sagerer, F. Wolf, and H. Feistel, "A knowledge based system for analysis of gated blood pool studies,"IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-7, pp. 246-259, 1985.
[32] H. Niemann, "A homogeneous architecture for knowledge based image understanding," inProc. 2nd Conf. Artificial Intell. Appl., Miami, FL, 1985, pp. 88-93.
[33] H. Niemann, A. Brietzmann, R. Mühlfeld, P. Regel, and G. Schukat, "The speech understanding and dialog system EVAR," in R. De Mori and S. Y. Suen, Ed.,New Systems and Architectures for Automatic Speech Recognition and Synthesis, NATO ASI Series F16. Berlin: Springer, 1985, pp. 271-302.
[34] H. Niemann, A. Brietzmann, U. Erhlich, and G. Sagerer, "Representation of a continuous speech understanding and dialog system in a homogeneous semantic net architecture," inProc. ICASSP'86, Tokyo, Japan, 1986, pp. 1581-1584.
[35] H. Niemann and H. Bunke,Künstliche Intelligenz in Bild- und Sprachanalyse. Stuttgart: Teubner, 1987.
[36] H, Niemann, A. Brietzmann, U. Ehrlich, S. Posch, P. Regel, G. Sagerer, R. Salzbrunn, and G. Schukat-Talamazzini, "A knowledge based speech understanding system,"Int. J. Pattern Recognition Art. In tell., vol. 2, pp. 321-350, 1988.
[37] H. Niemann, G. Sagerer, and W. Eichhorn, "Control strategies in a hierarchical knowledge structure,"Int. J. Pattern Recognition Art. Intell., vol. 3, pp. 557-572, 1988.
[38] N. Nilsson,Principles of Artificial Intelligence. Palo Alto, CA: Tioga, 1980.
[39] W. A. Perkins, "INSPECTOR: A computer vision system that learns to inspect parts,"IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-5, pp. 584-592, 1986.
[40] H. Prade, "A computational approach to approximate and plausible reasoning with applications to expert systems,"IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-7, pp. 260-283, 1985.
[41] G. Sagerer, "Darstellung und Nutzung von Expertenwissen for ein Bildanalysesystem," inInformatik Fachberichte. Berlin: Springer, 1985.
[42] P. Schefe,Künstliche Intelligenz--Überblick und Grundlagen. Mannheim, Wien, Zürich: Bibliographisches Institut, 1986.
[43] S. Schröder, H. Niemann, and G. Sagerer, "Knowledge acquisition for a knowledge based image analysis system," inProc. European Knowledge Acquisition Workshop (EKAW88), Gesellschaft für Mathematik und Datenverarbeitung mBH, Bonn, W. Germany, 1988, pp. 29/1-29/15.
[44] L. Shastri,Semantic Nets: Evidential Formalization and Its Connectionist Realization, Morgan-Kaufman, Los Altos/Pitman Publishing, London, Feb. 1988.
[45] Y. Shirai,Three-Dimensional Computer Vision. New York: Springer-Verlag, 1987.
[46] J. K. Tsotsos, "A framework for visual motion understanding, "Ph.D. dissertation, Dep. Comput. Sci., Univ. Toronto, Toronto, Ont., Canada, 1980.
[47] P. M. Winston,Artificial Intelligence. Reading, MA: Addison-Wesley, 1984.
[48] W. Woods, "What's in a link. Foundations for semantic networks," in D. Bobrow and A. Collins, Ed.,Representation and Understanding. New York: Academic, 1975.
[49] M. Yashida and S. Tsuji, "A versatile machine vision system for complex industrial parts,"IEEE Trans. Comput., vol. C-26, pp. 882- 894, 1977.

Index Terms:
image understanding; semantic network system; pattern understanding; speech understanding; syntax; problem-independent control algorithms; computerised pattern recognition; knowledge based systems; knowledge representation; speech recognition
H. Niemann, G.F. Sagerer, S. Schröder, F. Kummert, "ERNEST: A Semantic Network System for Pattern Understanding," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 12, no. 9, pp. 883-905, Sept. 1990, doi:10.1109/34.57683
Usage of this product signifies your acceptance of the Terms of Use.