This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Automated Concept Acquisition in Noisy Environments
July 1988 (vol. 10 no. 4)
pp. 555-578

A system that performs automated concept acquisition from examples and has been specially designed to work in noisy environments is presented. The learning methodology is aimed at the target problem of finding discriminant descriptions of a given set of concepts and uses both examples and counterexamples. The learned knowledge is expressed in the form of production rules, organized into separate clusters, linked together in a graph structure. Knowledge extraction is guided by a top-down control strategy, through a process of specialization. The system also utilizes a technique of problem reduction to contain the computational complexity. Several criteria are proposed for evaluating the acquired knowledge. The methodology has been tested on a problem in the field of speech recognition and the experimental results obtained are reported and discussed.

[1] L. Rendell, "A general framework for induction and a study for selective induction."Machine Learning, vol. 1, pp. 177-226, 1986.
[2] L. A. Rendell, "A new basis for state-space learning systems and a successful implementation,"AI J., vol. 4, pp. 369-392, 1983.
[3] J. Connell and M. Brady, "Learning shape descriptions," inProc. IJCAI-9, Los Angeles, CA, 1985, pp. 922-925.
[4] B. A. Shepherd, "An appraisal of a decision tree approach to image classification," inProc. IJCAI-8, Karlsruhe, Germany, 1983, pp. 474-475.
[5] J. D. Schaffer and J. J. Grefenstette, "Multi-objective learning via genetic algorithms," inProc. IJCAI-9, Los Angeles, CA, 1985, pp. 593-595.
[6] R. A. O'Keefe, "Concept formation from very large training sets," inProc. IJCAI-8, Karlsruhe, Germany, 1983, pp. 479-481.
[7] B. Arbab and D. Michie, "Generating rules from examples," inProc. IJCAI-9, Los Angeles, CA, 1985, pp. 631-633.
[8] J. Segen, "Learning concept descriptions from examples with errors," inProc. IJCAI-9, Los Angeles, CA, 1985, pp. 634-636.
[9] R. I. Phelps and P. B. Musgrove, "A prototypical approach to machine learning," inProc. IJCAI-9, Los Angeles, CA, 1985, pp. 698- 700.
[10] K. S. Fu:Syntactic Pattern Recognition and Applications, Englewood Cliffs. NJ Prentice-Hall, 1982.
[11] N. Nandhakumar and J. K. Aggarwal, "The artificial intelligence approach to pattern recognition--A perspective and an overview,"Pattern Recognition, vol. 18, no. 6, pp. 383-389, 1985.
[12] E. M. Riseman and A. R. Hanson, "A methodology for the development of general knowledge based vision systems," inProc. IEEE Workshop Principles of Knowledge Based Systems, Denver, CO, 1984, pp. 159-165.
[13] J. K. Tsotsos, "Knowledge of the visual process: Content, from and use," inProc. 6th Int. Joint. Conf. Pattern Recognition, Munich, W. Germany, 1982, pp. 654-669.
[14] E. A. Feigenbaum, "Rule based understanding of signals," inPattern Drected Inference Systems. D. A. Waterman and F. Hayes-Roth, Eds. New York: Academic. 1978, pp. 483-501.
[15] F. Bergadano and L. Saitta: "A general framework for knowledge based pattern recognition,"Int. J. Pattern Recognition and Artificial Intelligence, vol. 1, no. 2, pp. 189-206, Aug. 1987.
[16] J. H. Kim, D. W. Payton, and K. E. Olin, "An expert system for object recognition in natural scenes," inProc. First Conf. Applications of Artificial Intelligence, Denver, CO, 1984, pp. 170-175.
[17] R. Brooks, "Model based three dimensional interpretations of two dimensional images,"IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-5, pp. 140-150. 1983.
[18] A. M. Nazif and M. D. Levine, "Low level image segmentation: An expert system,"IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-6, pp. 555-577, 1984.
[19] D. M. McKeown, W. A. Harvey and J. McDermott, "Rule based interpretation of aerial imagery,"IEEE Trans. Pattern Anal. Machine Intell., vol. PAM1-7, pp. 570-585, 1985.
[20] T. Binford, "Survey of model based image analysis systems,"Int. J. Robotics Res., vol. 1, pp. 18-64, 1982.
[21] D. J. Mostow and F. Hayes-Roth, "A production system for speech understanding," inPattern Directed Inference Systems, D. A. Waterman and F. Hayes-Roth, Eds. New York: Academic. 1978, pp. 471- 481.
[22] L.D. Erman et al., "The Hearsay-II Speech Understanding System: Integrating Knowledge to Resolve Uncertainty,"ACM Computing Surveys, Vol. 12, No. 2, June 1980, pp. 213-253.
[23] R. DeMori, A. Giordana, P. Laface, and L. Saitta, "An expert system for mapping acoustic cues into phonetic features,"Inform. Sci., vol. 33, pp. 115-155.
[24] H. S. Lee, N. V. Thakor, "Frame based understanding of ECG signals," inProc. First Conf. Applications of Artificial Intelligence, Denver, CO, 1984, pp. 624-629.
[25] K. P. Birman: "Rule based learning for more accurate ECG analysis,"IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-4, pp. 369-380, 1982.
[26] P. L. Love and M. Simaan: "Segmentation of a seismic section using image processing and artificial intelligence techniques," inIEEE Workshop Application of Artificial Intelligence and Sgnal Processing to Underwater Acoustics and Geophysics Problems, Montreal, 1984.
[27] G. E. Kopee, "Commentary--Knowledge based signal processing," inTrends and Perspectives in Signal Processing, 1982.
[28] S. Watanabe,Knowing and Guessing -- A Formal and Quantitative Study. New York: Wiley, 1969.
[29] E. Sturt: "Computerized construction in Fortran of a discriminant function for categorical data,"Appl. Stat., vol. 30, pp. 213-222, 1981.
[30] H. Simon, "Why should machines learn?" inMachine Learning, R. Michalski. J. Carbonell, and T. Mitchell, Eds. Palo Alto, CA: Tioga, 1983. pp. 25-37.
[31] M. Ben-Bassat and L. Zaidenberg, "Contextual template matching: A distance measure in patterns with hierachically dependent features,"IEEE Trans. Patterns Anal. Machine Intell., vol. PAMI-6, pp. 201-211, 1984.
[32] L. A. Zadeh, "A computational approach to fuzzy quantifiers in natural languages,"Comput. Math. with Applications, vol.9, pp. 149- 184, 1983.
[33] R. Yager, "Quantified propositions in a linguistic logic,"Int. J. Man-Machine Studies, vol. 19, pp. 195-227, 1983.
[34] L. Lesmo, L. Saitta, and P. Torasso, "Evidence combination in expert systems,"Int. J. Man-Machine Studies, vol. 22, pp. 307-326, 1985.
[35] R. Rada, "Gradualness facilitates knowledge refinement,"IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-7, pp. 523-530, 1985.
[36] L. A. Zadeh, "The concept of linguistic variable and its application to approximate reasoning,"Inform. Sci., vol. 8, pp. 199-250, 1975.
[37] R. S. Michalski and R. L. Chilauski, "Learning by being told and learning from examples: An experimental comparison of the two methods of knowledge acquisition in the context of developing an expert system for soybean disease diagnosis,"Policy Anal. Inform. Syst., vol. 4, no. 2, pp. 125-160, 1980.
[38] R. Michalski, "Pattern recognition as rule-guided inductive inference,"IEEE Pattern Anal. Machine Intell.vol. PAMI-2, pp. 349- 361, 1980.
[39] A. L. Samuel, "Some studies in machine learning using the game of checkers," inComputers and Thought. E. A. Feigenbaum and J. Feldman, Eds. New York: McGraw-Hill, pp. 71-105, 1963.

Index Terms:
machine learning; formal logic; artificial intelligence; knowledge acquisition; knowledge engineering; noisy environments; automated concept acquisition; learning methodology; discriminant descriptions; clusters; graph structure; computational complexity; speech recognition; artificial intelligence; computational complexity; knowledge engineering; learning systems; pattern recognition; speech recognition
Citation:
F. Bergadano, A. Giordana, L. Saitta, "Automated Concept Acquisition in Noisy Environments," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 10, no. 4, pp. 555-578, July 1988, doi:10.1109/34.3917
Usage of this product signifies your acceptance of the Terms of Use.