This Article 
 Bibliographic References 
 Add to: 
Rule Acquiring Expert Controllers
June 1991 (vol. 3 no. 2)
pp. 252-256

A paradigm is developed for a controller to learn to control an environment by use of a benefit measure to judge the control. Rules are acquired that fire in a stimulus-response fashion for control, and rules continue to be acquired to adapt to an evolving environment. The model includes both knowledge acquisition and skill refinement through bottom-up (data driven) learning of the top-down control strategy. It is more flexible than hardware learning systems such as ADELINE or MADELINE. The controller model self-organizes by acquiring rules, and adapts by continuing to update its rules while controlling an external environment. It does this by judging the benefit of feedback due to the selected control rules and keeping counts in cells from which a rule function is generated.

[1] S. Bow,Pattern Recognition. New York: Marcel Dekker, 1984.
[2] D. J. Burr, "A neural network digit recognizer," inProc. IEEE Cybern. Conf., vol. 2, Atlanta, GA, 1986, pp. 1621-1625.
[3] C. Cooper, J. Gibson, V. Eveleigh, J. Lindenlaub, J. Meditch, and R. Raible, "A survey of the philosophy and state of the art of adaptive systems," Rep. PRF 2358. Purdue Univ., W. Lafayette, IN, July 1960.
[4] T. Dietterich and R. Michalski, "A comparative review of selected methods for learning from examples," inMachine Learning, Vol. 1, Palo Alto, CA: Tioga, 1983, pp. 41-81.
[5] R. Forsyth,Machine Learning for Expert Systems, appeared in Machine Learning, Forsyth and Rada, Eds. Chichester: Halsted (Wiley), 1986, pp. 14-23.
[6] K.S. Fu, "Learning control systems--A review and outlook,"IEEE Trans. Pattern Anal. Machine Intell., vol. 8, no. 3, pp. 327-342, May 1986.
[7] C. G. Looney, "Fuzzy Petri nets for rule-based decisionmaking,"IEEE Trans. Syst., Man, Cybern., vol. SMC-18, no. 1, pp. 178-183, Jan./Feb. 1988.
[8] C. Looney, E. Tacker, and A. Patel, "Pattern recognition in neural networks with multiple weight sets," inProc. ISMM 1989 Int. Conf. App. Microcomput., Reno, NV, Feb. 1989, pp. 13-16.
[9] J. Mendel and R. McLaren, "Reinforcement-learning control and pattern recognition systems," inAdaptive, Learning, and Pattern Recognition Systems, K. S. Fu and J. M. Mendel, Eds. New York: Academic, 1970, pp. 287-318.
[10] R. Michalski, J. Carbonnell, and T. Mitchell, "An overview of machine learning," inMachine Learning, Vol. 1, Carbonnell, Michalski, and Mitchell, Eds. Palo Alto, CA: Tioga, 1983, pp. 3-24.
[11] T. Mitchell, "Generalization as search,"Artif. Intell., vol. 18. pp. 202-226, 1982.
[12] K. Narendra and M. Thatachar, "Learning automata--A survey,"IEEE Trans. Syst., Man, Cybern., vol. 4, no. 4, pp. 323-334, July 1974.
[13] M. F. Norman, "Markovian learning processes,"SIAM Rev., vol. 16, no. 2, pp. 143-162, Apr. 1974.
[14] D. B. Parker, "Learning-logic," Invention Rep. S81-64, File 1, Office of Technology Licensing, Stanford Univ., Oct. 1982.
[15] E. Rich,Artificial Intelligence. New York: McGraw-Hill, 1983.
[16] D. E. Rumelhart, G. E. Hinton, and R. J. Williams, "Learning internal representation by error propagation,"Parallel Distributed Processing: Explorations in the Microstructure of Cognition, vols. 1 and 2. Cambridge, MA: MIT Press, 1986.
[17] G. Saridis, "On a class of performance-adaptive self-organizing control systems," inPattern Recognition and Machine Learning, K. S. Fu, Ed. New York: Plenum, 1971, pp. 204-220.
[18] H. Simon, "Why should machines learn?," inMachine Learning, Vol. 1, Carbonnell, Michalski, and Mitchell, Eds. Palo Alto, CA: Tioga, 1983.
[19] P. J. Werbos, "Beyond regression: New tools for prediction and analysis in the behavioral sciences," thesis in Applied Mathematics, Harvard Univ., Aug. 1974.
[20] B. Widrow and M. E. Hoff, "Adaptive switching circuits," inProc. IRE WESCON, 1960, pp. 96-104.
[21] S. W. Wilson, "Knowledge growth in an artificial animal," inAdaptive and Learning Systems: Theory and Applications, K. S. Narendra, Ed. New York: Plenum, 1986, pp. 255-264.

Index Terms:
expert controllers; stimulus-response fashion; evolving environment; knowledge acquisition; skill refinement; top-down control strategy; self-organizes; external environment; feedback; selected control rules; rule function; computerised control; expert systems; knowledge acquisition; learning systems
C.G. Looney, "Rule Acquiring Expert Controllers," IEEE Transactions on Knowledge and Data Engineering, vol. 3, no. 2, pp. 252-256, June 1991, doi:10.1109/69.88005
Usage of this product signifies your acceptance of the Terms of Use.