This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Influential Rule Search Scheme (IRSS)-A New Fuzzy Pattern Classifier
August 2004 (vol. 16 no. 8)
pp. 881-893

Abstract—Automatic generation of fuzzy rule base and membership functions from an input-output data set, for reliable construction of an adaptive fuzzy inference system, has become an important area of research interest. The present paper proposes a new robust, fast acting adaptive fuzzy pattern classification scheme, named influential rule search scheme (IRSS). In IRSS, rules which are most influential in contributing to the error produced by the adaptive fuzzy system are identified at the end of each epoch and subsequently modified for satisfactory performance. This fuzzy rule base adjustment scheme is accompanied by an output membership function adaptation scheme for fine tuning the fuzzy system architecture. This iterative method has shown a relatively high speed of convergence. Performance of the proposed IRSS is compared with other existing pattern classification schemes by implementing it for Fisher's iris data problem and Wisconsin breast cancer data problems.

[1] J.R. Jang and C. Sun, Neuro-Fuzzy Modeling and Control Proc. IEEE, vol. 83, no. 3, pp. 378-405, Mar. 1995.
[2] S. Abe and M.S. Lan, Fuzzy Rules Extraction Directly from Numerical Data for Function Approximation IEEE Trans. System, Man, and Cybernetics, vol. 25, no. 1, pp. 119-129, Jan. 1995.
[3] S. Abe and M.S. Lan, A Method for Fuzzy Rules Extraction Directly from Numerical Data and Its Application to Pattern Classification IEEE Trans. Fuzzy Systems, vol. 3, no. 1, pp. 18-28, Feb. 1995.
[4] B. Lampson, "Protection," Proc. 5th Princeton Symp. Information Sciences and Systems, Princeton Univ., Mar. 1971; reprinted inACM Operating Systems Review, Jan. 1974, pp. 18-24.
[5] G.O.A. Zapata, R.K.H. Galvao, and T. Yoneyama, Extracting Fuzzy Control Rules from Experimental Human Operator Data IEEE Trans. System, Man, and Cybernetics - Part B: Cybernetics, vol. 29, no. 3, pp. 398-406, June 1999.
[6] T.P. Wu and S.M. Chen, A New Method for Constructing Membership Functions and Fuzzy Rules from Training Examples IEEE Trans. System, Man, and Cybernetics - Part B: Cybernetics, vol. 29, no. 1, pp. 25-40, Feb. 1999.
[7] A. Lotfi and A.C. Tsoi, Learning Fuzzy Inference Systems Using an Adaptive Membership Function Scheme IEEE Trans. System, Man, and Cybernetics - Part B: Cybernetics, vol. 26, no. 2, pp. 326-331, Apr. 1996.
[8] L.X. Wang and J.M. Mendel, Generating Fuzzy Rules by Learning From Examples IEEE Trans. System, Man, and Cybernetics, vol. 22, no. 6, pp. 1414-1427, Dec. 1992.
[9] T.P. Hong and C.Y. Lee, Induction of Fuzzy Rules and Membership Functions from Training Examples Fuzzy Sets and Systems, vol. 84, pp. 33-47, 1996.
[10] T.P. Hong and J.B. Chen, Finding Relevant Attributes and Membership Functions Fuzzy Sets and Systems, vol. 103, pp. 389-404, 1999.
[11] T.P. Hong and J.B. Chen, Processing Individual Fuzzy Attributes for Fuzzy Rule Induction Fuzzy Sets and Systems, vol. 112, pp. 127-140, 2000.
[12] S. Wang, Generating Fuzzy Membership Functions: A Monotonic Neural Network Model Fuzzy Sets and Systems, vol. 61, pp. 71-81, 1994.
[13] I. Rojas, H. Pomares, J. Ortega, and A. Prieto, Self-Organised Fuzzy System Generation from Training Examples IEEE Trans. Fuzzy Systems, vol. 8, no. 1, pp. 23-36, Feb. 2000.
[14] P.K. Simpson, Fuzzy Min-Max Neural Networks-Part 1: Classification IEEE Trans. Neural Networks, vol. 3, no. 5, pp. 776-786, Sept. 1992.
[15] P.K. Simpson, Fuzzy Min-Max Neural Networks-Part 2: Clustering IEEE Trans. Fuzzy Systems, vol. 1, no. 1, pp. 32-45, Feb. 1993.
[16] S.C. Newton, S. Pemmaraju, and S. Mitra, Adaptive Fuzzy Leader Clustering of Complex Data Sets in Pattern Recognition IEEE Trans. Neural Networks, vol. 3, no. 5, pp. 794-800, Sept. 1992.
[17] I.H. Suh, J.H. Kim, and F.C.H. Rhee, Convex-Set-Based Fuzzy Clustering IEEE Trans. Fuzzy Systems, vol. 7, no. 3, pp. 271-285, June 1999.
[18] C.L. Blake and C.J. Merz, UCI Repository of Machine Learning Databases Univ. of California, Irvine, Dept. of Information and Computer Science,http://www.ics.uci.edu/~mlearnMLRepository.html , 1998.
[19] T.J. Ross, Fuzzy Logic in Engineering Applications. Mcgraw-Hill Inc., Int'l eds., 1997.
[20] R. Babuska, Fuzzy Modeling for Control. Kluwer Academic Publishers, 1998.
[21] M. Delgado, A.F.G. Skarmeta, and F. Martin, A Fuzzy Clustering Based Rapid Prototyping for Fuzzy Rule-Based Modeling IEEE Trans. Fuzzy Systems, vol. 5, no. 2, pp. 223-232, May 1997.
[22] T.A. Runkler and J.C. Bezdek, Alternating Cluster Estimation: A New Tool for Clustering and Function Approximation IEEE Trans. Fuzzy Systems, vol. 7, no. 4, pp. 377-393, Aug. 1999.
[23] A. Baraldi and P. Blonda, A Survey of Fuzzy Clustering Algorithms for Pattern Recognition - Part I and Part II IEEE Trans. Systems, Man, and Cybernetics - Part B: Cybernetics, vol. 29, no. 6, pp. 778-801, Dec. 1999.
[24] C.T. Lin and C.S.G. Lee, "Neural-Network-Based Fuzzy Logic Control and Decision System," IEEE Trans. Computers, vol. 40, no. 12, pp. 1,320-1,326, Dec. 1991.
[25] W. Pedrycz, Fuzzy Neural Networks with Reference Neurons as Pattern Classifiers IEEE Trans. Neural Networks, vol. 3, no. 5, pp. 770-775, Sept. 1992.
[26] T. Tani, S. Murakoshiz, and M. Umano, Neuro-Fuzzy Hybrid Control System of Tank Level in Petroleum Plant IEEE Trans. Fuzzy Systems, vol. 4, no. 3, pp. 360-368, Aug. 1996.
[27] J.T. Spooner and K.M. Passino, Stable Adaptive Control Using Fuzzy Systems and Neural Networks IEEE Trans. Fuzzy Systems, vol. 4, no. 3, pp. 339-359, Aug. 1996.
[28] J. Zhang and A.J. Morri, Fuzzy Neural Networks for Nonlinear Systems Modeling IEE Proc. Control Theory Applications, vol. 142, no. 6, pp. 551-561, Nov. 1995.
[29] Y.Q. Zhang and A. Kandel, Compensatory Neurofuzzy Systems with Fast Learning Algorithms IEEE Trans. Neural Networks, vol. 9, no. 1, pp. 83-105, Jan. 1998.
[30] D.A. Linkens and H.O. Nyongesa, Genetic Algorithms for Fuzzy Control, Part 1: Offline System Development and Application IEE Proc. Control Theory Applications, vol. 142, no. 3, pp. 161-176, May 1995.
[31] D.A. Linkens and H.O. Nyongesa, Genetic Algorithms for Fuzzy Control, Part 2: Online System Development and Application IEE Proc. Control Theory Applications, vol. 142, no. 3, pp. 177-185, May 1995.
[32] C.L. Karr and E.J. Gentry, Fuzzy Control of pH Using Genetic Algorithms IEEE Trans. Fuzzy Systems, vol. 1, no. 1, pp. 46-53, Feb. 1993.
[33] B.C. Lovel and A.P. Bradley, The Multiscale Classifier IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 18, no. 2, pp. 124-137, Feb. 1996.
[34] J.T-Y. Kwok, The Evidence Framework Applied to Support Vector Machines IEEE Trans. Neural Networks, vol. 11, no. 5, pp. 1162-1173, Sept. 2000.
[35] R. Setiono, ExtractingM-of-NRules from Trained Neural Networks IEEE Trans. Neural Networks, vol. 11, no. 2, pp. 512-519, Mar. 2000.
[36] T-P. Hong and S.-S. Tseng, A Generalised Version Space Learning Algorithm for Noisy and Uncertain Data IEEE Trans. Knowledge and Data Eng., vol. 9, no. 2, pp. 336-340, Mar.-Apr. 1997.
[37] H. Ishibuchi and T. Nakashima, Effect of Rule Weights in Fuzzy Rule-Based Classification Systems IEEE Trans. Fuzzy Systems, vol. 9, no. 4, pp. 506-515, Aug. 2001.
[38] H.-M. Lee, C.-M. Chen, J.-M. Chen, and Y.-L. Jou, An Efficient Fuzzy Classifier with Feature Selection Based on Fuzzy Entropy IEEE Trans. Systems, Man, and Cybernetics - Part B: Cybernetics, vol. 31, no. 3, pp. 426-432, June 2001.
[39] S. Fahlman and C. Lebiere, The Cascade-Correlation Learning Architecture Carnegie Mellon Univ., School of Computer Science, Technical Report CMU-CS-90-100, Feb. 1990.

Index Terms:
Pattern classification, adaptive fuzzy systems, fuzzy c-means clustering, Tuning of fuzzy rule base and output membership functions.
Citation:
Amitava Chatterjee, Anjan Rakshit, "Influential Rule Search Scheme (IRSS)-A New Fuzzy Pattern Classifier," IEEE Transactions on Knowledge and Data Engineering, vol. 16, no. 8, pp. 881-893, Aug. 2004, doi:10.1109/TKDE.2004.26
Usage of this product signifies your acceptance of the Terms of Use.