The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.01 - January-March (2008 vol.5)
pp: 67-79
ABSTRACT
A computational intelligent system that models the human cognitive abilities may promise significant performance in problem learning because human is effective in learning and problem solving. Functionally modelling the human cognitive abilities not only avoids the details of the underlying neural mechanisms performing the tasks, but also reduces the complexity of the system. The complementary learning mechanism is responsible for human pattern recognition, i.e. human attends to positive and negative samples when making decision. Furthermore, human concept learning is organized in a hierarchical fashion. Such hierarchical organization allows the divide-and-conquer approach to the problem. Thus, integrating the functional models of hierarchical organization and complementary learning can potentially improve the performance in pattern recognition. Hierarchical complementary learning exhibits many of the desirable features of pattern recognition. It is further supported by the experimental results that verify the rationale of the integration and that the hierarchical complementary learning system is a promising pattern recognition tool.
INDEX TERMS
cognitive learning, complementary learning, decision support, hierarchical model, fuzzy neural network
CITATION
Tuan Zea Tan, Geok See Ng, Chai Quek, "A Novel Biologically and Psychologically Inspired Fuzzy Decision Support System: Hierarchical Complementary Learning", IEEE/ACM Transactions on Computational Biology and Bioinformatics, vol.5, no. 1, pp. 67-79, January-March 2008, doi:10.1109/TCBB.2007.1064
REFERENCES
[1] G.S. Ng, S.S. Erdogan, and P.W. Ng, “Contenders Network, A New Competitive-Learning Scheme,” Pattern Recognition Letters, vol. 16, no. 11, pp. 1111-1118, 1995.
[2] G.S. Ng and H.C. Sim, “Recognition of Partially Occluded Objects with Back-Propagation Neural Network,” Int'l J. Pattern Recognition and Artificial Intelligence, vol. 12, no. 5, pp. 645-660, 1998.
[3] D. Wang, C. Quek, and G.S. Ng, “Novel Self-Organizing Takagi Sugeno Kang Fuzzy Neural Networks Based on ART-Like Clustering,” Neural Processing Letters, vol. 20, no. 1, pp. 39-51, 2004.
[4] A.M. Tang, C. Quek, and G.S. Ng, “GA-TSKfnn: Parameters Tuning of Fuzzy Neural Network Using Genetic Algorithms,” Expert Systems with Applications, vol. 29, no. 4, pp. 769-781, 2005.
[5] G.S. Ng and H. Singh, “Data Equalisation with Evidence Combination for Pattern Recognition,” Pattern Recognition Letters, vol. 19, no. 3-4, pp. 227-235, 1998.
[6] G.S. Ng and H. Singh, “Democracy in Pattern Classifications: Combinations of Votes from Various Pattern Classifiers,” Artificial Intelligence in Eng., vol. 12, no. 3, pp. 189-204, 1998.
[7] T. Zhang, R. Ramakrishnan, and M. Livny, “BIRCH: A New Data Clustering Algorithm and Its Application,” Data Mining and Knowledge Discovery, vol. 1, no. 2, pp. 141-182, 1997.
[8] W. Buntine and R. Caruana, “Introduction to Induction and Recursive Partitioning,” Technical Report FIA-91-28, NASA Ames Research Center, 1991.
[9] C. Olaru and L. Wehenkel, “A Complete Fuzzy Decision Tree Technique,” Fuzzy Sets and Systems, vol. 138, pp. 221-254, 2003.
[10] T.Z. Tan, C. Quek, and G.S. Ng, “Ovarian Cancer Diagnosis by Hippocampus and Neocortex-Inspired Learning Memory Structures,” Neural Networks, vol. 18, no. 5-6, pp. 818-825, 2005.
[11] K.A. De Jong, W.M. Spears, and D.F. Gordon, “Using Genetic Algorithms for Concept Learning,” Machine Learning, vol. 16, pp.161-188, 1993.
[12] A. An, “Learning Classification Rules from Data,” Computers and Math. with Applications, vol. 45, pp. 737-748, 2003.
[13] J. Cendrowska, “PRISM: An Algorithm for Inducing Modular Rules,” Int'l J. Man-Machine Studies, vol. 27, pp. 349-370, 1987.
[14] B. Bhanu and A. Dong, “Concepts Learning with Fuzzy Clustering and Relevance Feedback,” Eng. Applications of Artificial Intelligence, vol. 15, pp. 123-138, 2002.
[15] K. Yoshida and H. Motoda, “CLIP: Concept Learning from Inference Patterns,” Artificial Intelligence, vol. 75, pp. 63-92, 1995.
[16] M.G. Joo and J.S. Lee, “A Class of Hierarchical Fuzzy System with Constraints on the Fuzzy Rules,” IEEE Trans. Fuzzy Systems, vol. 13, no. 2, pp. 194-203, 2005.
[17] O. Huwendiek and W. Brookmann, “Function Approximation with Decomposed Fuzzy Systems,” Fuzzy Sets and Systems, vol. 101, pp. 273-286, 1999.
[18] P. Liu and H. Li, “Hierarchical TS Fuzzy System and Its Universal Approximation,” Information Sciences, vol. 169, pp. 279-303, 2005.
[19] C. Wei and L.-X. Wang, “A Note on Universal Approximation by Hierarchical Fuzzy Systems,” Information Sciences, vol. 123, pp.241-248, 2000.
[20] M.-L. Lee, H.-Y. Chung, and F.-M. Yu, “Modeling of Hierarchical Fuzzy Systems,” Fuzzy Sets and Systems, vol. 138, pp. 343-361, 2003.
[21] J. Feldman, “An Algebra of Human Concept Learning,” J. Math. Psychology, vol. 50, pp. 339-368, 2006.
[22] S.B. Fountain and J.D. Rowan, “Coding of Hierarchical versus Linear Pattern Structure in Rats and Humans,” J. Experimental Psychology: Animal Behavior Processes, vol. 21, no. 3, pp. 187-202, 1995.
[23] T. Kleinsorge, “Hierarchical Switching with Two Types of Judgment and Two Stimulus Dimensions,” Experimental Psychology, vol. 51, no. 2, pp. 145-149, 2004.
[24] C. De Lillo, “Imposing Structure on a Corsi-Type Task: Evidence for Hierarchical Organization Based on Spatial Proximity in Serial-Spatial Memory,” Brain and Cognition, vol. 55, pp. 415-426, 2004.
[25] J. Zhang and D.A. Norman, “Representations in Distributed Cognitive Tasks,” Cognitive Science, vol. 18, pp. 87-122, 1994.
[26] M. Riesenhuber and T. Poggio, “Hierarchical Models of Object Recognition in Cortex,” Nature Neuroscience, vol. 2, no. 11, pp.1019-1025, 1999.
[27] D. George and J. Hawkins, “A Hierarchical Bayesian Model of Invariant Pattern Recognition in the Visual Cortex,” Proc. Int'l Joint Conf. Neural Network, 2005.
[28] S. Sabatini, F. Solari, G. Andreani, C. Bartolozzi, and G.M. Bisio, “A Hierarchical Model of Complex Cells in Visual Cortex for the Binocular Perception of Motion-In-Depth,” Proc. Advances in Neural Information Processing Systems Conf., pp. 1271-1278, 2002.
[29] W. Zhou and R. Coggins, “Computational Models of the Amygdala and the Orbitofrontal Cortex: A Hierarchical Reinforcement Learning System for Robotic Control,” Proc. 15th Australian Joint Conf. Artificial Intelligence (AI '02), pp. 419-430, 2002.
[30] T.V. Sewards and M.A. Sewards, “Representations of Motivational Drives in Mesial Cortex, Medial Thalamus, Hypothalamus, and Midbrain,” Brain Research Bull., vol. 61, pp. 25-49, 2003.
[31] A. Bodegård, S. Geyer, C. Grefkes, K. Zilles, and P.E. Roland, “Hierarchical Processing of Tactile Shape in the Human Brain,” Neuron, vol. 31, pp. 317-328, 2001.
[32] T. Toda and M. Taoka, “Hierarchical Somesthetic Processing of Tongue Inputs in the Post-Central Somatosensory Cortex of Conscious Macaque Monkeys,” Experimental Brain Research, vol. 147, pp. 243-251, 2002.
[33] S. Grossberg, “The Complementary Brain: Unifying Brain Dynamics and Modularity,” Trends in Cognitive Science, vol. 4, no. 6, pp. 233-246, 2000.
[34] J.L. McClelland, B.L. McNaughton, and R.C. O'Reilly, “Why There Are Complementary Learning System in the Hippocampus and Neocortex: Insights from Successes and Failure of Connectionist Models of Learning and Memory,” Psychological Rev., vol. 102, pp.419-457, 1995.
[35] I. Gauthier, P. Skudlarski, J.C. Gore, and A.W. Anderson, “Expertise for Cars and Birds Recruits Brain Areas Involved in Face Recognition,” Nature Neuroscience, vol. 3, no. 2, pp. 191-197, 2000.
[36] Z. Zhang, Y. Liu, and T. Zhao, “SVM Based Feature Screening Applied to Hierarchical Cervical Cancer Detection,” Proc. Int'l Conf. Diagnostic Imaging and Analysis, Aug. 2002.
[37] F. Gobet, P.C.R. Lane, S. Croker, P.C.-H. Cheng, G. Jones, L. Oliver, and J.M. Pine, “Chunking Mechanisms in Human Learning,” Trends in Cognitive Sciences, vol. 5, no. 6, pp. 236-243, 2001.
[38] R. Jensen and Q. Shen, “Fuzzy-Rough Sets for Descriptive Dimensionality Reduction,” Proc. IEEE Int'l Conf. Fuzzy Systems, vol. 1, pp. 29-34, 2002.
[39] N. Bonnet, M. Herbin, J. Cutrona, and J.M. Zahm, “A New Clustering Approach, Based on the Estimation of the Probability Density Function, for Gene Expression Data,” Classification, Clustering and Data Analysis: Recent Advances and Applications, K.Jajuga, A. Sokolowski, H.-H. Bock, eds., Springer, 2002.
[40] Genetic Algorithms for Pattern Recognition, K.P. Sankar and P.P.Wong, eds. CRC Press, 1996.
[41] R. Agrawal, J. Gehrke, D. Gunopulos, and P. Raghavan, “Automatic Subspace Clustering of High Dimensional Data for Data Mining Application,” Proc. ACM SIGMOD '98, pp. 94-105, 1998.
[42] J. Casillas, O. Cordón, and F. Herrera, “Interpretability Improvements to Find the Balance Interpretability-Accuracy in Fuzzy Modeling: An Overview,” Accuracy Improvements in Linguistic Fuzzy Modeling, Studies in Fuzziness and Soft Computing, J. Casillas, O. Cordón, F. Herrera, and L. Magdalena, eds., pp. 27-45, Springer, 2003.
[43] M. Steinbach, L. Ertöz, and V. Kumar, “The Challenges of Clustering High Dimensional Data,” New Directions in Statistical Physics: Bioinformatics and Pattern Recognition, L.T. Wille, ed., pp.273-307, Springer, 2002.
[44] G.J. McLachlan, Discriminant Analysis and Statistical Pattern Recognition. John Wiley & Sons, 1992.
[45] J.S. Deogun, V.V. Raghavan, A. Sarkar, and H. Sever, “Data Mining: Trends in Research and Development,” Rough Sets and Data Mining, Analysis of Imprecise Data, T.Y. Lin and N. Cercone, eds., pp. 9-45, Kluwer Academic Publishers, 1997.
[46] S. Vijayakumar and A. D'Souza, “Incremental Online Learning in High Dimensions,” Neural Computation, vol. 17, pp. 2602-2634, 2005.
[47] P.S. Bradley, U.M. Fayyad, and C. Reina, “Scaling Clustering Algorithms to Large Database,” Proc. Fourth Int'l Conf. Knowledge Discovery and Data Mining (KDD '98), pp. 9-15, 1998.
[48] J. Hanm and N. Kamber, Data Mining: Concepts and Techniques. Morgan Kaufmann, 2001.
[49] D. Singh, P.G. Febbo, K. Ross, D.G. Jackson, J. Manola, C. Ladd, P. Tamayo, A.A. Renshaw, A.V. D'Amico, J.P. Richie, E.S. Lander, M. Loda, P.W. Kantoff, T.R. Golub, and W.R. Sellers, “Gene Expression Correlates of Clinical Prostate Cancer Behavior,” Cancer Cell, vol. 1, pp. 203-209, 2002.
[50] D.A. Notterman, U. Alon, A.J. Sierk, and A.J. Levine, “Transcriptional Gene Expression Profiles of Colorectal Adenoma, Adenocarcinoma and Normal Tissue Examined by Oligonucleotide Arrays,” Cancer Research, vol. 61, pp. 3124-3130, 2001.
[51] E.F. Petricoin III, A.M. Ardekani, B.A. Hitt, P.J. Levine, V.A. Fusaro, S.M. Steinberg, G.B. Mills, C. Simone, D.A. Fishman, E.C. Kohn, and L.A. Liotta, “Use of Proteomic Patterns in Serum to Identify Ovarian Cancer,” The Lancet, vol. 359, pp. 572-577, 2002.
[52] S.R. Hingorani, E.F. Petricoin III, A. Maitra, V. Rajapakse, C. King, M.A. Jocabetz, S. Ross, T.P. Conrads, T.D. Veenstra, B.A. Hitt, Y. Kawaguchi, D. Johann, L.A. Liotta, H.C. Crawford, M.E. Putt, T. Jacks, C.V.E. Wright, R.H. Hruban, A.M. Lowy, and D.A. Tuveson, “Preinvasive and Invasive Ductal Pancreatic Cancer and Its Early Detection in the Mouse,” Cancer Cell, vol. 4, no. 6, pp.437-450, 2003.
[53] E.-J. Yeoh, M.E. Ross, S.A. Shurtleff, W.K. Williams, D. Patel, R. Mahfouz, F.G. Behm, S.C. Raimondi, M.V. Relling, A. Patel, C. Cheng, D. Campana, D. Wilkins, X. Zhou, J. Li, H. Liu, C.-H. Pui, W.E. Evans, C. Naeve, L. Wong, and J.R. Downing, “Classification, Subtype Discovery and Prediction of Outcome in Pediatric Acute Lynphoblastic Leukemia by Gene Expression Profiling,” Cancer Cell, vol. 1, pp. 133-143, 2002.
[54] S.C. Madeira and A.L. Oliveira, “Biclustering Algorithms for Biological Data Analysis: A Survey,” IEEE Trans. Computational Biology and Bioinformatics, vol. 1, no. 1, pp. 24-45, Jan.-Mar. 2004.
[55] B. Krishnapuram, A.J. Hartemink, L. Carin, and M.A.T. Figueiredo, “A Bayesian Approach to Joint Feature Selection and Classifier Design,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 26, no. 9, pp. 1105-1111, Sept. 2004.
27 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool