This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
A Hybrid Neural Network System for Pattern Classification Tasks with Missing Features
April 2005 (vol. 27 no. 4)
pp. 648-653
A hybrid neural network comprising Fuzzy ARTMAP and Fuzzy C--Means Clustering is proposed for pattern classification with incomplete training and test data. Two benchmark problems and a real medical pattern classification task are employed to evaluate the effectiveness of the hybrid network. The results are analyzed and compared with those from other methods.

[1] F. Kahl, A. Heyden, and L. Quan, “Minimal Projective Reconstruction Including Missing Data,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, pp. 418-423, 2001.
[2] X. Huang and Q. Zhu, “A Pseudo-Nearest-Neighbor Approach for Missing Data Recovery on Gaussian Random Data Sets,” Pattern Recognition Letters, vol. 23, pp. 1613-1622, 2002.
[3] A.C. Morris, M.P. Cooke, and P.D. Green, “Some Solutions to the Missing Feature Problem in Data Classification with Application to Noise Robust ASR,” Proc. Int'l Conf. Acoustics, Speech, and Signal Processing, pp. 737-740, 1998.
[4] G. King, J. Honaker, A. Joseph, and K. Scheve, “Analyzing Incomplete Political Science Data: An Alternative Algorithm for Multiple Imputation,” Am. Political Science Rev., vol. 95, pp. 49-69, 2001.
[5] A.A. Afifi and R.M. Elashoff, “Missing Observations in Multivariate Statistics: Review of the Literature,” J. Am. Statistical Assoc., vol. 61, pp. 595-604, 1966.
[6] H.O. Hartley and R.R. Hocking, “The Analysis of Incomplete Data,” Biometrics, vol 14, pp. 174-194, 1971.
[7] R. Little and D. Rubin, Statistical Analysis with Missing Data, second ed. Wiley Interscience, 2002.
[8] V. Tresp, R. Neuneier, and S. Ahmad, “Efficient Methods for Dealing with Missing Data in Supervised Learning,” Proc. Advances in Neural Information Processing Systems 7, G. Tesauro, D.S. Touretzky, and T.K. Leen, eds., pp. 689-696, 1995.
[9] H. Ishibuchi, A. Miyazaki, K. Kwon, and H. Tanaka, “Learning from Incomplete Training Data with Missing Values and Medical Application,” Proc. IEEE Int'l Joint Conf. Neural Networks, pp. 1871-1874, 1993.
[10] Z. Ghahramani and M.I. Jordan, “Supervised Learning from Incomplete Data via an EM Approach,” Proc. Advances in Neural Information Processing Systems 6, J.D. Cowan, G. Tesauro, and J. Alspector, eds., pp. 120-127, 1994.
[11] M.J. Nijman and H.J. Kappen, “Symmetry Breaking and Training from Incomplete Data with Radial Basis Boltzmann Machines,” Int'l J. Neural Systems, vol. 8, pp. 301-316, 1997.
[12] G.A. Carpenter and S. Grossberg, “A Massively Parallel Architecture for a Self-Organizing Neural Pattern Recognition Machine,” Computer Vision, Graphics, and Image Processing, vol. 37, pp. 54-115, 1987.
[13] G.A. Carpenter, S. Grossberg, N. Markuzon, J.H. Reynolds, and D.B. Rosen, “Fuzzy ARTMAP: A Neural Network Architecture for Incremental Supervised Learning of Analogue Multidimensional Maps,” IEEE Trans. Neural Networks, vol. 3, pp. 698-712, 1992.
[14] M. Caudill and C. Butler, Naturally Intelligent Systems. MIT Press, 1990.
[15] E. Granger, M.A. Rubin, S. Grossberg, and P. Lavoie, “Classification of Incomplete Data Using the Fuzzy ARTMAP Neural Network,” Proc. IEEE Int'l Joint Conf. Neural Networks, vol. 6, pp. 35-40, 2001.
[16] J.C. Bezdek, Pattern Recognition with Fuzzy Objective Function Algorithms. New York: Plenum Press, 1981.
[17] R.J. Hathaway and J.C. Bezdek, “Fuzzy C-Means Clustering with Incomplete Data,” IEEE Trans. Systems, Man, and Cybernetics, Part B, vol. 31, pp. 735-744, 2001.
[18] R.J. Hathaway, Y. Hu, and J.C. Bezdek, “Local Convergence of Tri-Level Alternating Optimization,” Neural, Parallel, and Scientific Computations, vol. 9, pp. 19-28, 2001.
[19] C.P. Lim and R.F. Harrison, “An Incremental Adaptive Network for On-Line Supervised Learning and Probability Estimation,” Neural Networks, vol. 10, pp. 925-939, 1997.
[20] C.L. Blake and C.J. Merz, “UCI Repository of Machine Learning Databases,” Dept. of Information and Computer Science, Univ. of California, Irvine, http://www.ics.uci.edu/mlearnMLRepository.html , 1998.
[21] S.Y. Yoon and S.Y. Lee, “Training Algorithm with Incomplete Data for Feed-Forward Neural Networks,” Neural Processing Letters, vol. 10, pp. 171-179, 1999.
[22] B. Efron, “Bootstrap Methods: Another Look at the Jackknife,” The Annals of Statistics, vol. 7, pp. 1-26, 1979.
[23] A.C. Davidson and D.V. Hinkley, Bootstrap Methods and Their Application. Cambridge Univ. Press, 1997.
[24] M. Fernández and C. Hernández, “An Experimental Evaluation of Different Methods for Handling Missing Inputs,” Proc. Int'l Joint Conf. Neural Networks, vol. 2, pp. 1450-1453, 1998.
[25] G.D. Murray and J.G. Findlay, “Correcting for the Bias Caused by Drop-Outs in Hypertension Trials,” Statistics in Medicine, vol 7, pp. 941-946, 1988.
[26] D. Curran, G. Molenberghs, P.M. Fayers, and D. Machin, “Incomplete Quality of Life Data in Randomized Trials: Missing Forms,” Statistics in Medicine, vol. 17, pp. 697-709, 1998.

Index Terms:
Missing data, Fuzzy ARTMAP, Fuzzy c-Means Clustering, pattern classification.
Citation:
Chee-Peng Lim, Jenn-Hwai Leong, Mei-Ming Kuan, "A Hybrid Neural Network System for Pattern Classification Tasks with Missing Features," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 27, no. 4, pp. 648-653, April 2005, doi:10.1109/TPAMI.2005.64
Usage of this product signifies your acceptance of the Terms of Use.