This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Meta Analysis of Classification Algorithms for Pattern Recognition
November 1999 (vol. 21 no. 11)
pp. 1137-1144

Abstract—Various classification algorithms became available due to a surge of interdisciplinary research interests in the areas of data mining and knowledge discovery. We develop a statistical meta-model which compares the classification performances of several algorithms in terms of data characteristics. This empirical model is expected to aid decision making processes of finding the best classification tool in the sense of providing the minimum classification error among alternatives.

[1] S. Aeberhard, D. Coomans, and O. De Vel, “Comparative Analysis of Statistical Pattern Recognition Methods in High Dimensional Settings,” Pattern Recognition, vol. 27, no. 8, pp. 1,065-1,077, 1994.
[2] L. Breiman, J.H. Friedman, R.A. Olshen, and C.J. Stone, Classification and Regression Trees. Monterey, Calif.: Wadsworth and Brooks, 1984.
[3] F.Z. Brill, D.E. Brown, and W.N. Martin, Fast Genetic Selection of Features for Neural Network Classifiers IEEE Trans. Neural Networks, vol. 3, no. 2, pp. 324-328, Mar. 1992.
[4] C. Brodlly and P. Utgoff, “Multivariate Decision Trees,” Machine Learning, vol. 19, pp. 45-77, 1995.
[5] W. Buntine, “Learning Classification Trees,” Statistics and Computing, vol. 2, pp. 63-73, 1992.
[6] B.A. Draper, C.E. Brodley, and P.E. Utgoff, “Goal-Directed Classification Using Linear Machine Decision Trees,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 16, no. 9, pp. 888-893, 1994.
[7] B. Efron, The Jackknife, the Bootstrap and Other Resampling Plans. Philadelphia: SIAM, 1982.
[8] U. Fayyad and E. Simoudis, “An Introduction to Effective Data Mining,” Tutorial Notes, First Pacific-Asia Conf. Knowledge Discovery&Data Mining, Singapore, Feb. 1997.
[9] R. Gnanadesikan and J.R. Kettenring, “Weighting and Selection of Variables for Cluster Analysis,” J. Classification, vol. 12, no. 1, p. 113, 1995.
[10] D.W. Hosmer and S. Lemeshow, Applied Logistic Regression. John Wiley&Sons, 1989.
[11] E.A. Joachimsthaler and A. Stam, “Four Approaches to the Classification Problem in Discriminant Analysis: An Experimental Study,” Decision Sciences, vol. 19, pp. 323-333, 1988.
[12] B.J. Jung and S.Y. Sohn, “Determination of an Economic Lot Size of Color Filters in TFT-LCD Manufacturing,” IE Interfaces, vol. 10, pp. 47-56, 1997.
[13] D. Koller and M. Sahami, “Toward Optimal Feature Selection,” Proc. 13th Int'l Conf. Machine Learning (ML), Bari, Italy, July 1996.
[14] J. Livarinen, K. Valkealahti, A. Visa, and O. Simula, “Feature Selection with Self-Organizing Feature Map,” Proc. Int'l Conf. Artificial Neural Networks, vol. 1,Sorrento, Italy, May 1994.
[15] D. Lowe,A. R. Webb,“Optimized Feature Extraction and the Bayes Decision in Feed-Forward Classifier Networks,” IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 13, pp. 355-364, April 1991.
[16] O.L. Mangasarian, W.N. Street, and W.H. Wolberg, “Breast Cancer Diagnosis via Linear Programming,” Operations Research, vol. 43, pp. 570-577, 1995.
[17] D. Michie, D.J. Spiegelhalter, and C.C. Taylor, Machine Learning, Neural and Statistical Classification. New York: Ellis Horwood, 1994.
[18] J.R. Quinlan, C4.5: Programs for Machine Learning,San Mateo, Calif.: Morgan Kaufman, 1992.
[19] F.E. Shaudys and T.K. Leen, “Feature Selection for Improved Classification,” Proc. Int'l Joint Conf. Neural Networks, Baltimore, 1992.
[20] W. Siedlecki and J. Sklansky, “On Automatic Feature Selection,” Int'l J. Pattern Recognition and Artificial Intelligence, vol. 2, no. 2, pp. 197-220, 1988.
[21] J.E. Smith, T.C. Fogarty, and I.R. Johnson, “Genetic Feature Selection for Clustering and Classification,” Proc. IEE Colloquium Genetic Algorithms in Image Processing Vision, p. 193, 1994.
[22] S.Y. Sohn, “Accelerated Life-Tests for Intermittent Destructive Inspection with Logistic Failure-Distribution,” IEEE Trans. Reliability, vol. 46, pp. 122-129, 1997.
[23] S.Y. Sohn, “Mining Large Maintenance Database,” Facility Maintenance Eng. Proc., pp. 157-160, Seoul, Korea, May 1997.
[24] S.Y. Sohn, “Variable Selection with Correlated Binary Data,” submitted for publication, 1997.
[25] S.Y. Sohn, “Bayesian Dynamic Forecasting for Attribute Reliability,” Computers and IE, vol. 33, nos. 3-4, pp. 741-744, 1997.
[26] S.Y. Sohn, “Statistical Analysis of Environmental Effects on TOW Missile Stockpile Deterioration,” IIE Trans., vol. 28, pp. 995-1,002, Dec. 1996.
[27] S.Y. Sohn, “Growth Curve Analysis Applied to Ammunition Deterioration,” J. Quality Technology, vol. 27, no. 4, pp. 71-80, 1996.
[28] S.Y. Sohn, “Monitoring Declining Quality of Ammunition Stockpile under Step-Stress,” Naval Research Logistics, vol. 41, pp. 707-718, Mar. 1994.
[29] S.Y. Sohn, “Variable Selection in a Linear Growth Curve Model with Autoregressive Within-Individual Errors,” J. Statistical Computation and Simulation, vol. 40, no. 2, pp. 247-255, 1992.
[30] K. Srinivasan and D. Fisher, “Machine Learning Approaches to Estimating Software Development Effort,” IEEE Trans. Software Eng., vol. 21, no. 2, pp. 126–137, Feb. 1995.
[31] P.D. Wasserman, Advanced Methods in Neural Computing, Van Nostrand Reinhold, New York, 1993.
[32] M.A. Wong and T. Lane, “A kth Nearest Neighbor Clustering Procedures,” J. Royal Statistical Soc., Ser. B, 45, pp. 362-368, 1983.

Index Terms:
Data mining, meta analysis, logit model, multivariate statistics.
Citation:
So Young Sohn, "Meta Analysis of Classification Algorithms for Pattern Recognition," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 21, no. 11, pp. 1137-1144, Nov. 1999, doi:10.1109/34.809107
Usage of this product signifies your acceptance of the Terms of Use.