This Article 
 Bibliographic References 
 Add to: 
Linear Discriminant Analysis for Two Classes via Removal of Classification Structure
February 1997 (vol. 19 no. 2)
pp. 187-192

Abstract—A new method for two-class linear discriminant analysis, called "removal of classification structure," is proposed. Its novelty lies in the transformation of the data along an identified discriminant direction into data without discriminant information and iteration to obtain the next discriminant direction. It is free to search for discriminant directions oblique to each other and ensures that the informative directions already found will not be chosen again at a later stage. The efficacy of the method is examined for two discriminant criteria. Studies with a wide spectrum of synthetic data sets and a real data set indicate that the discrimination quality of these criteria can be improved by the proposed method.

[1] M.E. Aladjem, "PNM: A Program for Parametric and Nonparametric Mapping of Multidimensional Data," Computers in Biology and Medicine, vol. 21, pp. 321-343, 1991.
[2] M.E. Aladjem, "Multiclass Discriminant Mappings," Signal Processing, vol. 35, pp. 1-18, 1994.
[3] M.E. Aladjem, "Discriminant Plots Obtained via Removal of Classification Structure," Proc. 12th Int'l Conf. Pattern Recognition, vol. 2, pp. 67-71, 1994.
[4] P.A. Devijver and J. Kittler, Pattern Recognition: A Statistical Approach.London: Prentice-Hall, , 1982.
[5] J.H. Friedman, "Exploratory Projection Pursuit," J. American Statistical Association, vol. 82, pp. 249-266, 1987.
[6] J.H. Friedman, "Regularized Discriminant Analysis," J. American Statistical Association, vol. 84, pp. 165-175, 1989.
[7] K. Fukunaga and T.E. Flick, "The 2-NN Rule for More Accurate NN Risk Estimate," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 7, pp. 107-111, 1985.
[8] K. Fukunaga, Introduction to Statistical Pattern Recognition, second ed. New York: Academic Press, 1990.
[9] Y. Hamamoto, Y. Matsuura, T. Kanaoka, and S. Tomita, "A Note on the Orthonormal Discriminant Vector Method for Feature Extraction," Pattern Recognition, vol. 24, pp. 681-684, 1991.
[10] W.J. Krzanowski, P. Jonathan, W.V. McCarthy, and M.R. Thomas, "Discriminant Analysis With Singular Covariance Matrices: Methods and Applications to Spectroscopic Data," Applied Statistics, vol. 44, pp. 101-115, 1995.
[11] W. Malina, "On an Extended Fisher Criterion for Feature Selection," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 3, pp. 611-614, 1981.
[12] G.J. McLachlan, Discriminant Analysis and Statistical Pattern Recognition.New York: John Wiley&Sons, Inc., 1992.
[13] W. Siedlecki, K. Siedlecka, and J. Sklansky, "An Overview of Mapping Techniques for Exploratory Pattern Analysis," Pattern Recognition, vol. 21, pp. 411-429, 1988.

Index Terms:
Exploratory data analysis, dimension reduction, linear discriminant analysis, discriminant plots, structure removal.
Mayer Aladjem, "Linear Discriminant Analysis for Two Classes via Removal of Classification Structure," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 19, no. 2, pp. 187-192, Feb. 1997, doi:10.1109/34.574805
Usage of this product signifies your acceptance of the Terms of Use.