This Article 
 Bibliographic References 
 Add to: 
Classification Using Adaptive Wavelets for Feature Extraction
October 1997 (vol. 19 no. 10)
pp. 1058-1066

Abstract—A major concern arising from the classification of spectral data is that the number of variables or dimensionality often exceeds the number of available spectra. This leads to a substantial deterioration in performance of traditionally favored classifiers. It becomes necessary to decrease the number of variables to a manageable size, whilst, at the same time, retaining as much discriminatory information as possible. A new and innovative technique based on adaptive wavelets, which aims to reduce the dimensionality and optimize the discriminatory information is presented. The discrete wavelet transform is utilized to produce wavelet coefficients which are used for classification. Rather than using one of the standard wavelet bases, we generate the wavelet which optimizes specified discriminant criteria.

[1] S. Aeberhard, D. Coomans, and O. De Vel, "Comparative Analysis of Statistical Pattern Recognition Methods in High Dimensional Settings," Pattern Recognition, vol. 27, pp. 1,065-1,077, 1994.
[2] J. Friedman, "Regularized Discriminant Analysis," J. Am. Statistical Assoc., vol. 84, pp. 165-175, 1989.
[3] M. Bos and J.A.M. Vrielink, "The Wavelet Transform for Pre-processing IR Spectra in the Identification of Mono- and Di-substituted Benzenes," Chemometrics and Intelligent Laboratory Systems, vol. 23, pp. 115-122, 1994.
[4] R. Tate, D. Watson, and S. Eglen, "Using Wavelets for Classifying Human in vivo Magnetic Resonance Spectra," Wavelets and Statistics, A. Antoniadis and G. Oppenheim, eds., pp. 377-383.New York: Springer Verlag, 1995.
[5] N. Saito and R.R. Coifman, "Local Discriminant Bases," Mathematical Imaging: Wavelet Applications in Signal and Image Processing II, Proc. SPIE, A.F. Laine and M.A. Unser, eds., vol. 2,303, 1994.
[6] R.E. Learned and A.S. Wilsky, "A Wavelet Packet Approach to Transient Signal Classification," Applied and Computational Harmonic Analysis, vol. 2, pp. 265-278, 1995.
[7] B.A. Telfer, H.H. Szu, G.J. Dobeck, J.P. Garcia, H. Ko, A. Dubey, and N. Witherspoon, "Adaptive Wavelet Classification of Acoustic and Backscatter and Imagery," Optical Eng., vol. 33, pp. 2,192-2,203, 1994.
[8] H.H. Szu, B. Telfer, and S. Kadambe, "Neural Network Adaptive Wavelets for Signal Representation and Classification," Optical Eng., vol. 31, pp. 1,907-1,916, 1992.
[9] P. Steffen, P.N. Heller, R.A. Gopinath, and C.S. Burrus, Theory of Regular M-Band Wavelet Bases IEEE Trans. Signal Processing, vol. 41, no. 12, pp. 3497-3510, 1993.
[10] "The Lifting Scheme: A Construction of Second Generation Wavelets," Dept. of Mathematics, Univ. of South Carolina.
[11] K. Mardia, J. Kent, and J. Bibby, Multivariate Analysis.New York: Academic Press, 1979.
[12] R. Turcajová and J. Kautsky, "Shift Products and Factorizations of Wavelet Matrices," Numerical Algorithms, vol. 8, pp. 27-54, 1994.
[13] G. Strang, Wavelets and Filter Banks. Wellesley-Cambridge Press, 1996.
[14] I. Daubechies, "Ten Lectures on Wavelets, Science for Industrial and Applied Mathematics," 1992.
[15] S.G. Mallat,“A theory for multiresolution signal decomposition: The wavelet representation,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 11, no. 7, pp. 674-693, 1989.
[16] J. Kautsky and R. Turcajová, "Adaptive Wavelets for Signal Analysis," Proc. Sixth Int'l Conf. Computer Analysis of Images and Patterns, pp. 906-911,Prague, Springer Verlag, 1995.
[17] D. Coomans and I. Broeckaert, Potential Pattern Recognition in Chemical and Medical Decision Making, Research Studies Press.Chichester: John Wiley and Sons, 1986.
[18] S. Brier, Monthly Weather Rev., vol. 78, pp. 1-31, 1950.
[19] J. Habbema, J. Hilden, and B. Bjerregaard, Meth. Inf. Med., vol. 17, pp. 217-226, 1978.
[20] MATLAB Optimization Toolbox User's Guide, The Math Works Inc., Natick, 1994.
[21] Y. Mallet, D. Coomans, and O. de Vel, "Recent Developments in Discriminant Analysis on High Dimensional Data," Chemometrics and Intelligent Laboratory Systems, vol. 35, pp. 157-173, 1996.

Index Terms:
r class category, s set of high-pass filter coefficients l, level of decomposed data or level of the discrete wavelet transform, t band at some level of the discrete wavelet transform, n number of cases, p dimensionality or number of variables.
Yvette Mallet, Danny Coomans, Jerry Kautsky, Olivier De Vel, "Classification Using Adaptive Wavelets for Feature Extraction," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 19, no. 10, pp. 1058-1066, Oct. 1997, doi:10.1109/34.625106
Usage of this product signifies your acceptance of the Terms of Use.