This Article 
 Bibliographic References 
 Add to: 
Fast Parzen Density Estimation Using Clustering-Based Branch and Bound
September 1994 (vol. 16 no. 9)
pp. 950-954

This correspondence proposes a fast Parzen density estimation algorithm that would be especially useful in nonparametric discriminant analysis problems. By preclustering the data and applying a simple branch and bound procedure to the clusters, significant numbers of data samples that would contribute little to the density estimate can be excluded without detriment to actual evaluation via the kernel functions. This technique is especially helpful in the multivariant case, and does not require a uniform sampling grid. The proposed algorithm may also be used in conjunction with the data reduction technique of Fukunaga and Hayes (1989) to further reduce the computational load. Experimental results are presented to verify the effectiveness of this algorithm.

[1] B. W. Silverman,Density Estimation for Statistics and Data Analysis. London: Chapman and Hall, 1986.
[2] P. E. Hart, "The condensed nearest neighbor rule,"IEEE Trans. Inform. Theory, vol. IT-14, pp. 515-516, 1968.
[3] K. Fukunaga and P. M. Narendra, "A branch and bound algorithm for computingK-nearest neighbors,"IEEE Trans. Comput., vol. C-24, pp. 750-753, 1975.
[4] K. Fukunaga and R. R. Hayes, "The reduced parzen classifier,"IEEE Trans. Patt. Anal. Mach. Intell., vol. PAMI-11, pp. 423-425, 1989.
[5] B. W. Silverman, "Kernel density estimation using the fast fourier transform," Statistical Algorithm AS176,Appl. Statist., vol. 31, pp. 93-97, 1982.
[6] M. C. Jones and H. W. Lotwick, "A remark on algorithm AS 176: Kernel density estimation using the fast Fourier transform," Remark. AS R50,Appl. Statist., vol. 33, pp. 120-122, 1984.
[7] K. Fukunaga,Introduction to Statistical Pattern Recognition. New York: Academic, 1972.
[8] G. H. Ball and D. J. Hall, "Isodata: A novel method of data analysis and pattern classification," Stanford Research Institute Tech. Rep. NTIS-AD-699616, Stanford, CA, 1965.
[9] C. W. Therrien,Decision, Estimation, and Classification: An Introduction to Pattern Recognition and Related Topics. New York: Wiley, 1989.

Index Terms:
estimation theory; nonparametric statistics; pattern recognition; fast Parzen density estimation; clustering-based branch and bound; nonparametric discriminant analysis; data samples; kernel functions; multivariant case; data reduction technique; computational load
B. Jeon, D.A. Landgrebe, "Fast Parzen Density Estimation Using Clustering-Based Branch and Bound," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 16, no. 9, pp. 950-954, Sept. 1994, doi:10.1109/34.310693
Usage of this product signifies your acceptance of the Terms of Use.