This Article 
 Bibliographic References 
 Add to: 
Estimation of High-Density Regions Using One-Class Neighbor Machines
March 2006 (vol. 28 no. 3)
pp. 476-480
In this paper, we investigate the problem of estimating high-density regions from univariate or multivariate data samples. We estimate minimum volume sets, whose probability is specified in advance, known in the literature as density contour clusters. This problem is strongly related to One-Class Support Vector Machines (OCSVM). We propose a new method to solve this problem, the One-Class Neighbor Machine (OCNM) and we show its properties. In particular, the OCNM solution asymptotically converges to the exact minimum volume set prespecified. Finally, numerical results illustrating the advantage of the new method are shown.

[1] E. Alpaydin and C. Kaynak, “Cascading Classifiers,” Kybernetika, vol. 34, no. 4, pp. 369-374, 1998.
[2] L. Devroye, “Recursive Estimation of the Mode of Multivariate Density,” Canadian J. Statistics, vol. 7, no. 2, pp. 159-167, 1979.
[3] L. Devroye and A. Krzyzak, “On the Hilbert Kernel Density Estimate,” Statistics and Probability Letters, vol. 44, pp. 299-308, 1999.
[4] O.L. Mangasarian and W.H. Wolberg, “Cancer Diagnosis via Linear Programming,” SIAM News, vol. 23, no. 5, pp. 1-18, 1990.
[5] G. Rätsch, S. Mika, B. Schölkopf, and K.R. Müller, “Constructing Boosting Algorithms from SVMs: An Application to One-Class Classification,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 9, pp. 1184-1199, Sept. 2002.
[6] B. Schölkopf, C. Burges, and V. Vapnik, “Extracting Support Data for a Given Task,” Proc. First Int'l Conf. Knowledge Discovery and Data Mining, 1995.
[7] B. Schölkopf, J.C. Platt, J. Shawe-Taylor, A.J. Smola, and R.C. Williamson, “Estimating the Support of a High Dimensional Distribution,” Neural Computation, vol. 13, no. 7, pp. 1443-1471, 2001.
[8] B.W. Silverman, Density Estimation for Statistics and Data Analysis. Chapman & Hall, 1990.
[9] D.M.J. Tax and R.P.W. Duin, “Support Vector Data Description,” Machine Learning, vol. 54, no. 1, pp. 45-66, 2004.
[10] A.B. Tsybakov, “On Nonparametric Estimation of Density Level Sets,” Annals of Statistics, vol. 25, no. 3, pp. 948-969, 1997.

Index Terms:
Index Terms- Density estimation, kernel methods, One-Class Support Vector Machines.
Alberto Mu?, Javier M. Moguerza, "Estimation of High-Density Regions Using One-Class Neighbor Machines," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 28, no. 3, pp. 476-480, March 2006, doi:10.1109/TPAMI.2006.52
Usage of this product signifies your acceptance of the Terms of Use.