The Community for Technology Leaders
RSS Icon
Issue No.07 - July (2011 vol.33)
pp: 1482-1486
Albrecht Irle , University of Kiel, Kiel
Jonas Kauschke , University of Kiel, Kiel
A new condition for high accuracy on test sets is given for the method of stochastic discrimination (SD), a pattern recognition method introduced by Kleinberg. This condition provides a simple explanation for the observed good generalization properties and overtraining-resistance. We also show that the method of SD remains valid if the original assumption of uniform distribution on a finite space for resampling is relaxed.
Pattern recognition, stochastic discrimination.
Albrecht Irle, Jonas Kauschke, "On Kleinberg's Stochastic Discrimination Procedure", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.33, no. 7, pp. 1482-1486, July 2011, doi:10.1109/TPAMI.2010.225
[1] L. Breiman, "Bagging Predictors," Machine Learning, vol. 26, pp. 123-140, 1996.
[2] D. Chen, P. Huang, and X. Cheng, "A Concrete Statistical Realization of Kleinberg's Stochastic Discrimination for Pattern Recognition. I. Two-Class Classification," Annals of Statistics, vol. 31, pp. 1393-1412, 2003.
[3] R. Durrett, Probability: Theory and Examples. Wadsworth, 1991.
[4] Y. Freund, "Boosting a Weak Learning Algorithm by Majority," Information and Computation, vol. 121, pp. 256-285, 1995.
[5] Y. Freund and R. Schapire, "Experiments with a New Boosting Algorithm," Proc. 13th Int'l Conf. Machine Learning, pp. 148-156, 1996.
[6] J. Friedman, T. Hastie, and R. Tibshirani, "Additive Logistic Regression: A Statistical View of Boosting (with Discussion)," Annals of Statistics, vol. 28, pp. 337-407, 2000.
[7] T. Hastie, R. Tibshirani, and J. Friedman, The Elements of Statistical Learning: Data Mining, Inference, and Prediction. Springer 2001.
[8] T.K. Ho, "The Random Subspace Method for Constructing Decision Forests," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 20, no. 8, pp. 832-844, Aug. 1998.
[9] A. Irle and J. Kauschke, "On Kleinberg's Stochastic Discrimination Procedure," technical report, Univ. of Kiel, 2009.
[10] E.M. Kleinberg, "Stochastic Discrimination," Annals of Math. and Artificial Intelligence, vol. 1, pp. 207-239, 1990.
[11] E.M. Kleinberg, "An Overtraining-Resistant Stochastic Modeling Method for Pattern Recognition," Annals of Statistics, vol. 24, pp. 2319-2349, 1996.
[12] E.M. Kleinberg, "On the Algorithmic Implementation of Stochastic Discrimination," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 5, pp. 473-490, May 2000.
[13] data.html, 2010.
18 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool