| | This Article | |
| |
| |
| | Share | |
| |
| |
| | Bibliographic References | |
| |
| |
| | Add to: | |
| |
 Digg
 Furl
 Spurl
 Blink
 Simpy
 Google
 Del.icio.us
 Y!MyWeb
| |
| | Search | |
| |
| |
| | |
Adaptation in Statistical Pattern Recognition Using Tangent Vectors
February 2004 (vol. 26 no. 2)
pp. 269-274
Abstract—We integrate the tangent method into a statistical framework for classification analytically and practically. The resulting consistent framework for adaptation allows us to efficiently estimate the tangent vectors representing the variability. The framework improves classification results on two real-world pattern recognition tasks from the domains handwritten character recognition and automatic speech recognition.
[1] C.M. Bishop, Neural Networks for Pattern Recognition. Oxford Univ. Press 1995.
[2] C.M. Bishop, Bayesian PCA Advances in Neural Information Processing Systems, M. Kearns, S. Solla, and D. Cohn, eds., vol. 11, pp. 382-388, 1999.
[3] J. Dahmen, D. Keysers, H. Ney, and M.O. Güld, Statistical Image Object Recognition Using Mixture Densities J. Math. Imaging and Vision, vol. 14, no. 3, pp. 285-296, May 2001.
[4] R.O. Duda, P.E. Hart, and D.G. Stork, Pattern Classification, second ed. New York: Wiley, 2001.
[5] T. Eisele, R. Haeb-Umbach, and D. Langmann, A Comparative Study of Linear Feature Transformation Techniques for Automatic Speech Recognition Proc. Int'l Conf. Spoken Language Processing, vol. I, pp. 252-255, Oct. 1996.
[6] K. Fukunaga, Introduction to Statistical Pattern Recognition, second ed. Computer Science and Scientific Computing Academic Press Inc., 1990.
[7] T. Hastie and P. Simard, Metrics and Models for Handwritten Character Recognition Statistical Science, vol. 13, no. 1, pp. 54-65, Jan. 1998.
[8] T. Hastie, R. Tibshirani, and J. Friedman, The Elements of Statistical Learning. New York: Springer, 2001.
[9] G.E. Hinton, P. Dayan, and M. Revow, Modeling the Manifolds of Images of Handwritten Digits IEEE Trans. Neural Networks, vol. 8, no. 1, pp. 65-74, Jan. 1997.
[10] N. Kambhatla and T.K. Leen, Dimension Reduction by Local Principal Component Analysis Neural Computation, vol. 9, no. 7, pp. 1493-1516, 1997.
[11] D. Keysers, J. Dahmen, and H. Ney, A Probabilistic View on Tangent Distance Proc. 22. DAGM Symp. Mustererkennung, pp. 107-114, Sept. 2000.
[12] D. Keysers, W. Macherey, J. Dahmen, and H. Ney, Learning of Variability for Invariant Statistical Pattern Recognition Proc. 12th European Conf. Machine Learning, Lecture Notes in Computer Science, vol. 2167, pp. 263-275, Springer Verlag, Sept. 2001.
[13] T.P. Minka, Automatic Choice of Dimensionality for PCA Advances in Neural Information Processing Systems, T.K. Leen, T.G. Dietterich, and V. Tresp, eds., vol. 13, pp. 598-604, 2000.
[14] S. Roweis and Z. Ghahramani, A Unifying Review of Linear Gaussian Models Neural Computation, vol. 11, no. 2, pp. 305-345, 1999.
[15] B. Schölkopf, P. Simard, A. Smola, and V. Vapnik, Prior Knowledge in Support Vector Kernels Advances in Neural Information Processing Systems, M. Jordan, M. Kearns, and S. Solla, eds., vol. 10, pp. 640-646, 1998.
[16] P. Simard, Y. Le Cun, and J. Denker, Efficient Pattern Recognition Using a New Transformation Distance Advances in Neural Information Processing Systems, S. Hanson, J. Cowan, and C. Giles, eds., vol. 5, pp. 50-58, 1993.
[17] P. Simard, Y. Le Cun, J. Denker, and B. Victorri, Transformation Invariance in Pattern Recognition Tangent Distance and Tangent Propagation Proc. Neural Networks: Tricks of the Trade, Lecture Notes in Computer Science, vol. 1524, G. Orr and K.R. Müller, eds., pp. 239-274, Springer Verlag, 1998.
[18] M.E. Tipping, The Relevance Vector Machine Advances in Neural Information Processing Systems, vol. 12, S. Solla, T. Leen, and K. Müller, eds., pp. 332-388, 2000.
[19] M.E. Tipping and C.M. Bishop, Mixtures of Probabilistic Principal Component Analysers Neural Computation, vol. 11, no. 2, pp. 443-482, 1999.
[20] M. Turk and A. Pentland, Eigenfaces for Recognition J. Cognitive Neuroscience, vol. 3, no. 1, pp. 71-86, 1991.
[21] L. Welling, H. Ney, A. Eiden, and C. Forbrig, Connected Digit Recognition Using Statistical Template Matching Proc. European Conf. Speech Comm. and Technology, vol. 2, pp. 1483-1486, Sept. 1995.
Index Terms:
Statistical pattern recognition, adaptation, tangent vectors, linear models.
Citation:
Daniel Keysers, Wolfgang Macherey, Hermann Ney, J? Dahmen, "Adaptation in Statistical Pattern Recognition Using Tangent Vectors," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 26, no. 2, pp. 269-274, Jan. 2004, doi:10.1109/TPAMI.2004.1262198
