This Article 
 Bibliographic References 
 Add to: 
HMM Based On-Line Handwriting Recognition
October 1996 (vol. 18 no. 10)
pp. 1039-1045

Abstract—Hidden Markov Model (HMM) based recognition of handwriting is now quite common, but the incorporation of HMM's into a complex stochastic language model for handwriting recognition is still in its infancy. We have taken advantage of developments in the speech processing field to build a more sophisticated handwriting recognition system. The pattern elements of the handwriting model are subcharacter stroke types modeled by HMM's. These HMM's are concatenated to form letter models, which are further embedded in a stochastic language model. In addition to better language modeling, we introduce new handwriting recognition features of various kinds. Some of these features have invariance properties, and some are segmental, covering a larger region of the input pattern. We have achieved a writer independent recognition rate of 94.5% on 3,823 unconstrained handwritten word samples from 18 writers covering a 32 word vocabulary.

[1] C.C. Tappert, C.Y. Suen, and T. Wakahara, “The State of the Art in On-Line Handwriting Recognition,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 12, no. 8, pp. 179-190, Aug. 1990.
[2] R. Nag, K.H. Wong, and F. Fallside, "Script Recognition Using Hidden Markov Models," Proc. ICASSP '86, vol. 3, pp. 2,071-2,074,Japan, Apr. 1986.
[3] A. Kundu and P. Bahl, "Recognition of Handwritten Script: A Hidden Markov Model Based Approach," Proc. ICASSP '88, vol. 2, pp. 928-931,New York, Apr. 1988.
[4] S. Bercu and G. Lorette, "On-Line Handwritten Word Recognition: An Approach Based on Hidden Markov Models," Proc. Third IWFHR, pp. 385-390,Buffalo, N.Y., May 1993.
[5] J. Makhoul, T. Starner, R. Schartz, and G. Lou, “On-Line Cursive Handwriting Recognition Using Speech Recognition Models,” Proc. IEEE Int'l Conf. Acoustics, Speech, and Signal Processing, pp. v125-v128, Adelaide, Australia, 1994.
[6] K.S. Nathan, H.S.M. Beigi, J. Subrahmonia, G.J. Clary, and H. Maruyama, “Realtime On-Line Unconstrained Handwriting Recognition Using Statistical Methods,” Proc. Int'l Conf. Accoustics, Speech, and Signal Processing, pp. 2,619-2,622, Detroit, 1995.
[7] M.Y. Chen, A. Kundu, and J. Zhou, “Off-Line Handwritten Word Recognition Using a Hidden Markov Model Type Stochastic Network,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 16, no. 5, pp. 481-496, 1994.
[8] M.K. Brown and S.C. Glinski, "Stochastic Context-Free Language Modeling with Evolutional Grammars," Proc. ICSLP '94, vol. 2, pp. 779-782,Yokohama, Japan, Sept. 1994.
[9] G.L. Miller and R. Boie, "Capacitive Proximity Sensors," U.S. Patent #5,337,353,9, Aug. 1994.
[10] J. Hu, M.K. Brown, and W. Turin, "Invariant Features for HMM Based Handwriting Recognition," Proc. ICIAP '95, pp. 588-593,Sanremo, Italy, Sept. 1995.
[11] L.R. Rabiner and B.H. Juang, Fundamentals of Speech Recognition, Prentice Hall, Upper Saddle River, N.J., 1993.
[12] L.R. Rabiner, “Tutorial on Hidden Markov Model and Selected Applications in Speech Recognition,” Proc. IEEE, vol. 77, no. 2, pp. 257-285, 1989.
[13] S.A. Guberman and V.V. Rozentsveig, "Algorithm for the Recognition of Handwritten Text," Automation and Remote Control, vol. 37, pp. 751-757, May 1976. (Translated from Automatika i Telemekhanika, vol. 37, no. 5, pp. 122-129, May 1976.)
[14] B.T. Lowerre and D.R. Reddy, "The HARPY Speech Understanding System," Trends in Speech Recognition, W.A. Lean, ed., chapter 15, pp. 340-360. Prentice Hall, 1980.
[15] M.K. Brown and J.G. Wilpon, "A Grammar Compiler for Connected Speech Recognition," IEEE Trans. Signal Processing, vol. 39, no. 1, pp. 17-28, Jan. 1991.
[16] A.M. Bruckstein, R.J. Holt, A.N. Netravali, and T.J. Richardson, "Invariant Signatures for Planar Shape Recognition Under Partial Occlusion," CVGIP: Image Understanding, vol. 58, pp. 49-65, July 1993.
[17] M. Schenkel, I. Guyon, and D. Henderson, "On-Line Cursive Script Recognition Using Time Delay Neural Networks and Hidden markov Models," Special Issue of Machine Vision and Application on Cursive Script Recognition, R. Plamondon, ed. Springer Verlag, 1995.
[18] F. Sinden and G. Wilfong, "Method of Recognizing Handwritten Symbols," U.S. Patent #5,333,209, July26, 1994.

Index Terms:
On-line handwriting recognition, hidden Markov models, subcharacter models, evolutional grammar, invariant features, segmental features.
Jianying Hu, Michael K. Brown, William Turin, "HMM Based On-Line Handwriting Recognition," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 18, no. 10, pp. 1039-1045, Oct. 1996, doi:10.1109/34.541414
Usage of this product signifies your acceptance of the Terms of Use.