This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Automatic Recognition of Handwritten Numerical Strings: A Recognition and Verification Strategy
November 2002 (vol. 24 no. 11)
pp. 1438-1454

Abstract—A modular system to recognize handwritten numerical strings is proposed. It uses a segmentation-based recognition approach and a Recognition and Verification strategy. The approach combines the outputs from different levels such as segmentation, recognition, and postprocessing in a probabilistic model. A new verification scheme which contains two verifiers to deal with the problems of oversegmentation and undersegmentation is presented. A new feature set is also introduced to feed the oversegmentation verifier. A postprocessor based on a deterministic automaton is used and the global decision module makes an accept/reject decision. Finally, experimental results on two databases are presented: numerical amounts on Brazilian bank checks and NIST SD19. The latter aims at validating the concept of modular system and showing the robustness of the system using a well-known database.

[1] Banco Central do Brasil, Manual de Normas e Instruções—Circular$\big. n^o\bigr.$001825, Oct. 1990. http://www.bcb.gov.brmPag.asp?codP=106&cod=112&perfil=1 (in portuguese).
[2] C.M. Bishop, Neural Networks for Pattern Recognition. Clarendon Press, 1995.
[3] H. Bourlard and N. Morgan, “Merging Multilayer Perceptrons and Hidden Markov Models: Some Experiments in Continuous Speech Recognition,” Neural Networks: Advances and Applications, E. Gelenbe, ed., North Holland Press, 1991.
[4] J.S. Bridle, “Training Stochastic Model Recognition Algorithms as Networks Can Lead to Mutual Information Estimation of Parameters,” Advances in Neural Information Processing Systems, D.S. Touretzky, ed., vol. 2, pp. 211-217, 1990.
[5] A. BrittoJr., R. Sabourin, F. Bortolozzi, and C.Y. Suen, “A Two-Stage HMM-Based System for Recognizing Handwritten Numeral Strings,” Proc. Sixth Int'l Conf. Document Analysis and Recognition, pp. 396-400, 2001.
[6] T.M. Bruel, “A System for the Off-Line Recognition of Handwritten Text,” Proc. 12th Int'l Conf. Pattern Recognition, vol. 2, pp. 129-133, 1994.
[7] Y.K. Chen and J.F. Wang, “Segmentation of Single- or Multiple-Touching Handwritten Numeral String Using Background and Foreground Analysis,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 11, pp. 1304-1317, Nov. 2000.
[8] S.J. Cho, J. Kim, and J.H. Kim, “Verification of Graphemes Using Neural Networks in an HMM-Based On-Line Korean Handwriting Recognition System,” Proc. Seventh Int'l Workshop Frontiers in Handwriting Recognition, pp. 219-228, 2000.
[9] G. Dimauro, S. Impedovo, G. Pirlo, and A. Salzo, “Automatic Bankcheck Processing: A New Engineered System,” Int'l J. Pattern Recognition and Artificial Intelligence, S. Impedovo et al., eds., pp. 467-503, 1997.
[10] G.D. ForneyJr., “The Viterbi Algorithm,” Proc. IEEE, vol. 61, no. 3, pp. 268-278, 1973.
[11] G. Fumera, F. Roli, and G. Giacinto, “Reject Option with Multiple Thresholds,” Pattern Recognition, vol. 33, no. 12, pp. 2099-2101, 2000.
[12] P.J. Grother, “NIST Special Database 19-Handprinted Forms and Characters Database,” Nat'l Inst. Standards and Technology (NIST), 1995.
[13] T.M. Ha and H. Bunke, “On-Line, Handwritten Numeral Recognition by Perturbation Method,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 5, pp. 535-539, May 1997.
[14] T.M. Ha, M. Zimmermann, and H. Bunke, “Off-Line Handwritten Numeral String Recognition by Combining Segmentation-Based and Segmentation-Free Methods,” Pattern Recognition, vol. 31, no. 3, pp. 257-272, 1998.
[15] L. Heutte, J.V. Moreatu, B. Plessis, J.L. Plagnaud, and Y. Lecourtier, Handwritten Numeral Recognition Based on Multiple Feature Extractors Proc. IEEE Int'l Conf. Document Analysis and Recognition, pp. 167-170, 1993.
[16] L. Heutte, P. Pereira, O. Bougeois, J. Moreau, B. Plessis, and P. Courtellemont, “Multi-Bank Check Recognition System: Consideration on the Numeral Amount Recognition Module,” Int'l J. Pattern Recognition and Artificial Intelligence, S. Impedovo et al., eds., pp. 595-617, 1997.
[17] J. Cai and Z.-Q. Liu, “Integration of Structural and Statistical Information for Unconstrained Handwritten Numeral Recognition,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 21, no. 3, pp. 263-270, Mar. 1999.
[18] G. Kaufmann and H. Bunke, “Automated Reading of Cheque Amounts,” Pattern Analysis and Applications, vol. 3, no. 2, pp. 132-141, 2000.
[19] S. Knerr, V. Anisimov, O. Baret, N. Gorski, D. Price, and J. Simon, “The A2iA Intercheque System: Courtesy Amount and Legal Amount Recognition for French Checks,” Int'l J. Pattern Recognition and Artificial Intelligence, S. Impedovo et al., eds., pp. 505-547, 1997.
[20] G.E. Kopec and P.A. Chou, “Document Image Decoding Using Markov Source Models,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 16, no. 6, pp. 602-617, June 1994.
[21] Y. LeCun, B. Boser, J.S. Denker, B. Henderson, R.E. Howard, W. Hubbard, and L.D. Jackel, “Backpropagation Applied to Handwritten Zip Code Recognition,” Neural Computation, vol. 1, no. 4, pp. 541-551, 1989.
[22] S.W. Lee and S.Y. Kim, “Integrated Segmentation and Recognition of Handwritten Numerals with Cascade Neural Networks,” IEEE Trans. Systems, Man, and Cybernetics, Part C: Applications and Reviews, vol. 29, no. 2, pp. 285-290, 1999.
[23] E. Lethelier, M. Leroux, and M. Gilloux, “An Automatic Reading System for Handwritten Numeral Amounts on French Checks,” Proc. Third Int'l Conf. Document Analysis and Recognition, pp. 92-97, 1995.
[24] H.C. Leung, “Speech Recognition Using Stochastic Explicit-Segment Moduling,” Proc. Second European Conf. Speech Communication and Technology, pp. 931-934 1991.
[25] R.P. Lippmann, "Pattern Classification Using Neural Networks," IEEE Communications Magazine, pp. 47-64, Nov. 1989.
[26] O. Matan and C. Burges, “Recognizing Overlapping Hand-Printed Characters by Centered-Objects Integrated Segmentation and Recognition,” Proc. Int'l Joint Conf. Neural Networks, pp. 504-511, 1991.
[27] L.S. Oliveira, E. Lethelier, F. Bortolozzi, and R. Sabourin, “A New Segmentation Approach for Handwritten Digits,” Proc. 15th Int'l Conf. Pattern Recognition, vol. 2, pp. 323-326, 2000.
[28] L.S. Oliveira, R. Sabourin, F. Bortolozzi, and C.Y. Suen, “A Modular System to Recognize Numerical Amounts on Brazilian Bank Cheques,” Proc. Sixth Int'l Conf. Document Analysis and Recognition, pp. 389-394, 2001.
[29] M.D. Richard and R.P. Lippmann, “Neural Network Classifiers Estimate Bayesian a Posteriori Probabilities,” Neural Computation, vol. 3, no. 4, pp. 461-483, 1991.
[30] M. Shridhar and A. Badreldin, “Recognition of Isolated and Simply Connected Handwritten Numerals,” Pattern Recognition, vol. 19, no. 1, pp. 1-12, 1986.
[31] H. Takahashi and T. Griffin, “Recogniton Enhancement by Linear Tournament Verification,” Proc. Second Int'l Conf. Document Analysis and Recognition, pp. 585-588, 1993.
[32] J. Zhou, Q. Gan, A. Krzyzak, and C.Y. Suen, “Recognition and Verification of Touching Handwritten Numerals,” Proc. Seventh Int'l Workshop Fontiers in Handwriting Recognition, pp. 179-188, 2000.

Index Terms:
Handwritten numerical string recognition, segmentation and recognition of numerals, recognition and verification, feature extraction, probabilistic model.
Citation:
Luiz S. Oliveira, Robert Sabourin, Flávio Bortolozzi, Ching Y. Suen, "Automatic Recognition of Handwritten Numerical Strings: A Recognition and Verification Strategy," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 24, no. 11, pp. 1438-1454, Nov. 2002, doi:10.1109/TPAMI.2002.1046154
Usage of this product signifies your acceptance of the Terms of Use.