This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Effects of Classifier Structures and Training Regimes on Integrated Segmentation and Recognition of Handwritten Numeral Strings
November 2004 (vol. 26 no. 11)
pp. 1395-1407
In integrated segmentation and recognition of character strings, the underlying classifier is trained to be resistant to noncharacters. We evaluate the performance of state-of-the-art pattern classifiers of this kind. First, we build a baseline numeral string recognition system with simple but effective presegmentation. The classification scores of the candidate patterns generated by presegmentation are combined to evaluate the segmentation paths and the optimal path is found using the beam search strategy. Three neural classifiers, two discriminative density models, and two support vector classifiers are evaluated. Each classifier has some variations depending on the training strategy: maximum likelihood, discriminative learning both with and without noncharacter samples. The string recognition performances are evaluated on the numeral string images of the NIST Special Database 19 and the zipcode images of the CEDAR CDROM-1. The results show that noncharacter training is crucial for neural classifiers and support vector classifiers, whereas, for the discriminative density models, the regularization of parameters is important. The string recognition results compare favorably to the best ones reported in the literature though we totally ignored the geometric context. The best results were obtained using a support vector classifier, but the neural classifiers and discriminative density models show better trade-off between accuracy and computational overhead.

[1] H. Fujisawa, Y. Nakano, and K. Kurino, “Segmentation Methods for Character Recognition: From Segmentation to Document Structure Analysis,” Proc. IEEE, vol. 80, no. 7, pp. 1079-1092, 1992.
[2] R. Casey and E. Lecolinet, “A Survey of Methods in Strategies in Character Segmentation,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 18, pp. 690-706, 1996.
[3] C.J.C. Burges et al., "Shortest Path Segmentation: A Method for Training a Neural Network to Recognize Character Strings," IJCNN, vol. 3, pp. 165-171, 1992.
[4] Y. Saifullah and M.T. Manry, Classification-Based Segmentation of ZIP Codes IEEE Trans. System, Man, and Cybernetics, vol. 23, no. 5, pp. 1437-1443, 1993.
[5] C.L. Martin, Centered-Object Integrated Segmentation and Recognition of Overlapping Handprinted Characters Neural Computation, vol. 5, pp. 419-429, 1993.
[6] S.W. Lee and S.Y. Kim, “Integrated Segmentation and Recognition of Handwritten Numerals with Cascade Neural Networks,” IEEE Trans. Systems, Man, and Cybernetics, Part C: Applications and Reviews, vol. 29, no. 2, pp. 285-290, 1999.
[7] R.O. Duda, P.E. Hart, and D.G. Stork, Pattern Classification, second ed. Wiley Interscience, 2001.
[8] F. Kimura, K. Takashina, S. Tsuruoka, and Y. Miyake, Modified Quadratic Discriminant Functions and the Application to Chinese Character Recognition IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 9, no. 1, pp. 149-153, Jan. 1987.
[9] F. Kimura, Y. Miyake, and M. Sridhar, Handwritten ZIP Code Recognition Using Lexicon Free Word Recognition Algorithm Proc. Third Int'l Conf. Document Analysis and Recognition, pp. 906-910, 1995.
[10] J. Bromley and J.S. Denker, Improving Rejection Performance on Handwritten Digits by Training with Rubbish Neural Computation, vol. 5, pp. 367-370, 1993.
[11] J. Liu and P. Gader, Neural Networks with Enhanced Outlier Rejection Ability for Off-Line Handwritten Word Recognition Pattern Recognition, vol. 35, no. 1, pp. 2061-2071, 2002.
[12] P.D. Gader, M. Mohammed, and J.H. Chiang, “Handwritten Word Recognition with Character and Inter Character Neural Networks,” IEEE Trans. System, Man, and Cybernetics, pp. 158-164, vol. 27, no. 1, 1997.
[13] J. Zhou, A. Krzyzak, and C.Y. Suen, Verification A Method of Enhancing the Recognizers of Isolated and Touching Handwritten Numerals Pattern Recognition, vol. 35, no. 5, pp. 1179-1189, 2002.
[14] L.S. Oliveira, R. Sabourin, F. Bortolozzi, and C.Y. Suen, Automatic Recognition of Handwritten Numeral Strings: A Recognition and Verification Strategy IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 11, pp. 1438-1454, Nov. 2002.
[15] H. Xue and V. Govindaraju, Incorporating Contextual Character Geometry in Word Recognition Proc. Eighth Int'l Workshop Frontiers in Handwriting Recognition, pp. 123-127, 2002.
[16] C.M. Bishop, Neural Networks for Pattern Recognition. Oxford: Claderon Press, 1995.
[17] J. Schürmann, Pattern Classification: A Unified View of Statistical and Neural Approaches. Wiley Interscience, 1996.
[18] U. Kreßel and J. Schürmann, Pattern Classification Techniques Based on Function Approximation Handbook of Character Recognition and Document Image Analysis, H. Bunke and P.S.P. Wang, eds., pp. 49-78, 1997.
[19] C.-L. Liu and M. Nakagawa, Evaluation of Prototype Learning Algorithms for Nearest Neighbor Classifier in Application to Handwritten Character Recognition Pattern Recognition, vol. 34, no. 3, pp. 601-615, 2001.
[20] C.-L. Liu, H. Sako, and H. Fujisawa, Learning Quadratic Discriminant Function for Handwritten Character Recognition Proc. 16th Int'l Conf. Pattern Recognition, vol. 4, pp. 44-47, 2002.
[21] C.-L. Liu, H. Sako, and H. Fujisawa, Discriminative Learning Quadratic Discriminant Function for Handwriting Recognition IEEE Trans. Neural Networks, vol. 15, no. 2, pp. 430-444, 2004.
[22] V. Vapnik, The Nature of Statistical Learning Theory. Springer-Verlag, 1995.
[23] C.J.C. Burges, A Tutorial on Support Vector Machines for Pattern Recognition Knowledge Discovery and Data Mining, vol. 2, no. 2, pp. 1-43, 1998.
[24] C.-L. Liu, H. Sako, and H. Fujisawa, Integrated Segmentation and Recognition of Handwritten Numerals: Comparison of Classification Algorithms Proc. Eighth Int'l Workshop Frontiers in Handwriting Recognition, pp. 303-308, 2002.
[25] C.-L. Liu, M. Koga, and H. Fujisawa, Lexicon-Driven Segmentation and Recognition of Handwritten Character Strings for Japanese Address Reading IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 11, pp. 1425-1437, Nov. 2002.
[26] U. Ramer, An Iterative Procedure for the Polygonal Approximation of Plane Closed Curves Computer Graphics and Image Processing, vol. 1, pp. 244-256, 1972.
[27] D. Bouchaffra, V. Govindaraju, and S.N. Srihari, “Postprocessing of Recognized Strings Using Nonstationary Markovian Models,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 21, no. 10, pp. 990-999, Oct. 1999.
[28] S. Tulyakov and V. Govindaraju, Probabilistic Model for Segmentation Based Word Recognition with Lexicon Proc. Sixth Int'l Conf. Document Analysis and Recognition, pp. 164-167, 2001.
[29] B. H. Juang,S. Katagiri,“Discriminative Learning for Minimum Error Classification,” IEEE Trans. on Signal Processing, vol. 40, pp. 3043-3054, Dec. 1992.
[30] B.H. Juang, W. Chou, and C.H. Lee, Minimum Classification Error Rate Methods for Speech Recognition IEEE Trans. Speech&Audio Processing, vol. 5, no. 3, pp. 257-265, May 1997.
[31] H. Robbins and S. Monro, A Stochastic Approximation Method Annals Math. Statistics, vol. 22, pp. 400-407, 1951.
[32] O.L. Mangasarian and D.R. Musicant, Successive Overrelaxation for Support Vector Machines IEEE Trans. Neural Networks, vol. 10, no. 5, pp. 1032-1037, 1999.
[33] C.-L. Liu, H. Sako, and H. Fujisawa, Performance Evaluation of Pattern Classifiers for Handwritten Character Recognition Int'l J. Document Analysis and Recognition, vol. 4, no. 3, pp. 191-204, 2002.
[34] C.-L. Liu, Y-J. Liu, and R-W. Dai, Preprocessing and Statistical/Structural Feature Extraction for Handwritten Numeral Recognition Progress of Handwriting Recognition, A.C. Downton and S. Impedovo, eds., pp. 161-168, 1997.
[35] T.M. Ha, J. Zimmermann, and H. Bunke, Off-Line Handwritten Numeral String Recognition by Combining Segmentation-Based and Segmentation-Free Methods Pattern Recognition, vol. 31, no. 3, pp. 257-272, 1998.
[36] K. Kim, Y. Chung, J. Kim, and C.Y. Suen, Recognition of Unconstrained Handwritten Numeral Strings Using Decision Value Generator Proc. Sixth Int'l Conf. Document Analysis and Recognition, pp. 14-17, 2001.
[37] S. Veeramachaneni, H. Fujisawa, C.-L. Liu, and G. Nagy, Classifying Isogenous Fields Proc. Eighth Int'l Workshop Frontiers in Handwriting Recognition, pp. 41-46, 2002.

Index Terms:
Numeral string recognition, integrated segmentation and recognition, noncharacter resistance, character classification, neural classifiers, discriminative density models, support vector classifiers.
Citation:
Cheng-Lin Liu, Hiroshi Sako, Hiromichi Fujisawa, "Effects of Classifier Structures and Training Regimes on Integrated Segmentation and Recognition of Handwritten Numeral Strings," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 26, no. 11, pp. 1395-1407, Nov. 2004, doi:10.1109/TPAMI.2004.104
Usage of this product signifies your acceptance of the Terms of Use.