Ninth International Conference on Document Analysis and Recognition (ICDAR 2007) Vol 2
Deriving Symbol Dependent Edit Weights for Text Correction_The Use of Error Dictionaries
Curitiba, Parana, Brazil
September 23-September 26
ISBN: 0-7695-2822-8
DOI Bookmark:
http://doi.ieeecomputersociety.org/10.1109/ICDAR.2007.99
Most systems for correcting errors in texts make use of specific word distance measures such as the Levenshtein distance. In many experiments it has been shown that correction accuracy is improved when using edit weights that depend on the particular symbols of the edit opera- tion. However, most proposed approaches so far rely on high amounts of training data where errors and their cor- rections are collected. In practice, the preparation of suit- able ground truth data is often too costly, which means that uniform edit costs are used. In this paper we evaluate ap- proaches for deriving symbol dependent edit weights that do not need any ground truth training data, comparing them with methods based on ground truth training. We suggest a new approach where special error dictionaries are used to estimate weights. The method is simple and very efficient, needing one pass of the document to be corrected. Our ex- periments with different OCR systems and textual data show that the method consistently improves correction accuracy in a significant way, often leading to results comparable to those achieved with ground truth training.
Citation:
Ch. Ringlstetter, U. Reffle, A. Gotscharek, K. Schulz, "Deriving Symbol Dependent Edit Weights for Text Correction_The Use of Error Dictionaries," icdar, vol. 2, pp.639-643, Ninth International Conference on Document Analysis and Recognition (ICDAR 2007) Vol 2, 2007
Usage of this product signifies your acceptance of the
Terms of Use.
|
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||