This Article 
 Bibliographic References 
 Add to: 
Image Restoration of Arbitrarily Warped Documents
October 2004 (vol. 26 no. 10)
pp. 1295-1306
We present a framework for acquiring and restoring images of warped documents. The purpose of our restoration is to create a planar representation of a once planar document that has undergone an arbitrary and unknown rigid deformation. To accomplish this restoration, our framework acquires and flattens the 3D shape of a warped document to determine a nonlinear image transform that can correct for image distortion caused by the document's shape. Our framework is designed for use in library and museum digitization efforts where very old and badly damaged manuscripts are imaged.

[1] D. Baraff and A. Witkin, Large Steps in Cloth Simulation Computer Graphics (Proc. SIGGRAPH), pp. 43-52, Aug. 1998.
[2] J. Becos, Image Processing Algorithms for Readability Enhancement of Old Manuscripts Proc. Int'l Electronic Imaging Exposition and Conf., pp. 392-397, 1989.
[3] S. Borman and R.L. Stevenson, Super-Resolution from Image Sequences A Review Proc. 1998 Midwest Symp. Circuits and Systems, 1998.
[4] G. Braudaway, Restoration of Faded Photographic Transparencies by Digital Image Processing Proc. IS and T's 46 Ann. Conf., pp. 287-289, 1993.
[5] D.E. Breen, D.H. House, and M.J. Wozny, Predicting the Drape of Woven Cloth Using Interacting Particles Computer Graphics (Proc. SIGGRAPH), vol. 28, pp. 365-372, 1994.
[6] M.S. Brown, New Techniques and Algorithms for Acquiring, Restoring, and Displaying Digital Collections PhD thesis uky-cocs-2001-d-003, Univ. of Kentucky, Lexington, 2001.
[7] M.S. Brown and W.B. Seales, 3D Imaging and Processing of Damaged Texts Proc. Assoc. for Computing in the Humanities and Assoc. of Linguistic and Literacy Computing Joint Conf., June 2001.
[8] M.S. Brown and W.B. Seales, Digital Atheneum: New Approaches for Preserving, Restoring and Analyzing Damaged Manuscripts Proc. First ACM-IEEE Joint Conf. Digital Library, June 2001.
[9] M.S. Brown and W.B. Seales, Document Restoration Using 3D Shape: A General Deskewing Algorithm for Arbitrarily Warped Documents Proc. Int'l Conf. Computer Vision (ICCV '01), July 2001.
[10] H. Cao, X. Ding, and C. Liu, Rectifying the Bound Document Image Captured by the Camera: A Model Based Approach Proc. Int'l Conf. Document Analysis and Recognition (ICDAR '03), pp. 71-75, 2003.
[11] P. Cheeseman, B. Kanefsky, R. Kraft, J. Stutz, and R. Hanson, Super-Resolved Surface Reconstruction from Multiple Images G.R. Heidbreder, ed., Maximum Entropy and Bayesian Methods, pp. 293-308, Kluwer Academic, 1996.
[12] B. Gatos, N. Papamarkos, and C. Chamzas, Skew Detection in Text Line Position Determination in Digitized Documents Pattern Recognition, vol. 30, no. 9, pp. 1505-1519, 1997.
[13] K. Kiernan, B. Seales, and J. Griffioen, The Reappearances of St. Basil the Great in British Library MS Cotton Otho B.X. Computers and the Humanities, vol. 36, pp. 7-26, 2002.
[14] K.S. Kiernan, Digital Image Processing and the Beowulf Manuscript Literary and Linguistic Computing: Special Issue on Computers and Medieval Studies, vol. 6, pp. 20-27, 1991.
[15] Kontron Elektronic GmbH, Kontron Embedded Computers ag, http:/, 2003.
[16] J. Lander, Devil in Blue Faceted Dress: Real-Time Cloth Animation Game Developer, May 1999.
[17] E. Lecolinet, L. Likforman-Sulem, L. Robert, F. Role, and J-L. Lebrave, An Integrated Reading and Editing Environment for Scholarly Research on Literary Works and Their Handwritten Sources Proc. Third ACM Conf. Digital Libraries, pp. 144-151, 1998.
[18] U. Pal and B. Chaudhuri, An Improved Document Skew Angle Estimation Technique Pattern Recognition Letters, vol. 8, no. 17, pp. 899-904, July 1996.
[19] T. Pavlidis and S. Mori, Optical Character Recognition Proc. IEEE, vol. 80, no. 7, pp. 1027-1209, July 1992.
[20] A. Prescott, The Electronic Beowulf and Digital Restoration Literary and Linguistic Computing, vol. 12, no. 197, pp. 185-95, 1997.
[21] X. Provot, Deformation Constraints in a Mass-Spring Model to Describe Rigid Cloth Behavior Graphics Interface, pp. 174-155, 1995.
[22] R. Serway, The Law of Motion Physics for Scientists and Engineers, fourth ed., pp. 95-128, Saunders College Publishing, 1996.
[23] D. Terzopoulos and K. Fleischer, Modeling Inelastic Deformations: Viscoelasticity, Plasticity, Fracture Computer Graphics (Proc. SIGGRAPH), vol. 22, pp. 269-278, Aug. 1988.
[24] D. Terzopoulos, J.C. Platt, and A.H. Barr, Elastically Deformable Models Computer Graphics (Proc. SIGGRAPH), vol. 21, pp. 205-214, 1987.
[25] T. Wada, H. Ukida, and T. Matsuyama, Shape from Shading with Interreflections under Proximal Light Source: 3D Shape Reconstruction of Unfolded Book Surface from a Scanner Image Proc. Int'l Conf. Computer Vision, pp. 66-71, 1995.
[26] Y. Wu and D. Thalmann, Deformable Surfaces Using Physically-Based Particle Systems Computer Graphics Int'l, pp. 205-216, 1995.
[27] C.J. Yuan and W.B. Seales, Guided Linking: Efficient Making Image-to-Transcript Correspondence Proc. First ACM-IEEE Joint Conf. Digital Libraries, June 2001.
[28] Z. Zhang and C.L. Tan, Correcting Document Image Warping Based on Regression of Curved Text Lines Proc. Int'l Conf. Document Analysis and Recognition, pp. 589-593, 2003.

Index Terms:
Manuscript restoration, document deskewing, image restoration, cultural heritage digitization.
Michael S. Brown, W. Brent Seales, "Image Restoration of Arbitrarily Warped Documents," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 26, no. 10, pp. 1295-1306, Oct. 2004, doi:10.1109/TPAMI.2004.87
Usage of this product signifies your acceptance of the Terms of Use.