The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.07 - July (2013 vol.35)
pp: 1730-1743
Gaofeng Meng , Nat. Lab. of Pattern Recognition, Inst. of Autom., Beijing, China
Shiming Xiang , Nat. Lab. of Pattern Recognition, Inst. of Autom., Beijing, China
Nanning Zheng , Inst. of Artificial Intell. & Robot., Xi'an Jiaotong Univ., Xi'an, China
Chunhong Pan , Nat. Lab. of Pattern Recognition, Inst. of Autom., Beijing, China
ABSTRACT
A scanned image of an opened book page often suffers from various scanning artifacts known as scanning shading and dark borders noises. These artifacts will degrade the qualities of the scanned images and cause many problems to the subsequent process of document image analysis. In this paper, we propose an effective method to rectify these scanning artifacts. Our method comes from two observations: that the shading surface of most scanned book pages is quasi-concave and that the document contents are usually printed on a sheet of plain and bright paper. Based on these observations, a shading image can be accurately extracted via convex hulls-based image reconstruction. The proposed method proves to be surprisingly effective for image shading correction and dark borders removal. It can restore a desired shading-free image and meanwhile yield an illumination surface of high quality. More importantly, the proposed method is nonparametric and thus does not involve any user interactions or parameter fine-tuning. This would make it very appealing to nonexpert users in applications. Extensive experiments based on synthetic and real-scanned document images demonstrate the efficiency of the proposed method.
INDEX TERMS
Lighting, Noise, Surface treatment, Ink, Image edge detection, Text analysis, Image reconstruction, convex hull, Document image processing, illumination correction, scanning artifacts, dark border noise
CITATION
Gaofeng Meng, Shiming Xiang, Nanning Zheng, Chunhong Pan, "Nonparametric Illumination Correction for Scanned Document Images via Convex Hulls", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.35, no. 7, pp. 1730-1743, July 2013, doi:10.1109/TPAMI.2012.251
REFERENCES
[1] T. Wada, H. Ukida, and T. Matsuyama, "Shape from Shading with Interreflections under Proximal Light Source-3D Shape Reconstruction of Unfolded Book Surface from a Scanner Image," Proc. Fifth Int'l Conf. Computer Vision, pp. 66-71, 1995.
[2] T. Wada, H. Ukida, and T. Matsuyama, "Shape from Shading with Interreflections under a Proximal Light Source: Distortion-Free Copying of an Unfolded Book," Int'l J. Computer Vision, vol. 24, no. 2, pp. 125-135, 1997.
[3] C.L. Tan, L. Zhang, Z. Zhang, and T. Xia, "Restoring Warped Document Images through 3D Shape Modeling," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 2, pp. 195-208, Feb. 2006.
[4] J. Sauvola and M. Pietikäinen, "Adaptive Document Image Binarization," Pattern Recognition, vol. 33, no. 2, pp. 225-236, 2000.
[5] B. Gatos, I. Pratikakis, and S. Perantonis, "Adaptive Degraded Document Image Binarization," Pattern Recognition, vol. 39, no. 3, pp. 317-327, 2006.
[6] M. Azmi, M. Iqbal Saripan, R. Azmir, and R. Abdullah, "Illumination Compensation for Document Images Using Local-Global Block Analysis," Proc. First Int'l Visual Informatics Conf. Visual Informatics: Bridging Research and Practice, pp. 636-644, 2009.
[7] K.C. Fan, Y.K. Wang, and T.R. Lay, "Marginal Noise Removal of Document Images," Pattern Recognition, vol. 35, no. 11, pp. 2593-2611, 2002.
[8] F. Shafait, J. van Beusekom, D. Keysers, and T. Breuel, "Page Frame Detection for Marginal Noise Removal from Scanned Documents," Proc. 15th Scandinavian Conf. Image Analysis, pp. 651-660, 2007.
[9] F. Shafait, D. Keysers, and T.M. Breuel, "Performance Evaluation and Benchmarking of Six-Page Segmentation Algorithms," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 30, no. 6, pp. 941-954, June 2008.
[10] F. Shafait, D. Keysers, and T.M. Breuel, "Response to 'Projection Methods Require Black Border Removal'," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 31, no. 4, pp. 763-764, Apr. 2009.
[11] F. Shafait and T.M. Breuel, "The Effect of Border Noise on the Performance of Projection-Based Page Segmentation Methods," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 33, no. 4, pp. 846-851, Apr. 2011.
[12] S. Lu and C.L. Tan, "Binarization of Badly Illuminated Document Images through Shading Estimation and Compensation," Proc. Ninth Int'l Conf. Document Analysis and Recognition, vol. 1, pp. 312-316, 2007.
[13] S. Lu, B. Su, and C.L. Tan, "Document Image Binarization Using Background Estimation and Stroke Edges," Int'l J. Document Analysis and Recognition, vol. 13, pp. 303-314, 2010.
[14] T. Kanungo, R.M. Haralick, and I. Phillips, "Global and Local Document Degradation Models," Proc. Second Int'l Conf. Document Analysis and Recognition, pp. 730-734, 1993.
[15] L. Zhang, A.M. Yip, and C.L. Tan, "A Restoration Framework for Correcting Photometric and Geometric Distortions in Camera-Based Document Images," Proc. 11th IEEE Int'l Conf. Computer Vision, pp. 1-8, 2007.
[16] L. Zhang, A.M. Yip, M.S. Brown, and C.L. Tan, "A Unified Framework for Document Restoration Using Inpainting and Shape-from-Shading," Pattern Recognition, vol. 42, no. 11, pp. 2961-2978, 2009.
[17] R.D. Lins, D.M. Oliveira, G. Torreão, J. Fan, and M. Thielo, "Correcting Book Binding Distortion in Scanned Documents," Proc. Seventh Int'l Conf. Image Analysis and Recognition, vol. 2, pp. 355-365, 2010.
[18] R.C. González and R.E. Woods, Digital Image Processing. Prentice Hall, 2008.
[19] Y.C. Tsoi and M.S. Brown, "Geometric and Shading Correction for Images of Printed Materials: A Unified Approach Using Boundary," Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 240-246, 2004.
[20] M.S. Brown and Y.C. Tsoi, "Geometric and Shading Correction for Images of Printed Materials Using Boundary," IEEE Trans. Image Processing, vol. 15, no. 6, pp. 1544-1554, June 2006.
[21] L. Zhang, Z. Zhang, C.L. Tan, and T. Xia, "3D Geometric and Optical Modeling of Warped Document Images from Scanners," Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 337-342, 2005.
[22] J.S. Lee, C.H. Chen, and C.C. Chang, "A Novel Illumination-Balance Technique for Improving the Quality of Degraded Text-Photo Images," IEEE Trans. Circuits and Systems for Video Technology, vol. 19, no. 6, pp. 900-905, June 2009.
[23] D.M. Oliveira and R.D. Lins, "A New Method for Shading Removal and Binarization of Documents Acquired with Portable Digital Cameras," Proc. Third Int'l Workshop Camera-Based Document Analysis and Recognition, vol. 2, pp. 3-10, 2009.
[24] J. Fan, "Robust Color Image Enhancement of Digitized Books," Proc. 10th Int'l Conf. Document Analysis and Recognition, pp. 561-565, 2009.
[25] S. Hsia, M. Chen, and Y. Chen, "A Cost-Effective Line-Based Light-Balancing Technique Using Adaptive Processing," IEEE Trans. Image Processing, vol. 15, no. 9, pp. 2719-2729, Sept. 2006.
[26] M.S. Brown, M. Sun, R. Yang, L. Yun, and W.B. Seales, "Restoring 2D Content from Distorted Documents," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 29, no. 11, pp. 1904-1916, Nov. 2007.
[27] G.V. Landon, L. Yun, and W.B. Seales, "Towards Automatic Photometric Correction of Casually Illuminated Documents," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1-8, 2007.
[28] G. Meng, N. Zheng, S. Du, Y. Song, and Y. Zhang, "Shading Extraction and Correction for Scanned Book Images," IEEE Signal Processing Letters, vol. 15, pp. 849-852, 2008.
[29] I.K. Hyung, J. Kim, and I.C. Nam, "Composition of a Dewarped and Enhanced Document Image from Two View Images," IEEE Trans. Image Processing, vol. 18, no. 7, pp. 1551-1562, July 2009.
[30] E. Mariano, R. Lins, G. Pereira e Silva, J. Fan, P. Majewicz, and M. Thielo, "Correcting Specular Noise in Multiple Images of Photographed Documents," Proc. Eighth Int'l Conf. Document Analysis and Recognition, pp. 915-919, Sept. 2011.
[31] R.A. Jarvis, "On the Identification of the Convex Hull of a Finite Set of Points in the Plane," Information Processing Letters, vol. 2, pp. 18-21, 1973.
[32] T.T. Godfried, "A Historical Note on Convex Hull Finding Algorithms," Pattern Recognition Letters, vol. 3, no. 1, pp. 21-28, 1985.
[33] R. Graham, "An Efficient Algorithm for Determining the Convex Hull of a Finite Point Set," Information Processing Letters, vol. 1, pp. 132-133, 1972.
[34] A. Bykat, "Convex Hull of a Finite Set of Points in Two Dimensions," Information Processing Letters, vol. 7, pp. 296-298, 1978.
[35] W. Eddy, "A New Convex Hull Algorithm for Planar Sets," ACM Trans. Math. Software, vol. 3, pp. 398-403, 1977.
[36] F.P. Preparata and S.J. Hong, "Convex Hulls of Finite Sets of Points in Two and Three Dimensions," Comm. ACM, vol. 20, no. 2, pp. 87-93, 1977.
[37] A.M. Andrew, "Another Efficient Algorithm for Convex Hulls in Two Dimensions," Information Processing Letters, vol. 9, pp. 216-219, 1979.
[38] T. Chan, "Optimal Output-Sensitive Convex Hull Algorithms in Two and Three Dimensions," Discrete & Computational Geometry, vol. 16, pp. 361-368, 1996.
[39] C.A.R. Hoare, "Quicksort," Computer J., vol. 5, pp. 10-15, 1962.
[40] B.D. Ackland and N.H. Weste, "The Edge Flag Algorithm: A Fill Method for Raster Scan Displays," IEEE Trans. Computers, vol. 30, no. 1, pp. 41-48, Jan. 1981.
[41] S.R. Deans, The Radon Transform and Some of Its Applications. John Wiley & Sons, 1983.
[42] D. Knuth, The Art of Computer Programming, Vol. 3, Sorting and Searching, third ed. Addison-Wesley, 1997.
[43] N. Otsu, "A Threshold Selection Method from Gray-Level Histograms," IEEE Trans. Systems, Man, and Cybernetics, vol. 9, no. 1, pp. 62-66, Jan. 1979.
[44] M. Tappen, E. Adelson, and W. Freeman, "Estimating Intrinsic Component Images Using Non-Linear Regression," Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 2, pp. 1992-1999, 2006.
[45] L. Shen, P. Tan, and S. Lin, "Intrinsic Image Decomposition with Non-Local Texture Cues," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1-7, June 2008.
20 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool