Issue No. 04 - April (2012 vol. 34)
Shiming Xiang , Chinese Academy of Sciences , Beijing
Gaofeng Meng , Chinese Academy of Sciences, Beijing
Jiangyong Duan , Chinese Academy of Sciences, Beijing
Chunhong Pan , Chinese Academy of Sciences, Beijing
In this paper, we propose a metric rectification method to restore an image from a single camera-captured document image. The core idea is to construct an isometric image mesh by exploiting the geometry of page surface and camera. Our method uses a general cylindrical surface (GCS) to model the curved page shape. Under a few proper assumptions, the printed horizontal text lines are shown to be line convergent symmetric. This property is then used to constrain the estimation of various model parameters under perspective projection. We also introduce a paraperspective projection to approximate the nonlinear perspective projection. A set of close-form formulas is thus derived for the estimate of GCS directrix and document aspect ratio. Our method provides a straightforward framework for image metric rectification. It is insensitive to camera positions, viewing angles, and the shapes of document pages. To evaluate the proposed method, we implemented comprehensive experiments on both synthetic and real-captured images. The results demonstrate the efficiency of our method. We also carried out a comparative experiment on the public CBDAR2007 data set. The experimental results show that our method outperforms the state-of-the-art methods in terms of OCR accuracy and rectification errors.
Document image analysis, imaging geometry, geometric correction, shape-from-X, mesh warping.
Shiming Xiang, Gaofeng Meng, Jiangyong Duan, Chunhong Pan, "Metric Rectification of Curved Document Images", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol. 34, no. , pp. 707-722, April 2012, doi:10.1109/TPAMI.2011.151