The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.08 - August (2011 vol.33)
pp: 1603-1618
Yu-Wing Tai , Korea Advanced Institute of Science and Technology, Daejeon
Ping Tan , National University of Singapore, Singapore
Michael S. Brown , National University of Singapore, Singapore
ABSTRACT
This paper addresses how to model and correct image blur that arises when a camera undergoes ego motion while observing a distant scene. In particular, we discuss how the blurred image can be modeled as an integration of the clear scene under a sequence of planar projective transformations (i.e., homographies) that describe the camera's path. This projective motion path blur model is more effective at modeling the spatially varying motion blur exhibited by ego motion than conventional methods based on space-invariant blur kernels. To correct the blurred image, we describe how to modify the Richardson-Lucy (RL) algorithm to incorporate this new blur model. In addition, we show that our projective motion RL algorithm can incorporate state-of-the-art regularization priors to improve the deblurred results. The projective motion path blur model, along with the modified RL algorithm, is detailed, together with experimental results demonstrating its overall effectiveness. Statistical analysis on the algorithm's convergence properties and robustness to noise is also provided.
INDEX TERMS
Motion deblurring, spatially verying motion blur.
CITATION
Yu-Wing Tai, Ping Tan, Michael S. Brown, "Richardson-Lucy Deblurring for Scenes under a Projective Motion Path", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.33, no. 8, pp. 1603-1618, August 2011, doi:10.1109/TPAMI.2010.222
REFERENCES
[1] A. Agrawal and R. Raskar, "Resolving Objects at Higher Resolution from a Single Motion-Blurred Image," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1-8, 2007.
[2] J. Bardsley, S. Jefferies, J. Nagy, and R. Plemmons, "Blind Iterative Restoration of Images with Spatially-Varying Blur," Proc. Optics Express, pp. 1767-1782, 2006.
[3] M. Ben-Ezra and S. Nayar, "Motion Deblurring Using Hybrid Imaging," Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, vol. I, pp. 657-664, June 2003.
[4] M. Ben-Ezra and S. Nayar, "Motion-Based Motion Deblurring," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 26, no. 6, pp. 689-698, June 2004.
[5] D.A. Bini, N.J. Higham, and B. Meini, "Algorithms for the Matrix P'th Root," Numerical Algorithms, vol. 39, no. 4, pp. 349-378, 2005.
[6] T.F. Chan and C.-K. Wong, "Total Variation Blind Deconvolution," IEEE Trans. Image Processing, vol. 7, no. 3, pp. 370-375, Mar. 1998.
[7] S. Cho, Y. Matsushita, and S. Lee, "Removing Non-Uniform Motion Blur from Images," Proc. 11th IEEE Int'l Conf. Computer Vision, pp. 1-8, 2007.
[8] S. Dai and Y. Wu, "Motion from Blur," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1-8, 2008.
[9] A.D. Dempster, N.M. Laird, and D.B. Rubin, "Maximum Likelihood from Incomplete Data via the EM Algorithm," J. Royal Statistical Soc., vol. 39, no. 1, pp. 1-38, 1977.
[10] N. Dey, L. Blanc-Fraud, C. Zimmer, Z. Kam, P. Roux, J. Olivo-Marin, and J. Zerubia, "A Deconvolution Method for Confocal Microscopy with Total Variation Regularization," Proc. IEEE Int'l Symp. Biomedical Imaging: Nano to Macro, pp. 1223-1226, 2004.
[11] R. Fergus, B. Singh, A. Hertzmann, S.T. Roweis, and W.T. Freeman, "Removing Camera Shake from a Single Photograph," ACM Trans. Graphics, vol. 25, no. 3, pp. 787-794, 2006.
[12] G.M. Hong, A. Rahmati, Y. Wang, and L. Zhong, "Sensecoding: Accelerometer-Assisted Motion Estimation for Efficient Video Encoding," Proc. ACM Multimedia, pp. 749-752, 2008.
[13] J. Jia, "Single Image Motion Deblurring Using Transparency," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1-8, 2007.
[14] N. Joshi, S.B. Kang, L. Zitnick, and R. Szeliski, "Image Deblurring with Inertial Measurement Sensors," ACM Trans. Graphics, vol. 29, no. 3, 2010.
[15] A. Levin, "Blind Motion Deblurring Using Image Statistics," Proc. Advances in Neural Information Processing Systems, pp. 841-848, 2006.
[16] A. Levin, R. Fergus, F. Durand, and W.T. Freeman, "Image and Depth from a Conventional Camera with a Coded Aperture," ACM Trans. Graphics, vol. 26, no. 3, pp. 1-8, July 2007.
[17] A. Levin, Y. Weiss, F. Durand, and W. Freeman, "Understanding and Evaluating Blind Deconvolution Algorithms," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2009.
[18] F. Li, J. Yu, and J. Chai, "A Hybrid Camera for Motion Deblurring and Depth Map Super-Resolution," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2008.
[19] Y. Li, S.B. Kang, N. Joshi, S. Seitz, and D. Huttenlocher, "Generating Sharp Panoramas from Motion-Blurred Videos," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2010.
[20] L. Lucy, "An Iterative Technique for the Rectification of Observed Distributions," Astronomical J., vol. 79, no. 6, pp. 745-754, 1974.
[21] R. Raskar, A. Agrawal, and J. Tumblin, "Coded Exposure Photography: Motion Deblurring Using Fluttered Shutter," ACM Trans. Graphics, vol. 25, no. 3, pp. 795-804, 2006.
[22] W. Richardson, "Bayesian-Based Iterative Method of Image Restoration," J. Optical Soc. Am., vol. 62, no. 1, pp. 55-59, 1972.
[23] A.A. Sawchuk, "Space-Variant Image Restoration by Coordinate Transformations," J. Optical Soc. Am., vol. 64, no. 2, pp. 138-144, 1974.
[24] Q. Shan, J. Jia, and A. Agarwala, "High-Quality Motion Deblurring from a Single Image," ACM Trans. Graphics, vol. 27, no. 3, 2008.
[25] Q. Shan, W. Xiong, and J. Jia, "Rotational Motion Deblurring of a Rigid Object from a Single Image," Proc. IEEE Int'l Conf. Computer Vision, 2007.
[26] L.A. Shepp and Y. Vardi, "Maximum Likelihood Reconstruction for Emission Tomography," IEEE Trans. Medical Imaging, vol. 1, no. 2, pp. 113-122, Oct. 1982.
[27] Y. Tai, H. Du, M. Brown, and S. Lin, "Image/Video Deblurring Using a Hybrid Camera," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2008.
[28] Y. Tai, H. Du, M. Brown, and S. Lin, "Correction of Spatially Varying Image and Video Blur Using a Hybrid Camera," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 32, no. 6, pp. 1012-1028, June 2010.
[29] Y. Tai, N. Kong, S. Lin, and S. Shin, "Coded Exposure Imaging for Projective Motion Deblurring," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2010.
[30] Y. Vardi, Nonlinear Programming. Prentice-Hall, 1969.
[31] O. Whyte, J. Sivic, A. Zisserman, and J. Ponce, "Non-Uniform Deblurring for Shaken Images," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2010.
[32] Wiener and Norbert, Extrapolation, Interpolation, and Smoothing of Stationary Time Series. Wiley, 1949.
[33] L. Yuan, J. Sun, L. Quan, and H.-Y. Shum, "Progressive Inter-Scale and Intra-Scale Non-Blind Image Deconvolution," ACM Trans. Graphics, vol. 27, no. 3, 2008.
6 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool