This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Richardson-Lucy Deblurring for Scenes under a Projective Motion Path
August 2011 (vol. 33 no. 8)
pp. 1603-1618
ASCII Text
x 
 
Yu-Wing Tai, Ping Tan, Michael S. Brown, "Richardson-Lucy Deblurring for Scenes under a Projective Motion Path," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 33, no. 8, pp. 1603-1618, August, 2011.
 
 
BibTex
x
 
@article{ 10.1109/TPAMI.2010.222,
author = {Yu-Wing Tai and Ping Tan and Michael S. Brown},
title = {Richardson-Lucy Deblurring for Scenes under a Projective Motion Path},
journal ={IEEE Transactions on Pattern Analysis and Machine Intelligence},
volume = {33},
number = {8},
issn = {0162-8828},
year = {2011},
pages = {1603-1618},
doi = {http://doi.ieeecomputersociety.org/10.1109/TPAMI.2010.222},
publisher = {IEEE Computer Society},
address = {Los Alamitos, CA, USA},
}
 
 
RefWorks Procite/RefMan/Endnote
x 
 
TY - JOUR
JO - IEEE Transactions on Pattern Analysis and Machine Intelligence
TI - Richardson-Lucy Deblurring for Scenes under a Projective Motion Path
IS - 8
SN - 0162-8828
SP1603
EP1618
EPD - 1603-1618
A1 - Yu-Wing Tai,
A1 - Ping Tan,
A1 - Michael S. Brown,
PY - 2011
KW - Motion deblurring
KW - spatially verying motion blur.
VL - 33
JA - IEEE Transactions on Pattern Analysis and Machine Intelligence
ER -
 
Yu-Wing Tai, Korea Advanced Institute of Science and Technology, Daejeon
Ping Tan, National University of Singapore, Singapore
Michael S. Brown, National University of Singapore, Singapore
This paper addresses how to model and correct image blur that arises when a camera undergoes ego motion while observing a distant scene. In particular, we discuss how the blurred image can be modeled as an integration of the clear scene under a sequence of planar projective transformations (i.e., homographies) that describe the camera's path. This projective motion path blur model is more effective at modeling the spatially varying motion blur exhibited by ego motion than conventional methods based on space-invariant blur kernels. To correct the blurred image, we describe how to modify the Richardson-Lucy (RL) algorithm to incorporate this new blur model. In addition, we show that our projective motion RL algorithm can incorporate state-of-the-art regularization priors to improve the deblurred results. The projective motion path blur model, along with the modified RL algorithm, is detailed, together with experimental results demonstrating its overall effectiveness. Statistical analysis on the algorithm's convergence properties and robustness to noise is also provided.

[1] A. Agrawal and R. Raskar, "Resolving Objects at Higher Resolution from a Single Motion-Blurred Image," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1-8, 2007.
[2] J. Bardsley, S. Jefferies, J. Nagy, and R. Plemmons, "Blind Iterative Restoration of Images with Spatially-Varying Blur," Proc. Optics Express, pp. 1767-1782, 2006.
[3] M. Ben-Ezra and S. Nayar, "Motion Deblurring Using Hybrid Imaging," Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, vol. I, pp. 657-664, June 2003.
[4] M. Ben-Ezra and S. Nayar, "Motion-Based Motion Deblurring," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 26, no. 6, pp. 689-698, June 2004.
[5] D.A. Bini, N.J. Higham, and B. Meini, "Algorithms for the Matrix P'th Root," Numerical Algorithms, vol. 39, no. 4, pp. 349-378, 2005.
[6] T.F. Chan and C.-K. Wong, "Total Variation Blind Deconvolution," IEEE Trans. Image Processing, vol. 7, no. 3, pp. 370-375, Mar. 1998.
[7] S. Cho, Y. Matsushita, and S. Lee, "Removing Non-Uniform Motion Blur from Images," Proc. 11th IEEE Int'l Conf. Computer Vision, pp. 1-8, 2007.
[8] S. Dai and Y. Wu, "Motion from Blur," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1-8, 2008.
[9] A.D. Dempster, N.M. Laird, and D.B. Rubin, "Maximum Likelihood from Incomplete Data via the EM Algorithm," J. Royal Statistical Soc., vol. 39, no. 1, pp. 1-38, 1977.
[10] N. Dey, L. Blanc-Fraud, C. Zimmer, Z. Kam, P. Roux, J. Olivo-Marin, and J. Zerubia, "A Deconvolution Method for Confocal Microscopy with Total Variation Regularization," Proc. IEEE Int'l Symp. Biomedical Imaging: Nano to Macro, pp. 1223-1226, 2004.
[11] R. Fergus, B. Singh, A. Hertzmann, S.T. Roweis, and W.T. Freeman, "Removing Camera Shake from a Single Photograph," ACM Trans. Graphics, vol. 25, no. 3, pp. 787-794, 2006.
[12] G.M. Hong, A. Rahmati, Y. Wang, and L. Zhong, "Sensecoding: Accelerometer-Assisted Motion Estimation for Efficient Video Encoding," Proc. ACM Multimedia, pp. 749-752, 2008.
[13] J. Jia, "Single Image Motion Deblurring Using Transparency," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1-8, 2007.
[14] N. Joshi, S.B. Kang, L. Zitnick, and R. Szeliski, "Image Deblurring with Inertial Measurement Sensors," ACM Trans. Graphics, vol. 29, no. 3, 2010.
[15] A. Levin, "Blind Motion Deblurring Using Image Statistics," Proc. Advances in Neural Information Processing Systems, pp. 841-848, 2006.
[16] A. Levin, R. Fergus, F. Durand, and W.T. Freeman, "Image and Depth from a Conventional Camera with a Coded Aperture," ACM Trans. Graphics, vol. 26, no. 3, pp. 1-8, July 2007.
[17] A. Levin, Y. Weiss, F. Durand, and W. Freeman, "Understanding and Evaluating Blind Deconvolution Algorithms," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2009.
[18] F. Li, J. Yu, and J. Chai, "A Hybrid Camera for Motion Deblurring and Depth Map Super-Resolution," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2008.
[19] Y. Li, S.B. Kang, N. Joshi, S. Seitz, and D. Huttenlocher, "Generating Sharp Panoramas from Motion-Blurred Videos," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2010.
[20] L. Lucy, "An Iterative Technique for the Rectification of Observed Distributions," Astronomical J., vol. 79, no. 6, pp. 745-754, 1974.
[21] R. Raskar, A. Agrawal, and J. Tumblin, "Coded Exposure Photography: Motion Deblurring Using Fluttered Shutter," ACM Trans. Graphics, vol. 25, no. 3, pp. 795-804, 2006.
[22] W. Richardson, "Bayesian-Based Iterative Method of Image Restoration," J. Optical Soc. Am., vol. 62, no. 1, pp. 55-59, 1972.
[23] A.A. Sawchuk, "Space-Variant Image Restoration by Coordinate Transformations," J. Optical Soc. Am., vol. 64, no. 2, pp. 138-144, 1974.
[24] Q. Shan, J. Jia, and A. Agarwala, "High-Quality Motion Deblurring from a Single Image," ACM Trans. Graphics, vol. 27, no. 3, 2008.
[25] Q. Shan, W. Xiong, and J. Jia, "Rotational Motion Deblurring of a Rigid Object from a Single Image," Proc. IEEE Int'l Conf. Computer Vision, 2007.
[26] L.A. Shepp and Y. Vardi, "Maximum Likelihood Reconstruction for Emission Tomography," IEEE Trans. Medical Imaging, vol. 1, no. 2, pp. 113-122, Oct. 1982.
[27] Y. Tai, H. Du, M. Brown, and S. Lin, "Image/Video Deblurring Using a Hybrid Camera," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2008.
[28] Y. Tai, H. Du, M. Brown, and S. Lin, "Correction of Spatially Varying Image and Video Blur Using a Hybrid Camera," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 32, no. 6, pp. 1012-1028, June 2010.
[29] Y. Tai, N. Kong, S. Lin, and S. Shin, "Coded Exposure Imaging for Projective Motion Deblurring," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2010.
[30] Y. Vardi, Nonlinear Programming. Prentice-Hall, 1969.
[31] O. Whyte, J. Sivic, A. Zisserman, and J. Ponce, "Non-Uniform Deblurring for Shaken Images," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2010.
[32] Wiener and Norbert, Extrapolation, Interpolation, and Smoothing of Stationary Time Series. Wiley, 1949.
[33] L. Yuan, J. Sun, L. Quan, and H.-Y. Shum, "Progressive Inter-Scale and Intra-Scale Non-Blind Image Deconvolution," ACM Trans. Graphics, vol. 27, no. 3, 2008.

Index Terms:
Motion deblurring, spatially verying motion blur.
Citation:
Yu-Wing Tai, Ping Tan, Michael S. Brown, "Richardson-Lucy Deblurring for Scenes under a Projective Motion Path," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 33, no. 8, pp. 1603-1618, Aug. 2011, doi:10.1109/TPAMI.2010.222
Usage of this product signifies your acceptance of the Terms of Use.