loading...
 This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Motion-Based Motion Deblurring
June 2004 (vol. 26 no. 6)
pp. 689-698
ASCII Text
x 
 
Moshe Ben-Ezra, Shree K. Nayar, "Motion-Based Motion Deblurring," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 26, no. 6, pp. 689-698, June, 2004.
 
 
BibTex
x
 
@article{ 10.1109/TPAMI.2004.1,
author = {Moshe Ben-Ezra and Shree K. Nayar},
title = {Motion-Based Motion Deblurring},
journal ={IEEE Transactions on Pattern Analysis and Machine Intelligence},
volume = {26},
number = {6},
issn = {0162-8828},
year = {2004},
pages = {689-698},
doi = {http://doi.ieeecomputersociety.org/10.1109/TPAMI.2004.1},
publisher = {IEEE Computer Society},
address = {Los Alamitos, CA, USA},
}
 
 
RefWorks Procite/RefMan/Endnote
x 
 
TY - JOUR
JO - IEEE Transactions on Pattern Analysis and Machine Intelligence
TI - Motion-Based Motion Deblurring
IS - 6
SN - 0162-8828
SP689
EP698
EPD - 689-698
A1 - Moshe Ben-Ezra,
A1 - Shree K. Nayar,
PY - 2004
KW - Sharpening and deblurring
KW - inverse filtering
KW - motion
KW - motion blur
KW - point spread function
KW - resolution
KW - hybrid imaging.
VL - 26
JA - IEEE Transactions on Pattern Analysis and Machine Intelligence
ER -
 

Abstract—Motion blur due to camera motion can significantly degrade the quality of an image. Since the path of the camera motion can be arbitrary, deblurring of motion blurred images is a hard problem. Previous methods to deal with this problem have included blind restoration of motion blurred images, optical correction using stabilized lenses, and special cmos sensors that limit the exposure time in the presence of motion. In this paper, we exploit the fundamental trade off between spatial resolution and temporal resolution to construct a hybrid camera that can measure its own motion during image integration. The acquired motion information is used to compute a point spread function (psf) that represents the path of the camera during integration. This psf is then used to deblur the image. To verify the feasibility of hybrid imaging for motion deblurring, we have implemented a prototype hybrid camera. This prototype system was evaluated in different indoor and outdoor scenes using long exposures and complex camera motion paths. The results show that, with minimal resources, hybrid imaging outperforms previous approaches to the motion blur problem. We conclude with a brief discussion on how our ideas can be extended beyond the case of global camera motion to the case where individual objects in the scene move with different velocities.

[1] S. Baker and T. Kanade, Limits on Super-Resolution and How to Break Them IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 9, pp. 1167-1183, Sept. 2002.[2] B. Bascle, A. Blake, and A. Zisserman, Motion Deblurring and Super-Resolution from an Image Sequence Proc. Fourth European Conf. Computer Vision. ECCV `96, p. 573, 1996.[3] G. Besuievsky and X. Pueyo, A Motion Blur Method for Animated Radiosity Environments Proc. Sixth Int'l Conf. Computer Graphics and Visualization 98, p. 35, 1998.[4] S. Bottini, On the visual motion blur restoration Proc. Second Int'l Conf. Visual Psychophysics and Medical Imaging, p. 143, 1981.[5] G.J. Brostow and I. Essa, Image-Based Motion Blur for Stop Motion Animation Proc. SIGGRAPH 2001 Conf., p. 561, 2001.[6] W.-G. Chen, N. Nandhakumar, and W.N. Martin, Image Motion Estimation from Motion Smear A New Computational Model IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 18, p. 412, 1996.[7] P. Csillag and L. Boroczky, Estimation of Accelerated Motion for Motion-Compensated Frame Interpolation Proc. SPIE Conf., vol. 2727, p. 604, 1996.[8] R. Fabian and D. Malah, Robust Identification of Motion and Out-of-Focus Blur Parameters from Blurred and Noisy Images CVGIP: Graphical Models and Image Processing, vol. 53, p. 403, 1991.[9] J.S. Fox, Range from Translational Motion Blurring Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, p. 360, 1988.[10] A. Glassner, An Open and Shut Case Computer Graphics IEEE Computer Graphics and Applications, vol. 19, p. 82, 1999.[11] T. Hamamoto and K. Aizawa, A Computational Image Sensor with Adaptive Pixel-Based Integration Time IEEE J. Solid-State Circuits, vol. 36, p. 580, 2001.[12] S.T. Hammett, Motion Blur and Motion Sharpening in the Human Visual System Vision Research, vol. 37, p. 2505, 1997.[13] S.T. Hammett, M.A. Georgeson, and A. Gorea, Motion Blur and Motion Sharpening: Temporal Smear and Local Contrast Nonlinearity Vision Research, vol. 38, p. 2099, 1998.[14] Canon Inc.,www.canon.com/technology/optics/shakecorrect_ shift index.html, 2003.[15] Canon Inc.,www.canon.com/technology/optics/vapcontent. html , 2003.[16] Canon Inc.,www.roper.co.jp/htmltefbin.htm, 2003.[17] P.A. Jansson, Deconvolution of Image and Spectra, second ed. Academic Press, 1997.[18] Y. Jianchao, Motion Blur Identification Based on Phase Change Experienced After Trial Restorations Proc. Sixth Int'l Conf. Image Processing (ICIP '99), p. 180, 1999.[19] C. Kolb, D. Mitchell, and P. Hanrahan, A Realistic Camera Model for Computer Graphics Computer Graphics, vol. 29, pp. 317-324, 1995.[20] S.H. Lee, N.S. Moon, and C.W. Lee, Recovery of Blurred Video Signals Using Iterative Image Restoration Combined with Motion Estimation Proc. Int'l Conf. Image Processing, p. 755, 1997.[21] X. Liu and A. El Gamal, Simultaneous Image Formation and Motion Blur Restoration via Multiple Capture Proc. 2001 IEEE Int'l Conf. Acoustics, Speech, and Signal Processing, p. 1841, 2001.[22] B.D. Lucas and T. Kanade, An Iterative Image Registration Technique with Anapplication to Stereo Vision Defense Advanced Research Projects Agency, DARPA81, pp. 121-130, 1981.[23] D.P. MacAdam, Digital Image Restoration by Constrained Deconvolution J. Optical Soc. of Am., vol. 60, no. 12, pp. 1617-1627, Dec. 1970.[24] D. Majchrzak, S. Sarkar, B. Sheppard, and R. Murphy, Motion Detection from Temporally Integrated Images Proc. 15th Int'l Conf. Pattern Recognition, p. 836, 2000.[25] S.S. Makkad and J.S. Fox, Range from Motion Blur Optical Eng., vol. 32, p. 1915, 1993.[26] N.L. Max and D.M. Lerner, A Two-and-a-Half-D Motion-Blur Algorithm Computer Graphics, vol. 19, p. 85, 1985.[27] C. Mayntx, T. Aach, and D. Kunz, Blur Identification Using a Spectral Inertia Tensor and Spectral Zeros Proc. Sixth Int'l Conf. Image Processing (ICIP '99), p. 885, 1999.[28] Edmund Industrial Optics,www.edmundoptics.com/iod displayproduct.cfm?productid=1492 , 2003.[29] Digital Photo Outback,www.outbackphoto.com/reviews/ equipment/ canon_is_100_400canon_is_100_400.html, 2000.[30] Popular Photograpy,www.popularphotography.com/cameraarticledisplay.asp?articleid=59 , 2000.[31] M. Potmesil and I. Chakravarty, Modeling Motion Blur in Computer-Generated Images Computer Graphics, vol. 17, p. 389, 1983.[32] A. Rav-Acha and S. Peleg, Restoration of Multiple Images with Motion Blur in Different Directions Proc. Fifth IEEE Workshop Applications of Computer Vision (WACV 2000), p. 22, 2000.[33] I.M. Rekleitis, Optical Flow Recognition from the Power Spectrum of a Single Blurred Image Proc. Third IEEE Int'l Conf. Image Processing, p. 791, 1996.[34] H.S. Sawhney, Y. Guo, K. Hanna, R. Kumar, S. Adkins, and S. Zhou, Hybrid Stereo Camera: An IBR Approach for Synthesis of Very High Resolution Stereoscopic Image Sequences Proc. SIGGRAPH 2001 Conf., p. 451, 2001.[35] E. Shechtman, Y. Caspi, and M. Irani, Increasing Space-Time Resolution in Video Proc. Seventh European Conf. Computer Vision, vol. 1, p. 753, 2002.[36] H. Shekarforoush and R. Chellappa, Data-Driven Multi-Channel Super-Resolution with Application to Video Sequences J. Optical Soc. of Am. A, vol. 16, no. 3, pp. 481-492, 1999.[37] A. Stern and N.S. Kopeika, Analytical Method to Calculate Optical Transfer Functions for Image Motion and Vibrations Using Moments J. Optical Soc. of Am. A (Optics, Image Science and Vision), vol. 14, p. 388, 1997.[38] A. Stern, I. Kruchakov, E. Yoavi, and N.S. Kopeika, Recognition of Motion-Blurred Images by Use of the Method of Moments Applied Optics, vol. 41, p. 2164, 2002.[39] D.L. Tull and A.K. Katsaggelos, Regularized Blur-Assisted Displacement Field Estimation Proc. Third IEEE Int'l Conf. Image Processing, p. 85, 1996.[40] J.Y.A. Wang and E.H. Adelson, Representing Moving Images with Layers IEEE Trans. Image Processing, vol. 3, no. 5, pp. 625-638, Sept. 1994.[41] Y.F. Wang and P. Liang, 3D Shape and Motion Analysis from Image Blur and Smear: A Unified Approach Proc. IEEE Sixth Int'l Conf. Computer Vision, p. 1029, 1998.[42] M.M. Wloka and R.C. Zeleznik, Interactive Real-Time Motion Blur Visual Computer, vol. 12, p. 283, 1996.[43] Y. Yitzhaky, G. Boshusha, Y. Levy, and N.S. Kopeika, Restoration of an Image Degraded by Vibrations Using Only a Single Frame Optical Eng., vol. 39, p. 2083, 2000.[44] Y. Yitzhaky and N.S. Kopeika, Identification of the Blur Extent from Motion Blurred Images Proc. SPIE Conf., vol. 2470, p. 2, 1995.[45] Y. Yitzhaky, I. Mor, A. Lantzman, and N.S. Kopeika, Direct Method for Restoration of Motion-Blurred Images J. Optical Soc. of Am. A (Optics, Image Science and Vision), vol. 15, p. 1512, 1998.[46] Y. Zhang, C. Wen, and Y. Zhang, Estimation of Motion Parameters from Blurred Images Pattern Recognition Letters, vol. 21, p. 425, 2000.

Index Terms:
Sharpening and deblurring, inverse filtering, motion, motion blur, point spread function, resolution, hybrid imaging.
Citation:
Moshe Ben-Ezra, Shree K. Nayar, "Motion-Based Motion Deblurring," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 26, no. 6, pp. 689-698, June 2004, doi:10.1109/TPAMI.2004.1
Usage of this product signifies your acceptance of the Terms of Use.