This Article 
 Bibliographic References 
 Add to: 
Image Motion Estimation From Motion Smear-A New Computational Model
April 1996 (vol. 18 no. 4)
pp. 412-425

Abstract—Motion smear is an important visual cue for motion perception by the human vision system (HVS). However, in image analysis research, exploiting motion smear has been largely ignored. Rather, motion smear is usually considered as a degradation of images that needs to be removed. In this paper, we establish a computational model that estimates image motion from motion smear information—"motion from smear." In many real situations, the shutter of the sensing camera must be kept open long enough to produce images of adequate signal-to-noise ratio (SNR), resulting in significant motion smear in images. We present a new motion blur model and an algorithm that enables unique estimation of image motion. A prototype sensor system that exploits the new motion blur model has been built to acquire data for "motion-from-smear." Experimental results on images with both simulated smear and real smear, using our "motion-from-smear" algorithm as well as a conventional motion estimation technique, are provided. We also show that temporal aliasing does not affect "motion-from-smear" to the same degree as it does algorithms that use displacement as a cue. "Motion-from-smear" provides an additional tool for motion estimation and effectively complements the existing techniques when apparent motion smear is present.

[1] D. Burr, "Motion Smear," Nature, vol. 284, pp. 164-165, Mar. 1980.
[2] A.-C. Aho, K. Donner, S. Helenius, L.O. Larsen, and T. Reuter, "Visual Performance of the Toad (bufo bufo) at Low Light Levels: Retinal Ganglion Cell Responses and Prey-Catching Accuracy," J. Comp. Physiology A, vol. 172, pp. 671-682, 1993.
[3] C.H. Graham and R. Margaria, "Area and the Intensity-Time Relation in the Peripheral Retina," Am. J. Physiology, vol. 113, p. 299, 1935.
[4] J.B. Barlow, "Temporal and Spatial Summation in Human Vision at Different Background Intensities," J. Physiology,London, vol. 141, p. 337, 1958.
[5] L.O. Larsen and J.N. Pedersen, "The Snapping Response of the Toad, bufo bufo, Towards Prey Dummies at Very Low Light Intensities," Amphibia-Reptilia, vol. 2, pp. 321-327, 1982.
[6] D.H. Ballard, "Cortical Connections and Parallel Processing: Structure and Function," The Behavioral and Brain Sciences, vol. 9, pp. 67-91, 1986.
[7] K.E. Martin and J.A. Marshall, "Unsmearing Visual Motion: Development of Long-Range Horizontal Intrinsic Connections," Advances in Neural Information Processing Systems, S.J. Hanson, J.D. Cowan, and C.L. Giles, eds. San Mateo, Calif.: Morgan Kaufmann, 1993.
[8] H.C. Andrews and B.R. Hunt, Digital Image Restoration. Prentice Hall, 1977.
[9] A.K. Katsaggelos and K.-T. Lay, "Maximum Likelihood Identification and Restoration of Images Using the Expectation-Maximization Algorithm," Digital Image Restoration, A.K. Katsaggelos, ed., chaps. 6, 7, pp. 143-208. Springer-Verlag, 1991.
[10] G. Pavlovic and A.M. Tekalp, "Maximum Likelihood Parametric Blur Identification Based on a Continuous Spatial Domain Model," IEEE Trans. Image Processing, vol. 1, pp. 496-504, 1992.
[11] Digital Image Restoration, A.K. Katsaggelos, ed. Springer-Verlag, 1991.
[12] J.K. Aggarwal and N. Nandhakumar, “On the Computation of Motion from Sequences of Images: A Review,” Proc. IEEE, vol. 76, no. 8, pp. 917-935, 1988.
[13] R.C. Gonzales and P. Wintz, Digital Image Processing, second edition, pp. 146-152. Addison Wesley, 1987.
[14] N.B. Karayiannis and A.N. Venetsanopoulos, "Regularization Theory in Image Restoration—The Stabilizing Functional Approach, " IEEE Trans. Acoustics, Speech, and Signal Processing, vol. 38, no. 7, pp. 1,155-1,179, July 1990.
[15] B.K.P. Horn and B.G. Schunck, "Determining Optical Flow," Artificial Intelligence, vol. 17, pp. 185-203, 1981.
[16] B.C. Kuo, Digital Control Systems.New York: Holt Rhinehart and Winston, 1980.
[17] L. Ljung, System Identification: Theory for the User. Prentice Hall, 1987.
[18] Newport Corporation, The 1994 Newport Catalog.
[19] J.L. Barron, D.J. Fleet, and S.S. Beauchemin, “Performance of Optical Flow Techniques,” Int'l J. Computer Vision, vol. 12, no. 1, pp. 43–77, 1994.

Index Terms:
Motion estimation, motion smear (blur), motion-from-smear.
Wei-Ge Chen, N. Nandhakumar, Worthy N. Martin, "Image Motion Estimation From Motion Smear-A New Computational Model," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 18, no. 4, pp. 412-425, April 1996, doi:10.1109/34.491622
Usage of this product signifies your acceptance of the Terms of Use.