This Article 
 Bibliographic References 
 Add to: 
Error Analysis of Robust Optical Flow Estimation by Least Median of Squares Methods for the Varying Illumination Model
September 2006 (vol. 28 no. 9)
pp. 1418-1435
The apparent pixel motion in an image sequence, called optical flow, is a useful primitive for automatic scene analysis and various other applications of computer vision. In general, however, the optical flow estimation suffers from two significant problems: the problem of illumination that varies with time and the problem of motion discontinuities induced by objects moving with respect to either other objects or with respect to the background. Various integrated approaches for solving these two problems simultaneously have been proposed. Of these, those that are based on the LMedS (Least Median of Squares) appear to be the most robust. The goal of this paper is to carry out an error analysis of two different LMedS-based approaches, one based on the standard LMedS regression and the other using a modification thereof as proposed by us recently. While it is to be expected that the estimation accuracy of any approach would decrease with increasing levels of noise, for LMedS-like methods, it is not always clear as to how much of that decrease in performance can be attributed to the fact that only a small number of randomly selected samples is used for forming temporary solutions. To answer this question, our study here includes a baseline implementation in which all of the image data is used for forming motion estimates. We then compare the estimation errors of the two LMedS-based methods with the baseline implementation. Our error analysis demonstrates that, for the case of Gaussian noise, our modified LMedS approach yields better estimates at moderate levels of noise, but is outperformed by the standard LMedS method as the level of noise increases. For the case of salt-and-pepper noise, the modified LMedS method consistently performs better than the standard LMedS method.

[1] P. Stumpf, “Über die Abhängigkeit der Visuellen Bewegungsrichtung und Negativen Nachbildes von den Reizvorgangen auf der Netzhaut,” Zeitschrift für Psychologie, vol. 59, pp. 321-330, 1911.
[2] M.J. Black and P. Anandan, “A Framework for the Robust Estimation of Optical Flow,” Proc. Int'l Conf. Computer Vision, pp. 231-236, May 1993.
[3] B.K.P. Horn and B.G. Schunck, “Determining Optical Flow,” Artificial Intelligence, vol. 17, pp. 185-203, 1981.
[4] S. Negahdaripour, “Revised Definition of Optical Flow: Integration of Radiometric and Geometric Cues for Dynamic Scene Analysis,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 20, no. 9, pp. 961-979, Sept. 1998.
[5] B.D. Lucas and T. Kanade, “An Iterative Image Registration Technique with an Application to Stereovision,” Proc. Int'l Joint Conf. Artificial Intelligence, pp. 674-679, 1981.
[6] M.A. Gennert and S. Negahdaripour, “Relaxing the Brightness Constancy Assumption In Computing Optical Flow,” MIT AI Lab. Memo, no. 975, 1987.
[7] H.W. Haussecker and D.J. Fleet, “Computing Optical Flow with Physical Models of Brightness Variation,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 6, pp. 661-673, June 2001.
[8] N. Mukawa, “Optical-Model-Based Analysis of Consecutive Images,” Computer Vision and Image Understanding, vol. 66, no. 1, pp. 25-32, 1997.
[9] A. Bab-Hadiashar and D. Suter, “Robust Optic Flow Computation,” Int'l J. Computer Vision, vol. 29, no. 1, pp. 59-77, 1998.
[10] E.-P. Ong and M. Spann, “Robust Optical Flow Computation Based on Least-Median-of-Squares Regression,” Int'l J. Computer Vision, vol. 31, no. 1, pp. 51-82, 1999.
[11] M.J. Black, D.J. Fleet, and Y. Jacoobs, “Robustly Estimating Changes in Image Appearance,” Computer Vision and Image Understanding, vol. 78, no. 1, 2000.
[12] Y.-H. Kim, A.M. Martinez, and A.C. Kak, “A Local Approach for Robust Optical Flow Estimation under Varying Illumination,” Proc. British Machine Vision Conf., 2004.
[13] Y.-H. Kim, A.M. Martinez, and A.C. Kak, “Robust Motion Estimation under Varying Illumination,” Image and Vision Computing, vol. 23, no. 4, pp. 365-375, 2005.
[14] S.-H. Lai and M. Fang, “Robust and Efficient Image Alignment with Spatially Varying Illumination Models,” Proc. Conf. Computer Vision and Pattern Recognition (CVPR), 1999.
[15] J.-M. Odobez and P. Bouthemy, “Robust Multiresolution Estimation of Parametric Motion Models,” Visual Comm. and Image Representation, pp. 348-365, 1995.
[16] D. Shulman and J.-Y. Herve, “Regularization of Discontinuous Flow Fields,” Proc. IEEE Workshop Visual Motion, 1989.
[17] T.S. Huang, G.J. Yang, and G.Y. Tang, “A Fast Two-Dimensional Median Filtering Algorithm,” Acoustics, Speech, and Signal Processing Magazine, vol. 27, no. 1, pp. 13-18, 1979.
[18] H.-H. Nagel, “On the Estimation of Optical Flow: Relations between Different Approaches and Some New Results,” AI Magazine, vol. 33, pp. 299-324, 1987.
[19] S. Uras, F. Girosi, A. Verri, and V. Torre, “A Computational Approach to Motion Perception,” Biological Cybernetics, vol. 60, pp. 79-97, 1988.
[20] N. Cornelius and T. Kanade, “Adapting Optical Flow to Measure Object Motion in Reflectance and X-Ray Image Sequences,” Proc. ACM SIGGRAPH/SIGART Interdisciplinary Workshop Motion: Representation and Perception, Apr. 1983.
[21] N. Mukawa, “Motion Field Estimation for Shaded Scenes,” Proc. Int'l Conf. Image Processing (ICIP), Sept. 1989.
[22] B.G. Schunck, “Image Flow: Fundamentals and Future Research,” Proc. Conf. Computer Vision and Pattern Recognition (CVPR), June 1985.
[23] S. Negahdaripour and C. Yu, “A Generalized Brightness Change Model for Computing Optical Flow,” Proc. Int'l Conf. Computer Vision, 1993.
[24] P.J. Rousseeuw and A.M. Leroy, Robust Regression and Outlier Detection. New York: Wiley, 1987.
[25] P.W. Holland and R.E. Welsch, “Robust Regression Using Iteratively Reweighted Least Squares,” Comm. in Statistics, vol. A6, no. 9, pp. 813-827, 1977.
[26] S. Ayer, H.S. Sawhney, and M. Gorkani, “Model-Based 2D and 3D Dominant Motion Estimation for Mosaicing and Video Representation,” Proc. Int'l Conf. Computer Vision, pp. 583-590, 1995.
[27] P. Nesi, A. Del Bimbo, and D. Ben-Tzvi, “A Robust Algorithm for Optical Flow Estimation,” Computer Vision and Image Understanding, vol. 62, no. 1, pp. 59-68, 1995.
[28] B. Schunck, “Image Flow Segmentation and Estimation by Constraint Line Clustering,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 11, no. 10, Oct. 1989.
[29] R.M. Haralick, “Performance Characterization in Computer Vision,” Computer Vision Graphics Image Process: Image Understanding, vol. 60, no. 2, pp. 245-249, 1994.
[30] M. Otte and H.H. Nagel, “Optical Flow Estimation: Advances and Comparisons,” Proc. European Conf. Computer Vision, pp. 51-60, 1994.
[31] B. McCane, K. Novins, D. Crannitch, and B. Galvin, “On Benchmarking Optical Flow,” Computer Vision and Image Understanding, vol. 84, pp. 126-143, 2001.
[32] J.L. Barron, D.J. Fleet, and S.S. Beauchemin, “Performance of Optical Flow Techniques,” Int'l J. Computer Vision, 1994.

Index Terms:
Optical flow, robust estimation, varying illumination, least median of squares method, error analysis.
Yeon-Ho Kim, Avinash C. Kak, "Error Analysis of Robust Optical Flow Estimation by Least Median of Squares Methods for the Varying Illumination Model," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 28, no. 9, pp. 1418-1435, Sept. 2006, doi:10.1109/TPAMI.2006.185
Usage of this product signifies your acceptance of the Terms of Use.