This Article 
 Bibliographic References 
 Add to: 
A Fast Scalable Algorithm for Discontinuous Optical Flow Estimation
February 1996 (vol. 18 no. 2)
pp. 181-194

Abstract—Multiple moving objects, partially occluded objects, or even a single object moving against the background gives rise to discontinuities in the optical flow field in corresponding image sequences. While uniform global regularization based moderately fast techniques cannot provide accurate estimates of the discontinuous flow field, statistical optimization based accurate techniques suffer from excessive solution time. A 'weighted anisotropic' smoothness based numerically robust algorithm is proposed that can generate discontinuous optical flow field with high speed and linear computational complexity. Weighted sum of the first-order spatial derivatives of the flow field is used for regularization. Less regularization is performed where strong gradient information is available. The flow field at any point is interpolated more from those at neighboring points along the weaker intensity gradient-component. Such intensity gradient weighted regularization leads to Euler-Lagrange equations with strong anisotropies coupled with discontinuities in their coefficients. A robust multilevel iterative technique, that recursively generates coarse-level problems based on intensity gradient weighted smoothing weights, is employed to estimate discontinuous optical flow field. Experimental results are presented to demonstrate the efficacy of the proposed technique.

[1] P. Anandan, "A computational framework and an algorithm for the measurement of visual motion," Intl. J. Computer Vision, vol. 2, pp. 283-310, 1989.
[2] J.L. Barron, D.J. Fleet, and S.S. Beauchemin, “Performance of Optical Flow Techniques,” Int'l J. Computer Vision, vol. 12, no. 1, pp. 43–77, 1994.
[3] M. Bertero, T.A. Poggio, and V. Torre, "Ill-posed problems in early vision," Proc. IEEE, vol. 76, no. 8, pp. 869-889, 1988.
[4] J.H. Bramble, J.E. Pasciak, J. Wang, and J. Xu, "Convergence estimates for multigrid algorithm without regularity assumptions," Math. Comput., vol. 57, 1991.
[5] W.L. Briggs, A Multigrid Tutorial, SIAM, Philadelphia, 1987.
[6] F. Campbell, J. Kulikowski, "Orientation selectivity of the human visual system," J. Physiology, vol. 197, pp. 437-441, 1966.
[7] A. Stein and M. Werman,“Finding the repeated median regression line,” Third Symp. on Discrete Algorithms, 1992.
[8] W. Enkelmann,“Investigations of multigrid algorithms for estimation of optical flow fields in image sequences,” Computer Vision Graphics, Image Processing, vol. 43, no. 2, pp. 150-177, 1988.
[9] S. Geman, D. Geman, "Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 6, no. 11, pp. 721-741, 1984.
[10] S. Ghosal, R. Mehrotra, "Robust optical flow estimation," Proc. IEEE Intl. Conf. Image Proc., vol. II, pp. 780-784,Austin, 1994.
[11] F. Heitz and P. Bouthemy, Multimodal Estimation of Discontinuous Optical Flow Using Markov Random Fields IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 15, no. 12, pp. 1217-1232, Dec. 1993.
[12] B.K.P. Horn, B.G. Schunck, "Determining optical flow," Artificial Intelligence, vol. 17, pp. 185-204, 1981.
[13] B.D. Lucas, Generalized Image Matching by the Method of Differences. PhD thesis, Carnegie Mellon Univ., July 1984.
[14] J. Mandel, "Some recent advances in multigrid methods," Advances in Electronics and Electron Physics, P. Hawkes, ed., vol. 82, pp. 327-377. Academic Press: New York, 1991.
[15] J. Konrad and E. Dubois, Bayesian Estimation of Motion Vector Fields IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 14, no. 9, pp. 910-927, Sept. 1992.
[16] S.F. McCormick ed., Multigrid Methods, SIAM, Philadelphia, 1987.
[17] H. H. Nagel,W. Enkelmann,“An Investigation of smoothness constraints for the estimation of displacement vector fields from image sequences,” Trans. Pattern Analysis and Machine Intelligence, vol. 8, no. 5, pp. 565-593, 1986
[18] H.-H. Nagel, “On the Estimation of Optical Flow: Relations between Different Approaches and Some New Results,” Artificial Intelligence, vol. 33, pp. 299-324, 1987.
[19] J.W. Ruge, K. Stuben, "Algebraic Multigrid," Multigrid Methods S.F. McCormick, ed., vol. 5, Frontiers in Applied Mathematics, SIAM, Philadelphia, ch. 4, pp. 73-130.
[20] D. Terzopoulos, "Image Analysis Using Multigrid Relaxation Methods," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 8, no. 2, pp. 129-139, Mar. 1986.
[21] D. Terzopoulos, "The Computation of Visible Surface Representations," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 10, no. 4, pp. 417-438, Apr. 1988.
[22] E.P. Simoncelli, E.H. Adelson, and D.J. Heeger, "Probability Distributions of Optic Flow," IEEE CS Conf. Computer Vision and Pattern Recognition (CVPR'91), pp. 310-315,Maui, Hawaii, June 1991, IEEE CS Press.
[23] A. Singh, "An Estimation-Theoretic Framework for Image-Flow Computation," Third Int'l Conf. Computer Vision (ICCV'90), pp. 168-177,Osaka, Japan, Dec. 1990, IEEE CS Press.
[24] M.A. Snyder,“On the mathematical foundations of smoothness constraints for the determination of optical flow and for surface reconstruction,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 13, no. 11, pp. 1,105-1,114, 1991.
[25] R. Szeliski, "Fast Surface Interpolation Using Hierarchical Basis Functions," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 12, no. 6, pp. 513-528, June 1990.
[26] P. Vanek, "Acceleration of convergence of a two-level algorithm by smoothing transfer operator," Applications of Mathematics, vol. 37, 1992.
[27] P. Vanek, J. Mandel, and M. Brezina, "Algebraic Multigrid on Unstructured Meshes," Report No. 34, Center for Computational Mathematics, Univ. of Colorado at Denver, 1995.
[28] R. Varga, Matrix Iterative Analysis. Prentice-Hall: Englewood Cliffs, NJ, 1962.
[29] A. Verri and T. Poggio, "Motion field and optical flow: Qualitative properties," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 11, no. 5, pp. 490-498, May 1989.
[30] H. Zheng, S.D. Blostein, "An error-weighted regularization algorithm for image motion-field estimation," IEEE Trans. Image Processing, vol. 2, no. 2, pp. 246-252, 1993.
[31] H. Zheng, S.D. Blostein, "Anisotropic regularization for image-motion field estimation," Proc. Intl. Conf. Signal Proc., vol. 2, pp. 924-927,Beijing, 1993.
[32] H. Zheng, Estimation Of Image Motion In Scenes Containing Multiple Moving Objects, PhD Dissertation, Queen's Univ., Ontario, Canada, 1993.

Index Terms:
Discontinuous optical flow estimation, weighted anisotropic smoothness, partial differential equation (PDE), scalable algorithm, multilevel iterative methods.
Sugata Ghosal, Petr Vanek, "A Fast Scalable Algorithm for Discontinuous Optical Flow Estimation," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 18, no. 2, pp. 181-194, Feb. 1996, doi:10.1109/34.481542
Usage of this product signifies your acceptance of the Terms of Use.