This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Robust Reweighted MAP Motion Estimation
April 1998 (vol. 20 no. 4)
pp. 353-365

Abstract—This paper proposes a motion estimation algorithm that is robust to motion discontinuity and noise. The proposed algorithm is constructed by embedding the least median squares (LMedS) of robust statistics into the maximum a posteriori (MAP) estimator. Difficulties in accurate estimation of the motion field arise from the smoothness constraint and the sensitivity to noise. To cope robustly with these problems, a median operator and the concept of reweighted least squares (RLS) are applied to the MAP motion estimator, resulting in the reweighted robust MAP (RRMAP). The proposed RRMAP motion estimation algorithm is also generalized for multiple image frame cases. Computer simulation with various synthetic image sequences shows that the proposed algorithm reduces errors, compared to three existing robust motion estimation algorithms that are based on M-estimation, total least squares (TLS), and Hough transform. It is also observed that the proposed algorithm is statistically efficient and robust to additive Gaussian noise and impulse noise. Furthermore, the proposed algorithm yields reasonable performance for real image sequences.

[1] M. Bertero, T.A. Poggio, and V. Torre, "Ill-posed problems in early vision," Proc. IEEE, vol. 76, no. 8, pp. 869-889, 1988.
[2] S.A. Kassam and H.V. Poor, "Robust Techniques for Signal Processing: A Survey," Proc. IEEE, vol. 73, no. 3, pp. 433-481, Mar. 1985.
[3] X. Zhuang, T. Wang, and P. Zhang, A Highly Robust Estimator Through Partially Likelihood Function Modeling and Its Application in Computer Vision IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 14, pp. 19-35, 1992.
[4] J.K. Aggarwal and N. Nandhakumar, “On the Computation of Motion from Sequences of Images: A Review,” Proc. IEEE, vol. 76, no. 8, pp. 917-935, 1988.
[5] J.F. Vega-Riveros and K. Jabbour, "Review of Motion Analysis Techniques," IEE Proc. pt. 1, vol. 136, no. 6, pp. 397-404, Dec. 1989.
[6] J. Marroquin, S. Mitter, and T. Poggio, "Probabilistic Solution of Ill-Posed Problems in Computational Vision," J. Am. Statistical Assoc., vol. 82, no. 397, pp. 76-89, Mar. 1987.
[7] A.D. Jepson and M. Black, “Mixture Models for Optical Flow Computation,” Proc. Computer Vision and Pattern Recognition, pp. 760-761, June 1993.
[8] R. Szeliski and H.Y. Shum, “Motion Estimation with Quadtree Splines,” Proc. Fifth Int'l Conf. Computer Vision, pp. 757-763, June 1995.
[9] Y. Weiss and E. Adelson, “A Unified Mixture Framework for Motion Segmentation: Incorporating Spatial Coherence and Estimating the Number of Models,” Proc. IEEE Computer Soc. Conf. Computer Vision and Pattern Recognition, pp. 321-326, 1996.
[10] T. Darrell and A. Pentland, "Cooperative Robust Estimation Using Layers of Support," Trans. Pattern Analysis and Machine Intelligence, vol. 17, no. 5, pp. 474-487, May 1995.
[11] J.J. Clark and A.L. Yuille, Data Fusion for Sensory Information Processing Systems.Norwell, Mass.: Kluwer Academic Publishers, 1990.
[12] C. Bouman and K. Sauer, "A Generalized Gaussian Image Model for Edge Preserving MAP Estimation," IEEE Trans. Image Processing, vol. 2, pp. 296-310, July 1993.
[13] D.G. Sim and R.H. Park, "A Two-Stage Algorithm for Motion-Discontinuity Preserving Optical Flow Estimation," Computer Vision and Image Understanding, vol. 65, no. 1, pp. 19-37, Jan. 1997.
[14] D.G. Sim and R.H. Park, "Anisotropic Hierarchical Motion Estimation Method Based on Decomposition of the Functional Domain," J. Visual Comm. Image Representation, vol. 7, no. 3, pp. 259-272, Sept. 1996.
[15] P. Anandan, "A Computational Framework and an Algorithm for the Measurement of Visual Motion," Int'l J. Computer Vision, vol. 2, no. 3, pp. 283-319, Sept. 1989.
[16] S.X. Ju, M.J. Black, and A.D. Jepson, Skin and Bones: Multi-Layer, Locally Affine, Optical Flow and Regularization with Transparency Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 307-314, 1996.
[17] R.L. Stevenson, B.E. Schmitz, and E.J. Delp, "Discontinuity Preserving Regularization of Inverse Visual Problems," IEEE Trans. Systems, Man, and Cybernetics, vol. 24, pp. 455-469, Mar. 1994.
[18] S. Ayer and H. Sawhney, "Layered Representation of Motion Video Using Robust Maximum-Likelihood Estimation of Mixture Models and mdl Encoding," Int'l Conf. Computer Vision, pp. 777-784,Cambridge, Mass., June 1995.
[19] X. Yu, T.D. Bui, and A. Krzyzak, "Robust Estimation for Range Image Segmentation and Reconstruction," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 16, no. 5, pp. 530-538, May 1994.
[20] R.L. Kashyap and K.B. Eom, "Robust Image Modeling Techniques With an Image Restoration Application," IEEE Trans. Acoustics, Speech, and Signal Processing, vol. 36, no. 8, pp. 1,313-1,325, Aug. 1988.
[21] A.J. Koive and C.W. Kim, "Robust Image Modeling for Classification of Surface Defects on Wood Boards," IEEE Trans. Systems, Man, and Cybernetics, vol. 19, no. 6, pp. 1,659-1,666, Nov. 1989.
[22] I. Pitas and A.N. Venetsanopoulos, Nonlinear Digital Filters.Norwell, Mass.: Kluwer Academic Publishers, 1990.
[23] P. Meer, D. Mintz, D.Y. Kim, and A. Rosenfeld, "Robust Regression Methods for Computer Vision: A Review," Int'l J. Computer Vision, vol. 6, no. 1, pp. 59-70, Apr. 1991.
[24] A. Bab-Hadiashar and D. Suter, "Optic Flow Calculation Using Robust Statistics," Proc. Computer Vision Patern Recognition, pp. 988-993,San Juan, Puerto Rico, June 1997.
[25] P.J. Rousseeuw and A.M. Leroy, Robust Regression and Outlier Detection.New York: John Wiley&Sons, 1987.
[26] J. Weber and J. Malik, "Robust Computation of Optical Flow in a Multi-Scale Differential Framework," Int'l J. Computer Vision, vol. 14, no. 1, pp. 67-81, Jan. 1995.
[27] S.S. Sinha and B.G. Schunck,“A two-stage algorithm for discontinuity-perserving surface reconstruction,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 14, pp. 36-55, 1992.
[28] M.J. Black and P. Anandan,“A framework for the robust estimation of optical flow,” Proc. Int’l Conf. on Computer Vision, ICCV-93, Berlin, pp. 231-236, May 1993.
[29] M.J. Black and P. Anandan, “Robust Dynamic Motion Estimation Over Time,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 296–302, June 1991.
[30] M.J. Black and A. Rangarajan, "The Outlier Process: Unifying Line Processes and Robust Statistics," IEEE CS Conf. Computer Vision and Pattern Recognition (CVPR'94), pp. 15-22,Seattle, Washington, June 1994, IEEE CS Press.
[31] M.J. Black, "Recursive Non-Linear Estimation of Discontinuous Flow Fields," Proc. European Conf. Computer Vision, vol. 800, pp. 138-145,Stockholm, Sweden, May 1994.
[32] M.J. Black and P. Anandan, "The Robust Estimation of Multiple Motions: Parametric and Piecewise-Smooth Flow Fields," Computer Vision and Image Understanding, vol. 63, no. 1, pp. 75-104, Jan. 1996.
[33] M. Bober and J. Kittler, "Robust Motion Analysis," Proc. CVPR, pp. 947-952,Seattle, June 1994.
[34] M. Bober and J. Kittler, "On Combining the Hough Transform and Multiresolution MRFs for the Robust Analysis of Complex Motion," Proc. Second Asian Conf. Computer Vision, pp. 301-305,Singapore, Dec. 1995.
[35] B.K.P. Horn and B.G. Schunck, "Determining Optical Flow," Artificial Intelligence, vol. 17, pp. 185-203, Aug. 1981.
[36] C. Schnörr, "Computation of Discontinuous Optical Flow by Domain Decomposition and Shape Optimization," Int'l J. Computer Vision, vol. 8, no. 2, pp. 153-165, Aug. 1992.
[37] J.L. Barron, D.J. Fleet, and S.S. Beauchemin, "Performance of Optical Flow Techniques," Int'l J. Computer Vision, vol. 12, no. 1, pp. 43-77, Feb. 1994.

Index Terms:
Motion estimation, regularization, MAP estimation, robust statistics, LMedS.
Citation:
Dong-Gyu Sim, Rae-Hong Park, "Robust Reweighted MAP Motion Estimation," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 20, no. 4, pp. 353-365, April 1998, doi:10.1109/34.677261
Usage of this product signifies your acceptance of the Terms of Use.