The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.02 - Feb. (2013 vol.35)
pp: 425-436
P. Ghosh , Microsoft Corp., Redmond, WA, USA
B. S. Manjunath , Dept. of Electr. & Comput. Eng., Univ. of California Santa Barbara, Santa Barbara, CA, USA
ABSTRACT
We introduce a fast and efficient variational framework for Simultaneous Registration and Segmentation (SRS) applicable to a wide variety of image sequences. We demonstrate that a dense correspondence map (between consecutive frames) can be reconstructed correctly even in the presence of partial occlusion, shading, and reflections. The errors are efficiently handled by exploiting their sparse nature. In addition, the segmentation functional is reformulated using a dual Rudin-Osher-Fatemi (ROF) model for fast implementation. Moreover, nonparametric shape prior terms that are suited for this dual-ROF model are proposed. The efficacy of the proposed method is validated with extensive experiments on both indoor, outdoor natural and biological image sequences, demonstrating the higher accuracy and efficiency compared to various state-of-the-art methods.
INDEX TERMS
Shape, Robustness, Image segmentation, Optical imaging, Image reconstruction, Adaptive optics, Lighting,optimization, Segmentation, registration, tracking
CITATION
P. Ghosh, B. S. Manjunath, "Robust Simultaneous Registration and Segmentation with Sparse Error Reconstruction", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.35, no. 2, pp. 425-436, Feb. 2013, doi:10.1109/TPAMI.2012.103
REFERENCES
[1] P. Ghosh, M.E. Sargin, and B.S. Manjunath, "Robust Dynamical Model for Simultaneous Registration and Segmentation in a Variational Framework: A Bayesian Approach," Proc. 12th IEEE Int'l Conf. Computer Vision, Oct. 2009.
[2] M. Leventon, W. Grimson, and O. Faugeras, "Statistical Shape Influence in Geodesic Active Contours," Proc. Fifth IEEE EMBS Int'l Summer School on Biomedical Imaging, June 2002.
[3] T.F. Cootes, C.J. Taylor, D.H. Cooper, and J. Graham, "Active Shape Models: Their Training and Application," Computer Vision and Image Understanding, vol. 61, no. 1, pp. 38-59, Jan. 1995.
[4] T. Cootes et al., "Active Appearance Models," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 6, pp. 681-685, June 2001.
[5] S.C. Mitchell et al., "Multistage Hybrid Active Appearance Model Matching: Segmentation of Left and Right Ventricles in Cardiac MR Images," IEEE Trans. Medical Imaging, vol. 20, no. 5, pp. 415-423, May 2001.
[6] A. Tsai et al., "A Shape-Based Approach to the Segmentation of Medical Imagery Using Level Sets," IEEE Trans. Medical Imaging, vol. 22, no. 2, pp. 137-154, Feb. 2003.
[7] Y. Zhu, X. Papademetris, A. Sinusas, and J. Duncan, "Segmentation of Left Ventricle from 3D Cardiac MR Image Sequences Using a Subject-Specific Dynamical Model," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1-8, June 2008.
[8] H. Ishikawa and I. Jermyn, "Region Extraction from Multiple Images," Proc. Eighth IEEE Int'l Conf. Computer Vision, pp. 509-516, 2001.
[9] T. Schoenemann and D. Cremers, "Globally Optimal Shape-Based Tracking in Real-Time," Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, June 2008.
[10] T. Schoenemann and D. Cremers, "A Combinatorial Solution for Model-Based Image Segmentation and Real-Time Tracking," IEEE Trans. Pattern Analysis Machine Intelligence, vol. 32, no. 7, pp. 1153-1164, July 2010.
[11] T. Schoenemann and D. Cremers, "High Resolution Motion Layer Decomposition Using Dual-Space Graph Cuts," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1-7, 2008.
[12] S. Avidan, "Ensemble Tracking," Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, 2005.
[13] B. Babenko, M. Yang, and S. Belongie, "Visual Tracking with Online Multiple Instance Learning," IEEE Pattern Analysis and Machine Intelligence, vol. 32, no. 7, pp. 1153-1164, July 2009.
[14] X. Mei and H. Ling, "Robust Visual Tracking Using L1 Minimization," Proc. IEEE Int'l Conf. Computer Vision, pp. 1-8, 2009.
[15] X. Mei, H. Ling, and Y. Wu, "Minimum Error Bounded Efficient L1 Tracker with Occlusion Detection," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2011.
[16] J. An, Y. Chen, F. Huang, D. Wilson, and E. Geiser, "A Variational PDE Based Level Set Method for a Simultaneous Segmentation and Non-Rigid Registration," Medical Image Computing and Computer-Assisted Intervention, vol. 3749, pp. 286-293, 2005.
[17] G. Unal and G. Slabaugh, "Coupled PDES for Non-Rigid Registration and Segmentation," Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 168-175, June 2005.
[18] K. Saddi, C. Chefd'hotel, M. Rousson, and F. Cheriet, "Region-Based Segmentation via Non-Rigid Template Matching," Proc. IEEE Int'l Conf. Computer Vision, pp. 1-7, Oct. 2007.
[19] J. Ehrhardt, A. Richberg, and H. Handels, "A Variational Approach for Combined Segmentation and Estimation of Respiratory Motion in Temporal Image Sequences," Proc. IEEE Int'l Conf. Computer Vision, pp. 1-7, Oct. 2007.
[20] P. Ghosh, M.E. Sargin, and B.S. Manjunath, "Generalized Simultaneous Registration and Segmentation," Proc. IEEE Int'l Conf. Computer Vision, June 2010.
[21] M. Black and P. Anandan, "The Robust Estimation of Multiple Motions: Parametric and Piecewise-Smooth Flow Fields," Computer Vision and Image Understanding, vol. 63, no. 1, pp. 75-104, 1996.
[22] D. Cremers and S. Soatto, "Motion Competition: A Variational Approach to Piecewise Parametric Motion Segmentation," Int'l J. Computer Vision, vol. 62, no. 3, pp. 249-265, 2005.
[23] B. Horn and B. Schunck, "Determining Optical Flow," Computer Vision, vol. 17, pp. 185-203, 1981.
[24] T. Brox, A. Bruhn, N. Papenberg, and J. Weickert, "High Accuracy Optical Flow Estimation Based on a Theory for Warping," Proc. European Conf. Computer Vision, pp. 25-36, 2004.
[25] A. Wedel, T. Pock, C. Zach, H. Bischof, and D. Cremers, "An Improved Algorithm for TV-l 1 Optical Flow," Statistical and Geometrical Approaches to Visual Motion Analysis, vol. 5064, pp. 23-45, 2009.
[26] D. Sun, S. Roth, T. Darmstadt, and M. Black, "Secrets of Optical Flow Estimation and Their Principles," Proc. IEEE Int'l Conf. Computer Vision, June 2010.
[27] N. Papenberg, A. Bruhn, T. Brox, S. Didas, and J. Weickert, "Highly Accurate Optic Flow Computation with Theoretically Justified Warping," Int'l J. Computer Vision, vol. 67, no. 2, pp. 141-158, 2006.
[28] S. Baker, S. Roth, D. Scharstein, M. Black, J. Lewis, and R. Szeliski, "A Database and Evaluation Methodology for Optical Flow," Proc. IEEE Int'l Conf. Computer Vision, 2007.
[29] D. Cremers, "Dynamical Statistical Shape Priors for Level set Based Tracking," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 8, pp. 1262-1273, Aug. 2006.
[30] T. Chan and L. Vese, "Active Contours without Edges," IEEE Trans. Image Processing, vol. 10, no. 2, pp. 266-277, Feb. 2001.
[31] T. Chan, S. Esedoglu, and M. Nikolova, "Algorithms for Finding Global Minimizers of Image Segmentation and Denoising Models," SIAM J. Applied Math., vol. 66, no. 5, pp. 1632-1648, 2006.
[32] D. Cremers and S. Soatto, "A Pseudo-Distance for Shape Priors in Level Set Segmentation," Proc. Second IEEE Workshop Variational, Geometric and Level Set Methods in Computer Vision, pp. 169-176, 2003.
[33] X. Bresson, S. Esedoglu, P. Vandergheynst, J. Thiran, and S. Osher, "Fast Global Minimization of the Active Contour/Snake Model," J. Math. Imaging and Vision, vol. 28, no. 2, pp. 151-167, 2007.
[34] X. Bresson, P. Vandergheynst, and J. Thiran, "A Variational Model for Object Segmentation Using Boundary Information and Shape Prior Driven by the Mumford-Shah Functional," Int'l J. Computer Vision, vol. 68, no. 2, pp. 145-162, 2006.
[35] D. Cremers, S. Osher, and S. Soatto, "Kernel Density Estimation and Intrinsic Alignment for Shape Priors in Level Set Segmentation," Int'l J. Computer Vision, vol. 69, no. 3, pp. 335-351, 2006.
[36] J. Aujol, G. Gilboa, T. Chan, and S. Osher, "Structure-Texture Image Decomposition—Modeling, Algorithms, and Parameter Selection," Int'l J. Computer Vision, vol. 67, no. 1, pp. 111-136, 2006.
[37] M. Taron, N. Paragios, and M. Jolly, "Registration with Uncertainties and Statistical Modeling of Shapes with Variable Metric Kernels," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 31, no. 1, pp. 99-113, Jan. 2008.
[38] D. Comaniciu, V. Ramesh, and P. Meer, "Kernel-Based Object Tracking," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, no. 5, pp. 564-575, May 2003.
[39] D. Ross, J. Lim, R. Lin, and M. Yang, "Incremental Learning for Robust Visual Tracking," Int'l J. Computer Vision, vol. 77, no. 1, pp. 125-141, 2008.
84 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool