The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.10 - Oct. (2013 vol.35)
pp: 2513-2525
T. Dekel Basha , Dept. of Electr. Eng., Tel-Aviv Univ., Tel-Aviv, Israel
Y. Moses , Interdiscipl. Center, Herzliya, Israel
S. Avidan , Dept. of Electr. Eng., Tel-Aviv Univ., Tel-Aviv, Israel
ABSTRACT
Image retargeting algorithms attempt to adapt the image content to the screen without distorting the important objects in the scene. Existing methods address retargeting of a single image. In this paper, we propose a novel method for retargeting a pair of stereo images. Naively retargeting each image independently will distort the geometric structure and hence will impair the perception of the 3D structure of the scene. We show how to extend a single image seam carving to work on a pair of images. Our method minimizes the visual distortion in each of the images as well as the depth distortion. A key property of the proposed method is that it takes into account the visibility relations between pixels in the image pair (occluded and occluding pixels). As a result, our method guarantees, as we formally prove, that the retargeted pair is geometrically consistent with a feasible 3D scene, similar to the original one. Hence, the retargeted stereo pair can be viewed on a stereoscopic display or further processed by any computer vision algorithm. We demonstrate our method on a number of challenging indoor and outdoor stereo images.
INDEX TERMS
Couplings, Stereo image processing, Geometry, Green products, Algorithm design and analysis, Visualization,geometric consistency, Stereo, retargeting
CITATION
T. Dekel Basha, Y. Moses, S. Avidan, "Stereo Seam Carving a Geometrically Consistent Approach", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.35, no. 10, pp. 2513-2525, Oct. 2013, doi:10.1109/TPAMI.2013.46
REFERENCES
[1] T. Dekel (Basha), Y. Moses, and S. Avidan, "Geometrically Consistent Stereo Seam Carving," Proc. IEEE Int'l Conf. Computer Vision, pp. 1816-1823, 2011.
[2] A. Mansfield, P.V. Gehler, L.J.V. Gool, and C. Rother, "Scene Carving: Scene Consistent Image Retargeting," Proc. European Conf. Computer Vision, pp. 143-156, 2010.
[3] S. Avidan and A. Shamir, "Seam Carving for Content-Aware Image Resizing," ACM Trans. Graphics, vol. 26, article 10, 2007.
[4] M. Rubinstein, A. Shamir, and S. Avidan, "Improved Seam Carving for Video Retargeting," ACM Trans. Graphics, vol. 27, article 16, 2008.
[5] H. Hirschmuller, "Stereo Processing by Semiglobal Matching and Mutual Information," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 30, no. 2, pp. 328-341, Feb. 2008.
[6] Y. Pritch, E. Kav-Venaki, and S. Peleg, "Shift-Map Image Editing," Proc. IEEE Int'l Conf. Computer Vision, pp. 151-158, 2009.
[7] L. Wolf, M. Guttmann, and D. Cohen-Or, "Non-Homogeneous Content-Driven Video-Retargeting," Proc. IEEE Int'l Conf. Computer Vision, pp. 1-6, 2007.
[8] Y.-S. Wang, C.-L. Tai, O. Sorkine, T.-Y. Lee, and T.-Y. Lee, "Optimized Scale-and-Stretch for Image Resizing," ACM Trans. Graphics, vol. 27, pp. 1-8, 2008.
[9] M. Rubinstein, D. Gutierrez, O. Sorkine, and A. Shamir, "A Comparative Study of Image Retargeting," ACM Trans. Graphics, vol. 29, article 160, 2010.
[10] M. Grundmann, V. Kwatra, M. Han, and I.A. Essa, "Discontinuous Seam-Carving for Video Retargeting," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 569-576, 2010.
[11] M. Lang, A. Hornung, O. Wang, S. Poulakos, A. Smolic, and M.H. Gross, "Nonlinear Disparity Mapping for Stereoscopic 3D," ACM Trans. Graphics, vol. 29, article 75, 2010.
[12] C.-H. Chang, C.-K. Liang, and Y.-Y. Chuang, "Content-Aware Display Adaptation and Interactive Editing for Stereoscopic Images," IEEE Trans. Multimedia, vol. 13, no. 4, pp. 589-601, Aug. 2011.
[13] K. Lee, C. Chung, and Y. Chuang, "Scene Warping: Layer-Based Stereoscopic Image Resizing," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 49-56, 2012.
[14] K. Utsugi, T. Shibahara, T. Koike, K. Takahashi, and T. Naemura, "Seam Carving for Stereo Images," Proc. 3DTV-Conf.: The True Vision-Capture, Transmission and Display of 3D Video, pp. 1-4, 2010.
[15] C. Birklbauer and O. Bimber, "Light-Field Retargeting," Computer Graphics Forum, vol. 31, pp. 295-303, 2012.
[16] L. Wang, H. Jin, R. Yang, and M. Gong, "Stereoscopic Inpainting: Joint Color and Depth Completion from Stereo Images," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2008.
[17] W.-Y. Lo, J. van Baar, C. Knaus, M. Zwicker, and M.H. Gross, "Stereoscopic 3D Copy & Paste," ACM Trans. Graphics, vol. 29, article 147, 2010.
[18] S.J. Koppal, C.L. Zitnick, M.F. Cohen, S.B. Kang, B. Ressler, and A. Colburn, "A Viewer-Centric Editor for 3D Movies," IEEE Computer Graphics and Applications, vol. 31, no. 1, pp. 20-35, Jan./Feb. 2011.
[19] H. Hirschmuller and D. Scharstein, "Evaluation of Cost Functions for Stereo Matching," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1-8, 2007.
[20] F. Huguet and F. Devernay, "A Variational Method for Scene Flow Estimation from Stereo Sequences," Proc. IEEE Int'l Conf. Computer Vision, pp. 1-7, 2007.
[21] A. Fusiello, E. Trucco, and A. Verri, "A Compact Algorithm for Rectification of Stereo Pairs," Machine Vision Application, vol. 12, pp. 16-22, 2000.
[22] T. Basha, Y. Moses, and N. Kiryati, "Multi-View Scene Flow Estimation: A View Centered Variational Approach," Int'l J. Computer Vision, pp. 1-16, 2012.
99 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool