This Article 
 Bibliographic References 
 Add to: 
Detecting Binocular Half-Occlusions: Empirical Comparisons of Five Approaches
August 2002 (vol. 24 no. 8)
pp. 1127-1133

Binocular half-occlusion points are those that are visible in one of the two views provided by a binocular imaging system. Due to their importance in binocular matching as well as, subsequent interpretation tasks, a number of approaches have been developed for dealing with such points. In the current paper, we consider five methods that explicitly detect half-occlusions and report on a more uniform comparison than has previously been performed. Taking a disparity image and its associated match goodness image as input, we generate images that show the half-occluded points in the underlying scene. We quantitatively and qualitatively compare these methods under a variety of conditions.

[1] B. Anderson and K. Nakayama, “Toward a General Theory of Stereopsis: Binocular Matching, Occluding Contours, and Fusion,” Psychological Rev., vol. 101, no. 3, pp. 414-445, 1994.
[2] H.H. Baker and T.O. Binford, “Depth from Intensity and Edge Based Stereo,” Proc. Seventh Int'l Joint Conf. Artificial Intelligence, pp. 631-636, 1981.
[3] S. Barnard and M. Fischler, “Computational Stereo,” ACM Computing Surveys, vol. 14, no. 4, pp. 553–572, 1982.
[4] P.N. Belhumeur, “A Bayesian Approach to Binocular Stereopsis,” Int'l J. Computer Vision, vol. 19, no. 3, pp. 237-260, 1996.
[5] R. Bolles, H. Baker, and M. Hannah, “The JISCT Stereo Evaluation,” Proc. Defense Advanced Research Projects Agency (DARPA) Image Understanding Workshop, pp. 263-274, 1993.
[6] P.J. Burt and E.H. Adelson, “The Laplacian Pyramid as a Compact Image Code,” IEEE Trans. Comm., vol. 31, no. 4, pp. 532-540, 1983.
[7] Carnegie Mellon Univ., VASC Image Database, Jan. 2001.
[8] C. Chang, S. Chatterjee, and P.R. Kube, “On an Analysis of Static Occlusion in Stereo Vision,” Proc. Conf. Computer Vision and Pattern Recognition, pp. 722-723, 1991.
[9] U. Dhond and J.K. Aggarwal, "Structure From Stereo—A Review," IEEE Trans. Systems, Man, and Cybernetics, vol. 19, no. 6, pp. 1,489-1,510, Nov. 1989.
[10] G. Egnal and R.P. Wildes, “Detecting Binocular Half-Occlusions: Empirical Comparisons of Four Approaches,” Proc. Conf. Computer Vision and Pattern Recognition, vol. II, pp. 466-473, 2000.
[11] O.D. Faugeras, Three-Dimensional Computer Vision: A Geometric Viewpoint.Cambridge, Mass.: MIT Press, 1993.
[12] D. Geiger, B. Ladendorf, and A. Yuille, “Occlusions and Binocular Stereo,” Int'l J. Computer Vision, vol. 14, pp. 211-226, 1995.
[13] B. Gillam and E. Borsting, “The Role of Monocular Regions in Stereo Displays,” Perception, vol. 17, pp. 603-608, 1988.
[14] I.P. Howard and B.J. Rogers, Binocular Vision and Stereopsis. Oxford, U.K.: Oxford Univ. Press, 1995.
[15] S.S. Intille and A.F. Bobick, “Disparity-Space Images and Large Occlusion Stereo,” Proc. European Conf. Computer Vision, pp. 179-186, 1994.
[16] K. Konolige, “Small Vision Systems: Hardware and Implementation,” Proc. Int'l Symp. Robotics Research, 1997.
[17] J.D. Krol and W.A. van der Grind, “The Double-Nail Illusion,” Perception, vol. 11, pp. 615-619, 1982.
[18] R. Kumar, P. Anandan, and K. Hanna, “Direct Recovery of Shape from Multiple Views: A Parallax Based Approach,” Proc. Int'l Conf. Pattern Recognition, pp. 685-688, Oct. 1994.
[19] K.N. Kutulakos and S.M. Seitz, “A Theory of Shape by Space Carving,” Int'l J. Computer Vision, vol. 38, no. 3, pp. 199-218, 2000.
[20] R.B. Lawson and W.L. Gulick, “Stereopsis and Anomalous Contour,” Vision Research, vol. 7, pp. 271-297, 1967.
[21] J. Little and W. Gillett, “Direct Evidence for Occlusion in Stereo and Motion,” Proc. European Conf. Computer Vision, pp. 336-340, 1990.
[22] A. Luo and H. Burkhardt, “An Intensity-Based Cooperative Bidirectional Stereo Matching with Simultaneous Detection of Discontinuities and Occlusions,” Int'l J. Computer Vision, vol. 15, pp. 171-188, 1995.
[23] K. Nakayama and S. Shimojo, “DaVinci Stereopsis: Depth and Subjective Occluding Contours from Unpaired Image Points,” Vision Research, vol. 30, pp. 1811-1825, 1990.
[24] Y. Ohta and T. Kanade, “Stereo by Intra- and Inter-Scanline Search Using Dynamic Programming,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 7, no. 2, pp. 139-154, 1985.
[25] Selections from the Notebooks of Leonardo da Vinci. J. Richter, ed. Oxford U.K.: Oxford Univ. Press, 1977.
[26] H.S. Sawhney, "3D Geometry From Planar Parallax," Proc. CVPR '94, pp. 929-934, 1994.
[27] A. Shashua and N. Navab, "Relative Affine Structure: Theory and Application to 3D Reconstruction From Perspective Views," Proc. CVPR '94, pp. 483-489, 1994.
[28] T. Smitley and R. Bajcsy, “Stereo Processing of Aerial Urban Images,” Proc. Int'l Joint Conf. Pattern Recognition, pp. 405-409, 1984.
[29] A. Spoerri and S. Ullman, “The Early Detection of Motion Boundaries,” Proc. Int'l Conf. Computer Vision, pp. 209-218, 1987.
[30] R. Szeliski and R. Zabih, “An Experimental Comparison of Stereo Algorithms,” Proc. Int'l Workshop Vision Algorithms, pp. 1-19, 1999.
[31] H. Tao, H.S. Sawhney, and R. Kumar, “A Global Matching Framework for Stereo Computation,” Proc. Eighth Int'l Conf. Computer Vision, pp. 532-539, 2001.
[32] R. Trapp, S. Drüe, and G. Hartmann, “Stereo Matching with Implicit Detection of Occlusions,” Proc. European Conf. Computer Vision, pp. 17-33, 1998.
[33] Univ. of Tsukuba Stereo Pair, obtained from Richard Szeliski at stereo/Website current as of Sept. 2001.
[34] J. Weng, N. Ahuja, and T.S. Huang, “Two-View Matching,” Proc. Int'l Conf. Computer Vision, pp. 64-73, 1988.
[35] R.P. Wildes, “Direct Recovery of Three-Dimensional Scene Geometry from Binocular Stereo Disparity,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 13, no. 8, pp. 761-774, 1991.
[36] A.L. Yuille and T. Poggio, “A Generalized Ordering Constraint for Stereo Correspondence,” Artificial Intelligence Lab 777, MIT, Cambridge, Mass. 1984.

Index Terms:
Stereo matching, binocular half-occlusions, three-dimensional vision, empirical comparisons.
Geoffrey Egnal, Richard P. Wildes, "Detecting Binocular Half-Occlusions: Empirical Comparisons of Five Approaches," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 24, no. 8, pp. 1127-1133, Aug. 2002, doi:10.1109/TPAMI.2002.1023808
Usage of this product signifies your acceptance of the Terms of Use.