This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Joint Depth Map and Color Consistency Estimation for Stereo Images with Different Illuminations and Cameras
May 2013 (vol. 35 no. 5)
pp. 1094-1106
Yong Seok Heo, Dept. of Electr. Eng. & Comput. Sci., Seoul Nat. Univ., Seoul, South Korea
Kyoung Mu Lee, Dept. of Electr. Eng. & Comput. Sci., Seoul Nat. Univ., Seoul, South Korea
Sang Uk Lee, Dept. of Electr. Eng. & Comput. Sci., Seoul Nat. Univ., Seoul, South Korea
In this paper, we propose a method that infers both accurate depth maps and color-consistent stereo images for radiometrically varying stereo images. In general, stereo matching and performing color consistency between stereo images are a chicken-and-egg problem since it is not a trivial task to simultaneously achieve both goals. Hence, we have developed an iterative framework in which these two processes can boost each other. First, we transform the input color images to log-chromaticity color space, from which a linear relationship can be established during constructing a joint pdf of transformed left and right color images. From this joint pdf, we can estimate a linear function that relates the corresponding pixels in stereo images. Based on this linear property, we present a new stereo matching cost by combining Mutual Information (MI), SIFT descriptor, and segment-based plane-fitting to robustly find correspondence for stereo image pairs which undergo radiometric variations. Meanwhile, we devise a Stereo Color Histogram Equalization (SCHE) method to produce color-consistent stereo image pairs, which conversely boost the disparity map estimation. Experimental results show that our method produces both accurate depth maps and color-consistent stereo images, even for stereo images with severe radiometric differences.
Index Terms:
Image color analysis,Joints,Radiometry,Stereo vision,Robustness,Cameras,Probability density function,color consistency,Stereo matching,radiometric variation,mutual information,SIFT
Citation:
Yong Seok Heo, Kyoung Mu Lee, Sang Uk Lee, "Joint Depth Map and Color Consistency Estimation for Stereo Images with Different Illuminations and Cameras," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 35, no. 5, pp. 1094-1106, May 2013, doi:10.1109/TPAMI.2012.167
Usage of this product signifies your acceptance of the Terms of Use.