The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.12 - Dec. (2013 vol.35)
pp: 2956-2967
Ruiqi Guo , Dept. of Comput. Sci., Univ. of Illinois at Urbana Champaign, Urbana, IL, USA
Qieyun Dai , Dept. of Comput. Sci., Univ. of Illinois at Urbana Champaign, Urbana, IL, USA
Derek Hoiem , Dept. of Comput. Sci., Univ. of Illinois at Urbana Champaign, Urbana, IL, USA
ABSTRACT
In this paper, we address the problem of shadow detection and removal from single images of natural scenes. Differently from traditional methods that explore pixel or edge information, we employ a region-based approach. In addition to considering individual regions separately, we predict relative illumination conditions between segmented regions from their appearances and perform pairwise classification based on such information. Classification results are used to build a graph of segments, and graph-cut is used to solve the labeling of shadow and nonshadow regions. Detection results are later refined by image matting, and the shadow-free image is recovered by relighting each pixel based on our lighting model. We evaluate our method on the shadow detection dataset in Zhu et al. . In addition, we created a new dataset with shadow-free ground truth images, which provides a quantitative basis for evaluating shadow removal. We study the effectiveness of features for both unary and pairwise classification.
INDEX TERMS
Lighting, Shadow detection, Image color analysis, Image edge detection, Histograms,enhancement, Shadow detection, region classification, shadow removal
CITATION
Ruiqi Guo, Qieyun Dai, Derek Hoiem, "Paired Regions for Shadow Detection and Removal", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.35, no. 12, pp. 2956-2967, Dec. 2013, doi:10.1109/TPAMI.2012.214
REFERENCES
[1] J. Zhu, K.G.G. Samuel, S. Masood, and M.F. Tappen, "Learning to Recognize Shadows in Monochromatic Natural Images," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2010.
[2] R. Guo, Q. Dai, and D. Hoiem, "Single-Image Shadow Detection and Removal Using Paired Regions," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2011.
[3] J.-F. Lalonde, A.A. Efros, and S.G. Narasimhan, "Estimating Natural Illumination from a Single Outdoor Image," Proc. 12th IEEE Int'l Conf. Computer Vision, 2009.
[4] K. Karsch, V. Hedau, D. Forsyth, and D. Hoiem, "Rendering Synthetic Objects Into Legacy Photographs," Proc. ACM Siggraph, 2011.
[5] D.L. Waltz, "Generating Semantic Descriptions from Drawings of Scenes with Shadows," technical report, 1972.
[6] H. Barrow and J. Tenenbaum, "Recovering Intrinsic Scene Characteristics from Images," Computer Vision Systems, pp. 3-26, 1978.
[7] E.H. Land and J.J. McCann, "Lightness and Retinex Theory," J. Optical Soc. of Am., vol. 61, pp. 1-11, 1971.
[8] B.A. Maxwell, R.M. Friedhoff, and C.A. Smith, "A Bi-Illuminant Dichromatic Reflection Model for Understanding Images," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2008.
[9] S.G. Narasimhan, V. Ramesh, and S.K. Nayar, "A Class of Photometric Invariants: Separating Material from Shape and Illumination," Proc. Ninth IEEE Int'l Conf. Computer Vision, 2003.
[10] G.D. Finlayson, S.D. Hordley, C. Lu, and M.S. Drew, "On the Removal of Shadows from Images," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 1, pp. 59-68, Jan. 2006.
[11] G.D. Finlayson, M.S. Drew, and C. Lu, "Entropy Minimization for Shadow Removal," Int'l J. Computer Vision, vol. 85, no. 1, pp. 35-57, 2009.
[12] J.-F. Lalonde, A.A. Efros, and S.G. Narasimhan, "Detecting Ground Shadows in Outdoor Consumer Photographs," Proc. 11th European Conf. Computer Vision, 2010.
[13] A. Panagopoulos, C. Wang, D. Samaras, and N. Paragios, "Illumination Estimation and Cast Shadow Detection through a Higher-Order Graphical Model," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2011.
[14] M.H.V. Kwatra and S. Dai, "Shadow Removal for Aerial Imagery by Information Theoretic Intrinsic Image Analysis," Proc. IEEE Int'l Conf. Computational Photography, 2012.
[15] G.D. Finlayson, S.D. Hordley, and M.S. Drew, "Removing Shadows from Images Using Retinex," Proc. Color Imaging Conf., 2002.
[16] C. Fredembach and G.D. Finlayson, "Fast Re-Integration of Shadow Free Images," Proc. Color Imaging Conf., 2004.
[17] C. Fredembach and G. Finlayson, Proc. British Machine Vision Conf., 2005.
[18] E. Arbel and H. Hel-Or, "Shadow Removal Using Intensity Surfaces and Texture Anchor Points," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 33, no. 6, pp. 1202-1216, June 2011.
[19] E. Arbel and H. Hel-Or, "Texture-Preserving Shadow Removal in Color Images Containing Curved Surfaces," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2007.
[20] Y.-Y. Chuang, D.B. Goldman, B. Curless, D. Salesin, and R. Szeliski, "Shadow Matting and Compositing," ACM Trans. Graphics, vol. 22, no. 3, pp. 494-500, 2003.
[21] T.-P. Wu, C.-K. Tang, M.S. Brown, and H.-Y. Shum, "Natural Shadow Matting," ACM Trans. Graphics, vol. 26, no. 2, 2007.
[22] A. Levin, D. Lischinski, and Y. Weiss, "A Closed-Form Solution to Natural Image Matting," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 30, no. 2, pp. 228-242, Feb. 2008.
[23] D. Comaniciu and P. Meer, "Mean Shift: A Robust Approach Toward Feature Space Analysis," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 5, pp. 603-619, May 2002.
[24] D.R. Martin, C. Fowlkes, and J. Malik, "Learning to Detect Natural Image Boundaries Using Local Brightness, Color, and Texture Cues," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 26, no. 5, pp. 530-549, May 2004.
[25] C.-C. Chang and C.-J. Lin, "LIBSVM: A Library for Support Vector Machines," ACM Trans. Intelligent Systems and Technology, vol. 2, pp. 27:1-27:27, 2011.
[26] M. Baba and N. Asada, "Shadow Removal from a Real Picture," Proc. ACM Siggraph, 2003.
[27] V. Kolmogorov and R. Zabih, "What Energy Functions Can Be Minimized via Graph Cuts," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 26, no. 2, pp. 65-81, Feb. 2004.
[28] M. Everingham, L. Van Gool, C.K.I. Williams, J. Winn, and A. Zisserman, "The PASCAL Visual Object Classes Challenge 2010 (VOC2010) Results," http://www.pascal-network.org/ challenges/ VOC/voc2010/workshopindex.html, 2012.
96 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool