The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.02 - Feb. (2013 vol.35)
pp: 437-449
A. Panagopoulos , Dept. of Comput. Sci., Stony Brook Univ., Stony Brook, NY, USA
Chaohui Wang , Center for Visual Comput., Ecole Centrale Paris, Chatenay-Malabry, France
D. Samaras , Dept. of Comput. Sci., Stony Brook Univ., Stony Brook, NY, USA
N. Paragios , Center for Visual Comput., Ecole Centrale Paris, Chatenay-Malabry, France
ABSTRACT
The cast shadows in an image provide important information about illumination and geometry. In this paper, we utilize this information in a novel framework in order to jointly recover the illumination environment, a set of geometry parameters, and an estimate of the cast shadows in the scene given a single image and coarse initial 3D geometry. We model the interaction of illumination and geometry in the scene and associate it with image evidence for cast shadows using a higher order Markov Random Field (MRF) illumination model, while we also introduce a method to obtain approximate image evidence for cast shadows. Capturing the interaction between light sources and geometry in the proposed graphical model necessitates higher order cliques and continuous-valued variables, which make inference challenging. Taking advantage of domain knowledge, we provide a two-stage minimization technique for the MRF energy of our model. We evaluate our method in different datasets, both synthetic and real. Our model is robust to rough knowledge of geometry and inaccurate initial shadow estimates, allowing a generic coarse 3D model to represent a whole class of objects for the task of illumination estimation, or the estimation of geometry parameters to refine our initial knowledge of scene geometry, simultaneously with illumination estimation.
INDEX TERMS
Geometry, Lighting, Light sources, Three dimensional displays, Estimation, Image edge detection, Solid modeling,image models, Markov random fields, photometry, shading
CITATION
A. Panagopoulos, Chaohui Wang, D. Samaras, N. Paragios, "Simultaneous Cast Shadows, Illumination and Geometry Inference Using Hypergraphs", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.35, no. 2, pp. 437-449, Feb. 2013, doi:10.1109/TPAMI.2012.110
REFERENCES
[1] Y. Boykov and G.F. Lea, "Graph Cuts and Efficient N-D Image Segmentation," Int'l J. Computer Vision, vol. 70, no. 2, pp. 109-131, Nov. 2006.
[2] M. Bray, P. Kohli, and P.H.S. Torr, "Posecut: Simultaneous Segmentation and 3d Pose Estimation of Humans Using Dynamic Graph-Cuts," Proc. European Conf. Computer Vision, pp. 642-655, 2006.
[3] P.F. Felzenszwalb and D.P. Huttenlocher, "Efficient Graph-Based Image Segmentation," Int'l J. Computer Vision, vol. 59, no. 2, pp. 167-181, 2004.
[4] D.M.S. Finlayson, G.D, and C. Lu, "Entropy Minimization for Shadow Removal," Int'l J. Computer Vision, vol. 79, no. 1, pp. 13-30, 2009.
[5] G.D. Finlayson, S.D. Hordley, and M.S. Drew, "Removing Shadows from Images," Proc. European Conf. Computer Vision, 2002.
[6] R.A. Fisher, "Dispersion on a Sphere," Proc. Royal Soc. London, vol. 217, pp. 295-305, 1953.
[7] S. Geman and D. Geman, "Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images," Readings in Uncertain Reasoning, pp. 452-472, Morgan Kaufmann Publishers Inc., 1990.
[8] R.C. Gonzalez and R.E. Woods, Digital Image Processing, third ed. Prentice-Hall, Inc., 2006.
[9] K. Hara, K. Nishino, and K. Ikeuchi, "Light Source Position and Reflectance Estimation from a Single View without the Distant Illumination Assumption," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 4, pp. 493-505, Apr. 2005.
[10] K.M. He, J. Sun, and X. Tang, "Single Image Haze Removal Using Dark Channel Prior," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2009.
[11] H. Ishikawa, "Higher-Order Clique Reduction in Binary Graph Cut," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2009.
[12] T. Kim and K.S. Hong, "A Practical Approach for Estimating Illumination Distribution from Shadows Using a Single Image," Int'l J. Information Sciences and Techniques, vol. 15, no. 2, pp. 143-154, 2005.
[13] N. Komodakis and N. Paragios, "Beyond Pairwise Energies: Efficient Optimization for Higher-Order MRFs," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2009.
[14] N. Komodakis, G. Tziritas, and N. Paragios, "Performance vs Computational Efficiency for Optimizing Single and Dynamic MRFs: Setting the State of the Art with Primal-Dual Strategies," Computer Vision and Image Understanding, vol. 112, no. 1, pp. 14-29, 2008.
[15] J.F. Lalonde, A.A. Efros, and S.G. Narasimhan, "Estimating Natural Illumination from a Single Outdoor Image," Proc. 12th IEEE Int'l Conf. Computer Vision, 2009.
[16] J.F. Lalonde, A.A. Efros, and S.G. Narasimhan, "Detecting Ground Shadows in Outdoor Consumer Photographs." Proc. European Conf. Computer Vision, 2010.
[17] F.F. Li, R. Fergus, and P. Perona, "Learning Generative Visual Models from Few Training Examples: An Incremental Bayesian Approach Tested on 101 Object Categories," Computer Vision and Image Understanding, vol. 106, no. 1, pp. 59-70, Apr. 2007.
[18] Y. Li, S. Lin, H. Lu, and H.Y. Shum, "Multiple-Cue Illumination Estimation in Textured Scenes," Proc. Ninth IEEE Int'l Conf. Computer Vision, 2003.
[19] A. Panagopoulos, D. Samaras, and N. Paragios, "Robust Shadow and Illumination Estimation Using a Mixture Model," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2009.
[20] A. Panagopoulos, C. Wang, D. Samaras, and N. Paragios, "Estimating Shadows with the Bright Channel Cue," Proc. Color and Reflectance in Imaging and Computer Vision Workshop (in Conjuction with European Conf. Computer Vision), 2010.
[21] A. Panagopoulos, C. Wang, D. Samaras, and N. Paragios, "Illumination Estimation and Cast Shadow Detection through a Higher-Order Graphical Model," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2011.
[22] Q. Dai, R. Guo, and D. Hoiem, "Single-Image Shadow Detection and Removal Using Paired Regions," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2011.
[23] R. Ramamoorthi, M. Koudelka, and P. Belhumeur, "A Fourier Theory for Cast Shadows," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 2, pp. 288-295, Feb. 2005.
[24] C. Rother, V. Kolmogorov, and A. Blake, "Grabcut: Interactive Foreground Extraction Using Iterated Graph Cuts," ACM Trans. Graphics, vol. 23, pp. 309-314, 2004.
[25] E. Salvador, A. Cavallaro, and T. Ebrahimi, "Cast Shadow Segmentation Using Invariant Color Features," Computer Vision and Image Understanding, vol. 95, no. 2, pp. 238-259, 2004.
[26] I. Sato, Y. Sato, and K. Ikeuchi, "Illumination from Shadows," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, no. 3, pp. 290-300, Mar. 2003.
[27] C. Wang, M. De la Gorce, and N. Paragios, "Segmentation Ordering and Multi-Object Tracking Using Graphical Models," Proc. 12th IEEE Int'l Conf. Computer Vision, 2009.
[28] Y. Wang and D. Samaras, "Estimation of Multiple Directional Light Sources for Synthesis of Augmented Reality Images," Graphical Models, vol. 65, no. 4, pp. 185-205, 2003.
[29] Y. Yang and A. Yuille, "Sources from Shading," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 1991.
[30] W. Zhou and C. Kambhamettu, "A Unified Framework for Scene Illuminant Estimation," Image and Vision Computing, vol. 26, no. 3, pp. 415-429, 2008.
[31] J. Zhu, K.G.G. Samuel, S. Masood, and M.F. Tappen, "Learning to Recognize Shadows in Monochromatic Natural Images," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2010.
98 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool