The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.11 - Nov. (2012 vol.18)
pp: 1836-1848
Xiaopei Liu , Sch. of Comput. Eng., Nanyang Technol. Univ., Singapore, Singapore
Lei Jiang , Tencent Inc., Shenzhen, China
Tien-Tsin Wong , Dept. of Comput. Sci. & Eng., Chinese Univ. of Hong Kong, Shatin, China
Chi-Wing Fu , Sch. of Comput. Eng., Nanyang Technol. Univ., Singapore, Singapore
ABSTRACT
Estimating illumination and deformation fields on textures is essential for both analysis and application purposes. Traditional methods for such estimation usually require complicated and sometimes labor-intensive processing. In this paper, we propose a new perspective for this problem and suggest a novel statistical approach which is much simpler and more efficient. Our experiments show that many textures in daily life are statistically invariant in terms of colors and gradients. Variations of such statistics can be assumed to be influenced by illumination and deformation. This implies that we can inversely estimate the spatially varying illumination and deformation according to the variation of the texture statistics. This enables us to decompose a texture photo into an illumination field, a deformation field, and an implicit texture which are illumination- and deformation-free, within a short period of time, and with minimal user input. By processing and recombining these components, a variety of synthesis effects, such as exemplar preparation, texture replacement, surface relighting, as well as geometry modification, can be well achieved. Finally, convincing results are shown to demonstrate the effectiveness of the proposed method.
INDEX TERMS
statistical analysis, image texture, geometry modification, statistical invariance, texture synthesis, labor-intensive processing, novel statistical approach, deformation, illumination, texture statistics, texture photo, exemplar preparation, texture replacement, surface relighting, Lighting, Image color analysis, Estimation, Surface texture, Geometry, Tensile stress, Surface reconstruction, illumination and deformation estimation, Texture synthesis, statistical invariance
CITATION
Xiaopei Liu, Lei Jiang, Tien-Tsin Wong, Chi-Wing Fu, "Statistical Invariance for Texture Synthesis", IEEE Transactions on Visualization & Computer Graphics, vol.18, no. 11, pp. 1836-1848, Nov. 2012, doi:10.1109/TVCG.2012.75
REFERENCES
[1] Y. Tsin, Y. Liu, and V. Ramesh, "Texture Replacement in Real Images," Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 2, pp. 539-544, Dec. 2001.
[2] Y. Liu, W.-C. Lin, and J. Hays, "Near-Regular Texture Analysis and Manipulation," Proc. ACM SIGGRAPH '04, pp. 368-376, 2004.
[3] H. Fang and J.C. Hart, "Textureshop: Texture Synthesis as a Photograph Editing Tool," Proc. ACM SIGGRAPH '04, pp. 354-359, 2004.
[4] C. Eisenacher, S. Lefebvre, and M. Stamminger, "Texture Synthesis from Photographs," Proc. Eurographics Conf., pp. 419-428, 2008.
[5] P. Tan, S. Lin, L. Quan, and H.-Y. Shum, "Highlight Removal by Illumination-Constrained Inpainting," Proc. IEEE Int'l Conf. Computer Vision, vol. 1, pp. 164-169, 2003.
[6] P. Tan, L. Quan, and S. Lin, "Separation of Highlight Reflections on Textured Surfaces," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1855-1860, 2006.
[7] G.D. Finlayson, S.D. Hordley, C. Lu, and M.S. Drew, "On the Removal of Shadows from Images," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 1, pp. 59-68, Jan. 2006.
[8] E. Arbel and H. Hel-Or, "Texture-Preserving Shadow Removal in Color Images Containing Curved Surfaces," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1-8, 2007.
[9] F. Liu and M. Gleicher, "Texture-Consistent Shadow Removal," Proc. European Conf. Computer Vision, pp. 437-450, 2008.
[10] B.M. Oh, M. Chen, J. Dorsey, and F. Durand, "Image-Based Modeling and Photo Editing," Proc. ACM SIGGRAPH '01, pp. 433-442, 2001.
[11] K. Subr, C. Soler, and F. Durand, "Edge-Preserving Multiscale Image Decomposition Based on Local Extrema," Proc. ACM SIGGRAPH Asia '09, pp. 147:1-147:9, 2009.
[12] M.F. Tappen, W.T. Freeman, and E.H. Adelson, "Recovering Intrinsic Images from a Single Image," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 9, pp. 1459-1472, Sept. 2005.
[13] L. Shen, P. Tan, and S. Lin, "Intrinsic Image Decomposition with Non-Local Texture Cues," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1-7, 2008.
[14] A. Bousseau, S. Paris, and F. Durand, "User-Assisted Intrinsic Images," Proc. ACM SIGGRAPH Asia '09, pp. 130:1-130:10, 2009.
[15] Y. Weiss, "Deriving Intrinsic Images from Image Sequences," Proc. IEEE Int'l Conf. Computer Vision, vol. 2, pp. 68-75, 2001.
[16] X. Liu, L. Wan, Y. Qu, T.-T. Wong, S. Lin, C.-S. Leung, and P.-A. Heng, "Intrinsic Colorization," Proc. ACM SIGGRAPH Asia '08, pp. 152:1-152:9, 2008.
[17] Y. Dong, X. Tong, F. Pellacini, and B. Guo, "AppGen: Interactive Material Modeling from a Single Image," Proc. ACM SIGGRAPH Asia '11, pp. 146:1-146:10, 2011.
[18] A. Rao and R. Jain, "Computerized flow Field Analysis: Oriented Texture Fields," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 14, no. 7, pp. 693-709, July 1992.
[19] P. Perona, "Orientation Diffusions," IEEE Trans. Image Processing, vol. 7, no. 3, pp. 457-467, Mar. 1999.
[20] J. Weickert and H. Hagen, Visualization and Processing of Tensor Fields, Mathematics and Visualization, Springer-Verlag New York, Inc., 2005.
[21] S. Paris, H.M. Briceño, and F.X. Sillion, "Capture of Hair Geometry From Multiple Images," Proc. ACM SIGGRAPH '04, pp. 712-719, 2004.
[22] J. Malik and R. Rosenholtz, "Computing Local Surface Orientation and Shape from Texture for Curved Surfaces," Int'l J. Computer Vision, vol. 23, no. 1, pp. 149-168, 1997.
[23] M. Clerc and S. Mallat, "The Texture Gradient Equation for Recovering Shape from Texture," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 4, pp. 536-549, Apr. 2002.
[24] T. Lindeberg, Scale-Space Theory in Computer Vision. Kluwer Academic Publishers, 1994.
[25] Y.-W. Tai, M.S. Brown, and C.-K. Tang, Robust Estimation of Texture Flow via Dense Feature Sampling," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2007.
[26] L.-Y. Wei, J. Han, K. Zhou, H. Bao, B. Guo, and H.-Y. Shum, "Inverse Texture Synthesis," Proc. ACM SIGGRAPH '08, pp. 52:1-52:9, 2008.
[27] D.J. Heeger and J.R. Bergen, "Pyramid-Based Texture Analysis/Synthesis," Proc. ACM SIGGRAPH '95, pp. 229-238, 1995.
[28] L.-Y. Wei and M. Levoy, "Fast Texture Synthesis Using Tree-Structured Vector Quantization," Proc. ACM SIGGRAPH '00, pp. 479-488, 2000.
[29] L. Liang, C. Liu, Y.-Q. Xu, B. Guo, and H.-Y. Shum, "Real-Time Texture Synthesis by Patch-Based Sampling," ACM Trans. Graphics, vol. 20, no. 3, pp. 127-150, 2001.
[30] V. Kwatra, A. Schödl, I. Essa, G. Turk, and A. Bobick, "Graphcut Textures: Image and Video Synthesis Using Graph Cuts," Proc. ACM SIGGRAPH '03, pp. 277-286, 2003.
[31] S. Lefebvre and H. Hoppe, "Parallel Controllable Texture Synthesis," Proc. ACM SIGGRAPH '05, pp. 777-786, 2005.
[32] V. Kwatra, I. Essa, A. Bobick, and N. Kwatra, "Texture Optimization for Example-Based Synthesis," Proc. ACM SIGGRAPH '05, pp. 795-802, 2005.
[33] S. Lefebvre and H. Hoppe, "Appearance-Space Texture Synthesis," Proc. ACM SIGGRAPH '06, pp. 541-548, 2006.
[34] E. Zhang, K. Mischaikow, and G. Turk, "Vector Field Design on Surfaces," ACM Trans. Graphics, vol. 25, no. 4, pp. 1294-1326, 2006.
[35] L. Wang, Y. Yu, K. Zhou, and B. Guo, "Example-Based Hair Geometry Synthesis," Proc. ACM SIGGRAPH '09, pp. 56:1-56:9, 2009.
[36] C. Ma, L.-Y. Wei, B. Guo, and K. Zhou, "Motion Field Texture Synthesis," Proc. ACM SIGGRAPH Asia '09, pp. 110:1-110:8, 2009.
[37] N. Jojic, B.J. Frey, and A. Kannan, "Epitomic Analysis of Appearance and Shape," Proc. IEEE Ninth Int'l Conf. Computer Vision, vol. 1, pp. 34-41, 2003.
[38] H. Wang, Y. Wexler, E. Ofek, and H. Hoppe, "Factoring Repeated Content within and among Images," Proc. ACM SIGGRAPH '08, pp. 14:1-14:10, 2008.
[39] C. Barnes, E. Shechtman, A. Finkelstein, and D.B. Goldman, "PatchMatch: A Randomized Correspondence Algorithm for Structural Image Editing," Proc. ACM SIGGRAPH '09, pp. 24:1-24:11, 2009.
[40] C. Barnes, E. Shechtman, D.B Goldman, and A. Finkelstein, "The Generalized Patchmatch Correspondence Algorithm," Proc. European Conf. Computer Vision, pp. 29-43, 2010.
[41] A. Buades, B. Coll, and J.-M. Morel, "A Non-Local Algorithm for Image Denoising," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 60-65, 2005.
[42] J. Portilla and E.P. Simoncelli, "A Parametric Texture Model Based on Joint Statistics of Complex Wavelet Coefficients," Int'l J. Computer Vision, vol. 40, pp. 49-70, Oct. 2000.
[43] G.D. Finlayson, M.S. Drew, and C. Lu, "Intrinsic Images by Entropy Minimization," Proc. European Conf. Computer Vision, pp. 582-595, 2004.
[44] B. Cabral and L.C Leedom, "Imaging Vector Fields Using Line Integral Convolution," Proc. ACM SIGGRAPH '93, pp. 263-270, 1993.
[45] F. Bookstein, "Principal Warps: Thin-Plate Splines and the Decomposition of Deformations," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 11, no. 6, pp. 567-585, June 1989.
[46] J.R. Shewchuk, "Triangle: Engineering a 2D Quality Mesh Generator and Delaunay Triangulator," Applied Computational Geometry: Towards Geometric Eng., vol. 1148, pp. 203-222, May 1996.
[47] M. Park, K. Brocklehurst, R.T. Collins, and Y. Liu, "Deformed Lattice Detection in Real-World Images Using Mean-Shift Belief Propagation," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 31, no. 10, pp. 1804-1816, Oct. 2009.
60 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool