The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.11 - Nov. (2012 vol.18)
pp: 1849-1857
Fang-Lue Zhang , TNList, Tsinghua Univ., Beijing, China
Ming-Ming Cheng , TNList, Tsinghua Univ., Beijing, China
Jiaya Jia , Dept. of Comput. Sci. & Eng., Chinese Univ. of Hong Kong, Hong Kong, China
Shi-Min Hu , TNList, Tsinghua Univ., Beijing, China
ABSTRACT
We present a semiautomatic image editing framework dedicated to individual structured object replacement from groups. The major technical difficulty is element separation with irregular spatial distribution, hampering previous texture, and image synthesis methods from easily producing visually compelling results. Our method uses the object-level operations and finds grouped elements based on appearance similarity and curvilinear features. This framework enables a number of image editing applications, including natural image mixing, structure preserving appearance transfer, and texture mixing.
INDEX TERMS
image texture, feature extraction, texture mixing, ImageAdmixture, dissimilar objects, semiautomatic image editing framework, structured object replacement, element separation, irregular spatial distribution, image synthesis methods, visually compelling results, object-level operations, appearance similarity, curvilinear features, natural image mixing, structure preserving appearance transfer, Shape, Visualization, Feature extraction, Vectors, Active contours, Image segmentation, Image color analysis, image processing, Natural image, structure analysis, texture
CITATION
Fang-Lue Zhang, Ming-Ming Cheng, Jiaya Jia, Shi-Min Hu, "ImageAdmixture: Putting Together Dissimilar Objects from Groups", IEEE Transactions on Visualization & Computer Graphics, vol.18, no. 11, pp. 1849-1857, Nov. 2012, doi:10.1109/TVCG.2012.68
REFERENCES
[1] N. Ahuja and S. Todorovic, "Extracting Texels in 2.1D Natural Textures," Proc. IEEE 11th Int'l Conf. Computer Vision (ICCV), pp. 1-8, 2007.
[2] S. Aksoy and R. Haralick, "Feature Normalization and Likelihood-Based Similarity Measures for Image Retrieval," Pattern Recognition Letters, vol. 22, no. 5, pp. 563-582, 2001.
[3] W.-C. Lin and Z.-C. Yan, "Attention-Based High Dynamic Range Imaging," The Visual Computer, vol. 27, no. 6, pp. 717-727, 2011.
[4] Z. Bar-Joseph, R. El-Yaniv, D. Lischinski, and M. Werman, "Texture Mixing and Texture Movie Synthesis Using Statistical Learning," IEEE Trans Visualization and Computer Graphics (TVCG), vol. 7, no. 2, pp. 120-135, Apr.-June 2001.
[5] C. Barnes, E. Shechtman, A. Finkelstein, and D.B. Goldman, "PatchMatch: A Randomized Correspondence Algorithm for Structural Image Editing," ACM Trans Graphics, vol. 28, pp. 24:1-24:11, 2009.
[6] W. Beaudot and K. Mullen, "How Long Range Is Contour Integration in Human Color Vision?" Visual Neuroscience, vol. 20, no. 1, pp. 51-64, 2003.
[7] P. Bhat, C. Zitnick, M. Cohen, and B. Curless, "GradientShop: A Gradient-Domain Optimization Framework for Image and Video Filtering," ACM Trans Graphics, vol. 29, no. 2, pp. 1-14, 2010.
[8] S. Brooks and N. Dodgson, "Self-Similarity Based Texture Editing," ACM Trans Graphics, vol. 21, pp. 653-656, 2002.
[9] G. Brown, G. Sapiro, and G. Seroussi, "Texture Mixing Via Universal Simulation," Proc. Int'l Workshop Texture Analysis and Synthesis, 2005.
[10] T. Chen, M. Cheng, P. Tan, A. Shamir, and S. Hu, "Sketch2Photo: Internet Image Montage," ACM Trans Graphics, vol. 28, no. 5, pp. 124: 1-10, 2009.
[11] H. Huang, L. Zhang, and H.-C. Zhang, "Arcimboldo-Like Collage Using Internet Images," ACM Trans Graphics, vol. 30, no. 6, pp. 155:1-155:8, 2011.
[12] M.-M. Cheng, F.-L. Zhang, N.J. Mitra, X. Huang, and S.-M. Hu, "Repfinder: Finding Approximately Repeated Scene Elements for Image Editing," ACM Trans Graphics, vol. 29, no. 4, pp. 83:1-8, 2010.
[13] J.-M. Dischler, K. Maritaud, B. Lvy, and D. Ghazanfarpour, "Texture Particles," Computer Graphics Forum, vol. 21, pp. 401-410, 2002.
[14] A.A. Efros and W.T. Freeman, "Image Quilting for Texture Synthesis And Transfer," Proc. ACM SIGGRAPH, pp. 341-346, 2001.
[15] A.A. Efros and T.K. Leung, "Texture Synthesis by Non-Parametric Sampling," Proc. IEEE Seventh Int'l Conf. Computer Vision (ICCV), pp. 1033-1038, 1999.
[16] Z. Farbman, G. Hoffer, Y. Lipman, D. Cohen-Or, and D. Lischinski, "Coordinates for Instant Image Cloning," ACM Trans Graphics, vol. 28, pp. 67:1-9, 2009.
[17] C. Han, E. Risser, R. Ramamoorthi, and E. Grinspun, "Multiscale Texture Synthesis," ACM Trans Graphics, vol. 27, no. 3, pp. 1-8, 2008.
[18] J. Hays, M. Leordeanu, A. Efros, and Y. Liu, "Discovering Texture Regularity as a Higher-Order Correspondence Problem," Proc. Ninth European Conf. Computer Vision (ECCV), pp. 522-535, 2006.
[19] A. Hertzmann, C.E. Jacobs, N. Oliver, B. Curless, and D.H. Salesin, "Image Analogies," Proc. ACM SIGGRAPH, pp. 327-340, 2001.
[20] T. Ijiri, R. Mch, T. Igarashi, and G. Miller, "An Example-Based Procedural System for Element Arrangement," Computer Graphics Forum, vol. 27, pp. 429-436, 2008.
[21] B. Julesz, "Textons, The Elements of Texture Perception, and Their Interactions." Nature, vol. 290, no. 5802, pp. 91-97, 1981.
[22] V. Kwatra, I. Essa, A. Bobick, and N. Kwatra, "Texture Optimization for Example-Based Synthesis," ACM Trans Graphics, vol. 24, pp. 795-802, 2005.
[23] V. Kwatra, A. Schödl, I. Essa, G. Turk, and A. Bobick, "Graphcut Textures: Image and Video Synthesis Using Graph Cuts," ACM Trans Graphics, vol. 22, pp. 277-286, 2003.
[24] J.-F. Lalonde, A. Efros, and S. Narasimhan, "Estimating Natural Illumination from a Single Outdoor Image," Proc. IEEE 12th Int'l Conf. Computer Vision (ICCV), pp. 183-190, 2009.
[25] J.-F. Lalonde, D. Hoiem, A.A. Efros, C. Rother, J. Winn, and A. Criminisi, "Photo Clip Art," ACM Trans Graphics, vol. 26, 2007.
[26] S. Lefebvre and H. Hoppe, "Parallel Controllable Texture Synthesis," ACM Trans Graphics, vol. 24, pp. 777-786, 2005.
[27] Y. Liu, R. Collins, and Y. Tsin, "A Computational Model for Periodic Pattern Perception Based on Frieze and Wallpaper Groups," IEEE Trans Pattern Analysis and Machine Intelligence, vol. 26, no. 3, pp. 354-371, Mar. 2004.
[28] Y. Liu, J. Wang, S. Xue, X. Tong, S. Kang, and B. Guo, "Texture Splicing," Computer Graphics Forum, vol. 28, no. 7, pp. 1907-1915, 2009.
[29] Y. Liu, W.-C. Lin, and J. Hays, "Near-Regular Texture Analysis and Manipulation," ACM Trans Graphics, vol. 23, pp. 368-376, 2004.
[30] C. Ma, L.-Y. Wei, and X. Tong, "Discrete Element Textures," ACM Trans Graphics, vol. 30, pp. 62:1-62:10, Aug. 2011.
[31] W. Matusik, M. Zwicker, and F. Durand, "Texture Design Using a Simplicial Complex of Morphable Textures," ACM Trans Graphics, vol. 24, no. 3, pp. 787-794, 2005.
[32] P. Pérez, M. Gangnet, and A. Blake, "Poisson Image Editing," ACM Trans Graphics, vol. 22, pp. 313-318, 2003.
[33] T. Porter and T. Duff, "Compositing Digital Images," ACM SIGGRAPH, vol. 18, no. 3, pp. 253-259, 1984.
[34] G. Martens, C. Poppe, P. Lambert, and R.V.d. Walle, "Noise- and Compression-Robust Biological Features for Texture Classification," The Visual Computer, vol. 26, no. 6, pp. 915-922, 2010.
[35] E. Risser, C. Han, R. Dahyot, and E. Grinspun, "Synthesizing Structured Image Hybrids," ACM Trans Graphics, vol. 29, pp. 85:1-6, 2010.
[36] L. Ritter, W. Li, M. Agrawala, B. Curless, and d. Salesin, "Painting with Texture," Proc. 17th Eurographics Symp. Rendering (EGSR), pp. 371-377, 2006.
[37] A. Rosenberger, D. Cohen-Or, and D. Lischinski, "Layered Shape Synthesis: Automatic Generation of Control Maps for Non-Stationary Textures," ACM Trans Graphics, vol. 28, no. 5, p. 107, 2009.
[38] C. Rother, V. Kolmogorov, and A. Blake, ""GrabCut": Interactive Foreground Extraction Using Iterated Graph Cuts," vol. 23, no. 3, pp. 309-314, 2004.
[39] C. Steger, "An Unbiased Detector of Curvilinear Structures," IEEE Trans Pattern Analysis and Machine Intelligence, vol. 20, no. 2, pp. 113-125, Feb. 1998.
[40] S. Todorovic and N. Ahuja, "Texel-Based Texture Segmentation," Proc. IEEE 12th Int'l Conf. Computer Vision (ICCV), pp. 841-848, 2009.
[41] M. Ding and R.-F. Tong, "Content-Aware Copying and Pasting in Images," The Visual Computer, vol. 26, no. 6, pp. 721-729, 2010.
[42] J. Wang and M.F. Cohen, "Image and Video Matting: A Survey," Foundation and Trends in Computer Graphics Vision, vol. 3, pp. 97-175, 2007.
[43] L.Y. Wei, S. Lefebvre, V. Kwatra, and G. Turk, "State of the Art in Example-Based Texture Synthesis," Eurographics, State of the Art Report, 2009.
[44] L.-Y. Wei and M. Levoy, "Fast Texture Synthesis Using Tree-Structured Vector Quantization," Proc. SIGGRAPH, pp. 479-488, 2000.
[45] L. Wei, "Texture Synthesis from Multiple Sources," Proc. ACM SIGGRAPH Sketches and Applications, p. 1, 2003.
[46] Q. Wu and Y. Yu, "Feature Matching and Deformation for Texture Synthesis," ACM Trans Graphics, vol. 23, no. 3, pp. 364-367, 2004.
[47] J. Zhang, K. Zhou, L. Velho, B. Guo, and H. Shum, "Synthesis of Progressively-Variant Textures on Arbitrary Surfaces," ACM Trans Graphics, vol. 22, no. 3, pp. 295-302, 2003.
[48] D. Aiger, D. Cohen-Or, and N.J. Mitra, "Repetition Maximization Based Texture Rectification," Computer Graphics Forum, vol. 31, no. 2, 2012.
31 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool