Subscribe

Issue No.02 - Feb. (2014 vol.20)

pp: 182-195

Zongqiao Yu , Nanjing Univ., Nanjing, China

Lin Lu , Shandong Univ., Jinan, China

Yanwen Guo , Nanjing Univ., Nanjing, China

Rongfei Fan , Nanjing Univ., Nanjing, China

Mingming Liu , Nanjing Univ., Nanjing, China

Wenping Wang , Univ. of Hong Kong, Hong Kong, China

DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/TVCG.2013.106

ABSTRACT

In this paper, we present a novel approach for automatically creating the photo collage that assembles the interest regions of a given group of images naturally. Previous methods on photo collage are generally built upon a well-defined optimization framework, which computes all the geometric parameters and layer indices for input photos on the given canvas by optimizing a unified objective function. The complex nonlinear form of optimization function limits their scalability and efficiency. From the geometric point of view, we recast the generation of collage as a region partition problem such that each image is displayed in its corresponding region partitioned from the canvas. The core of this is an efficient power-diagram-based circle packing algorithm that arranges a series of circles assigned to input photos compactly in the given canvas. To favor important photos, the circles are associated with image importances determined by an image ranking process. A heuristic search process is developed to ensure that salient information of each photo is displayed in the polygonal area resulting from circle packing. With our new formulation, each factor influencing the state of a photo is optimized in an independent stage, and computation of the optimal states for neighboring photos are completely decoupled. This improves the scalability of collage results and ensures their diversity. We also devise a saliency-based image fusion scheme to generate seamless compositive collage. Our approach can generate the collages on nonrectangular canvases and supports interactive collage that allows the user to refine collage results according to his/her personal preferences. We conduct extensive experiments and show the superiority of our algorithm by comparing against previous methods.

INDEX TERMS

Complexity theory, Optimization, Image color analysis, Image edge detection, Histograms, Shape, Indexes,image saliency, Complexity theory, Optimization, Image color analysis, Image edge detection, Histograms, Shape, Indexes, circle packing, Photo collage

CITATION

Zongqiao Yu, Lin Lu, Yanwen Guo, Rongfei Fan, Mingming Liu, Wenping Wang, "Content-Aware Photo Collage Using Circle Packing",

*IEEE Transactions on Visualization & Computer Graphics*, vol.20, no. 2, pp. 182-195, Feb. 2014, doi:10.1109/TVCG.2013.106REFERENCES

- [1] J. Wang, J. Sun, L. Quan, X. Tang, and H.-Y. Shum, “Picture Collage,”
Proc. IEEE CS Conf. Computer Vision and Pattern Recognition (CVPR), pp. 347-354. 2006,- [2] T. Liu, J. Wang, J. Sun, N. Zheng, X. Tang, and H.-Y. Shum, “Picture Collage,”
IEEE Trans. Multimedia, vol. 11, no. 7, pp. 1225-1239, Nov. 2009.- [3] Y. Wei, Y. Matsushita, and Y. Yang, “Efficient Optimization of Photo Collage,” technical report, Microsoft Research, 2009.
- [4] Y. Yang, Y. Wei, C. Liu, Q. Peng, and Y. Matsushita, “An Improved Belief Propagation Method for Dynamic Collage,”
The Visual Computer, vol. 25, nos. 5-7, pp. 431-439, 2009.- [5] A. Agarwala, M. Dontcheva, M. Agrawala, S. Drucker, A. Colburn, B. Curless, D. Salesin, and M.F. Cohen, “Interactive Digital Photomontage,”
ACM Trans. Graphics, vol. 23, no. 3, pp. 294-302, 2004.- [6] C. Rother, S. Kumar, V. Kolmogorov, and A. Blake, “Digital Tapestry,”
Proc. IEEE CS Conf. Computer Vision and Pattern Recognition (CVPR), pp. 589-596. 2005.- [7] C. Rother, L. Bordeaux, Y. Hamadi, and A. Blake, “Autocollage,”
ACM Trans. Graphics, vol. 25, no. 3, pp. 847-852, 2006.- [8] S. Goferman, A. Tal, and L. Zelnik-Manor, “Puzzle-Like Collage,”
Computer Graphics Forum, vol. 29, no. 2, pp. 459-468, 2010.- [9] P. Brivio, M. Tarini, and P. Cignoni, “Browsing Large Image Datasets through Voronoi Diagrams,”
IEEE Trans. Visualization and Computer Graphics, vol. 16, no. 6, pp. 1261-1270, Nov. 2010.- [10] J. Rigau, M. Feixas, and M. Sbert, “An Information-Theoretic Framework for Image Complexity,”
Proc. First Eurographics Conf. Computational Aesthetics in Graphics, Visualization, and Imaging, pp. 177-184, 2005.- [11] Q. Liu, A.H. Sung, B. Ribeiro, M. Wei, Z. Chen, and J. Xu, “Image Complexity and Feature Mining for Steganalysis of Least Significant Bit Matching Steganography,”
Information Sciences, vol. 178, pp. 21-36, 2008.- [12] J. Perkiö and A. Hyvärinen, “Modeling Image Complexity by Independent Component Analysis, with Application to Content-Based Image Retrieval,”
Proc. 19th Int'l Conf. Artificial Neural Networks (ICANN), pp. 704-714, 2009.- [13] J. Kim and F. Pellacini, “Jigsaw Image Mosaics,”
ACM Trans. Graphics, vol. 21, no. 3, pp. 657-664, 2002.- [14] A.W. Klein, T. Grant, A. Finkelstein, and M.F. Cohen, “Video Mosaics,”
Proc. Second Int'l Symp. Nonphotorealistic Animation and Rendering (NPAR), pp. 21-28. 2002.- [15] H. Huang, L. Zhang, and H.-C. Zhang, “Arcimboldo-Like Collage Using Internet Images,”
ACM Trans. Graphics, vol. 30, no. 6, p. 155, 2011.- [16] T. Chen, M.-M. Cheng, P. Tan, A. Shamir, and S.-M. Hu, “Sketch2Photo: Internet Image Montage,”
ACM Trans. Graphics, vol. 28, no. 5, p. 124, 2009.- [17] T. Wang, X.-S. Hua, X.-L. Liu, and H.-Q. Zhou, “Video Collage: A Novel Presentation of Video Sequence,”
Proc. IEEE Int'l Conf. Multimedia and Expo (ICME), pp. 1479-1482, 2007.- [18] B. Yang, T. Mei, L.-F. Sun, S.-Q. Yang, and X.-S. Hua, “Free-Shaped Video Collage,”
Proc. Int'l Conf. Multimedia Modeling, pp. 175-185, 2008.- [19] T. Mei, B. Yang, S.-Q. Yang, and X.-S. Hua, “Video Collage: Presenting a Video Sequence Using a Single Image,”
The Visual Computer, vol. 25, no. 1, pp. 39-51, 2009.- [20] H.-W. Kang, Y. Matsushita, X. Tang, and X.-Q. Chen, “Space-Time Video Montage,”
Proc. IEEE CS Conf. Computer Vision and Pattern Recognition (CVPR), pp. 1331-1338, 2006.- [21] R. Gal, O. Sorkine, T. Popa, A. Sheffer, and D. Cohen-Or, “3D Collage: Expressive Non-realistic Modeling,”
Proc. Fifth Int'l Symp. Nonphotorealistic Animation and Rendering (NPAR), pp. 7-14. 2007.- [22] M. Johnson, G. Brostow, J. Shotton, O. Arandjelovic, V. Kwatra, and R. Cipolla, “Semantic Photo Synthesis,”
Computer Graphics Forum, vol. 25, no. 3, pp. 407-413, 2006.- [23] J. Hays and A.A. Efros, “Scene Completion Using Millions of Photographs,”
ACM Trans. Graphics, vol. 26, no. 3, pp. 4:1-4:7, 2007.- [24] Y. Rubner, C. Tomasi, and L.J. Guibas, “The Earth Mover's Distance as a Metric for Image Retrieval,”
Int'l J. Computer Vision, vol. 40, no. 2, pp. 99-121, 2000.- [25] O. Pele and M. Werman, “Fast and Robust Earth Mover's Distances,”
Proc. IEEE 12th Int'l Conf. Computer Vision (ICCV), pp. 460-467, 2009.- [26] M. Hifi and R. M'Hallah, “A Literature Review on Circle and Sphere Packing Problems: Models and Methodologies,”
Advances in Operations Research, vol. 2009, Article ID 150624, p. 22, 2009.- [27] F. Aurenhammer, “Power Diagrams: Properties, Algorithms, and Applications,”
SIAM J. Computing, vol. 16, no. 1, pp. 78-96, 1987.- [28] Q. Du, V. Faber, and M. Gunzburger, “Centroidal Voronoi Tessellations: Applications and Algorithms,”
SIAM Rev., vol. 41, no. 4, pp. 637-676, 1999.- [29] S.P. Lloyd, “Least Squares Quantization in PCM,”
IEEE Trans. Information Theory, vol. 28, no. 2, pp. 129-136, Mar. 1982.- [30] R.J. Fowler, M. Paterson, and S.L. Tanimoto, “Optimal Packing and Covering in the Plane Are NP-Complete,”
Information Processing Letters, vol. 12, no. 3, pp. 133-137, 1981.- [31] L. Lu, Y. king Choi, F. Sun, and W. Wang, “Variational Circle Packing Based on Power Diagram,” technical report, Shandong Univ., http://vr.sdu.edu.cn/lulinCP_TechReport.pdf , 2011.
- [32] L. Itti and C. Koch, “Computational Modeling of Visual Attention,”
Nature Rev. Neuroscience, vol. 2, no. 3, pp. 194-203, 2001.- [33] Y.-F. Ma and H.-J. Zhang, “Contrast-Based Image Attention Analysis by Using Fuzzy Growing,”
Proc. 11th ACM Int'l Conf. Multimedia (Multimedia), pp. 374-381, 2003.- [34] M.-M. Cheng, G.-X. Zhang, N.J. Mitra, X. Huang, and S.-M. Hu, “Global Contrast Based Salient Region Detection,”
Proc. IEEE Computer Vision and Pattern Recognition (CVPR), pp. 409-416, 2011.- [35] J. Kopf, D. Cohen-Or, O. Deussen, and D. Lischinski, “Recursive Wang Tiles for Real-Time Blue Noise,”
Proc. ACM SIGGRAPH, pp. 509-518, 2006. |