The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.08 - August (2011 vol.17)
pp: 1135-1147
Chunxia Xiao , Wuhan University, Wuhan
Yongwei Nie , Wuhan University, Wuhan
Feng Tang , HP Labs, Palo Alto
ABSTRACT
This paper presents a novel unified hierarchical structure for scalable edit propagation. Our method is based on the key observation that in edit propagation, appearance varies very smoothly in those regions where the appearance is different from the user-specified pixels. Uniformly sampling in these regions leads to redundant computation. We propose to use a quadtree-based adaptive subdivision method such that more samples are selected in similar regions and less in those that are different from the user-specified regions. As a result, both the computation and the memory requirement are significantly reduced. In edit propagation, an edge-preserving propagation function is first built, and the full solution for all the pixels can be computed by interpolating from the solution obtained from the adaptively subdivided domain. Furthermore, our approach can be easily extended to accelerate video edit propagation using an adaptive octree structure. In order to improve user interaction, we introduce several new Gaussian Mixture Model (GMM) brushes to find pixels that are similar to the user-specified regions. Compared with previous methods, our approach requires significantly less time and memory, while achieving visually same results. Experimental results demonstrate the efficiency and effectiveness of our approach on high-resolution photographs and videos.
INDEX TERMS
Tone adjustment, Gaussian mixture model, hierarchical data structure, high dynamic range imaging, tone mapping.
CITATION
Chunxia Xiao, Yongwei Nie, Feng Tang, "Efficient Edit Propagation Using Hierarchical Data Structure", IEEE Transactions on Visualization & Computer Graphics, vol.17, no. 8, pp. 1135-1147, August 2011, doi:10.1109/TVCG.2010.125
REFERENCES
[1] Adobe Systems, Inc., “Adobe Photoshop CS2,” 2005.
[2] D. Lischinski, Z. Farbman, M. Uyttendaele, and R. Szeliski, “Interactive Local Adjustment of Tonal Values,” Proc. ACM SIGGRAPH '06, vol. 25, no. 3, pp. 646-653, 2006.
[3] F. Pellacini and J. Lawrence, “AppWand: Editing Measured Materials Using Appearance-Driven Optimization,” Proc. ACM SIGGRAPH, 2007.
[4] X. An and F. Pellacini, “AppProp: All-Pairs Appearance-Space Edit Propagation,” Proc. ACM SIGGRAPH '08, 2008.
[5] A. Agarwala, “Efficient Gradient-Domain Compositing Using Quadtrees,” ACM Trans. Graphics, vol. 26, no. 3, pp. 94:1-94:5, 2007.
[6] F. Losasso, F. Gibou, and R. Fedkiw, “Simulating Water and Smoke with an Octree Data Structure,” ACM Trans. Graphics, vol. 23, no. 3, pp. 457-462, 2004.
[7] A. Levin, D. Lischinski, and Y. Weiss, “Colorization Using Optimization,” ACM Trans. Graphics, vol. 23, no. 3, pp. 689-694, 2004.
[8] Y. Li, E. Adelson, and A. Agarwala, “ScribbleBoost: Adding Classification to Edge-Aware Interpolation of Local Image and Video Adjustments,” Computer Graphics Forum, vol. 27, pp. 1255-1264, 2008.
[9] Y. Li, J. Sun, C.K. Tang, and H.Y. Shum, “Lazy Snapping,” Proc. ACM SIGGRAPH, pp. 303-308, 2004.
[10] J. Wang and M.F. Cohen, “An Iterative Optimization Approach for Unified Image Segmentation and Matting,” Proc. Int'l Conf. Computer Vision (ICCV '05), vol. 2, 2005.
[11] Y. Qu, T.T. Wong, and P.A. Heng, “Manga Colorization,” Proc. ACM SIGGRAPH '06, vol. 25, no. 3, pp. 1214-1220, 2006.
[12] Q. Luan, F. Wen, D. Cohen-Or, L. Liang, Y.Q. Xu, and H.Y. Shum, “Natural Image Colorization,” Proc. Eurographics Symp. Rendering Techniques, 2007.
[13] L. Yatziv and G. Sapiro, “Fast Image and Video Colorization Using Chrominance Blending,” IEEE Trans. Image Processing, vol. 15, no. 5, pp. 1120-1129, May 2006.
[14] C. Xiao, S. Liu, H. Fu, C. Lin, C. Song, Z. Huang, F. He, and Q. Peng, “Video Completion and Synthesis,” Computer Animation and Virtual Worlds, vol. 19, nos. 3/4, pp. 341-353, 2008.
[15] C. Rother, V. Kolmogorov, and A. Blake, “‘GrabCut’: Interactive Foreground Extraction Using Iterated Graph Cuts,” ACM Trans. Graphics, vol. 23, no. 3, pp. 309-314, 2004.
[16] X. Bai and G. Sapiro, “A Geodesic Framework for Fast Interactive Image and Video Segmentation and Matting,” Proc. Int'l Conf. Computer Vision (ICCV), pp. 1-8, 2007.
[17] Y. Saad, Iterative Methods for Sparse Linear Systems. Soc. for Industrial and Applied Math., 2003.
[18] J. Bolz, I. Farmer, E. Grinspun, and P. Schröoder, “Sparse Matrix Solvers on the GPU: Conjugate Gradients and Multigrid,” Proc. ACM SIGGRAPH, pp. 917-924, 2003.
[19] R. Szeliski, “Locally Adapted Hierarchical Basis Preconditioning,” Proc. ACM SIGGRAPH, pp. 1135-1143, 2006.
[20] R. Szeliski and H.Y. Shum, “Motion Estimation with Quadtree Splines,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 18, no. 12, pp. 1199-1210, June 1996.
[21] J. Chen, S. Paris, and F. Durand, “Real-Time Edge-Aware Image Processing with the Bilateral Grid,” Proc. ACM SIGGRAPH, 2007.
[22] K. Xu, Y. Li, T. Ju, S.M. Hu, and T.Q. Liu, “Efficient Affinity-Based Edit Propagation Using KD Tree,” Proc. ACM SIGGRAPH ASIA, 2009.
[23] R. Fattal, “Edge-Avoiding Wavelets and Their Applications,” Proc. ACM SIGGRAPH '09, pp. 1-10, 2009.
[24] Z. Farbman, R. Fattal, D. Lischinski, and R. Szeliski, “Edge-Preserving Decompositions for Multi-Scale Tone and Detail Manipulation,” Proc. ACM SIGGRAPH, 2008.
[25] C. Tomasi and R. Manduchi, “Bilateral Filtering for Gray and Color Images,” Proc. Int'l Conf. Computer Vision (ICCV '98), pp. 839-846, 1998.
[26] R. Fattal, M. Agrawala, and S. Rusinkiewicz, “Multiscale Shape and Detail Enhancement from Multi-Light Image Collections,” ACM Trans. Graphics, vol. 26, no. 3, p. 51, 2007.
[27] W.H. Press, S.A. Teukolsky, and W.T. Vetterling, Numerical Recipes in C++: The Art of Scientific Computing. Cambridge Univ. Press 2002.
[28] H. Samet, Applications of Spatial Data Structures: Computer Graphics, Image Processing, and GIS. Addison-Wesley, 1990.
[29] D.R. Fuhrmann, “Quadtree Traversal Algorithms for Pointer-Based and Depth-First Representations,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 10, no. 6, pp. 955-960, Nov. 1988.
[30] F. Durand and J. Dorsey, “Fast Bilateral Filtering for the Display of High-Dynamic-Range Images,” Proc. ACM SIGGRAPH, pp. 257-266, 2002.
[31] J. Wang, P. Bhat, R.A. Colburn, M. Agrawala, and M.F. Cohen, “Interactive Video Cutout,” Proc. ACM SIGGRAPH, pp. 585-594, 2005.
[32] G.M. Hunter and K. Steiglitz, “Operations on Images Using Quad Trees,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. PAMI-1, pp. 145-153, Apr. 1979.
[33] D.J.R. Meagher, “Octree Encoding: A New Technique for the Representation, Manipulation and Display of Arbitrary 3-D Objects by Computer,” Technical Report IPL.-TR-80-111, Image Processing Laboratory, Electrical and Systems Eng. Dept., Rensselaer Polytechnic Inst., 1980.
[34] R. Fattal, D. Lischinski, and M. Werman, “Gradient Domain High Dynamic Range Compression,” ACM Trans. Graphics, vol. 21, no. 3, pp. 249-256, 2002.
[35] E. Reinhard, M. Stark, P. Shirley, and J. Ferwerda, “Photographic Tone Reproduction for Digital Images,” ACM Trans. Graphics, vol. 21, no. 3, pp. 267-276, 2002.
[36] C. Xiao, Y. Nie, W. Hua, and W. Zheng, “Fast Multi-Scale Joint Bilateral Texture Upsampling,” The Visual Computer, vol. 26, no. 4, pp. 263-275, 2010.
13 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool