The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.01 - January (2012 vol.18)
pp: 58-67
Jong-Chul Yoon , Dept. of Broadcasting Visual Art Technol. & Entertainment, Kangwon Nat. Univ. at Samcheuk, Samcheuk, South Korea
In-Kwon Lee , Dept. of Comput. Sci., Yonsei Univ., Seoul, South Korea
ABSTRACT
We present a method for constructing 3D feature flow from video and its application to video stylization. Our method extracts smoothly aligned 3D vectors that describe the smallest variation of colors within a spatiotemporal video cube, and thus effectively preserves both spatial and temporal coherence in a relatively inexpensive manner. As an application of this flow field we present a particle-based video stylization technique to rerender the video in a feature enhancing, painterly style. Our method consists of per-pixel operations and is suitable for GPU implementation, which enables real-time video stylization.
INDEX TERMS
video signal processing, computer graphic equipment, coprocessors, image colour analysis, rendering (computer graphics), nonphotorealistic rendering, video painting, stabilized time varying flow field, 3D feature flow construction, video stylization, 3D vectors, spatiotemporal video cube, color variation, particle based video stylization technique, GPU implementation, Three dimensional displays, Pixel, Painting, Image color analysis, Rendering (computer graphics), Color, Coherence, painterly rendering., Nonphotorealistic rendering, flow-based filtering, video abstraction
CITATION
Jong-Chul Yoon, In-Kwon Lee, H. Kang, "Video Painting Based on a Stabilized Time-Varying Flow Field", IEEE Transactions on Visualization & Computer Graphics, vol.18, no. 1, pp. 58-67, January 2012, doi:10.1109/TVCG.2011.47
REFERENCES
[1] P. Litwinowicz, “Processing Images and Video for an Impressionist Effect,” Proc. ACM SIGGRAPH, pp. 407-414, 1997.
[2] A. Hertzmann and K. Perlin, “Painterly Rendering for Video and Interaction,” Proc. First Int'l Symp. Nonphotorealistic Animation and Rendering, pp. 7-12, 2000.
[3] A.W. Klein, P.-P. Sloan, A. Finkelstein, and M.F. Cohen, “Stylized Video Cubes,” Proc. ACM SIGGRAPH/Eurographics Symp. Computer Animation, pp. 15-22, 2002.
[4] J. Hays and I. Essa, “Image and Video Based Painterly Animation,” Proc. Third Int'l Symp. Nonphotorealistic Animation and Rendering, pp. 113-120, 2004.
[5] J. Wang, Y. Xu, H.-Y. Shum, and M.F. Cohen, “Video Tooning,” ACM Trans. Graphics, vol. 23, no. 3, pp. 574-583, 2004.
[6] H. Winnemöller, S.C. Olsen, and B. Gooch, “Real-Time Video Abstraction,” ACM Trans. Graphics, vol. 25, no. 3, pp. 1221-1226, 2006.
[7] A. Bousseau, F. Neyret, J. Thollot, and D. Salesin, “Video Watercolorization Using Bidirectional Texture Advection,” ACM Trans. Graphics, vol. 26, no. 3, pp. 104:1-104:7, 2007.
[8] H. Zhao, X. Jin, J. Shen, X. Mao, and J. Feng, “Real-Time Feature-Aware Video Abstraction,” The Visual Computer: Int'l J. Computer Graphics, vol. 24, no. 7, pp. 727-734, 2008.
[9] M.P. Salisbury, M.T. Wong, J.F. Hughes, and D.H. Salesin, “Orientable Textures for Image-Based Pen-and-Ink Illustration,” Proc. ACM SIGGRAPH, pp. 401-406, 1997.
[10] V. Ostromoukhov, “Digital Facial Engraving,” Proc. ACM SIGGRAPH, pp. 417-424, 1999.
[11] A. Hausner, “Simulating Decorative Mosaic,” Proc. ACM SIGGRAPH, pp. 573-578, 2001.
[12] D. Kim, M. Son, Y. Lee, H. Kang, and S. Lee, “Feature-Guided Image Stippling,” Computer Graphics Forum, vol. 27, no. 4, pp. 1209-1216, 2008.
[13] H. Kang, S. Lee, and C. Chui, “Coherent Line Drawing,” Proc. Fifth Int'l Symp. Nonphotorealistic Animation and Rendering, pp. 43-50, 2007.
[14] J.E. Kyprianidis and J. Dollner, “Image Abstraction by Structure Adaptive Filtering,” Proc. EG UK Theory and Practice of Computer Graphics, pp. 51-58, 2008.
[15] H. Kang, S. Lee, and C.K. Chui, “Flow-Based Image Abstraction,” IEEE Trans. Visualization and Computer Graphics, vol. 15, no. 1, pp. 62-76, Jan./Feb. 2009.
[16] S.C. Olsen, B.A. Maxwell, and B. Gooch, “Interactive Vector Fields for Painterly Rendering,” Proc. Graphics Interface Conf., pp. 241-247, 2005.
[17] A. Agarwala, “Snaketoonz: A Semi-Automatic Approach to Creating Cel Animation from Video,” Proc. Second Int'l Symp. Nonphotorealistic Animation and Rendering, pp. 139-146, 2002.
[18] A. Agarwala, A. Hertzmann, D.H. Salesin, and S.M. Seitz, “Keyframe-Based Tracking for Rotoscoping and Animation,” ACM Trans. Graphics, vol. 23, no. 3, pp. 584-591, 2004.
[19] C. Xu and J.L. Prince, “Snakes, Shapes, and Gradient Vector Flow,” IEEE Trans. Image Processing, vol. 7, no. 3, pp. 359-369, Mar. 1998.
[20] D. Tschumperlé, “Curvature-Preserving Regularization of Multi-Valued Images Using PDE's,” Proc. European Conf. Computer Vision, pp. 295-307, 2006.
[21] E. Zhang, K. Mischaikow, and G. Turk, “Vector Field Design on Surfaces,” ACM Trans. Graphics, vol. 25, no. 4, pp. 1294-1326, 2006.
[22] E. Zhang, J. Hays, and G. Turk, “Interactive Tensor Field Design and Visualization on Surfaces,” IEEE Trans. Visualization and Computer Graphics, vol. 13, no. 1, pp. 94-107, Jan./Feb. 2007.
[23] J. Palacios and E. Zhang, “Rotational Symmetry Field Design on Surfaces,” ACM Trans. Graphics, vol. 26, no. 3, pp. 55:1-55:10, 2007.
[24] A. Hertzmann, “Painterly Rendering with Curved Brush Strokes of Multiple Sizes,” Proc. ACM SIGGRAPH, pp. 453-460, 1998.
[25] A. Hertzmann, “Paint by Relaxation,” Proc. Computer Graphics Int'l, pp. 47-54, 2001.
[26] B. Gooch, G. Coombe, and P. Shirley, “Artistic Vision: Painterly Rendering Using Computer Vision Techniques,” Proc. Second Int'l Symp. Nonphotorealistic Animation and Rendering, pp. 83-90, 2002.
[27] D. DeCarlo and A. Santella, “Stylization and Abstraction of Photographs,” ACM Trans. Graphics, vol. 21, no. 3, pp. 769-776, 2002.
[28] M. Grundland, C. Gibbs, and N.A. Dodgson, “Stylized Multiresolution Image Representation,” J. Electronic Imaging, vol. 17, no. 1, pp. 1-17, 2008.
[29] Flickr, “Share Your Photos. Watch the World,” http:/flickr.com, 2011.
[30] Q. Hou, K. Zhou, and B. Guo, “BSGP: Bulk-Synchronous GPU Programming,” ACM Trans. Graphics, vol. 27, no. 3, pp. 19:1-19:12, 2008.
[31] Stock, “Freestockfootage.com,” http:/www.freestockfootage. com/, 2009.
[32] C. Tomasi and R. Manduchi, “Bilateral Filtering for Gray and Color Images,” Proc. IEEE Int'l Conf. Computer Vision, pp. 839-846, 1998.
[33] S. Paris, “Edge-Preserving Smoothing and Mean-Shift Segmentation of Video Streams,” Proc. European Conf. Computer Vision, pp. 460-473, 2008.
[34] M. Kagaya, W. Brendel, Q. Deng, T. Kesterson, S. Todorovic, P. Neill, and E. Zhang, “Video Painting with Space-Time-Varying Style Parameters,” IEEE Trans. Visualization and Computer Graphics, vol. 17, no. 1, pp. 74-87, Jan. 2011.
[35] M. Balzer, T. Schlömer, and O. Deussen, “Capacity-Constrained Point Distributions: A Variant of Lloyd's Method,” ACM Trans. Graphics, vol. 28, no. 3, pp. 86:1-8, 2009.
6 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool