The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.01 - January (2011 vol.17)
pp: 74-87
Mizuki Kagaya , Oregon State University, Corvallis
William Brendel , Oregon State University, Corvallis
Qingqing Deng , Oregon State University, Corvallis
Todd Kesterson , Oregon State University, Corvallis
Sinisa Todorovic , Oregon State University, Corvallis
Patrick J. Neill , NVidia, Santa Clara
Eugene Zhang , Oregon State University, Corvallis
ABSTRACT
Artists use different means of stylization to control the focus on different objects in the scene. This allows them to portray complex meaning and achieve certain artistic effects. Most prior work on painterly rendering of videos, however, uses only a single painting style, with fixed global parameters, irrespective of objects and their layout in the images. This often leads to inadequate artistic control. Moreover, brush stroke orientation is typically assumed to follow an everywhere continuous directional field. In this paper, we propose a video painting system that accounts for the spatial support of objects in the images or videos, and uses this information to specify style parameters and stroke orientation for painterly rendering. Since objects occupy distinct image locations and move relatively smoothly from one video frame to another, our object-based painterly rendering approach is characterized by style parameters that coherently vary in space and time. Space-time-varying style parameters enable more artistic freedom, such as emphasis/de-emphasis, increase or decrease of contrast, exaggeration or abstraction of different objects in the scene in a temporally coherent fashion.
INDEX TERMS
Nonphotorealistic rendering, video painting, multistyle painting, tensor field design.
CITATION
Mizuki Kagaya, William Brendel, Qingqing Deng, Todd Kesterson, Sinisa Todorovic, Patrick J. Neill, Eugene Zhang, "Video Painting with Space-Time-Varying Style Parameters", IEEE Transactions on Visualization & Computer Graphics, vol.17, no. 1, pp. 74-87, January 2011, doi:10.1109/TVCG.2010.25
REFERENCES
[1] P. Haeberli, "Paint by Numbers: Abstract Image Representations," Proc. ACM SIGGRAPH '90, pp. 207-214, 1990.
[2] P. Litwinowicz, "Processing Images and Video for an Impressionist Effect," Proc. ACM SIGGRAPH '97, pp. 407-414, 1997.
[3] A. Hertzmann, "Paint by Relaxation," Proc. Computer Graphics Int'l (CGI '01), pp. 47-54, 2001.
[4] D. DeCarlo and A. Santella, "Stylization, Abstraction of Photographs," Proc. ACM SIGGRAPH '02, pp. 769-776, 2002.
[5] A. Hertzmann, "Fast Paint Texture," Proc. Second Int'l Symp. Non-Photorealistic Animation and Rendering (NPAR '02), pp. 91-97, 2002.
[6] J. Hays and I. Essa, "Image, Video Based Painterly Animation," Proc. Third Int'l Symp. Non-Photorealistic Animation and Rendering (NPAR '04), pp. 113-120, 2004.
[7] A. Hertzmann and K. Perlin, "Painterly Rendering for Video Interaction," Proc. First Int'l Symp. Non-Photorealistic Animation and Rendering (NPAR '00), pp. 7-12, 2000.
[8] A. Bousseau, F. Neyret, J. Thollot, and D. Salesin, "Video Watercolorization Using Bidirectional Texture Advection," Proc. SIGGRAPH '07, ACM SIGGRAPH 2007 Papers, p. 104, 2007.
[9] J. Wang, Y. Xu, H.-Y. Shum, and M.F. Cohen, "Video Tooning," Proc. SIGGRAPH '04, ACM SIGGRAPH 2004 Papers, pp. 574-583, 2004.
[10] J.P. Collomosse, D. Rowntree, and P.M. Hall, "Stroke Surfaces: Temporally Coherent Artistic Animations from Video," IEEE Trans. Visualization Computer Graphics, vol. 11, no. 5, pp. 540-549, Sept. 2005.
[11] E. Zhang, J. Hays, and G. Turk, "Interactive Tensor Field Design and Visualization on Surfaces," IEEE Trans. Visualization and Computer Graphics, vol. 13, no. 1, pp. 94-107, Jan. 2007.
[12] W. Brendel and S. Todorovic, "Video Object Segmentation by Tracking Regions," Proc. IEEE Int'l Conf. Computer Vision, pp. 1-8, 2009.
[13] A. Hertzmann, "Painterly Rendering with Curved Brush Strokes of Multiple Sizes," Proc. ACM SIGGRAPH '98, pp. 453-460, 1998.
[14] A. Hertzmann, C.E. Jacobs, N. Oliver, B. Curless, and D.H. Salesin, "Image Analogies," Proc. ACM SIGGRAPH '01, pp. 327-340, 2001.
[15] A.W. Klein, P.-P.J. Sloan, A. Finkelstein, and M.F. Cohen, "Stylized Video Cubes," Proc. ACM SIGGRAPH/Eurographics Symp. Computer Animation (SCA '02), pp. 15-22, 2002.
[16] B.J. Meier, "Painterly Rendering for Animation," Proc. ACM SIGGRAPH '96, pp. 477-484, 1996.
[17] M. Cunzi, J. Thollot, S. Paris, G. Debunne, J.-D. Gascuel, and F. Durand, "Dynamic Canvas for Non-Photorealistic Walkthroughs," Proc. Graphics Interface Conf., pp. 121-130, 2003.
[18] E. Zhang, K. Mischaikow, and G. Turk, "Vector Field Design on Surfaces," ACM Trans. Graphics, vol. 25, no. 4, pp. 1294-1326, 2006.
[19] B. Cabral and L.C. Leedom, "Imaging Vector Fields Using Line Integral Convolution," Proc. ACM SIGGRAPH '93, pp. 263-270, 1993.
[20] D. Stalling and H.-C. Hege, "Fast, Resolution Independent Line Integral Convolution," Proc. ACM SIGGRAPH '95, pp. 249-256, 1995.
[21] J.J. van Wijk, "Image Based Flow Visualization," Proc. ACM SIGGRAPH '02, pp. 745-754, 2002.
[22] T. Delmarcelle and L. Hesselink, "Visualizing Second-Order Tensor Fields with Hyperstream Lines," IEEE Computer Graphics and Applications, vol. 13, no. 4, pp. 25-33, July 1993.
[23] X. Zheng and A. Pang, "Hyperlic," Proc. IEEE Visualization Conf., pp. 249-256, 2003.
[24] W.H. Press, S.A. Teukolsky, W.T. Vetterling, and B.P. Flannery, Numerical Recipes in C: The Art of Scientific Computing. Cambridge Univ. Press, 1992.
[25] N.J. Foster and A.C. Sanderson, "Determining Object Orientation Using Ellipse Fitting," Proc. IEEE Int'l Conf. Computer Vision, 2009.
[26] C.-H. Tzeng, Z.-F. Yang, and W.-H. Tsai, "Adaptive Data Hiding in Palette Images by Color Ordering and Mapping with Security Protection," IEEE Trans. Comm., vol. 52, no. 5, pp. 791-800, May 2004.
[27] B.D. Lucas and T. Kanade, "An Iterative Image Registration Technique with an Application to Stereo Vision," Proc. Int'l Joint Conf. Artificial Intelligence (IJCAI), pp. 674-679, 1981.
[28] Y.-Y. Chuang, A. Agarwala, B. Curless, D.H. Salesin, and R. Szeliski, "Video Matting of Complex Scenes," Proc. ACM SIGGRAPH '02, pp. 243-248, 2002.
[29] A. Agarwala, A. Hertzmann, D.H. Salesin, and S.M. Seitz, "Keyframe-Based Tracking for Rotoscoping Animation," Proc. ACM SIGGRAPH '04, ACM SIGGRAPH 2004 Papers, pp. 584-591, 2004.
[30] R. Megret and D. DeMenthon, "A Survey of Spatio-Temporal Grouping Techniques," Technical Report CS-TR-4403, Univ. of Maryland, 2002.
[31] A. Agarwala, "Snaketoonz: A Semi-Automatic Approach to Creating Cel Animation from Video," Proc. Second Int'l Symp. Non-Photorealistic Animation and Rendering (NPAR '02), pp. 139-148, 2002.
[32] Y. Park and K. Yoon, "Painterly Animation Using Motion Maps," Graphical Models, vol. 70, nos. 1-2, pp. 1-15, 2008.
39 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool