This Article 
 Bibliographic References 
 Add to: 
Stylized Rendering Using Samples of a Painted Image
March/April 2008 (vol. 14 no. 2)
pp. 468-480
We introduce a novel technique to generate painterly art map (PAM) for 3D non-photorealistic rendering. Our technique can automatically transfer brush stroke textures and color changes to 3D models from samples of a painted image. Therefore, the generation of stylized images/animation in the style of a given artwork can be achieved. This new approach works particularly well for a rich variety of brush strokes ranging from simple 1D and 2D line-art strokes to very complicated ones with significant variations in stroke characteristics. During the rendering/animation process, the coherence of brush stroke textures and color changes over 3D surfaces can be well maintained. With PAM, we can also easily generate the illusion of flow animation over a 3D surface to convey the shape of a model.

[1] E. Praun, H. Hoppe, M. Webb, and A. Finkelstein, “Real-Time Hatching,” Proc. ACM SIGGRAPH '01, pp. 579-584, 2001.
[2] M. Webb, E. Praun, A. Finkelstein, and H. Hoppe, “Fine Tone Control in Hardware Hatching,” Proc. Second Int'l Symp. Non-Photorealistic Animation and Rendering (NPAR '02), pp. 53-58, 2002.
[3] C.D. Kulla, J.D. Tucek, R.J. Bailey, and C.M. Grimm, “Using Texture Synthesis for Non-Photorealistic Shading from Paint Samples,” Proc. 11th Pacific Conf. Computer Graphics and Applications (PG '03), pp. 477-481, 2003.
[4] M.-T. Chi and T.-Y. Lee, “Stylized and Abstract Painterly Rendering System Using a Multiscale Segmented Sphere Hierarchy,” IEEE Trans. Visualization and Computer Graphics, vol. 12, no. 1, pp. 61-72, Jan./Feb. 2006.
[5] J. Zhang, K. Zhou, L. Velho, B. Guo, and H.-Y. Shum, “Synthesis of Progressively Variant Textures on Arbitrary Surfaces,” ACM Trans. Graphics, vol. 22, no. 3, pp. 295-302, July 2003.
[6] A.A. Efros and W.T. Freeman, “Image Quilting for Texture Synthesis and Transfer,” Proc. ACM SIGGRAPH '01, pp. 341-346, 2001.
[7] Q. Wu and Y. Yu, “Feature Matching and Deformation for Texture Synthesis,” ACM Trans. Graphics, vol. 23, no. 3, pp. 364-367, Aug. 2004.
[8] V. Kwatra, A. SchLodl, I. Essa, G. Turk, and A. Bobick, “Graphcut Textures: Image and Video Synthesis Using Graph Cuts,” ACM Trans. Graphics, vol. 22, no. 3, pp. 277-286, July 2003.
[9] V. Kwatra, I. Essa, A. Bobick, and N. Kwatra, “Texture Optimization for Example-Based Synthesis,” ACM Trans. Graphics, vol. 24, no. 3, pp. 795-802, Aug. 2005.
[10] A. Hertzmann, “A Survey of Stroke-Based Rendering,” IEEE Computer Graphics and Applications, vol. 23, no. 4, pp. 70-81, 2003.
[11] A. Hertzmann, C.E. Jacobs, N. Oliver, B. Curless, and D.H. Salesin, “Image Analogies,” Proc. ACM SIGGRAPH '01, pp. 327-340, 2001.
[12] O. Deussen and T. Strothotte, “Computer-Generated Pen-and-Ink Illustration of Trees,” Proc. ACM SIGGRAPH '00, pp. 13-18, 2000.
[13] A. Hertzmann and D. Zorin, “Illustrating Smooth Surfaces,” Proc. ACM SIGGRAPH '00, pp. 517-526, 2000.
[14] J.D. Northrup and L. Markosian, “Artistic Silhouettes: A Hybrid Approach,” Proc. First Int'l Symp. Non-Photorealistic Animation and Rendering (NPAR '00), pp. 31-37, 2000.
[15] B.J. Meier, “Painterly Rendering for Animation,” Proc. ACM SIGGRAPH '96, pp. 477-484, 1996.
[16] D. Cornish, A. Rowan, and D. Luebke, “View-Dependent Particles for Interactive Non-Photorealistic Rendering,” Proc. Graphics Interface (GI '01), pp. 151-158, 2001.
[17] R.D. Kalnins, L. Markosian, B.J. Meier, M.A. Kowalski, J.C. Lee, P.L. Davidson, M. Webb, J.F. Hughes, and A. Finkelstein, “WYSIWYG NPR: Drawing Strokes Directly on 3D Models,” ACM Trans. Graphics, vol. 21, no. 3, pp. 755-762, July 2002.
[18] P.-P.J. Sloan, W. Martin, A. Gooch, and B. Gooch, “The Lit Sphere: A Model for Capturing NPR Shading from Art,” Proc. Graphics Interface (GI '01), pp. 143-150, 2001.
[19] H. Xu, N. Gossett, and B. Chen, “Pointworks: Abstraction and Rendering of Sparsely Scanned Outdoor Environments,” Proc. 15th Eurographics Symp. Rendering (EGSR '04), pp. 45-52, 2004.
[20] S. Zelinka and M. Garland, “Interactive Texture Synthesis on Surfaces Using Jump Maps,” Proc. 14th Eurographics Symp. Rendering (EGSR '03), pp. 90-96, 2003.
[21] M.F. Cohen, J. Shade, S. Hiller, and O. Deussen, “Wang Tiles for Image and Texture Generation,” ACM Trans. Graphics, vol. 22, no. 3, pp. 287-294, July 2003.
[22] D.J. Heeger and J.R. Bergen, “Pyramid-Based Texture Analysis/Synthesis,” Proc. ACM SIGGRAPH '95, pp. 229-238, 1995.
[23] Z. Bar-Joseph, R. El-Yaniv, D. Lischinski, and M. Werman, “Texture Mixing and Texture Movie Synthesis Using Statistical Learning,” IEEE Trans. Visualization and Computer Graphics, vol. 7, no. 2, pp. 120-135, Apr.-June 2001.
[24] W. Matusik, M. Zwicker, and F. Durand, “Texture Design Using a Simplicial Complex of Morphable Textures,” ACM Trans. Graphics, vol. 24, no. 3, pp. 787-794, Aug. 2005.
[25] Y. Deng, B.S. Manjunath, and H. Shin, “Color Image Segmentation,” Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR '99), pp. 2446-2451, 1999.
[26] L. Liang, C. Liu, Y.-Q. Xu, B. Guo, and H.-Y. Shum, “Real-Time Texture Synthesis by Patch-Based Sampling,” ACM Trans. Graphics, vol. 20, no. 3, pp. 127-150, July 2001.
[27] L.-Y. Wei and M. Levoy, “Fast Texture Synthesis Using Tree-Structured Vector Quantization,” Proc. ACM SIGGRAPH '00, pp.479-488, 2000.
[28] T.-Y. Lee and C.-R. Yan, “Feature-Based Texture Synthesis,” LNCS 3482, pp. 1043-1049, 2005.
[29] T.-Y. Lee, C.-R. Yan, and M.-T. Chi, “Stylized Rendering for Anatomic Visualization,” Computing in Science and Eng., vol. 9, no. 1, pp. 13-19, 2007.
[30] H. Pfister, M. Zwicker, J. van Baar, and M. Gross, “Surfels: Surface Elements as Rendering Primitives,” Proc. ACM SIGGRAPH '00, pp. 335-342, 2000.
[31] E.B. Lum, A. Stompel, and K.-L. Ma, “Using Motion to Illustrate Static 3D Shape-Kinetic Visualization,” IEEE Trans. Visualization and Computer Graphics, vol. 9, no. 2, pp. 115-126, Apr.-June 2003.
[32] T.-Y. Lee, C.-H. Lin, S.-W. Yen, and H.-J. Chen, “A Natural Pen-and-Paper Like Sketching Interface for Modeling and Animation,” Proc. Int'l Conf. Computer Animation and Social Agents (CASA '07), pp. 87-92, 2007.
[33] S. Bruckner and M.E. GrLoller, “Style Transfer Functions for Illustrative Volume Rendering,” Computer Graphics Forum, vol. 26, pp. 715-724, 2007.
[34] E. Reinhard, M. Ashikhmin, B. Gooch, and P.S. Shirley, “Color Transfer between Images,” IEEE Computer Graphics and Applications, vol. 21, no. 5, pp. 34-41, Sept./Oct. 2001.
[35] P.-H. Lin and T.-Y. Lee, “Camera-Sampling Field and Its Applications,” IEEE Trans. Visualization and Computer Graphics, vol. 10, no. 3, pp. 241-251, May/June 2004.

Index Terms:
computer graphics, color, shading, shadowing, and texture, display algorithms
Chung-Ren Yen, Ming-Te Chi, Tong-Yee Lee, Wen-Chieh Lin, "Stylized Rendering Using Samples of a Painted Image," IEEE Transactions on Visualization and Computer Graphics, vol. 14, no. 2, pp. 468-480, March-April 2008, doi:10.1109/TVCG.2007.70440
Usage of this product signifies your acceptance of the Terms of Use.