This Article 
 Bibliographic References 
 Add to: 
Cubist Style Rendering from Photographs
October-December 2003 (vol. 9 no. 4)
pp. 443-453

Abstract—The contribution of this paper is a novel nonphotorealistic rendering (NPR) technique, influenced by the style of Cubist art. Specifically, we are motivated by artists such as Picasso and Braque, who produced art work by composing elements of a scene taken from multiple points of view; paradoxically, such compositions convey a sense of motion without assuming temporal dependence between views. Our method accepts a set of two-dimensional images as input and produces a Cubist style painting with minimal user interaction. We use salient features identified within the image set, such as eyes, noses, and mouths, as compositional elements; we believe the use of such features to be a unique contribution to NPR. Before composing features into a final image, we geometrically distort them to produce the more angular forms common in Cubist art. Finally, we render the composition to give a painterly effect, using an automatic algorithm. This paper describes our method, illustrating the application of our algorithm with a gallery of images. We conclude with a critical appraisal and suggest the use of “high-level” features is of interest to NPR.

[1] P. Hall, Non-Photorealistic Rendering by Q-Mapping Computer Graphics Forum, vol. 1, no. 18, pp. 27-39, 1999.
[2] J. Lansdown and S. Schofield, Expressive Rendering: A Review of Non-Photorealistic Rendering Techniques IEEE Computer Graphics and Applications, vol. 15, no. 3, pp. 29-37, May 1995.
[3] C. Reynolds, Non-Photorealistic, Painterly, and 'Toon Rendering, Oct. 2002.
[4] S. Green, D. Salesin, S. Schofield, A. Hertzmann, and P. Litwinowicz, Non-Photorealistic Rendering SIGGRAPH '99 Non-Photorealistic Rendering Course Notes, 1999.
[5] B. Gooch and A. Gooch, Nonphotorealistic Rendering, A.K. Peters, 2001.
[6] G. Elber, Interactive Line Art Rendering of Freeform Surfaces Computer Graphics Forum, vol. 3, no. 18, pp. 1-12, Sept. 1999.
[7] T. Strothotte, B. Preim, A. Raab, J. Schumann, and D.R. Forsey, How to Render Frames and Influence People Proc. Computer Graphics Forum (Eurographics), vol. 13, pp. C455-C466, 1994.
[8] C. Rossl and L Kobbelt, Line-Art Rendering of 3D-Models Proc. Pacific Graphics, pp. 87-96, 2000.
[9] M.P. Salisbury et al., "Orientable Textures for Image-Based Pen-and-Ink Illustration," Proc. Siggraph 97, ACM Press, 1997, pp. 401-406.
[10] O Deussen, S. Hiller, C. van Overveld, and T. Strothotte, Floating Points: A Method for Computing Stipple Drawings Proc. Computer Graphics Forum (Eurographics), vol. 19, pp. 41-50, 2000.
[11] P. Hanrahan and P. Haeberli, Direct WYSIWYG Painting and Texturing on 3D Shapes Proc. Computer Graphics (ACM SIGGRAPH), vol. 24, pp. 215-223, Aug. 1990.
[12] E. Daniels, Deep Canvas in Disney's Tarzan Proc. Computer Graphics (ACM SIGGRAPH, Abstracts and Applications), p. 200, 1999.
[13] P. Haeberli, “Paint by Numbers: Abstract Image Representation,” Computer Graphics (Proc. Siggraph), Vol. 24, No. 4, Aug. 1990, pp. 207-214.
[14] B. Baxter, V. Scheib, M.C. Line, and D. Manocha, DAB: Interactive Haptic Painting with 3D Virtual Brushes Proc. Computer Graphics (ACM SIGGRAPH), pp. 461-468, 2001.
[15] S. Mizuno, M. Okada, and J.I. Toriwaki, Virtual Sculpting and Virtual Woodcut Printing The Visual Computer, vol. 2, no. 14, pp. 39-51, 1998.
[16] T. Cockshott, J. Patterson, and D. England, Modelling the Texture of Paint Computer Graphics Forum, vol. 11, no. 3, pp. 217-226, Sept. 1992.
[17] C. Curtis, S. Anderson, J. Seims, K. Fleischer, and D.H. Salesin, Computer-Generated Watercolor Proc. Computer Graphics (ACM SIGGRAPH), pp. 421-430, 1997.
[18] S. Strassman, “Hairy Brushes,” Computer Graphics, Vol. 20, No. 4, Aug. 1986, pp. 225-231.
[19] S. Hsu and I. Lee, "Drawing and Animation using Skeletal Strokes," Computer Graphics, Annual Conf. Series (Proc. Siggraph 94), ACM Press, New York, 1994, pp. 109-118.
[20] G. Winkenbach and D.H. Salesin, “Computer-Generated Pen-and-Ink Illustration,” Computer Graphics (Proc. Siggraph), Vol. 28, No. 4, Oct. 1994, pp. 91-108.
[21] W. Leister, Computer Generated Copper Plates Computer Graphics Forum, vol. 13, no. 1, pp. 69-77, Mar. 1994.
[22] B.J. Meier, “Painterly Rendering for Animation,” SIGGRAPH '96 Conf. Proc., H. Rushmeier, ed., pp. 477-484, New Orleans, 1996.
[23] P. Litwinowicz, "Processing Images and Video for an Impressionist Effect," Proc. Siggraph 97, ACM Press, 1997, pp. 407-414.
[24] A. Hertzmann, "Painterly Rendering with Curved Brush Strokes of Multiple Sizes," Proc. Siggraph 98, ACM Press, 1998, pp. 453-460.
[25] M. Shiraishi and Y. Yamaguchi, An Algorithm for Automatic Painterly Rendering Based on Local Source Image Approximation Proc. First Int'l Symp. Non-Photorealistic Animation and Rendering (NPAR), pp. 53-58, 2000.
[26] L. Markosian et al., "Real-Time Nonphotorealistic Rendering," Proc. Siggraph 97, Computer Graphics (Proc. Ann. Conf. Series), T. Whitted, ed., Addison Wesley, 1997, pp. 415-420.
[27] E. Praun, H. Hoppe, M. Webb, and A. Finkelstein, Real-Time Hatching Proc. Computer Graphics (ACM SIGGRAPH), pp. 581-586, 2001.
[28] D. Lee and K. Sabnani, “Reverse-Engineering of Communication Protocols,” Proc. Int’l Conf. Network Protocols, IEEE CS Press, 1993, 1993, pp. 208-216.
[29] A. Butler, C. Van Cleave, and S. Stirling, The Art Book. The Phaidon Press, 1994.
[30] A. Chen, K. Knudtzon, J.L. Stumpfel, and J.K. Hodgins, Artistic Rendering of Dynamic Motion Proc. Computer Graphics (ACM SIGGRAPH Sketches), 2000.
[31] A.W. Klein, P.J. Sloan, R.A. Colburn, A. Finkelstein, and M.F. Cohen, Video Cubism technical report, Microsoft Research, May 2001.
[32] K.N. Walker, T.F. Cootes, and C.J. Taylor, Locating Salient Object Features Proceedings British Machine Vision Conf. (BMVC), vol. 2, pp. 557-567, 1998.
[33] P. Hall, D. Marshall, and R. Martin, Merging and Splitting Eigenspaces IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 9, pp. 1024-1049, Sept. 2000.
[34] C.B. Barber, D.P. Dobkin, and H.T. Huhdanpaa, The Quickhull Algorithm for Convex Hulls ACM Trans. Math. Software, no. 22, pp. 469-483, 1996.
[35] P.L. Rosin, “Fitting Superellipses,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 7, pp. 726-732, July 2000.
[36] W.H. Press, Numerical Recipes in C: the Art of Scientific Computing. Cambridge Univ. Press, 1992.
[37] M. Sonka, V. Hlavac, and R. Boyle, Image Processing, Analysis, and Machine Vision. P.W.S. Publishing, 1999.
[38] A.P. Dempster, N.M. Laird, and D.B. Rubin, Maximum Likelihood from Incomplete Data via the EM Algorithm Royal Statistical Soc. Series B, vol. 39, pp. 1-38, 1997.
[39] X. Wu, Colour Quantization by Dynamic Programming and Principal Analysis ACM Trans. Graphics, vol. 4, no. 11, pp. 348-372, Oct. 1992.
[40] R. Hughes, The Shock of the New. Thames and Hudson, 1991.
[41] A. Santella and D. DeCarlo, Abstracted Painterly Renderings Using Eye-Tracking Data Proc. Second Int'l Symp. Non-Photorealistic Animation and Rendering (NPAR), 2002.
[42] R. Duda, P. Hart, and D. Stork, Pattern Classification. New York: John Wiley&Sons, 2001.
[43] G.J. Chaitin, M.A. Auslander, A.K. Chandra, J. Cocke, M.E. Hopkins, and P.W. Markstein, Register Allocation via Colouring Computer Languages, vol. 6, pp. 47-57, 1981.

Index Terms:
Nonphotorealistic rendering, Cubism, salient features.
John P. Collomosse, Peter M. Hall, "Cubist Style Rendering from Photographs," IEEE Transactions on Visualization and Computer Graphics, vol. 9, no. 4, pp. 443-453, Oct.-Dec. 2003, doi:10.1109/TVCG.2003.1260739
Usage of this product signifies your acceptance of the Terms of Use.