The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.08 - Aug. (2013 vol.19)
pp: 1252-1263
Yi-Zhe Song , Sch. of Electron. Eng. & Comput. Sci., Queen Mary, Univ. of London, London, UK
D. Pickup , Dept. of Comput. Sci., Univ. of Bath, Bath, UK
Chuan Li , Dept. of Comput. Sci., Univ. of Bath, Bath, UK
P. Rosin , Sch. of Comput. Sci. & Inf., Univ. of Cardiff, Cardiff, UK
P. Hall , Dept. of Comput. Sci., Univ. of Bath, Bath, UK
ABSTRACT
This paper shows that classifying shapes is a tool useful in nonphotorealistic rendering (NPR) from photographs. Our classifier inputs regions from an image segmentation hierarchy and outputs the "best” fitting simple shape such as a circle, square, or triangle. Other approaches to NPR have recognized the benefits of segmentation, but none have classified the shape of segments. By doing so, we can create artwork of a more abstract nature, emulating the style of modern artists such as Matisse and other artists who favored shape simplification in their artwork. The classifier chooses the shape that "best” represents the region. Since the classifier is trained by a user, the "best shape” has a subjective quality that can over-ride measurements such as minimum error and more importantly captures user preferences. Once trained, the system is fully automatic, although simple user interaction is also possible to allow for differences in individual tastes. A gallery of results shows how this classifier contributes to NPR from images by producing abstract artwork.
INDEX TERMS
Image segmentation, Rendering (computer graphics), Shape analysis, Classification, Art,abstract art, Nonphotorealistic rendering, shape fitting, shape classification
CITATION
Yi-Zhe Song, D. Pickup, Chuan Li, P. Rosin, P. Hall, "Abstract Art by Shape Classification", IEEE Transactions on Visualization & Computer Graphics, vol.19, no. 8, pp. 1252-1263, Aug. 2013, doi:10.1109/TVCG.2013.13
REFERENCES
[1] P. Haeberli, "Paint by Numbers: Abstract Image Representations," Proc. 17th Int'l Conf. Computer Graphics and Interactive Techniques (ACM SIGGRAPH), vol. 4, no. 24, pp. 207-214, 1990.
[2] M.P. Salisbury, S.E. Anderson, R. Barzel, and D.H. Salesin, "Interactive Pen-and-Ink Illustration," Proc. 21st Int'l Conf. Computer Graphics and Interactive Techniques (ACM SIGGRAPH), pp. 101-108, 1994.
[3] T. Cockshott, J. Patterson, and D. England, "Modelling the Texture of Paint," Computer Graphics Forum, vol. 11, no. 3, pp. 217-226, 1992.
[4] P. Litwinowicz, "Processing Images and Video for an IMP Ressionist Effect," Proc. 24th Int'l Conf. Computer Graphics and Interactive Techniques (ACM SIGGRAPH,) pp. 407-414, 1997.
[5] M.P. Salisbury, M.T. Wong, J.F. Hughes, and D.H. Salesin, "Orientable Textures for Image-Based Pen-and-Ink Illustration," Proc. 24th Int'l Conf. Computer Graphics and Interactive Techniques (ACM SIGGRAPH), pp. 401-406, 1997.
[6] P. Hall, "Non-Photorealistic Rendering by Q-Mapping," Computer Graphics Forum, vol. 1, no. 18, pp. 27-39, 1999.
[7] C. Curtis, S. Anderson, J. Seims, K. Fleischer, and D.H. Salesin, "Computer-Generated Watercolor," Proc. 24th Int'l Conf. Computer Graphics and Interactive Techniques (ACM SIGGRAPH), pp. 421-430, 1997.
[8] S. Brooks, "Mixed Media Painting and Portraiture," IEEE Trans. Visualization and Computer Graphics, vol. 13, no. 5, pp. 1041-1054, Sept./Oct. 2007.
[9] R. Vergne, D. Vanderhaeghe, J. Chen, P. Barla, X. Granier, and C. Schlick, "Implicit Brushes for Stylized Line-Based Rendering," Eurographics, 2011.
[10] A. Hertzmann, "Painterly Rendering with Curved Brush Strokes of Multiple Sizes," Proc. 25th Int'l Conf. Computer Graphics and Interactive Techniques (ACM SIGGRAPH), pp. 453-460, 1998.
[11] J.P. Collomosse and P.M. Hall, "Salience-Adaptive Painterly Rendering Using Genetic Search," Int'l J. Artificial Intelligence Tools, vol. 15, no. 4, pp. 551-576, Aug. 2006.
[12] H. Winnemöller, S. Olson, and B. Gooch, "Real-Time Video Abstraction," Proc. ACM SIGGRAPH, pp. 1221-1226, 2006.
[13] H. Kang, S. Lee, C.K., and Chui, "Flow-Based Image Abstraction," IEEE Trans. Visualization and Computer Graphics, vol. 15, no. 1, pp. 62-76, Jan. 2009.
[14] P.L. Rosin and Y.K. Lai, "Towards Artistic Minimal Rendering," Proc. Int'l Symp. Non-Photorealistic Animation and Rendering (NPAR), pp. 119-127, 2010.
[15] J.E. Kyprianidis and H. Kang, "Image and Video Abstraction by Coherence-Enhancing Filtering," Eurographics, 2011.
[16] S.M.F. Treavett and M. Chen, "Statistical Techniques for the Automated Synthesis of Non-Photorealistic Images," Proc. 15th Eurographics UK Conf., pp. 201-210, 1997.
[17] S. Paris, S.W. Hasinoff, and J. Kautz, "Local Laplacian Filters: Edge-Aware Image Processing with a Laplacian Pyramid," Proc. ACM SIGGRAPH 2011 papers, pp. 68:1-68:12, http://doi.acm.org/10.11451964921.1964963 , 2011.
[18] D. DeCarlo and A. Santella, "Stylization and Abstraction of Photographs," ACM Trans. Graphics, vol. 21, pp. 769-776, http://doi.acm.org/10.1145566654.566650, July 2002.
[19] J.P. Collomosse and P.M. Hall, "Painterly Rendering Using Image Salience," Proc. 20th Eurographics UK Conf., pp. 122-128, 2002.
[20] J. Bangham, S. Gibson, and R. Harvey, "The Art of Scale-Space," Proc. Conf. British Machine Vision Assoc., pp. 569-578, 2003.
[21] B. Gooch, G. Coombe, and P. Shirley, "Artistic Vision: Painterly Rendering Using Computer Vision techniques," Proc. Second ACM Symp. Non-Photorealistic Animation and Rendering, pp. 83-90, June 2002.
[22] P. Arbelaez, M. Maire, C. Fowlkes, and J. Malik, "From Contours to Regions: An Empirical Evaluation," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2009.
[23] Y.-Z. Song, P. Arbelaez, P. Hall, C. Li, and A. Balikai, "Finding Semantic Structures in Image Hierarchies Using Laplacian Graph Energy," Proc. European Conf. Computer Vision (ECCV '10), pp. 694-707, 2010.
[24] D. Mould, "A Stained Glass Image Filter," Proc. 14th Eurographics Workshop Rendering Techniques, pp. 20-25, 2003.
[25] V. Setlur and S. Wilkinson, "Automatic Stained Glass Rendering," Proc. 24th Int'l Conf. Advances Computer Graphics (CGI), pp. 682-691, 2006.
[26] J.P. Collomosse and P.M. Hall, "Cubist Style Rendering from Photographs," IEEE Trans. Visualization and Computer Graphics, vol. 4, no. 9, pp. 443-453, Oct. 2003.
[27] J. Xu and C. Kaplan, "Artistic Thresholding," Proc. Int'l Symp. Non-Photorealistic Animation and Rendering, pp. 39-47, 2007.
[28] J. Orchard and C. Kaplan, "Cut-Out Image Mosaics," Proc. Int'l Symp. Non-Photorealistic Animation and Rendering, pp. 79-87, 2008.
[29] H. Huang, L. Zhang, and H.-C. Zhang, "Arcimboldo-Like Collage Using Internet Images," Proc. SIGGRAPH Asia Conf., pp. 155:1-155:8, http://doi.acm.org/10.11452024156.2024189 , 2011.
[30] J. Wang, Y. Xu, H. Shum, and M. Cohen, "Video Tooning," ACM Trans. Graphics, vol. 3, no. 23, pp. 574-583, 2004.
[31] J.P. Collomosse, D. Rowntree, and P.M. Hall, "Stroke Surfaces: Temporally Coherent Artistic Animations from Video," IEEE Trans. Visualization and Computer Graphics, vol. 11, no. 5, pp. 540-549, Sept. 2005.
[32] D. Mould, "Region-Based Abstraction," pp. 125-148, 2012.
[33] J. Shi and J. Malik, "Normalized Cuts and Image Segmentation," Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR '97), pp. 731-737, 1997.
[34] T. Cour, F. Benezit, and J. Shi, "Spectral Segmentation with Multiscale Graph Decomposition," Proc. IEEE CS Conf. Computer Vision and Pattern Recognition (CVPR '05), vol. 2, pp. 1124-1131, 2005.
[35] D. Martin, C. Fowlkes, and J. Malik, "Learning to Detect Natural Image Boundaries Using Local Brightness, Color and Texture Cues," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 26, no. 5, pp. 530-549, May 2004.
[36] K. Voss and H. Süße, "Invariant fitting of planar objects by primitives," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 1, pp. 80-84, Jan. 1997.
[37] H. Süße and K. Voss, "A New Efficient Algorithm for Fitting of Rectangles and Squares," Proc. Int'l Conf. Image Processing, pp. 809-812, 2001.
[38] P.L. Rosin and G.A.W. West, "Curve Segmentation and Representation by Superellipses," Proc. IEE Vision, Image, and Signal Processing, vol. 142, pp. 280-288, 1995.
[39] W.H. Press, B.P. Flannery, S.A. Teukolsky, and W.T. Vettering, Numerical Recipes in C. Cambridge Univ. Press, 1990.
[40] P.L. Rosin and C.L. Mumford, "A Symmetric Convexity Measure," Computer Vision and Image Understanding, vol. 103, no. 2, pp. 101-111, 2006.
[41] A. Kolesnikov and P. Fränti, "Optimal Algorithm for Convexity Measure Calculation," Proc. Int'l Conf. Image Processing, pp. 353-356, 2005.
[42] J.R. Quinlan, C4.5: Programs for Machine Learning. Morgan Kaufmann Publishers Inc., 1993.
[43] G. Sharma, Digital Color Imaging Handbook. CRC Press, 2003.
111 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool