The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.11 - Nov. (2012 vol.34)
pp: 2147-2157
J. M. Hughes , Dept. of Comput. Sci., Dartmouth Coll., Hanover, NH, USA
Dong Mao , Dept. of Math., Michigan State Univ., East Lansing, MI, USA
D. N. Rockmore , Dept. of Math., Dartmouth Coll., Hanover, NH, USA
Yang Wang , Dept. of Math., Michigan State Univ., East Lansing, MI, USA
Qiang Wu , Dept. of Math. Sci., Middle Tennessee Univ., Murfreesboro, TN, USA
ABSTRACT
In this paper, we show how the tools of empirical mode decomposition (EMD) analysis can be applied to the problem of “visual stylometry,” generally defined as the development of quantitative tools for the measurement and comparisons of individual style in the visual arts. In particular, we introduce a new form of EMD analysis for images and show that it is possible to use its output as the basis for the construction of effective support vector machine (SVM)-based stylometric classifiers. We present the methodology and then test it on collections of two sets of digital captures of drawings: a set of authentic and well-known imitations of works attributed to the great Flemish artist Pieter Bruegel the Elder (1525-1569) and a set of works attributed to Dutch master Rembrandt van Rijn (1606-1669) and his pupils. Our positive results indicate that EMD-based methods may hold promise generally as a technique for visual stylometry.
INDEX TERMS
support vector machines, art, image classification, visual arts, empirical mode decomposition analysis, visual stylometry, EMD analysis, support vector machine-based stylometric classifiers, SVM, drawing digital captures, Visualization, Art, Shape, Kernel, Vectors, Wavelet analysis, Electronic mail, image processing., Empirical mode decomposition, stylometry, classifier
CITATION
J. M. Hughes, Dong Mao, D. N. Rockmore, Yang Wang, Qiang Wu, "Empirical Mode Decomposition Analysis for Visual Stylometry", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.34, no. 11, pp. 2147-2157, Nov. 2012, doi:10.1109/TPAMI.2012.16
REFERENCES
[1] O. Benesch, The Drawings of Rembrandt: Complete Edition in Six Volumes, E. Benesch, ed. Phaidon Press, 1973.
[2] I. Berezhnoy, E. Postma, and H. van den Herik, "Authentic: Computerized Brushstroke Analysis," Proc. IEEE Int'l Conf. Multimedia and Expo, pp. 1586-1588, 2005.
[3] H. Bevers, L. Hendrix, W.W. Robinson, and P. Schatborn, Drawings by Rembrandt and His Pupils: Telling the Difference. Getty Publications, 2010.
[4] Q. Chen, N. Huang, S. Riemenschneider, and Y. Xu, "A B-Spline Approach for Empirical Mode Decomposition," Advances in Computational Math., vol. 24, pp. 171-195, 2006.
[5] J. Coddington, J. Elton, D.N. Rockmore, and Y. Wang, "Multifractal Analysis and Authentication of Jackson Pollock's Paintings," Computer Image Analysis in the Study of Art, D.G. Stork and J. Coddington, eds., vol. 6810, pp. 68100F1-68112F1, 2008.
[6] J.C. Echeverria, J.A. Crowe, M.S. Woolfson, and B.R. Hayes-Gill, "Application of Empirical Mode Decomposition to Heart Rate Variability Analysis," Medical and Biological Eng. and Computing, vol. 39, pp. 471-479, 2001.
[7] C. Ginzburg, "Morelli Freud and Sherlock Holmes: Clues and Scientific Method," History Workshop J., vol. 9, no. 1, pp. 5-36, 1980, doi:10.1093/hwj/9.1.5.
[8] I. Guyon, J. Weston, S. Barnhill, and V. Vapnik, "Gene Selection for Cancer Classification Using Support Vector Machines," Machine Learning, vol. 46, pp. 389-422, 2002.
[9] T. Hastie, R. Tibshirani, and J. Friedman, The Elements of Statistical Learning. Springer, 2009.
[10] D.I. Holmes and J. Kardos, "Who Was the Author? An Introduction to Stylometry," Chance, vol. 16, no. 2, pp. 5-8, 2003.
[11] N. Huang et al., "The Empirical Mode Decomposition and the Hilbert Spectrum for Nonlinear Nonstationary Time Series Analysis," Proc. Royal Soc. of London A, vol. 454, pp. 903-995, 1998.
[12] N. Huang, Z. Shen, and S. Long, "A New View of Nonlinear Water Waves: The Hilbert Spectrum," Ann. Rev. Fluid Mechanics, vol. 31, pp. 417-457, 1999.
[13] J.M. Hughes, D.J. Graham, and D.N. Rockmore, "Stylometrics of Artwork: Uses and Limitations," Proc. SPIE: Computer Vision and Image Analysis of Art, vol. 7531, pp. 75310C-75315C, 2010.
[14] J.M. Hughes, D. Graham, and D.N. Rockmore, "Quantification of Artistic Style through Sparse Coding Analysis in the Drawings of Pieter Bruegel the Elder," Proc. Nat'l Academy of Sciences USA, vol. 107, no. 4, pp. 1279-1283, 2010.
[15] A.J. Izenman, Modern Multivariate Statistical Techniques: Regression, Classification, and Manifold Learning. Springer, 2008.
[16] C.R. Johnson, E. Hendriks, I.J. Berezhnoy, E. Brevdo, S.M. Hughes, I. Daubechies, J. Li, E. Postma, and J.Z. Wang, "Image Processing for Artist Identification," IEEE Signal Processing Magazine, vol. 25, no. 4, pp. 37-48, July 2008.
[17] K. Jones-Smith, H. Mathur, and L. Krauss, "Drip Paintings and Fractal Analysis," Physical Rev. E, vol. 79, p. 046111, 2009, doi:10.1103/PhysRevE.79.046111.
[18] K. Jones-Smith and H. Mathur, "Fractal Analysis: Revisiting Pollock's Drip Paintings," Nature, vol. 444, pp. E9-E10, 2006.
[19] G. Leibon and D.N. Rockmore, "Steps Toward Digital Authentication," Matematica e Cultura, M. Emmer, ed., pp. 107 -118, Springer, 2007.
[20] J. Li and J.Z. Wang, "Studying Digital Imagery of Ancient Paintings by Mixtures of Stochastic Models," IEEE Trans. Image Processing, vol. 13, no. 3, pp. 340-353, Mar. 2004.
[21] H.-T. Lin, C.-J. Lin, and R. Weng, "A Note on Platt's Probabilistic Outputs for Support Vector Machines," Machine Learning, vol. 68, pp. 267-276, 2007.
[22] L. Lin, Y. Wang, and H. Zhou, "Iterative Filtering as an Alternative Algorithm for Empirical Mode Decomposition," Advances in Adaptive Data Analysis, vol. 1, no. 4, pp. 543-560, 2009.
[23] B. Liu, S. Riemenschneider, and Y. Xu, "Gearbox Fault Diagnosis Using Empirical Mode Decomposition and Hilbert Spectrum," Mechanical Systems and Signal Processing, vol. 20, pp. 718-734, 2006.
[24] S. Lyu, D.N. Rockmore, and H. Farid, "A Digital Technique for Art Authentication," Proc. Nat'l Academy Sciences USA, vol. 101, no. 49, pp. 17006-17010, 2004.
[25] B. Manaris, J. Romero, P. Machado, D. Krehbiel, T. Hirzel, W. Pharr, and R.B. Davis, "Zipf's Law, Music Classification and Aesthetics," Computer Music J., vol. 29, no. 1, pp. 55-69, 2005.
[26] B. Manaris, P. Roos, P. Machado, D. Krehbiel, L. Pellicoro, and J. Romero, "A Corpus-Based Hybrid Approach to Music Analysis and Composition," Proc. 22nd Conf. Artificial Intelligence, pp. 839-845, July 2007.
[27] D. Mao, Y. Wang, and Q. Wu, "A New Approach for Physiological Time Series," preprint, 2009.
[28] A. de Morgan, "Letter to Rev. Heald 18/08/1851," Memoirs of Augustus de Morgan with Selections from His Letters, S. Elizabeth and D. Morgan, eds., Longman's Green and Co., 1982.
[29] J.R. Mureika, C.C. Dyer, and G.C. Cupchik, "Multifractal Structure in Nonrepresentational Art," Physical Rev. E, vol. 72, p. 046101, 2005.
[30] N.M. Orenstein, "Followers and Fakers of Pieter Bruegel," Int'l Foundation for Art Research J., vol. 6, no. 3, pp. 12-17, 2003.
[31] N.M. Orenstein, Pieter Bruegel the Elder. Yale Univ. Press, 2001.
[32] A. Pawlowski, "Wincenty Lutoslawski—A Forgotten Father of Stylometry," Glottometrics, vol. 8, pp. 83-89, 2004.
[33] D. Pines and L. Salvino, "Health Monitoring of One-Dimensional Structures Using Empirical Mode Decomposition and the Hilbert-Huang Transform," Proc. SPIE, vol. 4701, pp. 127-143, 2002.
[34] J.C. Platt, "Probabilistic Outputs for Support Vector Machines and Comparisons to Regularized Likelihood Methods," Advances in Large Margin Classifiers, MIT Press 1999.
[35] H. Qi and S. Hughes, "A New Method for Visual Stylometry of Impressionist Paintings," Proc. Int'l Conf. Acoustics, Speech, and Signal Processing, 2011.
[36] C.S. Sapp, "Comparative Analysis of Multiple Musical Performances," Proc. Int'l Conf. Music Information Retrieval, pp. 497-500, 2007.
[37] Provided by P. Schatborn, 2008.
[38] R.P. Taylor, R. Guzman, T.P. Martin, G.D.R. Hall, A.P. Micolich, D. Jonas, B.C. Scannell, M.S. Fairbanks, and C.A. Marlow, "Authenticating Pollock Paintings Using Fractal Geometry," Nature, vol. 399, p. 422, 2006.
[39] R.P. Taylor, A.P. Micolich, and D. Jonas, "Fractal Analysis: Revisiting Pollock's Drip Paintings (Reply)," Nature, vol. 444, pp. E10-E11, Nov. 2006.
[40] R.P. Taylor, A.P. Micholich, and D. Jonas, "Fractal Analysis of Pollock's Drip Paintings," Nature, vol. 399, p. 422, 1999.
[41] Y. Wang and Z. Zhou, "On the Convergence of EMD in $l^\infty$ ," preprint.
[42] R. Wollheim, "Giovanni Morelli and the Origins of Scientific Connoisseurship," On Art and Mind: Essays and Lectures, Allen Lane, 1973.
[43] Z. Yang, L. Yang, D. Qi, and C.Y. Suen, "An EMD-Based Recognition Method for Chinese Fonts and Styles," Pattern Recognition Letters, vol. 27, pp. 1692-1701, 2006.
[44] Z. Yang, L. Yang, and D. Qi, "Detection of Spindles in Sleep EEGs Using a Novel Algorithm Based on the Hilbert-Huang Transform," Wavelet Analysis and Applications, T. Qian, M.I. Vai, and Y. Xu, eds., pp. 543-559, Birkhauser, 2006.
[45] Z. Yang, L. Yang, and Y.Y. Tang, "Illumination-Rotation-Invariant Feature Extraction for Texture Classification Based on Hilbert-Huang Transform," preprint.
[46] L. Yao, J. Li, and J.Z. Wang, "Characterizing Elegance of Curves Computationally for Distinguishing Morrisseau Paintings and the Imitations," Proc. IEEE 16th Int'l Conf. Image Processing, special session on cultural heritage, pp. 73-76, 2009.
[47] T. Zheng, L. Xie, and L. Yang, "Integrated Extraction on Handwritten Numeral Strings in Form Document," Pattern Recognition and Artificial Intelligence, in press.
47 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool