Subscribe

Issue No.07 - July (2013 vol.19)

pp: 1228-1241

Hui Fang , Dept. of Comput. Sci., Swansea Univ., Swansea, UK

G. K-L Tam , Dept. of Comput. Sci., Swansea Univ., Swansea, UK

R. Borgo , Dept. of Comput. Sci., Swansea Univ., Swansea, UK

A. J. Aubrey , Dept. of Comput. Sci., Cardiff Univ., Cardiff, UK

P. W. Grant , Dept. of Comput. Sci., Swansea Univ., Swansea, UK

P. L. Rosin , Dept. of Comput. Sci., Cardiff Univ., Cardiff, UK

C. Wallraven , Dept. of Brain & Cognitive Eng., Korea Univ., Seoul, South Korea

D. Cunningham , Brandenburg Tech. Univ., Brandenburg, Germany

D. Marshall , Dept. of Comput. Sci., Cardiff Univ., Cardiff, UK

Min Chen , Oxford e-Res. Centre, Univ. of Oxford, Oxford, UK

DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/TVCG.2012.312

ABSTRACT

Natural image statistics is an important area of research in cognitive sciences and computer vision. Visualization of statistical results can help identify clusters and anomalies as well as analyze deviation, distribution, and correlation. Furthermore, they can provide visual abstractions and symbolism for categorized data. In this paper, we begin our study of visualization of image statistics by considering visual representations of power spectra, which are commonly used to visualize different categories of images. We show that they convey a limited amount of statistical information about image categories and their support for analytical tasks is ineffective. We then introduce several new visual representations, which convey different or more information about image statistics. We apply ANOVA to the image statistics to help select statistically more meaningful measurements in our design process. A task-based user evaluation was carried out to compare the new visual representations with the conventional power spectra plots. Based on the results of the evaluation, we made further improvement of visualizations by introducing composite visual representations of image statistics.

INDEX TERMS

Visualization, Histograms, Principal component analysis, Kernel, Spectral analysis, Data visualization, Image color analysis,visual design, Image statistics, image visualization, usability study

CITATION

Hui Fang, G. K-L Tam, R. Borgo, A. J. Aubrey, P. W. Grant, P. L. Rosin, C. Wallraven, D. Cunningham, D. Marshall, Min Chen, "Visualizing Natural Image Statistics",

*IEEE Transactions on Visualization & Computer Graphics*, vol.19, no. 7, pp. 1228-1241, July 2013, doi:10.1109/TVCG.2012.312REFERENCES

- [1] R. Buccigrossi and E. Simoncelli, “Image Compression via Joint Statistical Characterization in the Wavelet Domain,”
IEEE Trans. Image Processing, vol. 8, no. 12, pp. 1688-1701, Dec. 1999.- [2] N. Dalal and B. Triggs, “Histograms of Oriented Gradients for Human Detection,”
Proc. IEEE CS Conf. Computer Vision and Pattern Recognition (CVPR '05), pp. 886-893, 2005.- [3] J. Daugman, “Complete Discrete 2-D Gabor Transforms by Neural Networks for Image Analysis and Compression,”
IEEE Trans. Acoustics, Speech, and Signal Processing, vol. 36, no. 7, pp. 1169-1179, July 1988.- [4] O. Deussen and B. Lintermann,
Digital Design of Nature: Computer Generated Plants and Organics. Springer-Verlag, 2005.- [5] R.O. Dror, E.H. Adelson, and A.S. Willsky, “Surface Reflectance Estimation and Natural Illumination Statistics,”
Proc. IEEE Workshop Statistical and Computational Theories of Vision, 2001.- [6] R. Fergus, B. Singh, A. Hertzmann, S. Roweis, and W. Freeman, “Removing Camera Shake from a Single Photograph,”
ACM Trans. Graphics, vol. 25, pp. 787-794, 2006.- [7] D. Field, “Relations between the Statistics of Natural Images and the Response Profiles of Cortical Cells,”
J. Optical Soc. Am. A, vol. 4, pp. 2379-2394, 1987.- [8] W.S. Geisler, “Visual Perception and the Statistical Properties of Natural Scenes,”
Ann. Rev. Psychology, vol. 59, pp. 167-192, 2008.- [9] D.J. Graham and C. Redies, “Statistical Regularities in Art: Relations with Visual Coding and Perception,”
Vision Research, vol. 50, no. 16, pp. 1503-1509, 2010.- [10] I. Groen, S. Ghebreab, V. Lamme, and S. Scholte, “The Role of Weibull Image Statistics in Rapid Object Detection in Natural Scenes,”
J. Vision, vol. 10, no. 7, p. 992, 2010.- [11] S. Haroz and K.-L. Ma, “Natural Visualizations,”
Proc. IEEE Eurographics VGTC Symp. Visualization, pp. 43-50, 2006.- [12] J.M. Hughes, D.J. Graham, and D.N. Rockmore, “Quantification of Artistic Style through Sparse Coding Analysis in the Drawings of Pieter Bruegel the Elder,”
Proc. Nat'l Academy of Sciences USA, vol. 107, pp. 1279-1283, 2010.- [13] A. Hyvärinen, “Statistical Models of Natural Images and Cortical Visual Representation.”
Topics in Cognitive Science, vol. 2, no. 2, pp. 251-264, 2010.- [14] A. Hyvärinen and E. Oja, “Independent Component Analysis: Algorithms and Applications,”
Neural Networks, vol. 13, nos. 4/5, pp. 411-430, 2000.- [15] I.T. Jolliffe,
Principal Component Analysis. Springer-Verlag, 1986.- [16] N. Katsumata and Y. Matsuyama, “Database Retrieval for Similar Images Using ICA and PCA Bases,”
Eng. Applications of Artificial Intelligence, vol. 18, no. 2005, pp. 705-717, 2005.- [17] K. Kim, M. Franz, and B. Scholkopf, “Iterative Kernel Principal Component Analysis for Image Modeling,”
IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 9, pp. 1351-1366, Sept. 2005.- [18] A. Levin, A. Zomet, and Y. Weiss, “Learning How to Inpaint from Global Image Statistics,”
Proc. IEEE Int'l Conf. Computer Vision, pp. 305-312, 2003.- [19] R. MillerJr.,
Beyond ANOVA: Basics of Applied Statistics. Chapman & Hall/CRC, 1997.- [20] A. Oliva and A. Torralba, “Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope,”
Int'l J. Computer Vision, vol. 42, no. 3, pp. 145-175, 2001.- [21] A. Olshausen and D. Field, “Sparse Coding with an Overcomplete Basis Set: A Strategy Employed by V1?”
Vision Research, vol. 23, no. 37, pp. 3311-3325, Dec. 1997.- [22] J. Portilla and E.P. Simoncelli, “Image Denoising via Adjustment of Wavelet Coefficient Magnitude Correlation,”
Proc. Seventh Int'l Conf. Image Processing, 2000.- [23] T. Pouli, D. Cunningham, and E. Reinhard, “Image Statistics and Their Applications in Computer Graphics,”
Proc. EUROGRAPHICS, pp. 59-88, 2010.- [24] T. Pouli and E. Reinhard, “Progressive Color Transfer for Images of Arbitrary Dynamic Range,”
Computers and Graphics, vol. 35, no. 1, pp. 67-80, 2011.- [25] E. Reinhard, M. Ashikhmin, B. Gooch, and P. Shirley, “Color Transfer between Images,”
IEEE Computer Graphics and Applications, vol. 21, no. 5, pp. 34-41, Sept./Oct. 2001.- [26] E. Reinhard, P. Shirley, M. Ashikhmin, and T. Troscianko, “Second Order Image Statistics in Computer Graphics,”
Proc. First Symp. Applied Perception in Graphics and Visualization (APGV '04), pp. 99-106, 2004.- [27] E. Reinhard, P. Shirley, M. Ashikhmin, and T. Troscianko, “Second Order Image Statistics in Computer Graphics,”
Proc. First Symp. Applied Perception in Graphics and Visualization, 2004.- [28] E. Rosch, C. Mervis, W. Gray, D. Johnson, and P. Boyes-Braem, “Basic Objects in Natural Categories,”
Cognitive Psychology, vol. 8, pp. 382-439, 1976.- [29] M. Ross and A. Oliva, “Estimating Perception of Scene Layout Properties from Global Image Features,”
J. Vision, vol. 10, no. 2, pp. 1-25, 2010.- [30] A. Torralba, “Torralba Outdoor Scene Categorization Data Set,” http://people.csail.mit.edu/torralba/code spatialenvelope/, 2013.
- [31] A. Torralba and A. Oliva, “Depth Estimation From Image Structure,”
IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 9, pp. 1-13, Sept. 2002.- [32] A. Torralba and A. Oliva, “Statistics of Natural Image Categories,”
Network: Computation in Neural Systems, vol. 14, pp. 291-412, 2003.- [33] B. Tversky and K. Hemenway, “Categories of Scenes,”
Cognitive Psychology, vol. 15, pp. 121-149, 1983.- [34] A. van der Schaaf and J. van Hateren, “Modelling the Power Spectra of Natural Images: Statistics and Information,”
Vision Research, vol. 36, no. 17, pp. 2759-2770, 1996.- [35] H. Wickham, D. Cook, H. Hofmann, and A. Buja, “Graphical Inference for Infovis.”
IEEE Trans. Visualization and Computer Graphics, vol. 16, no. 6, pp. 973-979, Nov./Dec. 2010. |