This Article 
 Bibliographic References 
 Add to: 
A New Image Representation Algorithm Inspired by Image Submodality Models, Redundancy Reduction, and Learning in Biological Vision
September 2005 (vol. 27 no. 9)
pp. 1367-1378
We develop a new biologically motivated algorithm for representing natural images using successive projections into complementary subspaces. An image is first projected into an edge subspace spanned using an ICA basis adapted to natural images which captures the sharp features of an image like edges and curves. The residual image obtained after extraction of the sharp image features is approximated using a mixture of probabilistic principal component analyzers (MPPCA) model. The model is consistent with cellular, functional, information theoretic, and learning paradigms in visual pathway modeling. We demonstrate the efficiency of our model for representing different attributes of natural images like color and luminance. We compare the performance of our model in terms of quality of representation against commonly used basis, like the discrete cosine transform (DCT), independent component analysis (ICA), and principal components analysis (PCA), based on their entropies. Chrominance and luminance components of images are represented using codes having lower entropy than DCT, ICA, or PCA for similar visual quality. The model attains considerable simplification for learning from images by using a sparse independent code for representing edges and explicitly evaluating probabilities in the residual subspace.

[1] B.A. Olshausen and D.J. Field, “Sparse Coding with an Overcomplete Basis Set: A Strategy Employed by V1?” Vision Research, vol. 37, no. 23, pp. 3311-3325, 1997.
[2] R.S. Snell, Clinical Neuroanatomy for Medical Students, pp. 702-720. Philadelphia: Lippincott Williams and Wilkins, 1997.
[3] Neural Codes and Distributed Representations: Foundations of Neural Computation, L. Abbott and T.J. Sejnowski, eds. Cambridge, Mass.: MIT Press, 1999.
[4] J. Daugman, “Gabor Wavelets and Statistical Pattern Recognition,” The Handbook of Brain Theory and Neural Networks, second ed., M.A. Arbib, ed., pp. 457-463. Cambridge: MIT Press, 2003.
[5] H. Neumann and E. Mingolla, “Contour and Surface Perception,” The Handbook of Brain Theory and Neural Networks, second ed., M.A. Arbib, ed., pp. 271-276. Cambridge: MIT Press, 2003.
[6] H.B. Barlow, “Possible Principles Underlying the Transformations of Sensory Messages,” Sensory Comm., W.A. Rosenblith, ed., pp. 217-234. Cambridge: MIT Press, 1961.
[7] H.B. Barlow, “Unsupervised Learning,” Neural Computation, vol. 1, pp. 295-311, 1989.
[8] H.B. Barlow, “Redundancy Reduction Revisited,” Network: Computation in Neural Systems, vol. 12, pp. 241-253, 2001.
[9] J.A. McArthur and B. Moulden, “A Two-Dimensional Model of Brightness Perception Based on Spatial Filtering Consistent with Retinal Processing,” Vision Research, vol. 39, pp. 1199-1219, 1999.
[10] E.H. Land and J.J. McCann, “Lightness and Retinex Theory,” J. Optical Soc. Am., vol. 61, pp. 1-11, 1971.
[11] A. Hurlbert, “Formal Connections between Lightness Algorithms,” J. Optical Soc. Am., vol. 3, pp. 1684-1693, 1986.
[12] S. Grossberg and D. Todorovi, “Neural Dynamics of 1-D and 2-D Brightness Perception: A Unified Model of Classical and Recent Phenomena,” Perception & Psychophysics, vol. 43, pp. 723-742, 1988.
[13] M.A. Paradiso and K. Nakayama, “Brightness Perception and Filling-In,” Vision Research, vol. 39, pp. 1221-1236, 1991.
[14] R. Kentridge, C. Heywood, and J. Davidoff, “Color Perception,” The Handbook of Brain Theory and Neural Networks, second ed., M.A. Arbib, ed., pp. 230-233. Cambridge Mass.: MIT Press, 2003.
[15] A. Hyvärinen, J. Karhunen, and E. Oja, Independent Component Analysis. New York: John Wiley & Sons, 2001.
[16] A. Hyvärinen, “Fast ICA Matlab Package,” , Apr. 2003.
[17] A. Hyvärinen and P. Hoyer, “Emergence of Phase and Shift Invariant Features by Decomposition of Natural Images into Independent Feature Subspaces,” Neural Computation, vol. 12, no. 7, pp. 1705-1720, 2000.
[18] A. Hyvärinen, P.O. Hoyer, and M. Hinki, “Topographic Independent Component Analysis,” Neural Computation, vol. 13, no. 7, pp. 1527-1558, 2001.
[19] M. Tipping and C. Bishop, “Mixtures of Probabilistic Principal Component Analyzers,” Neural Computation, vol. 11, no. 2, pp. 443-482, 1999.
[20] I. Nabney and C. Bishop, “Netlab Neural Network Software,”, July 2003.
[21] R.C. Gonzalez and R.E. Woods, Digital Image Processing. Reading, Mass.: Addison Wesley, 1993.
[22] T.M. Cover and J.A. Thomas, Elements of Information Theory, pp. 12-49. New York: John Wiley & Sons, 1991.
[23] D.H. Ballard, An Introduction to Natural Computation, pp. 46-48. Cambridge, Mass.: MIT Press, 1999.
[24] N. Krüger, “Collinearity and Parallelism are Statistically Significant Second Order Relations of Complex Cell Responses,” Neural Processing Letters, vol. 8, pp. 117-129, 1998.
[25] W.S. Geisler, J.S. Perry, B.J. Super, and D.P. Gallogly, “Edge Co-Occurrence in Natural Images Predicts Contour Grouping Performance,” Vision Research, vol. 41, pp. 711-724, 2001.

Index Terms:
Index Terms- Computer vision, feature representation, statistical models, clustering algorithms, machine learning, color.
Nikhil Balakrishnan, Karthik Hariharakrishnan, Dan Schonfeld, "A New Image Representation Algorithm Inspired by Image Submodality Models, Redundancy Reduction, and Learning in Biological Vision," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 27, no. 9, pp. 1367-1378, Sept. 2005, doi:10.1109/TPAMI.2005.170
Usage of this product signifies your acceptance of the Terms of Use.