The Community for Technology Leaders
RSS Icon
Issue No.08 - Aug. (2013 vol.35)
pp: 1847-1871
N. Kruger , Maersk Mc-Kinney Moller Inst., Univ. of Southern Denmark, Odense, Denmark
P. Janssen , Lab. voor Neuroen Psychofysiologie, KU Leuven, Leuven, Belgium
S. Kalkan , Dept. of Comput. Eng., Middle East Tech. Univ., Ankara, Turkey
M. Lappe , Inst. for Psychol., Univ. of Munster, Munster, Germany
A. Leonardis , Fac. of Comput. & Inf. Sci., Univ. of Ljubljana, Ljubljana, Slovenia
J. Piater , Intell. & Interactive Syst. Group, Univ. of Innsbruck, Innsbruck, Austria
A. J. Rodriguez-Sanchez , Intell. & Interactive Syst. Group, Univ. of Innsbruck, Innsbruck, Austria
L. Wiskott , Inst. fur Neuroinformatik, Ruhr-Univ. Bochum, Bochum, Germany
Computational modeling of the primate visual system yields insights of potential relevance to some of the challenges that computer vision is facing, such as object recognition and categorization, motion detection and activity recognition, or vision-based navigation and manipulation. This paper reviews some functional principles and structures that are generally thought to underlie the primate visual cortex, and attempts to extract biological principles that could further advance computer vision research. Organized for a computer vision audience, we present functional principles of the processing hierarchies present in the primate visual system considering recent discoveries in neurophysiology. The hierarchical processing in the primate visual system is characterized by a sequence of different levels of processing (on the order of 10) that constitute a deep hierarchy in contrast to the flat vision architectures predominantly used in today's mainstream computer vision. We hope that the functional description of the deep hierarchies realized in the primate visual system provides valuable insights for the design of computer vision algorithms, fostering increasingly productive interaction between biological and computer vision research.
Visualization, Computer vision, Visual systems, Retina, Organizations, Neurons,biological modeling, Computer vision, deep hierarchies
N. Kruger, P. Janssen, S. Kalkan, M. Lappe, A. Leonardis, J. Piater, A. J. Rodriguez-Sanchez, L. Wiskott, "Deep Hierarchies in the Primate Visual Cortex: What Can We Learn for Computer Vision?", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.35, no. 8, pp. 1847-1871, Aug. 2013, doi:10.1109/TPAMI.2012.272
[1] Y. Amit, 2D Object Detection and Recognition: Models, Algorithms and Networks. MIT Press, 2002.
[2] Y. Amit and D. Geman, "A Computational Model for Visual Selection," Neural Computation, vol. 11, no. 7, pp. 1691-1715, 1999.
[3] R. Andersen, A. Batista, L. Snyder, C. Buneo, and Y. Cohen, "Programming to Look and Reach in the Posterior Parietal Cortex," The New Cognitive Neurosciences, M. Gazzaniga, ed., chapter 36, second ed., pp. 515-524, MIT Press, 2000.
[4] R. Andersen and V.B. Mountcastle, "The Influence of the Angle of Gaze upon the Excitability of the Light-Sensitive Neurons of the Posterior Parietal Cortex," J. Neuroscience, vol. 3, no. 3, pp. 532-548, 1983.
[5] A. Anzai, S. Chowdhury, and G. DeAngelis, "Coding of Stereoscopic Depth Information in Visual Areas V3 and V3a," J. Neuroscience, vol. 31, no. 28, pp. 10270-10282, 2011.
[6] L. Bazzani, N. Freitas, H. Larochelle, V. Murino, and J.-A. Ting, "Learning Attentional Policies for Tracking and Recognition in Video with Deep Networks," Proc. 28th Int'l Conf. Machine Learning, pp. 937-944, L. Getoor and T. Scheffer, eds., June 2011.
[7] S. Becker and G.E. Hinton, "A Self-Organizing Neural Network that Discovers Surfaces in Random-Dot Stereograms," Nature, vol. 355, no. 6356, pp. 161-163, 1992.
[8] A.J. Bell and T.J. Sejnowski, "The 'Independent Components' of Natural Scenes Are Edge Filters," Vision Research, vol. 37, no. 23, pp. 3327-3338, 1997.
[9] Y. Bengio, "Learning Deep Architectures for AI," Foundations and Trends in Machine Learning, vol. 2, no. 1, pp. 1-127, 2009.
[10] P. Berkes and L. Wiskott, "Slow Feature Analysis Yields a Rich Repertoire of Complex Cell Properties," J. Vision, vol. 5, no. 6, pp. 579-602,, 2005, doi:10.1167/5.6.9.
[11] J.W. Bisley and M.E. Goldberg, "Attention, Intention, and Priority in the Parietal Lobe," Ann. Rev. Neuroscience, vol. 33, pp. 1-21, 2010.
[12] E. Borra, A. Belmalih, R. Calzavara, M. Gerbella, A. Murata, S. Rozzi, and G. Luppino, "Cortical Connections of the Macaque Anterior Intraparietal (AIP) Area," Cerebral Cortex, vol. 18, no. 5 pp. 1094-1111, 2008.
[13] J. Bowmaker and H. Dartnall, "Visual Pigments of Rods and Cones in a Human Retina," J. Physiology, vol. 298, pp. 501-511, 1980.
[14] D.C. Bradley, G.C. Chang, and R.A. Andersen, "Encoding of Three-Dimensional Structure-from-Motion by Primate Area MT Neurons," Nature, vol. 392, pp. 714-717, 1998.
[15] F. Bremmer, M. Kubischik, M. Pekel, M. Lappe, and K.-P. Hoffmann, "Linear Vestibular Self-Motion Signals in Monkey Medial Superior Temporal Area," Ann. New York Academy of Sciences, vol. 871, pp. 272-281, 1999.
[16] M. Brown, D. Burschka, and G. Hager, "Advances in Computational Stereo," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, no. 8, pp. 993-1008, Aug. 2003.
[17] E. Brunswik and J. Kamiya, "Ecological Cue-Validity of 'Proximity' and of Other Gestalt Factors," Am. J. Psychologie, vol. 66, pp. 20-32, 1953.
[18] D. Calow, N. Krüger, F. Wörgötter, and M. Lappe, "Biologically Motivated Space-Variant Filtering for Robust Optic Flow Processing," Network, vol. 16, no. 4, pp. 323-340, 2005.
[19] M. Carandini and D.J. Heeger, "Normalization as a Canonical Neural Computation," Nature Neuroscience, vol. 13, pp. 51-62, 2012.
[20] M.S. Caywood, B. Willmore, and D.J. Tolhurst, "Independent Components of Color Natural Scenes Resemble V1 Neurons in Their Spatial and Color Tuning," J. Neurophysiology, vol. 91, no. 6, pp. 2859-2873, June 2004.
[21] C. Colby and M. Goldberg, "Space and Attention in Parietal Cortex," Ann. Rev. Neuroscience, vol. 22, no. 1, pp. 319-349, 1999.
[22] B. Conway, "Spatial Structure of Cone Inputs to Color Cells in Alert Macaque Primary Visual cortex (V-1)," The J. Neuroscience, vol. 21, no. 8, pp. 2768-2783, 2001.
[23] B.R. Conway, "Color Vision, Cones, and Color-Coding in the Cortex," Neuroscientist, vol. 15, pp. 274-290, June 2009.
[24] B.R. Conway, S. Moeller, and D.Y. Tsao, "Specialized Color Modules in Macaque Extrastriate Cortex," Neuron, vol. 56, pp. 560-573, Nov. 2007.
[25] H. Cui and R. Andersen, "Posterior Parietal Cortex Encodes Autonomously Selected Motor Plans," Neuron, vol. 56, no. 3, pp. 552-559, 2007.
[26] B. Cumming and A. Parker, "Responses of Primary Visual Cortical Neurons to Binocular Disparity without Depth Perception," Nature, vol. 389, no. 6648, pp. 280-283, 1997.
[27] B. Cumming and A. Parker, "Binocular Neurons in V1 of Awake Monkeys Are Selective for Absolute, Not Relative, Disparity," J. Neuroscience, vol. 19, no. 13, pp. 5602-5618, 1999.
[28] C. Curcio and K. Allen, "Topography of Ganglion Cells in Human Retina," J. Comparative Neurology, vol. 300, no. 1 pp. 5-25, 1990.
[29] J. Daugman, "Complete Discrete 2-D Gabor Transforms by Neural Networks for Image Analysis and Compression," IEEE Trans. Acoustics, Speech, and Signal Processing, vol. 36, no. 7 pp. 1169-1179, July 1988.
[30] G.C. De Angelis, B.G. Cumming, and W.T. Newsome, "Cortical Area MT and the Perception of Stereoscopic Depth," Nature, vol. 394, pp. 677-680, 1998.
[31] J.J. DiCarlo and D.D. Cox, "Untangling Invariant Object Recognition," Trends in Cognitive Sciences, vol. 11, no. 8, pp. 333-341, 2007.
[32] S. Dickinson, "The Evolution of Object Categorization and the Challenge of Image Abstraction," Object Categorization: Computer and Human Vision Perspectives, S. Dickinson, A. Leonardis, B. Schiele, and M.J. Tarr, eds., pp. 1-37, Cambridge Univ. Press, 2009.
[33] Y. Dong, S. Mihalas, F. Qiu, R. von der Heydt, and E. Niebur, "Synchrony and the Binding Problem in Macaque Visual Cortex," J. Vision, vol. 8, no. 7,article 30, 2008.
[34] C.J. Duffy and R.H. Wurtz, "Sensitivity of MST Neurons to Optic Flow Stimuli. II. Mechanisms of Response Selectivity Revealed by Small-Field Stimuli," J. Neurophysiology, vol. 65, pp. 1346-1359, 1991.
[35] J. Duhamel, F. Bremmer, S. BenHamed, and W. Graf, "Spatial Invariance of Visual Receptive Fields in Parietal Cortex Neurons," Nature, vol. 389, no. 6653, pp. 845-848, 1997.
[36] J. Duhamel, C. Colby, and M. Goldberg, "The Updating of the Representation of Visual Space in Parietal Cortex by Intended Eye Movements," Science, vol. 255, no. 5040 pp. 90-92, 1992.
[37] M.R. Dürsteler and R.H. Wurtz, "Pursuit and Optokinetic Deficits Following Chemical Lesions of Cortical Areas MT and MST," J. Neurophysiology, vol. 60, pp. 940-965, 1988.
[38] W. Einhäuser, C. Kayser, P. König, and K.P. Körding, "Learning the Invariance Properties of Complex Cells from Their Responses to Natural Stimuli," Euro J. Neuroscience, pp. 475-486, Feb. 2002.
[39] J.H. Elder, "Are Edges Incomplete?" Int'l J. Computer Vision, vol. 34, pp. 97-122, 1999.
[40] A. Engel, P. Roelfsema, P. Fries, M. Brecht, and W. Singer, "Role of the Temporal Domain for Response Selection and Perceptual Binding," Cerebral Cortex, vol. 7, no. 6, pp. 571-582, 1997.
[41] R.G. Erickson and P. Thier, "A Neuronal Correlate of Spatial Stability during Periods of Self-Induced Visual Motion," Experimental Brain Research, vol. 86, pp. 608-616, 1991.
[42] G.J. Ettinger, "Hierarchical Object Recognition Using Libraries of Parameterized Model Sub-Parts," technical report, MIT, 1987.
[43] F. Fang, H. Boyaci, and D. Kersten, "Border Ownership Selectivity in Human Early Visual Cortex and Its Modulation by Attention," J. Neuroscience, vol. 29, no. 2, pp. 460-465, 2009.
[44] D. Felleman and D.V. Essen, "Distributed Hierarchical Processing in Primate Cerebral Cortex," Cerebral Cortex, vol. 1, pp. 1-47, 1991.
[45] S. Fidler, M. Boben, and A. Leonardis, "Similarity-Based Cross-Layered Hierarchical Representation for Object Categorization," Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, 2008.
[46] S. Fidler, M. Boben, and A. Leonardis, "Learning Hierarchical Compositional Representations of Object Structure," Object Categorization: Computer and Human Vision Perspectives, S. Dickinson, A. Leonardis, B. Schiele, and M.J. Tarr, eds., pp. 196-215, Cambridge Univ. Press, 2009.
[47] G. Finlayson and S. Hordley, "Color Constancy at a Pixel," J. Optical Soc. Am. A, vol. 18, pp. 253-264, 2001.
[48] I.M. Finn and D. Ferster, "Computational Diversity in Complex Cells of Cat Primary Visual Cortex," J. Neuroscience, vol. 27, no. 36, pp. 9638-9648, 2007.
[49] D.J. Fleet, A.D. Jepson, and M.R. Jenkin, "Phase-Based Disparity Measurement," CVGIP: Image Understanding, vol. 53, no. 2, pp. 10, 1991.
[50] D.J. Fleet, H. Wagner, and D.J. Heeger, "Neural Encoding of Binocular Disparity: Energy Models, Position Shifts and Phase Shifts," Vision Research, vol. 36, no. 12, pp. 1839-1857, June 1996.
[51] M. Franzius, N. Wilbert, and L. Wiskott, "Invariant Object Recognition and Pose Estimation with Slow Feature Analysis," Neural Computation, vol. 23, no. 9, pp. 2289-2323, 2011.
[52] D. Freedman and J. Assad, "Experience-Dependent Representation of Visual Categories in Parietal Cortex," Nature, vol. 443, no. 5502, pp. 85-88, 2006.
[53] D. Freedman, M. Riesenhuber, T. Poggio, and E. Miller, "Categorical Representation of Visual Stimuli in the Primate Prefrontal Cortex," Science, vol. 291, no. 5502, pp. 312-316, 2001.
[54] K. Fukushima, S. Miyake, and T. Ito, "Neocognitron: A Neural Network Model for a Mechanism of Visual Pattern Recognition," IEEE Systems, Man, and Cybernetics, vol. 13, no. 3, pp. 826-834, Sept./Oct. 1983.
[55] A. Gail and R. Andersen, "Neural Dynamics in Monkey Parietal Reach Region Reflect Context-Specific Sensorimotor Transformations," J. Neuroscience, vol. 26, no. 37, pp. 9376-9384, 2006.
[56] V. Gallese, A. Murata, M. Kaseda, N. Niki, and H. Sakata, "Deficit of Hand Preshaping after Muscimol Injection in Monkey Parietal Cortex," Neuroreport, vol. 5, no. 12, pp. 1525-1529, 1994.
[57] C. Galletti, P.P. Battaglini, and P. Fattori, "'Real-Motion' Cells in Area V3a of Macaque Visual Cortex," Experimental Brain Research, vol. 82, pp. 67-76, 1990.
[58] I. Gauthier, P. Skudlarski, J.C. Gore, and A.W. Anderson, "Expertise for Cars and Birds Recruits Brain Areas Involved in Face Recognition," Nature Neuroscience, vol. 3, no. 2, pp. 191-197, 2000.
[59] S. Geman, "Hierarchy in Machine and Natural Vision," Proc. 11th Scandinavian Conf. Image Analysis, 1999.
[60] S. Geman, D. Potter, and Z. Chi, "Composition Systems," Quarterly of Applied Math., vol. 60, no. 4, pp. 707-736, 2002.
[61] J. Gibson, "The Perception of Visual Surfaces," Am. J. Psychology, vol. 63, pp. 367-384, 1950.
[62] C. Gilbert and W. Li, "Adult Visual Cortical Plasticity," Neuron, vol. 75, no. 2, pp. 250-264, 2012.
[63] I. Gödecke and T. Bonhoeffer, "Development of Identical Orientation Maps for Two Eyes without Common Visual Experience," Nature, vol. 379, pp. 251-255, 1996.
[64] M.A. Goodale and A.D. Milner, "Separate Visual Pathways for Perception and Action," Trends Neuroscience, vol. 15, no. 1, pp. 20-25, 1992.
[65] J.P. Gottlieb, M. Kusunoki, and M.E. Goldberg, "The Representation of Visual Salience in Monkey Parietal Cortex," Nature, vol. 391, pp. 481-484, 1998.
[66] E. Gould, A. Reeves, M. Graziano, and C. Gross, "Neurogenesis in the Neocortex of Adult Primates," Science, vol. 286, no. 5439, pp. 548-552, 1999.
[67] Y. Gu, P. Watkins, D. Angelaki, and G. DeAngelis, "Visual and Nonvisual Contributions to Three-Dimensional Heading Selectivity in the Medial Superior Temporal Area," J. Neuroscience, vol. 26, no. 1, pp. 73-85, 2006.
[68] M. Hawken and A. Parker, "Spatial Properties of Neurons in the Monkey Striate Cortex," Proc. Royal Soc. London, Series B, Biological Sciences, vol. 231, pp. 251-288, 1987.
[69] J. Hawkins and S. Blakeslee, On Intelligence. Times Books, 2004.
[70] D. Hinkle et al., "Three-Dimensional Orientation Tuning in Macaque Area v4," Nature Neuroscience, vol. 5, no. 7, pp. 665-670, 2002.
[71] I. Howard and B.J. Rogers, Seeing in Depth, Vol. 1: Basic Mechanisms. Univ. of Toronto Press, 2002.
[72] D. Hubel and T. Wiesel, "Receptive Fields, Binocular Interaction and Functional Architecture in the Cat's Visual Cortex," J. Phyiology, vol. 160, pp. 106-154, 1962.
[73] D. Hubel and T. Wiesel, "Receptive Fields and Functional Architecture of Monkey Striate Cortex," J. Physiology, vol. 195, no. 1, pp. 215-243, 1968.
[74] C. Hung, G. Kreiman, T. Poggio, and J. DiCarlo, "Fast Readout of Object Identity from Macaque Inferior Temporal Cortex," Science, vol. 310, no. 5749, pp. 863-866, 2005.
[75] M. Ito, H. Tamura, I. Fujita, and K. Tanaka, "Size and Position Invariance of Neuronal Responses in Monkey Inferotemporal Cortex," J. Neurophysiology, vol. 73, no. 1, pp. 218-226, Jan. 1995.
[76] P. Janssen and M. Shadlen, "A Representation of the Hazard Rate of Elapsed Time in Macaque Area Lip," Nature Neuroscience, vol. 8, no. 2, pp. 234-241, 2005.
[77] P. Janssen, R. Vogels, Y. Liu, and G. Orban, "Macaque Inferior Temporal Neurons Are Selective for Three-Dimensional Boundaries and Surfaces," J. Neuroscience, vol. 21, no. 23, pp. 9419-9429, 2001.
[78] P. Janssen, R. Vogels, Y. Liu, and G. Orban, "At Least at the Level of Inferior Temporal Cortex, the Stereo Correspondence Problem Is Solved," Neuron, vol. 37, no. 4, pp. 693-701, 2003.
[79] P. Janssen, R. Vogels, and G. Orban, "Macaque Inferior Temporal Neurons Are Selective for Disparity-Defined Three-Dimensional Shapes," Proc. Nat'l Academy of Sciences, vol. 96, no. 14 p. 8217, 1999.
[80] P. Janssen, R. Vogels, and G. Orban, "Selectivity for 3D Shape that Reveals Distinct Areas within Macaque Inferior Temporal Cortex," Science, vol. 288, no. 5473, pp. 2054-2056, 2000.
[81] P. Janssen, R. Vogels, and G. Orban, "Three-Dimensional Shape Coding in Inferior Temporal Cortex," Neuron, vol. 27, no. 2, pp. 385-397, 2000.
[82] J. Jones and L. Palmer, "An Evaluation of the Two Dimensional Gabor Filter Model of Simple Receptive Fields in Striate Cortex," J. Neurophysiology, vol. 58, no. 6, pp. 1223-1258, 1987.
[83] B. Julesz, Foundations of Cyclopean Perception. Univ. Chicago Press, 1971.
[84] Principles of Neural Science, E.R. Kandel, J.H. Schwartz, and T.M. Jessel eds., fourth ed. McGraw-Hill, 2000.
[85] N. Kanwisher, J. McDermott, and M.M. Chun, "The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception," J. Neuroscience, vol. 17, no. 11, pp. 4302-4311, 1997.
[86] N. Katsuyama, A. Yamashita, K. Sawada, T. Naganuma, H. Sakata, and M. Taira, "Functional and Histological Properties of Caudal Intraparietal Area of Macaque Monkey," Neuroscience, vol. 167, no. 1, pp. 1-10, 2010.
[87] P. Kellman and M. Arterberry, The Cradle of Knowledge. MIT Press, 1998.
[88] R. Kiani, H. Esteky, K. Mirpour, and K. Tanaka, "Object Category Structure in Response Patterns of Neuronal Population in Monkey Inferior Temporal Cortex," J. Neurophysiology, vol. 97, no. 6, pp. 4296-4309, 2007.
[89] C. Koch, Biophysics of Computation: Information Processing in Single Neurons. Oxford Univ. Press, 1999.
[90] K. Koffka, Principles of Gestalt Psychology. Routledge, 1955.
[91] P. König and N. Krüger, "Perspectives: Symbols as Self-Emergent Entities in an Optimization Process of Feature Extraction and Predictions," Biological Cybernetics, vol. 94, no. 4, pp. 325-334, 2006.
[92] K. Köteles, P. De Maziere, M. Van Hulle, G. Orban, and R. Vogels, "Coding of Images of Materials by Macaque Inferior Temporal Cortical Neurons," European J. Neuroscience, vol. 27, no. 2, pp. 466-482, 2008.
[93] Z. Kourtzi and J.J. DiCarlo, "Learning and Neural Plasticity in Object Recognition," Current Opinion Neurobiology, vol. 16, pp. 152-158, Apr. 2006.
[94] R.J. Krauzlis and S.G. Lisberger, "A Model of Visually-Guided Smooth Pursuit Eye Movements Based on Behavioral Observations," J. Computational Neuroscience, vol. 1, no. 4, pp. 265-283, 1994.
[95] J. Kremers, The Primate Visual System: A Comparative Approach. Wiley, 2005.
[96] K. Krug, B. Cumming, and A. Parker, "Comparing Perceptual Signals of Single V5/MT Neurons in Two Binocular Depth Tasks," J. Neurophysiology, vol. 92, no. 3, pp. 1586-1596, 2004.
[97] K. Krug and A. Parker, "Neurons in Dorsal Visual Area V5/MT Signal Relative Disparity," J. Neuroscience, vol. 31, no. 49, pp. 17892-17904, 2011.
[98] V. Lamme et al., "Neuronal Synchrony Does Not Represent Texture Segregation," Nature, vol. 396, no. 6709, pp. 362-366, 1998.
[99] M. Lappe, "Functional Consequences of an Integration of Motion and Stereopsis in Area MT of Monkey Extrastriate Visual Cortex," Neural Computation, vol. 8, no. 7, pp. 1449-1461, 1996.
[100] M. Lappe, F. Bremmer, M. Pekel, A. Thiele, and K.P. Hoffmann, "Optic Flow Processing in Monkey STS: A Theoretical and Experimental Approach," J. Neuroscience, vol. 16, no. 19, pp. 6265-6285, 1996.
[101] Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner, "Gradient-Based Learning Applied to Document Recognition," Proc. IEEE, vol. 86, no. 11, pp. 2278-2324, Nov. 1998.
[102] T. Lee and D. Mumford, "Hierarchical Bayesian Inference in the Visual Cortex," J. Optical Soc. Am., vol. 20, no. 7, pp. 1434-1448, 2003.
[103] J. Lewis and D. Van Essen, "Corticocortical Connections of Visual, Sensorimotor, and Multimodal Processing Areas in the Parietal Lobe of the Macaque Monkey," J. Comparative Neurology, vol. 428, no. 1, pp. 112-137, 2000.
[104] N. Li and J. DiCarlo, "Unsupervised Natural Visual Experience Rapidly Reshapes Size-Invariant Object Representation in Inferior Temporal Cortex," Neuron, vol. 67, no. 6, pp. 1062-1075, 2010.
[105] S. Li, S.D. Mayhew, and Z. Kourtzi, "Learning Shapes Spatiotemporal Brain Patterns for Flexible Categorical Decisions," Cerebral Cortex, to be published, 2011.
[106] M.S. Livingstone, C.C. Pack, and R.T. Born, "Two-Dimensional Substructure of MT Receptive Fields," Neuron, vol. 30, no. 3, pp. 781-793, 2001.
[107] D.G. Lowe, "Distinctive Image Features from Scale-Invariant Keypoints," Int'l J. Computer Vision, vol. 2, no. 60, pp. 91-110, 2004.
[108] B. Manjunath and W. Ma, "Texture Features for Browsing and Retrieval of Image Data," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 18, no. 8, pp. 837-842, Aug. 1996.
[109] D. Marr, Vision: A Computational Investigation into the Human Representation and Processing of Visual information. Freeman, 1977.
[110] G. Masson, C. Busettini, and F. Miles, "Vergence Eye Movements in Response to Binocular Disparity without Depth Perception," Nature, vol. 389, no. 6648, pp. 283-286, 1997.
[111] T. Matsumora, K. Koida, and H. Komatsu, "Relationship between Color Discrimination and Neural Responses in the Inferior Temporal Cortex of the Monkey," J. Neurophysiology, vol. 100, no. 6, pp. 3361-3374, 2008.
[112] J.H.R. Maunsell and D.C. van Essen, "Functional Properties of Neurons in Middle Temporal Visual Area of the Macaque Monkey. I. Selectivity for Stimulus Direction, Speed, and Orientation," J. Neurophysiology, vol. 49, no. 5, pp. 1127-1147, 1983.
[113] S.D. Mayhew, S. Li, and Z. Kourtzi, "Learning Acts on Distinct Processes for Visual Form Perception in the Human Brain," J. Neuroscience, vol. 32, no. 3, pp. 775-786, 2012.
[114] B.W. Mel and J. Fiser, "Minimizing Binding Errors Using Learned Conjunctive Features," Neural Computation, vol. 12, no. 4, pp. 731-762, 2000.
[115] B.W. Mel, D.L. Ruderman, and K.A. Archie, "Translation-Invariant Orientation Tuning in Visual 'Complex' Cells Could Derive from Intradendritic Computations," J. Neuroscience, vol. 18, no. 11, pp. 4325-4334, 1998.
[116] K. Mikolajczyk and C. Schmid, "A Performance Evaluation of Local Descriptors," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 10, pp. 1615-1630, Oct. 2005.
[117] J.A. Movshon, E.H. Adelson, M.S. Gizzi, and W.T. Newsome, "The Analysis of Moving Visual Patterns," Pattern Recognition Mechanisms, C. Chagas, R. Gattass, and C. Gross, eds., pp. 117-151, Springer, 1985.
[118] J.A. Movshon and W.T. Newsome, "Visual Response Properties of Striate Cortical Neurons Projecting to Area MT in Macaque Monkeys," J. Neuroscience, vol. 16, no. 23, pp. 7733-7741, 1996.
[119] R. Mruczek and D. Sheinberg, "Activity of Inferior Temporal Cortical Neurons Predicts Recognition Choice Behavior and Recognition Time during Visual Search," J. Neuroscience, vol. 27, no. 11, pp. 2825-2836, 2007.
[120] A. Murata, V. Gallese, G. Luppino, M. Kaseda, and H. Sakata, "Selectivity for the Shape, Size, and Orientation of Objects for Grasping in Neurons of Monkey Parietal Area AIP," J. Neurophysiology, vol. 83, no. 5, pp. 2580-2601, 2000.
[121] H. Nakamura, T. Kuroda, M. Wakita, M. Kusunoki, A. Kato, A. Mikami, H. Sakata, and K. Itoh, "From Three-Dimensional Space Vision to Prehensile Hand Movements: The Lateral Intraparietal Area Links the Area V3a and the Anterior Intraparietal Area in Macaques," J. Neuroscience, vol. 21, no. 20, pp. 8174-8187, 2001.
[122] W.T. Newsome, R.H. Wurtz, and H. Komatsu, "Relation of Cortical Areas MT and MST to Pursuit Eye Movements. II. Differentiation of Retinal from Extraretinal Inputs," J. Neurophysiology, vol. 60, no. 2, pp. 604-620, 1988.
[123] J. Nguyenkim and G. DeAngelis, "Disparity-Based Coding of Three-Dimensional Surface Orientation by Macaque Middle Temporal Neurons," J. Neuroscience, vol. 23, no. 18, pp. 7117-7128, 2003.
[124] A. Oliva and A. Torralba, "The Role of Context in Object Recognition," Trends Cognitive Sciences, vol. 11, pp. 520-527, 2007.
[125] B.A. Olshausen and D.J. Field, "Emergence of Simple-Cell Receptive Field Properties by Learning a Sparse Code for Natural Images," Nature, vol. 381, no. 6583, pp. 607-609, June 1996.
[126] B. Ommer and J.M. Buhmann, "Learning the Compositional Nature of Visual Objects," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2007.
[127] G.A. Orban, "Higher Order Visual Processing in Macaque Extrastriate Cortex," Physiological Rev., vol. 88, pp. 59-89, Jan. 2008.
[128] C. Pack, M.S. Livingstone, K. Duffy, and R. Born, "End-Stopping and the Aperture Problem: Two-Dimensional Motion Signals in Macaque V1," Neuron, vol. 39, pp. 671-680, 2003.
[129] C.C. Pack and R.T. Born, "Temporal Dynamics of a Neural Solution to the Aperture Problem in Visual Area MT of Macaque Brain," Nature, vol. 409, no. 6823, pp. 1040-1042, 2001.
[130] A. Parker, "Binocular Depth Perception and the Cerebral Cortex," Nature Rev. Neuroscience, vol. 8, no. 5, pp. 379-391, 2007.
[131] A. Pasupathy and C. Connor, "Responses to Contour Features in Macaque Area V4," J. Neurophysiology, vol. 82, no. 5 pp. 2490-2502, 1999.
[132] M. Pekel, M. Lappe, F. Bremmer, A. Thiele, and K.-P. Hoffmann, "Neuronal Responses in the Motion Pathway of the Macaque Monkey to Natural Optic Flow Stimuli," NeuroReport, vol. 7, no. 4, pp. 884-888, 1996.
[133] J.A. Perrone and A. Thiele, "Speed Skills: Measuring the Visual Speed Analyzing Properties of Primate MT Neurons," Nature Neuroscience, vol. 4, no. 5, pp. 526-532, 2001.
[134] B. Pesaran, M. Nelson, and R. Andersen, "Free Choice Activates a Decision Circuit between Frontal and Parietal Cortex," Nature, vol. 453, no. 7193, pp. 406-409, 2008.
[135] R. Peters, A. Iyer, L. Itti, and C. Koch, "Components of Bottom-Up Gaze Allocation in Natural Images," Int'l J. Neural Systems, vol. 45, no. 18, pp. 2397-2416, 2005.
[136] M. Platt and P. Glimcher, "Neural Correlates of Decision Variables in Parietal Cortex," Nature, vol. 400, no. 6741, pp. 233-238, 1999.
[137] A. Pouget and T.J. Sejnowski, "Spatial Transformations in the Parietal Cortex Using Basis Functions," J. Coginitive Neuroscience, vol. 9, no. 2, pp. 222-237, 1997.
[138] R.Q. Quiroga, L. Reddy, C. Koch, and I. Fried, "Decoding Visual Inputs from Multiple Neurons in the Human Temporal Lobe," J Neurophysiology, vol. 98, no. 4, pp. 1997-2007, 2007.
[139] S. Raiguel, R. Vogels, S. Mysore, and G. Orban, "Learning to See the Difference Specifically Alters the Most Informative V4 Neurons," J. Neuroscience, vol. 26, no. 24, pp. 6589-6602, 2006.
[140] M. Riesenhuber and T. Poggio, "Hierarchical Models of Object Recognition in Cortex," Nature Neuroscience, vol. 11, no. 2, pp. 1019-1025, 1999.
[141] K. Rockland, J. Kaas, and A. Peters, Cerebral Cortex: Extrastriate Cortex in Primates, vol. 12. Springer, 1997.
[142] A. Rodríguez-Sánchez, E. Simine, and J. Tsotsos, "Attention and Visual Search," Int'l J. Neural Systems, vol. 17, no. 4, pp. 275-288, 2007.
[143] A.J. Rodriguez-Sanchez and J.K. Tsotsos, "The Importance of Intermediate Representations for the Modeling of 2D Shape Detection: Endstopping and Curvature Tuned Computations," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 4321-4326, 2011.
[144] A.J. Rodriguez-Sanchez and J.K. Tsotsos, "The Roles of Endstopped and Curvature Tuned Computations in a Hierarchical Representation of 2D Shape," PLoS ONE, vol. 7, no. 8, pp. 1-13, 2012.
[145] P. Roelfsema, "Solutions for the Binding Problem," Zeitschrift für Naturforschung. C, J. Biosciences, vol. 53, no. 7/8, pp. 691-715, 1998.
[146] E. Rolls, B. Webb, and M.C.A. Booth, "Responses of Inferior Temporal Cortex Neurons to Objects in Natural Scenes," Soc. Neuroscience Abstracts, vol. 26, p. 1331, 2000.
[147] J.-P. Roy and R.H. Wurtz, "Disparity Sensitivity of Neurons in Monkey Extrastriate Area MST," J. Neuroscience, vol. 12, no. 7, pp. 2478-2492, 1992.
[148] N. Rust, O. Schwartz, J. Movshon, and E. Simoncelli, "Spike-Triggered Characterization of Excitatory and Suppressive Stimulus Dimensions in Monkey V1," Neurocomputing, vol. 58, pp. 793-799, 2004.
[149] U. Rutishauser, R.J. Douglas, and J.J. Slotine, "Collective Stability of Networks of Winner-Take-All Circuits," Neural Computation, vol. 23, no. 3, pp. 735-773, 2011.
[150] H. Sakata, M. Taira, M. Kusunoki, A. Murata, and Y. Tanaka, "The Parietal Association Cortex in Depth Perception and Visual Control of Hand Action," Trends in Neurosciences, vol. 20, no. 8, pp. 350-357, 1997.
[151] C.D. Salzman, K.H. Britten, and W.T. Newsome, "Cortical Microstimulation Influences Perceptual Judgements of Motion Direction," Nature, vol. 346, no. 12, pp. 174-177, 1990.
[152] F. Scalzo and J.H. Piater, "Statistical Learning of Visual Feature Hierarchies," Proc. IEEE Workshop Learning Computer Vision and Pattern Recognition, 2005.
[153] C.E. Stern and H.E. Schendan, "Mental Rotation and Object Categorization Share a Common Network of Prefrontal and Dorsal and Ventral Regions of Posterior Cortex," Neuroimage, vol. 35, pp. 1264-1277, 2007.
[154] A. Schoups, R. Vogels, N. Qian, and G. Orban, "Practising Orientation Identification Improves Orientation Coding in V1 Neurons," Nature, vol. 412, no. 6846, pp. 549-53, 2001.
[155] A. Sereno and J. Maunsell, "Shape Selectivity in Primate Lateral Intraparietal Cortex," Nature, vol. 395, no. 6701, pp. 500-503, 1998.
[156] T. Serre and A.T. Poggio, "Neuromorphic Approach to Computer Vision," Comm. ACM, vol. 53, pp. 54-61, 2010.
[157] T. Serre, L. Wolf, S. Bileschi, M. Riesenhuber, and T. Poggio, "Object Recognition with Cortex-Like Mechanisms," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 29, no. 3, pp. 411-426, Mar. 2007.
[158] M. Shadlen and J. Movshon, "Synchrony Unbound: Review a Critical Evaluation of the Temporal Binding Hypothesis," Neuron, vol. 24, pp. 67-77, 1999.
[159] M. Shadlen and W. Newsome, "Motion Perception: Seeing and Deciding," Proc. Nat'l Academy of Sciences, vol. 93, no. 2 pp. 628-633, 1996.
[160] R. Shapley and M.J. Hawken, "Color in the Cortex: Single- and Double-Opponent Cells," Vision Research, vol. 51, no. 7, pp. 701-717, Apr. 2011.
[161] X. Shi, N. Bruce, and J.K. Tsotsos, "Fast, Recurrent, Attentional Modulation Improves Saliency Representation and Scene Recognition," Proc. IEEE Conf. Computer Vision and Pattern Recognition Workshop Biologically-Consistent Vision, pp. 1-8, 2011.
[162] E. Shikata et al., "Selectivity of the Parietal Visual Neurones in 3D Orientation of Surface of Stereoscopic Stimuli," Neuroreport, vol. 7, no. 14, pp. 2389-2394, 1996.
[163] E. Simoncelli, "Vision and the Statistics of the Visual Environment," Current Opinion in Neurobiology, vol. 13, no. 2, pp. 144-149, 2003.
[164] E.P. Simoncelli and D.J. Heeger, "A Model of Neuronal Responses in Visual Area MT," Vision Research, vol. 38, no. 5, pp. 743-761, 1998.
[165] W. Singer, "Consciousness and the Binding Problem," Ann. New York Academy of Sciences, vol. 929, no. 1, pp. 123-146, 2001.
[166] H. Spitzer and S. Hochstein, "A Complex-Cell Receptive-Field Model," J. Neurophysiology, vol. 53, no. 5, pp. 1266-1286, 1985.
[167] S. Srivastava, G. Orban, P. De Mazière, and P. Janssen, "A Distinct Representation of Three-Dimensional Shape in Macaque Anterior Intraparietal Area: Fast, Metric, and Coarse," J. Neuroscience, vol. 29, no. 34, pp. 10613-10626, 2009.
[168] S. Swaminathan and D. Freedman, "Preferential Encoding of Visual Categories in Parietal Cortex Compared with Prefrontal Cortex," Nature Neuroscience, vol. 15, pp. 315-320, 2012.
[169] M. Taira, K. Tsutsui, M. Jiang, K. Yara, and H. Sakata, "Parietal Neurons Represent Surface Orientation from the Gradient of Binocular Disparity," J. Neurophysiology, vol. 83, no. 5 pp. 3140-3146, 2000.
[170] A. Takemura, Y. Inoue, K. Kawano, C. Quaia, and F. Miles, "Single-Unit Activity in Cortical Area MST Associated with Disparity-Vergence Eye Movements: Evidence for Population Coding," J. Neurophysiology, vol. 85, no. 5, pp. 2245-2266, 2001.
[171] S. Tanabe, K. Umeda, and I. Fujita, "Rejection of False Matches for Binocular Correspondence in Macaque Visual Cortical Area V4," J. Neuroscience, vol. 24, no. 37, pp. 8170-8180, 2004.
[172] K. Tanaka, "Neuronal Mechanisms of Object Recognition," Science, vol. 262, pp. 685-688, 1993.
[173] K. Tanaka, "Inferotemporal Cortex and Object Vision," Ann. Rev. of Neuroscience, vol. 19, no. 1, pp. 109-139, 1996.
[174] K. Tanaka, H. Saito, Y. Fukada, and M. Moriya, "Coding Visual Images of Objects in the Inferotemporal Cortex of the Macaque Monkey," J. Neurophysiology, vol. 66, no. 1, pp. 170-189, 1991.
[175] K. Tanaka and H.-A. Saito, "Analysis of Motion of the Visual Field by Direction, Expansion/Contraction, and Rotation Cells Clustered in the Dorsal Part of the Medial Superior Temporal Area of the Macaque Monkey," J. Neurophysiology, vol. 62, no. 3, pp. 626-641, 1989.
[176] H. Tanigawa, H.D. Lu, and A.W. Roe, "Functional Organization for Color and Orientation in Macaque V4," Nature Neuroscience, vol. 13, pp. 1542-1548, Dec. 2010.
[177] J.B. Tenenbaum, C. Kemp, T.L. Griffiths, and N.D. Goodman, "How to Grow a Mind: Statistics, Structure, and Abstraction," Science, vol. 331, pp. 1279-1285, 2011.
[178] F.E. Theunissen, S.V. David, N.C. Singh, A. Hsu, W.E. Vinje, and J.L. Gallant, "Estimating Spatio-Temporal Receptive Fields of Auditory and Visual Neurons from Their Responses to Natural Stimuli," Network: Computation in Neural Systems, vol. 12, no. 3, pp. 289-316, 2001.
[179] T. Theys, S. Srivastava, J. van Loon, J. Goffin, and P. Janssen, "Selectivity for Three-Dimensional Contours and Surfaces in the Anterior Intraparietal Area," J. Neurophysiology, vol. 107, no. 3, pp. 995-1008, 2012.
[180] P. Thier and R. Andersen, "Electrical Microstimulation Suggest Two Different Kinds of Representation of Head-Centered Space in the Intraparietal Sulcus of Rhesus Monkeys," Proc. Nat'l Academy of Sciences USA, vol. 93, pp. 4962-4967, 1996.
[181] O. Thomas, B. Cumming, and A. Parker, "A Specialization for Relative Disparity in V2," Nature Neuroscience, vol. 5, no. 5, pp. 472-478, 2002.
[182] T. Tompa and G. Sáry, "A Review on the Inferior Temporal Cortex of the Macaque," Brain Research Rev., vol. 62, no. 2, pp. 165-182, 2010.
[183] R. Tootell, K. Nelissen, W. Vanduffel, and G. Orban, "Search for Color Center(s) in Macaque Visual Cortex," Cerebral Cortex, vol. 14, no. 4, pp. 353-363, 2004.
[184] M.J. Tovée, E.T. Rolls, and P. Azzopardi, "Translation Invariance in the Responses to Faces of Single Neurons in the Temporal Visual Cortical Areas of the Alert Macaque," J. Neurophysiology, vol. 72, no. 3, pp. 1049-1060, Sept. 1994.
[185] A. Treisman, "The Binding Problem," Current Opinion in Neurobiology, vol. 6, no. 2, pp. 171-178, 1996.
[186] A. Treisman and H. Schmidt, "Illusory Conjunctions in the Perception of Objects," Cognitive Psychology, vol. 14, no. 1, pp. 107-141, 1982.
[187] D. Tsao et al., "Stereopsis Activates V3a and Caudal Intraparietal Areas in Macaques and Humans," Neuron, vol. 39, no. 3, pp. 555-568, 2003.
[188] J.K. Tsotsos, "Analyzing Vision at the Complexity Level," Behavioral and Brain Sciences, vol. 13, no. 3, pp. 423-469, 1990.
[189] K. Tsutsui, H. Sakata, T. Naganuma, and M. Taira, "Neural Correlates for Perception of 3D Surface Orientation from Texture Gradient," Science, vol. 298, no. 5592, pp. 409-412, 2002.
[190] T. Uka and G. DeAngelis, "Linking Neural Representation to Function in Stereoscopic Depth Perception: Roles of the Middle Temporal Area in Coarse versus Fine Disparity Discrimination," J. Neuroscience, vol. 26, no. 25, pp. 6791-6802, 2006.
[191] S. Ullman and B. Epshtein, "Visual Classification by a Hierarchy of Extended Features," Towards Category-Level Object Recognition. Springer-Verlag, 2006.
[192] L.G. Ungerleider and M. Mishkin, "Two Cortical Visual Systems," Analysis of Visual Behavior, D.J. Ingle, M.A. Goodale, and R.J.W. Mansfield, eds., pp. 549-586, MIT Press, 1982.
[193] C. van den Boomen, M.J. van der Smagt, and C. Kemner, "Keep Your Eyes on Development: The Behavioral and Neurophysiological Development of Visual Mechanisms Underlying Form Processing," Front Psychiatry, vol. 16, no. 3, 2012.
[194] J.H. van Hateren and D.L. Ruderman, "Independent Component Analysis of Natural Image Sequences Yields Spatio-Temporal Filters Similar to Simple Cells in Primary Visual Cortex," Proc. Biological Sciences, vol. 265, no. 1412, pp. 2315-2320, 1998.
[195] B. Verhoef, R. Vogels, and P. Janssen, "Contribution of Inferior Temporal and Posterior Parietal Activity to Three-Dimensional Shape Perception," Current Biology, vol. 20, no. 10, pp. 909-913, 2010.
[196] B. Verhoef, R. Vogels, and P. Janssen, "Inferotemporal Cortex Subserves Three-Dimensional Structure Categorization," Neuron, vol. 73, pp. 171-182, 2012.
[197] R. Vogels, "Categorization of Complex Visual Images by Rhesus Monkeys. Part 2: Single-Cell Study," European J. Neuroscience, vol. 11, no. 4, pp. 1239-1255, 1999.
[198] Handbuch der Physiologischen Optic, H. von Helmholtz, ed. Hamburg and Leipzig, 1866.
[199] J. Wagemans, J. Elder, M. Kubovy, S. Palmer, M. Peterson, M. Singh, and R. von der Heydt, "A Century of Gestalt Psychology in Visual Perception: I. Perceptual Grouping and Figure-Ground Organization," Psychological Bull., to be Published.
[200] L. Wiskott, "How Does Our Visual System Achieve Shift and Size Invariance?" 23 Problems in Systems Neuroscience, chapter 16, J.L. van Hemmen and T.J. Sejnowski, ed., pp. 322-340, Oxford Univ. Press, 2006.
[201] L. Wiskott, J.-M. Fellous, N. Krüger, and C. von der Malsburg, "Face Recognition by Elastic Bunch Graph Matching," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 7, pp. 775-779, July 1997.
[202] J.M. Wolfe, "Visual Search," Attention, H. Pashler, ed., Univ. College London Press, 1998.
[203] F. Xu and S. Carey, "Infants' Metaphysics: The Case of Numerical Identity," Cognitive Psychology, vol. 30, no. 2, pp. 111-153, Apr. 1996.
[204] S. Zeki, S. Aglioti, D. McKeefry, and G. Berlucchi, "The Neurobiological Basis of Conscious Color Perception in a Blind Patient," Proc. Nat'l Academy of Sciences, vol. 96, pp. 14124-14129, 1999.
[205] H. Zhou, H. Friedman, and R. Von Der Heydt, "Coding of Border Ownership in Monkey Visual Cortex," J. Neuroscience, vol. 20, no. 17, pp. 6594-6611, 2000.
[206] D. Zipser and R.A. Andersen, "A Back-Propagation Programmed Network That Simulates Response Properties of a Subset of Posterior Parietal Neurons," Nature, vol. 331, no. 6158, pp. 679-684, 1988.
[207] N. Pugeault, F. Wörgötte, and N. Krüger, "Visual Primitives: Local, Condensed, and Semantically Rich Visual Descriptors and Their Applications in Robotics," Int'l J. Humanoid Robotics, special issue on cognitive humanoid vision, vol. 7, no. 3, pp. 379-405, 2010.
31 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool