The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.11 - Nov. (2013 vol.35)
pp: 2810-2816
N. Murray , Xerox Res. Centre Eur., Meylan, France
M. Vanrell , Centre de Visio per Computador, Barcelona, Spain
X. Otazu , Centre de Visio per Computador, Barcelona, Spain
C. A. Parraga , Centre de Visio per Computador, Barcelona, Spain
ABSTRACT
We propose a saliency model termed SIM (saliency by induction mechanisms), which is based on a low-level spatiochromatic model that has successfully predicted chromatic induction phenomena. In so doing, we hypothesize that the low-level visual mechanisms that enhance or suppress image detail are also responsible for making some image regions more salient. Moreover, SIM adds geometrical grouplets to enhance complex low-level features such as corners, and suppress relatively simpler features such as edges. Since our model has been fitted on psychophysical chromatic induction data, it is largely nonparametric. SIM outperforms state-of-the-art methods in predicting eye fixations on two datasets and using two metrics.
INDEX TERMS
Image color analysis, Wavelet transforms, Visualization, Measurement, Image representation, Biological system modeling,hierarchical image representation, Computational models of vision, color
CITATION
N. Murray, M. Vanrell, X. Otazu, C. A. Parraga, "Low-Level Spatiochromatic Grouping for Saliency Estimation", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.35, no. 11, pp. 2810-2816, Nov. 2013, doi:10.1109/TPAMI.2013.108
REFERENCES
[1] A. Borji and L. Itti, "State-of-the-Art in Visual Attention Modeling," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 35, no. 1, pp. 185-207, Jan. 2013.
[2] L. Itti, C. Koch, and E. Niebur, "A Model of Saliency-Based Visual Attention for Rapid Scene Analysis," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 20, no. 11, pp. 1254-1259, Nov. 1998.
[3] D. Gao, V. Mahadevan, and N. Vasconcelos, "On the Plausibility of the Discriminant Center-Surround Hypothesis for Visual Saliency," J. Vision, vol. 8, no. 7, pp. 1-18, 2008.
[4] N.D. Bruce and J.K. Tsotsos, "Saliency Based on Information Maximization," Advances in Neural Information Processing Systems 18, Y. Weiss, B. Schölkopf, and J. Platt, eds., pp. 155-162, MIT Press, 2006.
[5] X. Hou and L. Zhang, "Dynamic Visual Attention: Searching for Coding Length Increments," Proc. Conf. Advances in Neural Information Processing Systems, vol. 21, pp. 681-688, 2008.
[6] L. Zhang, M.H. Tong, T.K. Marks, H. Shan, and G.W. Cottrell, "SUN: A Bayesian Framework for Saliency Using Natural Statistics," J. Vision, vol. 8, no. 7, 2008.
[7] H.J. Seo and P. Milanfar, "Static and Space-Time Visual Saliency Detection by Self-Resemblance," J. Vision, vol. 9, no. 12, pp. 1-27, 2009.
[8] W. Kienzle, F. Wichmann, B. Schalkopf, and M.O. Franz, "A Nonparametric Approach to Bottom-Up Visual Saliency," Advances in Neural Information Processing Systems 19, MIT Press, 2007.
[9] Q. Zhao and C. Koch, "Learning Visual Saliency by Combining Feature Maps in a Nonlinear Manner Using Adaboost," J. Vision, vol. 12, no. 6, 2012.
[10] N. Pinto, D. Doukhan, J. DiCarlo, and D. Cox, "A High-Throughput Screening Approach to Discovering Good Forms of Biologically Inspired Visual Representation," PLoS Computational Biology, vol. 5, no. 11, p. e1000579, 2009.
[11] S. Mallat, "Geometrical Grouplets," Applied and Computational Harmonic Analysis, vol. 26, no. 2, pp. 161-180, 2009.
[12] N. Murray, M. Vanrell, X. Otazu, and C. Parraga, "Saliency Estimation Using a Non-Parametric Low-Level Vision Model," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 433-440, 2011.
[13] S. Zeki, J. Watson, C. Lueck, K. Friston, C. Kennard, and R. Frackowiak, "A Direct Demonstration of Functional Specialization in Human Visual Cortex," The J. Neuroscience, vol. 11, no. 3, pp. 641-649, 1991.
[14] R. Shapley and M.J. Hawken, "Color in the Cortex: Single- and Double-Opponent Cells," Vision Research, vol. 51, no. 7, pp. 701-717, 2011.
[15] X. Otazu, C.A. Parraga, and M. Vanrell, "Toward a Unified Chromatic Induction Model," J. Vision, vol. 10, no. 12, 2010.
[16] E.P. Simoncelli and O. Schwartz, "Modeling Surround Suppression in V1 Neurons with a Statistically-Derived Normalization Model," Advances in Neural Information Processing Systems 2, pp. 153-159, MIT Press, 1999.
[17] K. Mullen, "The Contrast Sensitivity of Human Color-Vision to Red Green and Blue Yellow Chromatic Gratings," J. Physiology, vol. 359, pp. 381-400, 1985.
[18] B. Blakeslee and M.E. McCourt, "Similar Mechanisms Underlie Simultaneous Brightness Contrast and Grating Induction," Vision Research, vol. 37, no. 20, pp. 2849-2869, 1997.
[19] F. Attneave, "Some Informational Aspects of Visual Perception," Psychological Rev., vol. 61, no. 3, pp. 183-193, 1954.
[20] L. Itti and C. Koch, "Computational Modelling of Visual Attention," Nature Rev. Neuroscience, vol. 2, no. 3, pp. 194-203, Mar. 2001.
[21] C. Zetzsche, K. Schill, H. Deubel, G. Krieger, E. Umkehrer, and S. Beinlich, "Investigation of a Sensorimotor System for Saccadic Scene Analysis: An Integrated Approach," Proc. Fifth Int'l Conf. Simulation of Adaptive Behavior: From Animals to Animats 5, pp. 120-126, 1998.
[22] R.J. Peters, A. Iyer, L. Itti, and C. Koch, "Components of Bottom-Up Gaze Allocation in Natural Images," Vision Research, vol. 45, no. 8, pp. 2397-2416, Aug. 2005.
[23] J.R. Cavanaugh, W. Bair, and J.A. Movshon, "Nature and Interaction of Signals from the Receptive Field Center and Surround in Macaque V1 Neurons," J. Neurophysiology, vol. 88, pp. 2530-2546, 2002.
[24] A. Smith, K. Singh, A. Williams, and M. Greenlee, "Estimating Receptive Field Size from fMRI Data in Human Striate and Extrastriate Visual Cortex," Cerebral Cortex, vol. 11, no. 12, pp. 1182-1190, 2001.
[25] L. Chao-Yi and L. Wu, "Extensive Integration Field Beyond the Classical Receptive Field of Cat's Striate Cortical Neurons-Classification and Tuning Properties," Vision Research, vol. 34, no. 18, pp. 2337-2355, 1994.
[26] G. Walker et al., "Suppression Outside the Classical Cortical Receptive Field," Visual Neuroscience, vol. 17, no. 3, pp. 369-379, 2000.
[27] J. Harel, C. Koch, and P. Perona, "Graph-Based Visual Saliency," Proc. Conf. Advances in Neural Information Processing Systems, vol. 19, p. 545, 2007.
[28] X. Hou, J. Harel, and C. Koch, "Image Signature: Highlighting Sparse Salient Regions," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 34, no. 1, pp. 194-201, Jan. 2012.
[29] T. Judd, K. Ehinger, F. Durand, and A. Torralba, "Learning to Predict Where Humans Look," Proc. IEEE Int'l Conf. Computer Vision, 2009.
116 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool