The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.11 - Nov. (2013 vol.19)
pp: 1808-1819
Li-Qian Ma , Dept. of Comput. Sci. & Technol., Tsinghua Univ., Beijing, China
Kun Xu , Dept. of Comput. Sci. & Technol., Tsinghua Univ., Beijing, China
Tien-Tsin Wong , Dept. of Comput. Sci. & Eng., Chinese Univ. of Hong Kong, Shatin, China
Bi-Ye Jiang , Dept. of Comput. Sci. & Technol., Tsinghua Univ., Beijing, China
Shi-Min Hu , Dept. of Comput. Sci. & Technol., Tsinghua Univ., Beijing, China
ABSTRACT
Change blindness refers to human inability to recognize large visual changes between images. In this paper, we present the first computational model of change blindness to quantify the degree of blindness between an image pair. It comprises a novel context-dependent saliency model and a measure of change, the former dependent on the site of the change, and the latter describing the amount of change. This saliency model in particular addresses the influence of background complexity, which plays an important role in the phenomenon of change blindness. Using the proposed computational model, we are able to synthesize changed images with desired degrees of blindness. User studies and comparisons to state-of-the-art saliency models demonstrate the effectiveness of our model.
INDEX TERMS
Blindness, Visualization, Computational modeling, Complexity theory, Image color analysis, Psychology, Context modeling,image synthesis, Change blindness
CITATION
Li-Qian Ma, Kun Xu, Tien-Tsin Wong, Bi-Ye Jiang, Shi-Min Hu, "Change Blindness Images", IEEE Transactions on Visualization & Computer Graphics, vol.19, no. 11, pp. 1808-1819, Nov. 2013, doi:10.1109/TVCG.2013.99
REFERENCES
[1] R.A. Rensink, J.K. O'Regan, and J.J. Clark, "To See or Not to See: The Need for Attention to Perceive Changes in Scenes," Psychological Science, vol. 8, no. 5, pp. 368-373, 1997.
[2] R.A. Rensink, "Change Detection," Ann. Rev. of Psychology, vol. 53, pp. 245-277, 2002.
[3] D.J. Simons and D. Levin, "Change Blindness," Trends in Cognitive Sciences, vol. 1, pp. 261-267, 1997.
[4] J. Allman, F. Miezin, and E. McGuinness, "Stimulus Specific Responses from Beyond the Classical Receptive Field: Neurophysiological Mechanisms for Local-Global Comparisons in Visual Neurons," Ann. Rev. of Neuroscience, vol. 8, pp. 407-430, 1985.
[5] C.-T. Yang, "Relative Saliency in Change Signals Affects Perceptual Comparison and Decision Processes in Change Detection," J. Experimental Psychology: Human Perception and Performance, vol. 37, no. 6, pp. 1708-1728, 2011.
[6] J. Grimes, "On the Failure to Detect Changes in Scenes Across Saccades," Perception, vol. 5, pp. 89-110, 1996.
[7] J.K. O'Regan, R.A. Rensink, and J.J. Clark, "Change Blindness as a Result of 'Mudsplashes'," Nature, vol. 398, no. 34, 1999.
[8] D.J. Simons and D.T. Levin, "Failure to Detect Changes to People During a Real-World Interaction," Psychonomic Bull. and Rev., vol. 5, no. 4, pp. 644-649, 1998.
[9] D.J. Simons and R.A. Rensink, "Change Blindness: Past, Present and Future," Trends in Cognitive Sciences, vol. 9, no. 1, pp. 16-20, 2005.
[10] D.J. Simons and M.S. Ambinder, "Change Blindness: Theory and Consequences," Current Directions in Psychological Science, vol. 14, no. 1, pp. 44-48, 2005.
[11] J.A. Stirk and G. Underwood, "Low-Level Visual Saliency Does Not Predict Change Detection in Natural Scenes," J. Vision, vol. 7, no. 10, pp. 3:1-3:10, 2007.
[12] M. Verma and P.W. McOwan, "A Semi-Automated Approach to Balancing of Bottom-Up Salience for Predicting Change Detection Performance," J. Vision, vol. 10, no. 6, pp. 3:1-3:17, 2010.
[13] R.A. Rensink, "Change Blindness: Implications for the Nature of Visual Attention," Visual Attention, pp. 169-188, 2001.
[14] A.M. Treisman and G. Gelade, "A Feature-Integration Theory of Attention," Cognitive Psychology, vol. 12, no. 1, pp. 97-136, 1980.
[15] L. Itti, C. Koch, and E. Niebur, "A Model of Saliency-Based Visual Attention for Rapid Scene Analysis," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 20, no. 11, pp. 1254-1659, Nov. 1998.
[16] Y.-F. Ma and H.-J. Zhang, "Contrast-Based Image Attention Analysis by Using Fuzzy Growing," Proc. ACM Int'l Conf. Multimedia, pp. 374-381, 2003.
[17] J. Harel, C. Koch, and P. Perona, "Graph-Based Visual Saliency," Advances in Neural Information Processing Systems 19, pp. 545-552, MIT Press, 2007.
[18] T. Judd, K. Ehinger, F. Durand, and A. Torralba, "Learning to Predict Where Humans Look," Proc. IEEE 12th Int'l Conf. Computer Vision (ICCV), pp. 2106-2113, 2009.
[19] N.D.B. Bruce and J.K. Tsotsos, "Saliency, Attention, and Visual Search: An Information Theoretic Approach," J. Vision, vol. 9, no. 3, pp. 5:1-5:24, 2009.
[20] R. Achanta, S. Hemami, F. Estrada, and S. Süsstrunk, "Frequency-Tuned Salient Region Detection," Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition (CVPR), pp. 1597-1604, 2009.
[21] X. Hou, J. Harel, and C. Koch, "Image Signature: Highlighting Sparse Salient Regions," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 34, no. 1, pp. 194-201, Jan. 2011.
[22] T. Liu, Z. Yuan, J. Sun, J. Wang, N. Zheng, X. Tang, and H.Y. Shum, "Learning to Detect a Salient Object," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 33, no. 2, pp. 353-367, Feb. 2011.
[23] M.-M. Cheng, G.-X. Zhang, N.J. Mitra, X. Huang, and S.-M. Hu, "Global Contrast Based Salient Region Detection," Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition (CVPR), pp. 409-416, 2011.
[24] S.-M. Hu, T. Chen, K. Xu, M.-M. Cheng, and R.R. Martin, "Internet Visual Media Processing: A Survey with Graphics and Vision Applications," The Visual Computer, vol. 29, no. 5, pp. 393-405, 2013.
[25] A. Oliva and A. Torralba, "The Role of Context in Object Recognition," Trends in Cognitive Sciences, vol. 11, no. 12, pp. 520-527, 2007.
[26] A. Torralba, A. Oliva, M.S. Castelhano, and J.M. Henderson, "Contextual Guidance of Eye Movements and Attention in Real-World Scenes: The Role of Global Features in Object Search," Psychological Rev., vol. 113, no. 4, pp. 766-786, 2006.
[27] S. Goferman, L. Zelnik-Manor, and A. Tal, "Context-Aware Saliency Detection," Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition (CVPR), pp. 2376-2383, 2010.
[28] H. Yee, S. Pattanaik, and D.P. Greenberg, "Spatiotemporal Sensitivity and Visual Attention for Efficient Rendering of Dynamic Environments," ACM Trans. Graphics, vol. 20, no. 1, pp. 39-65, 2001.
[29] K. Cater, A. Chalmers, and P. Ledda, "Selective Quality Rendering by Exploiting Human Inattentional Blindness: Looking but Not Seeing," Proc. ACM Symp. Virtual Reality Software and Technology (VRST '02), pp. 17-24, 2002.
[30] K. Cater, A. Chalmers, and G. Ward, "Detail to Attention: Exploiting Visual Tasks for Selective Rendering," Proc. 14th Eurographics Workshop Rendering, pp. 270-280, 2003.
[31] K. Cater, A. Chalmers, and C. Dalton, "Varying Rendering Fidelity by Exploiting Human Change Blindness," Proc. First Int'l Conf. Computer Graphics and Interactive Techniques in Australasia and South East Asia, pp. 39-46, 2003.
[32] J. Harrison, R.A. Rensink, and M. van de Panne, "Obscuring Length Changes during Animated Motion," ACM Trans. Graphics, vol. 23, no. 3, pp. 569-573, 2004.
[33] W.-C. Lin and Z.-C. Yan, "Attention-Based High Dynamic Range Imaging," The Visual Computer, vol. 27, nos. 6-8, pp. 717-727, 2011.
[34] V. Sundstedt, D. Gutierrez, O. Anson, F. Banterle, and A. Chalmers, "Perceptual Rendering of Participating Media," ACM Trans. Applied Perception, vol. 4, no. 3, 2007.
[35] R. McDonnell, M. Larkin, B. Hernández, I. Rudomin, and C. O'Sullivan, "Eye-Catching Crowds: Saliency Based Selective Variation," ACM Trans. Graphics, vol. 28, no. 3, pp. 55:1-55:10, 2009.
[36] F. Navarro, S. Castillo, F.J. Serón, and D. Gutierrez, "Perceptual Considerations for Motion Blur Rendering," ACM Trans. Applied Perception, vol. 8, no. 3, pp. 20:1-20:15, 2011.
[37] G. Ramanarayanan, J. Ferwerda, B. Walter, and K. Bala, "Visual Equivalence: Towards a New Standard for Image Fidelity," ACM Trans. Graphics, vol. 26, no. 3, pp. 76:1-76:11, 2007.
[38] S.J. Daly, "Visible Differences Predictor: An Algorithm for the Assessment of Image Fidelity," Proc. SPIE, vol. 1666, pp. 2-15, 1992.
[39] A. Oliva, A. Torralba, and P.G. Schyns, "Hybrid Images," ACM Trans. Graphics, vol. 25, no. 3, pp. 527-532, 2006.
[40] M.-T. Chi, T.-Y. Lee, Y. Qu, and T.-T. Wong, "Self-Animating Images: Illusory Motion Using Repeated Asymmetric Patterns," ACM Trans. Graphics, vol. 27, no. 3, pp. 62:1-62:8, 2008.
[41] N.J. Mitra, H.-K. Chu, T.-Y. Lee, L. Wolf, H. Yeshurun, and D. Cohen-Or, "Emerging Images," ACM Trans. Graphics, vol. 28, no. 5, pp. 163:1-163:8, 2009.
[42] H.-K. Chu, W.-H. Hsu, N.J. Mitra, D. Cohen-Or, T.-T. Wong, and T.-Y. Lee, "Camouflage Images," ACM Trans. Graphics, vol. 29, no. 4, pp. 51:1-51:8, 2010.
[43] Q. Tong, S.-H. Zhang, S.-M. Hu, and R.R. Martin, "Hidden Images," Proc. Int'l Symp. Non-Photorealistic Animation and Rendering (NPAR), pp. 27-34, 2011.
[44] C. O'Sullivan, S. Howlett, Y. Morvan, R. Mcdonnell, and K. O'Conor, "Perceptually Adaptive Graphics," Proc. Eurographics State-of-the-Art Report, pp. 141-164, 2004.
[45] D. Bartz, D. Cunningham, J. Fischer, and C. Wallraven, "The Role of Perception for Computer Graphics," Proc. Eurographics State-of-the-Art Report, pp. 65-86, 2008.
[46] A. McNamara, K. Mania, and D. Gutierrez, "Perception in Graphics, Visualization, Virtual Environments and Animation," Proc. SIGGRAPH Asia 2011 Courses, pp. 1-137, 2011.
[47] Y. Liu and Y. Yu, "Interactive Image Segmentation Based on Level Sets of Probabilities," IEEE Trans. Visualization and Computer Graphics, vol. 18, no. 2, pp. 202-213, Feb. 2012.
[48] M.J. Dahan, N. Chen, A. Shamir, and D. Cohen-Or, "Combining Color and Depth for Enhanced Image Segmentation and Retargeting," The Visual Computer, vol. 28, no. 12, pp. 1181-1193, 2012.
[49] D. Comaniciu and P. Meer, "Mean Shift: A Robust Approach toward Feature Space Analysis," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 5, pp. 603-619, May 2002.
[50] Y. Rubner, C. Tomasi, and L.J. Guibas, "The Earth Mover's Distance as a Metric for Image Retrieval," Int'l J. Computer Vision, vol. 40, no. 2, pp. 99-121, 2000.
[51] B. Manjunath and W. Ma, "Texture Features for Browsing and Retrieval of Image Data," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 18, no. 8, pp. 837-842, Aug. 1996.
[52] S. Belongie, J. Malik, and J. Puzicha, "Shape Matching and Object Recognition Using Shape Contexts," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 4, pp. 509-522, Apr. 2002.
[53] T. Chen, M.M. Cheng, P. Tan, A. Shamir, and S.M. Hu, "Sketch2photo: Internet Image Montage," ACM Trans. Graphics, vol. 28, no. 5, pp. 1-10, 2009.
[54] X. An and F. Pellacini, "AppProp: All-Pairs Appearance-Space Edit Propagation," ACM Trans. Graphics, vol. 27, no. 3, pp. 40:1-40:9, 2008.
[55] B.J. Frey and D. Dueck, "Clustering by Passing Messages between Data Points," Science, vol. 315, pp. 972-976, 2007.
[56] K. Xu, Y. Li, T. Ju, S.-M. Hu, and T.-Q. Liu, "Efficient Affinity-Based Edit Propagation Using K-D Tree," ACM Trans. Graphics, vol. 28, no. 5, pp. 118:1-118:6, 2009.
[57] B. Feng, J. Cao, X. Bao, L. Bao, Y. Zhang, S. Lin, and X. Yun, "Graph-Based Multi-Space Semantic Correlation Propagation for Video Retrieval," The Visual Computer, vol. 27, no. 1, pp. 21-34, 2011.
[58] C. Barnes, E. Shechtman, A. Finkelstein, and D.B. Goldman, "PatchMatch: A Randomized Correspondence Algorithm for Structural Image Editing," ACM Trans. Graphics, vol. 28, no. 3, pp. 24:1-24:11, 2009.
[59] A. Levin, D. Lischinski, and Y. Weiss, "A Closed Form Solution to Natural Image Matting," Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition (CVPR), pp. 61-68, 2006.
[60] C. Kent and K. Lamberts, "The Time Course of Perception and Retrieval in Matching and Recognition," J. Experimental Psychology: Human Perception and Performance, vol. 32, no. 4, pp. 920-931, 2006.
[61] H.-T. Chen, L.-Y. Wei, and C.-F. Chang, "Nonlinear Revision Control for Images," ACM Trans. Graphics, vol. 30, no. 4, pp. 105:1-105:10, 2011.
[62] T.A. Kelley, "Effects of Scene Inversion on Change Detection of Targets Matched for Visual salience," J. Vision, vol. 3, pp. 1-5, 2003.
[63] M. Wertheimer, "Untersuchungen Zur Lehre Der Gestalt II," Psycologische Forschung, vol. 4, pp. 301-350, 1923.
[64] V. Aginsky and M.J. Tarr, "How Are Different Properties of a Scene Encoded in Visual Memory?" Visual Cognition, vol. 7, no. 1/2/3, pp. 147-162, 2000.
72 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool