This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Exploring Tiny Images: The Roles of Appearance and Contextual Information for Machine and Human Object Recognition
Oct. 2012 (vol. 34 no. 10)
pp. 1978-1991
Devi Parikh, Toyota Technological Institute Chicago, Chicago
C. Lawrence Zitnick, Microsoft Research, Redmond
Tsuhan Chen, Cornell University, Ithaca
Typically, object recognition is performed based solely on the appearance of the object. However, relevant information also exists in the scene surrounding the object. In this paper, we explore the roles that appearance and contextual information play in object recognition. Through machine experiments and human studies, we show that the importance of contextual information varies with the quality of the appearance information, such as an image's resolution. Our machine experiments explicitly model context between object categories through the use of relative location and relative scale, in addition to co-occurrence. With the use of our context model, our algorithm achieves state-of-the-art performance on the MSRC and Corel data sets. We perform recognition tests for machines and human subjects on low and high resolution images, which vary significantly in the amount of appearance information present, using just the object appearance information, the combination of appearance and context, as well as just context without object appearance information (blind recognition). We also explore the impact of the different sources of context (co-occurrence, relative-location, and relative-scale). We find that the importance of different types of contextual information varies significantly across data sets such as MSRC and PASCAL.
Index Terms:
Context awareness,Image resolution,Image segmentation,Human factors,Image recognition,Context modeling,Computational modeling,human studies.,Object recognition,context,tiny images,blind recognition,image labeling
Citation:
Devi Parikh, C. Lawrence Zitnick, Tsuhan Chen, "Exploring Tiny Images: The Roles of Appearance and Contextual Information for Machine and Human Object Recognition," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 34, no. 10, pp. 1978-1991, Oct. 2012, doi:10.1109/TPAMI.2011.276
Usage of this product signifies your acceptance of the Terms of Use.