Issue No. 10 - October (2011 vol. 33)
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/TPAMI.2011.48
P. N. Belhumeur , Comput. Sci. Dept., Columbia Univ., New York, NY, USA
A. Berg , Comput. Sci. Dept., Stony Brook Univ., Stony Brook, NY, USA
N. Kumar , Comput. Sci. Dept., Columbia Univ., New York, NY, USA
S. Nayar , Comput. Sci. Dept., Columbia Univ., New York, NY, USA
We introduce the use of describable visual attributes for face verification and image search. Describable visual attributes are labels that can be given to an image to describe its appearance. This paper focuses on images of faces and the attributes used to describe them, although the concepts also apply to other domains. Examples of face attributes include gender, age, jaw shape, nose size, etc. The advantages of an attribute-based representation for vision tasks are manifold: They can be composed to create descriptions at various levels of specificity; they are generalizable, as they can be learned once and then applied to recognize new objects or categories without any further training; and they are efficient, possibly requiring exponentially fewer attributes (and training data) than explicitly naming each category. We show how one can create and label large data sets of real-world images to train classifiers which measure the presence, absence, or degree to which an attribute is expressed in images. These classifiers can then automatically label new images. We demonstrate the current effectiveness-and explore the future potential-of using attributes for face verification and image search via human and computational experiments. Finally, we introduce two new face data sets, named FaceTracer and PubFig, with labeled attributes and identities, respectively.
image retrieval, content-based retrieval, face recognition, image classification, image representation, face recognition, describable visual attributes, face verification, image search, attribute-based representation, FaceTracer, PubFig, attribute classification, feature selection, content-based image retrieval, Face, Visualization, Lighting, Search engines, Databases, Face recognition, Accuracy, image search., Face recognition, attribute classification, feature selection, classifier training, content-based image retrieval
P. N. Belhumeur, A. Berg, N. Kumar and S. Nayar, "Describable Visual Attributes for Face Verification and Image Search," in IEEE Transactions on Pattern Analysis & Machine Intelligence, vol. 33, no. , pp. 1962-1977, 2011.