The Community for Technology Leaders
Green Image
Issue No. 06 - June (2013 vol. 35)
ISSN: 0162-8828
pp: 1410-1422
Brendan F. Klare , Noblis, Falls Church
Anil K. Jain , Michigan State University, East Lansing and Korea University, Seoul
ABSTRACT
Heterogeneous face recognition (HFR) involves matching two face images from alternate imaging modalities, such as an infrared image to a photograph or a sketch to a photograph. Accurate HFR systems are of great value in various applications (e.g., forensics and surveillance), where the gallery databases are populated with photographs (e.g., mug shot or passport photographs) but the probe images are often limited to some alternate modality. A generic HFR framework is proposed in which both probe and gallery images are represented in terms of nonlinear similarities to a collection of prototype face images. The prototype subjects (i.e., the training set) have an image in each modality (probe and gallery), and the similarity of an image is measured against the prototype images from the corresponding modality. The accuracy of this nonlinear prototype representation is improved by projecting the features into a linear discriminant subspace. Random sampling is introduced into the HFR framework to better handle challenges arising from the small sample size problem. The merits of the proposed approach, called prototype random subspace (P-RS), are demonstrated on four different heterogeneous scenarios: 1) near infrared (NIR) to photograph, 2) thermal to photograph, 3) viewed sketch to photograph, and 4) forensic sketch to photograph.
INDEX TERMS
Face, Face recognition, Kernel, Prototypes, Probes, Forensics, Training,forensic sketch, Heterogeneous face recognition, prototypes, nonlinear similarity, discriminant analysis, local descriptors, random subspaces, thermal image, infrared image
CITATION
Brendan F. Klare, Anil K. Jain, "Heterogeneous Face Recognition Using Kernel Prototype Similarities", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol. 35, no. , pp. 1410-1422, June 2013, doi:10.1109/TPAMI.2012.229
351 ms
(Ver )