Issue No. 02 - February (2011 vol. 33)
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/TPAMI.2010.63
Ira Kemelmacher-Shlizerman , University of Washington, Seattle
Ronen Basri , Weizmann Institute of Science, Rehovot
Human faces are remarkably similar in global properties, including size, aspect ratio, and location of main features, but can vary considerably in details across individuals, gender, race, or due to facial expression. We propose a novel method for 3D shape recovery of faces that exploits the similarity of faces. Our method obtains as input a single image and uses a mere single 3D reference model of a different person's face. Classical reconstruction methods from single images, i.e., shape-from-shading, require knowledge of the reflectance properties and lighting as well as depth values for boundary conditions. Recent methods circumvent these requirements by representing input faces as combinations (of hundreds) of stored 3D models. We propose instead to use the input image as a guide to "mold” a single reference model to reach a reconstruction of the sought 3D shape. Our method assumes Lambertian reflectance and uses harmonic representations of lighting. It has been tested on images taken under controlled viewing conditions as well as on uncontrolled images downloaded from the Internet, demonstrating its accuracy and robustness under a variety of imaging conditions and overcoming significant differences in shape between the input and reference individuals including differences in facial expressions, gender, and race.
Computer vision, photometry, shape from shading, 3D reconstruction, lighting, single images, face, depth reconstruction.
Ira Kemelmacher-Shlizerman, Ronen Basri, "3D Face Reconstruction from a Single Image Using a Single Reference Face Shape", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol. 33, no. , pp. 394-405, February 2011, doi:10.1109/TPAMI.2010.63