Issue No. 05 - May (2013 vol. 35)
O. Aldrian , Dept. of Comput. Sci., Univ. of York, York, UK
W. A. P. Smith , Dept. of Comput. Sci., Univ. of York, York, UK
In this paper, we present a complete framework to inverse render faces with a 3D Morphable Model (3DMM). By decomposing the image formation process into geometric and photometric parts, we are able to state the problem as a multilinear system which can be solved accurately and efficiently. As we treat each contribution as independent, the objective function is convex in the parameters and a global solution is guaranteed. We start by recovering 3D shape using a novel algorithm which incorporates generalization error of the model obtained from empirical measurements. We then describe two methods to recover facial texture, diffuse lighting, specular reflectance, and camera properties from a single image. The methods make increasingly weak assumptions and can be solved in a linear fashion. We evaluate our findings on a publicly available database, where we are able to outperform an existing state-of-the-art algorithm. We demonstrate the usability of the recovered parameters in a recognition experiment conducted on the CMU-PIE database.
Lighting, Shape, Harmonic analysis, Solid modeling, Cameras, Rendering (computer graphics), Vectors
O. Aldrian and W. A. Smith, "Inverse Rendering of Faces with a 3D Morphable Model," in IEEE Transactions on Pattern Analysis & Machine Intelligence, vol. 35, no. 5, pp. 1080-1093, 2013.