DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/TVCG.2013.249
Chen Cao , Zhejiang University, Hangzhou
Yanlin Weng , Zhejiang University, Hangzhou
Shun Zhou , Zhejiang University, Hangzhou
Yiying Tong , Michigan State University, East Lansing
Kun Zhou , Zhejiang University, Hangzhou
We present FaceWarehouse, a database of 3D facial expressions for visual computing applications. We use Microsoft's Kinect system to capture 150 individuals from various ethnic backgrounds. For each person, we captured the RGBD data of her different expressions, including the neutral expression and 19 other expressions. For every raw data record, a set of facial feature points on the color image such as eye corners and mouth contour are automatically localized, and manually adjusted if better accuracy is required. We then deform a template facial mesh to fit the depth data as closely as possible while matching the feature points on the color image to their corresponding points on the mesh. Starting from these fitted face meshes, we construct a set of individual-specific expression blendshapes for each person. These meshes with consistent topology are assembled as a rank-three tensor to build a bilinear face model with two attributes, identity and expression. Compared with previous 3D facial databases, for every person in our database, there is a much richer matching collection of expressions, enabling depiction of most human facial actions. We demonstrate the potential of FaceWarehouse with four applications: facial image manipulation, face component transfer, real-time performance-based facial image animation, and facial animation retargeting from video to image.
Face, Three-dimensional displays, Databases, Solid modeling, Computational modeling, Mouth, Color, Animation, Graphics data structures and data types
Y. Tong, S. Zhou, Y. Weng, C. Cao and K. Zhou, "FaceWarehouse: A 3D Facial Expression Database for Visual Computing," in IEEE Transactions on Visualization & Computer Graphics.