This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
What Shape Are Dolphins? Building 3D Morphable Models from 2D Images
Jan. 2013 (vol. 35 no. 1)
pp. 232-244
T. J. Cashman, Fac. of Inf., Univ. of Lugano, Lugano, Switzerland
A. W. Fitzgibbon, Microsoft Res. Ltd., Cambridge, UK
3D morphable models are low-dimensional parameterizations of 3D object classes which provide a powerful means of associating 3D geometry to 2D images. However, morphable models are currently generated from 3D scans, so for general object classes such as animals they are economically and practically infeasible. We show that, given a small amount of user interaction (little more than that required to build a conventional morphable model), there is enough information in a collection of 2D pictures of certain object classes to generate a full 3D morphable model, even in the absence of surface texture. The key restriction is that the object class should not be strongly articulated, and that a very rough rigid model should be provided as an initial estimate of the “mean shape.” The model representation is a linear combination of subdivision surfaces, which we fit to image silhouettes and any identifiable key points using a novel combined continuous-discrete optimization strategy. Results are demonstrated on several natural object classes, and show that models of rather high quality can be obtained from this limited information.
Index Terms:
surface texture,geometry,image morphing,image representation,optimisation,solid modelling,surface roughness,combined continuous-discrete optimization strategy,dolphins,3D morphable models,2D images,low-dimensional parameterizations,3D object classes,3D geometry,3D scans,general object classes,user interaction,2D pictures,surface texture,rough rigid model,model representation,subdivision surfaces,image silhouettes,identifiable key points,Three dimensional displays,Solid modeling,Shape,Cameras,Image reconstruction,Dolphins,Biological system modeling,single-view reconstruction,Morphable model,shape from silhouette,subdivision surfaces,image-based modeling
Citation:
T. J. Cashman, A. W. Fitzgibbon, "What Shape Are Dolphins? Building 3D Morphable Models from 2D Images," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 35, no. 1, pp. 232-244, Jan. 2013, doi:10.1109/TPAMI.2012.68
Usage of this product signifies your acceptance of the Terms of Use.