This Article 
 Bibliographic References 
 Add to: 
Image-Based Surface Detail Transfer
May/June 2004 (vol. 24 no. 3)
pp. 30-35
Zicheng Liu, Microsoft Research
Zhengyou Zhang, Microsoft Research
Ying Shan, Sarnoff Corporation
This article presents a novel technique, called image-based surface detail transfer, that transfers geometric details from one surface to another with simple 2D image operations. The authors? basic finding is that, without knowing its 3D geometry, geometric details (local deformations) of an object can be extracted from a single image in a way independent of its surface reflectance. Furthermore, these geometric details can be directly transferred to modify the appearance of other objects in image space. The article provides examples of surface detail transfer between real objects, as well as between real and synthesized objects. It also demonstrates that this technique can be applied to human faces to produce aging effects or as a touch-up tool to remove wrinkles and color spots on the face images.

1. H. Rushmeier, G. Taubin, and A. Gueziec, "Applying Shape from Lighting Variation to Bump Map Capture," Proc. Eurographics Workshop on Rendering, Springer, 1997, pp. 35-44.
2. B. Horn and M.J. Brooks, Shape from Shading, MIT Press, 1989.
3. T. Vetter and T. Poggio, "Linear Object Classes and Image Synthesis from Single Example Image," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 7, pp. 733-741, July 1997.
4. V. Blanz and T. Vetter, "A Morphable Model for the Synthesis of 3D Faces," Proc. Siggraph, ACM Press, 1999, pp. 353-360.
5. Y. Shan, Z. Liu, and Z. Zhang, "Image-Based Surface Detail Transfer," Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 2, IEEE Press, 2001, pp. 794-799.
6. T. Beier and S. Neely, "Feature-Based Image Metamorphosis," Proc. Siggraph, ACM Press, 1992, pp. 35-42.
7. S.R. Marschner, B. Guenter, and S. Raghupathy, "Modeling and Rendering for Realistic Facial Animation," Rendering Techniques, SpringerWein, 2000, pp. 231-242.
8. P.E. Debevec et al., "Acquiring the Reflectance Field of a Human Face," Proc. Siggraph, ACM Press, 2000, pp. 145-156.
1. S.K. Nayar and R.M. Bolle, “Reflectance Ration: A Photometric Invariant for Object Recognition,” Proc. Int'l Conf. Computer Vision, Berlin, May 1993.
2. T. Riklin-Raviv and A. Shashua, “The Quotient Image: Class Based Recognition and Synthesis under Varying Illumination,” Proc. Conf. Computer Vision and Pattern Recognition, pp. 566-571, 1999.
3. A. Stoschek, “Image-Based Re-rendering of Faces for Continuous Pose and Illumination Directions,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 582-587, June 2000.
4. S.R. Marschner and D.P. Greenberg, "Inverse Lighting for Photography," Proc. IST/SID 5th Color Imaging Conf., IS&T, 1997, pp. 262-265.
5. P.E. Debevec, "Rendering Synthetic Objects into Real Scenes: Bridging Traditional and Image-based Graphics with Global Illumination and High Dynamic Range Photography," Proc. Siggraph, ACM Press, 1998, pp. 189-198.
6. N. Burson and T.D. Schneider, Method and Apparatus for Producing an Image of a Person's Face at a Different Age, US patent 4276570, US Patent and Trademark Office, 1981.
7. Z. Liu, Y. Shan, and Z. Zhang, "Expressive Expression Mapping with Ratio Images," Proc. Siggraph, ACM Press, 2001, pp. 271-276.

Index Terms:
geometric details, aging simulation, surface detail transfer.
Zicheng Liu, Zhengyou Zhang, Ying Shan, "Image-Based Surface Detail Transfer," IEEE Computer Graphics and Applications, vol. 24, no. 3, pp. 30-35, May-June 2004, doi:10.1109/MCG.2004.1297008
Usage of this product signifies your acceptance of the Terms of Use.