This Article 
 Bibliographic References 
 Add to: 
The Texture Gradient Equation for Recovering Shape from Texture
April 2002 (vol. 24 no. 4)
pp. 536-549

This paper studies the recovery of shape from texture under perspective projection. We regard Shape from Texture as a statistical estimation problem, the texture being the realization of a stochastic process. We introduce warplets, which generalize wavelets over the 2D affine group. At fine scales, the warpogram of the image obeys a transport equation, called Texture Gradient Equation. In order to recover the 3D shape of the surface, one must estimate the deformation gradient, which measures metric changes in the image. This is made possible by imposing a notion of homogeneity for the original texture, according to which the deformation gradient is equal to the velocity of the Texture Gradient Equation. By measuring the warplet transform of the image at different scales, we obtain a deformation gradient estimator.

[1] J. Gibson, The Perception of the Visual World. Boston, Mass.: Houghton Mifflin, 1950.
[2] J. Gårding, “Shape from Texture for Smooth Curved Surfaces in Perspective Projection,” J. Math. Imaging Vision, vol. 2, pp. 327–350, 1992.
[3] W. Hwang, C.-S. Lu, and P.-C. Chung, “Shape from Texture: Estimation of Planar Surface Orientation through the Ridge Surfaces of Continuous Wavelet Transform,” IEEE Trans. Image Processing, vol. 7, pp. 773–780, 1998.
[4] K. Kanatani and T. Chou,“Shape from texture: General principle,” Artificial Intelligence, vol. 38, pp. 1-48, 1989.
[5] J. Malik and R. Rosenholtz, “Computing Local Surface Orientation and Shape from Texture for Curved Surfaces,” Int'l J. Computer Vision, vol. 23, no. 2, pp. 149–168, 1997.
[6] H. Permuter and J. Francos, “Estimating the Orientation of Planar Surfaces: Algorithms and Bounds,” IEEE Trans. Information Theory, vol. 46, no. 5, 2000.
[7] B.J. Super and A.C. Bovik, “Shape from Texture Using Local Spectral Moments,” IEEE Trans. Pattern Analysis Machine Intelligence, vol. 17, no. 4, pp. 333-343, Apr. 1995.
[8] R. Bajcsy and L. Lieberman, “Texture Gradient as a Depth Cue,” Computer Graphics and Image Processing, vol. 5, pp. 52–67, 1976.
[9] M. Clerc and S. Mallat, “Shape from Texture through Deformations,” Proc. Seventh Int'l Conf. Computer Vision, 1999.
[10] B. Horn and B. Schunck, “Determining Optical Flow,” Artificial Intelligence, vol. 17, nos. 1-3, pp. 185–203, 1981.
[11] R. Rosenholtz and J. Malik, “Surface Orientation from Texture: Isotropy or Homogeneity (or Both)?,” Vision Research, vol. 37, no. 16, pp. 2283–2293, 1997.
[12] M. Clerc and S. Mallat, “Estimating Deformations of Stationary Processes,” Technical Report 2000-192, CERMICS, L'Ecole Nationale des Ponts et Chaussões, 2000.
[13] B.K. Horn, Robot Vision. Cambridge, Mass.: MIT Press, 1986.
[14] M. Clerc and S. Mallat, “Shape from Texture and Shading with Wavelets,” Dynamical Systems, Control, Coding, Computer Vision, Progress in Systems and Control Theory, vol. 25, pp. 393–417, 1999.
[15] M.D. Carmo, Differential Geometry of Curves and Surfaces. Prentice-Hall, 1976.
[16] P. Lions, E. Rouy, and A. Tourin, “Shape-from-Shading, Viscosity Solutions and Edges,” Numerische Mathematik, vol. 64, pp. 323–353, 1993.
[17] S. Mallat, A Wavelet Tour of Signal Processing. Academic Press, 1999.
[18] A. Yaglom, Correlation Theory of Stationary and Related Random Functions, vol. 1. Springer-Verlag, 1987.
[19] T. Randen and J.H. Husoy, “Filtering for Texture Classification: A Comparative Study,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 21, no. 4, pp. 291-310, Apr. 1999.
[20] G.H. Golub and C.F. Van Loan, Matrix Computations. Johns Hopkins Univ. Press, 1989.
[21] J. Gårding, “Surface Orientation and Curvature from Differential Texture Distorsion,” Proc. Fifth Int'l Conf. Computer Vision, 1995.
[22] M. Clerc, “Estimation de Processus Localement Dilatés et Application au Gradient de Texture,” PhD thesis, Ecole Polytechnique, Paris, 1999.
[23] D. Forsyth, “Shape from Texture and Integrability,” Proc. Eighth Int'l Conf. Computer Vision, 2001.
[24] T. Leung and J. Malik, “Recognizing Surfaces Using Three-Dimensional Textons,” Proc. Seventh Int'l Conf. Computer Vision, 1999.

Index Terms:
shape from texture, texture gradient, warplets, wavelets
M. Clerc, S. Mallat, "The Texture Gradient Equation for Recovering Shape from Texture," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 24, no. 4, pp. 536-549, April 2002, doi:10.1109/34.993560
Usage of this product signifies your acceptance of the Terms of Use.