| | This Article | |
| |
| |
| | Share | |
| |
| |
| | Bibliographic References | |
| |
| |
| | Add to: | |
| |
 Digg
 Furl
 Spurl
 Blink
 Simpy
 Google
 Del.icio.us
 Y!MyWeb
| |
| | Search | |
| |
| |
| | |
Shape from Periodic Texture Using the Eigenvectors of Local Affine Distortion
December 2001 (vol. 23 no. 12)
pp. 1459-1465
This paper shows how the local slant and tilt angles of regularly textured curved surfaces can be estimated directly, without the need for iterative numerical optimization. We work in the frequency domain and measure texture distortion using the affine distortion of the pattern of spectral peaks. The key theoretical contribution is to show that the directions of the eigenvectors of the affine distortion matrices can be used to estimate local slant and tilt angles of tangent planes to curved surfaces. In particular, the leading eigenvector points in the tilt direction. Although not as geometrically transparent, the direction of the second eigenvector can be used to estimate the slant direction. The required affine distortion matrices are computed using the correspondences between spectral peaks, established on the basis of their energy ordering. We apply the method to a variety of real-world and synthetic imagery.
[1] J.J. Gibson, The Perception of the Visual World. Boston: Houghton Miffin, 1950.
[2] D. Marr, Vision: A Computational Investigation into the Human Representation and Processing of Visual Information. Freeman, 1982.
[3] A. Blake and C. Marinos,“Shape from texture: Estimation, isotropy and moments,” Artificial Intelligence, vol. 45, pp. 323-380, 1990.
[4] J. Krumm and S.A. Shafer,“Shape from periodic texture using the spectrogram,” Proc. Conf. Computer Vision and Pattern Recognition, pp. 284-289,Champaign, Ill., June 1992.
[5] B.J. Super and A.C. Bovik, “Planar Surface Orientation from Texture Spatial Frequencies,” Pattern Recognition, vol. 28, no. 5, pp. 729-743, 1995.
[6] J.R. Kender, “Shape from Texture: An Aggregation Transform that Maps a Class of Texture into Surface Orientation,” Proc. Sixth Int'l Joint Conf. Artificial Intelligence, pp. 475-480, 1979.
[7] J.S. Kwon, H.K. Hong, and J.S. Choi, “Obtaining a 3-D Orientation of Projective Textures Using a Morphological Method,” Pattern Recognition, vol. 29, pp. 725-732, 1996.
[8] J. Gårding,“Shape from texture for smooth curved surfaces,” Proc. European Conf. Computer Vision, pp. 630-638, May 1992.
[9] J. Garding, “Shape from Texture for Smooth Curved Surfaces in Perspective Projection,” J. Math. Imaging and Vision, vol. 2, pp. 329-352, 1992.
[10] J. Malik and R. Rosenholtz, “A Differential Method for Computing Local Shape-from-Texture for Planar and Curved Surfaces,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 267-273, 1993.
[11] J. Malik and R. Rosenholtz, “Recovering Surface Curvature and Orientation from Texture Distortion, a Least Squares Algorithm and Sensitive Analysis,” Proc. European Conf. Computer Vision '94, vol. 800, pp. 353-364, 1994.
[12] B.J. Super and A.C. Bovik, “Shape from Texture Using Local Spectral Moments,” IEEE Trans. Pattern Analysis Machine Intelligence, vol. 17, no. 4, pp. 333-343, Apr. 1995.
[13] J. Krumm and S.A. Shafer, “Texture Segmentation and Shape in the Same Image,” Proc. Int'l Conf. Computer Vision, pp. 121-127, 1995.
[14] B.J. Super and A.C. Bovik, “Filters for Directly Detecting Surface Orientation in an Image,” Proc. SPIE Conf. Visual Comm. and Image Processing, pp. 144-155, 1992.
[15] J. Krumm and S.A. Shafer,“Local spatial frequency analysis of image texture,” Third Int’l Conf. Computer Vision, pp. 354-358, Dec. 1990.
[16] A. Rosenfeld, “A Note on Automatic Detection of Texture Gradients,” IEEE Trans. Computers, vol. 24, pp. 988-991, 1975.
[17] R. Bajcsy and L. Lieberman, “Texture Gradient as a Depth Cue,” Computer Graphics and Image Processing, vol. 5, pp. 52-67, 1976.
[18] K.A. Stevens, “The Information Content of Texture Gradients,” Biological Cybernetics, vol. 42, pp. 95-105, 1981.
[19] K. A. Stevens, “Slant-Tilt: The Visual Encoding of Surface Orientation,” Biological Cybernetics, vol. 46, pp. 183-195, 1983.
[20] A.P. Witkin, “Recovering Surface Shape and Orientation from Texture,” Artificial Intelligence, vol. 17, pp. 17-45, 1981.
[21] K. Ikeuchi, “Shape from Regular Patterns,” Artificial Intelligence, vol. 22, pp. 49-75, 1984.
[22] J. Aloimonos,“Shape from texture,” Biological Cybernetics, vol. 58, pp. 345-360, 1988.
[23] K. Ikeuchi and B.K.P. Horn, “Numerical Shape from Shading and Occluding Boundaries,” Artificial Intelligence, vol. 17, pp. 141-184, 1981.
[24] K. Kanatani and T. Chou,“Shape from texture: General principle,” Artificial Intelligence, vol. 38, pp. 1-48, 1989.
[25] L.G. Brown and H. Shvaytser, “Surface Orientation from Projective Foreshortening of Isotropic Texture Autocorrelation,” IEEE Trans. Pattern Analysis Machine Intelligence, vol. 12, pp. 584-588, 1990.
[26] K. Sakai and L.H. Finkel, “A Shape-from-Texture Algorithm Based on Human Visual Psychophysics,” Proc. IEEE Conf. Vision and Pattern Recognition, pp. 527-532, 1994.
[27] J.Y. Jau and R.T. Chin, “Shape from Texture Using Wigner Distribution,” Computer Vision, Graphics, and Image Processing,” vol. 52, pp. 248-263, 1990.
[28] S.M. Kay, Modern Spectral Estimation: Theory and Application. Prentice Hall, 1988.
[29] A.D.J. Cross and E.R. Hancock, Graph Matching with Dual Step Em Algorithm IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 20, pp. 1236-1253, 1998.
[30] B.K. Horn, Robot Vision. Cambridge, Mass.: MIT Press, 1986.
[31] P.L. Worthington and E.R. Hancock, “New Constraints on Data-Closeness and Needle-Map Consistency for SFS,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 21, no. 12, pp. 1250-1267, Dec. 1999.
Index Terms:
Shape-from-texture, spectral analysis, affine distortion, eigen-analysis
Citation:
E. Ribeiro, E.R. Hancock, "Shape from Periodic Texture Using the Eigenvectors of Local Affine Distortion," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 23, no. 12, pp. 1459-1465, Dec. 2001, doi:10.1109/34.977570
