The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.08 - August (2008 vol.30)
pp: 1460-1471
ABSTRACT
Conventional photometric stereo recovers one normal direction per pixel of the input image. This fundamentally limits the scale of recovered geometry to the resolution of the input image, and cannot model surfaces with subpixel geometric structures. In this paper, we propose a method to recover subpixel surface geometry by studying the relationship between the subpixel geometry and the reflectance properties of a surface. We first describe a generalized physically-based reflectance model that relates the distribution of surface normals inside each pixel area to its reflectance function. The distribution of surface normals can be computed from the reflectance functions recorded in photometric stereo images. A convexity measure of subpixel geometry structure is also recovered at each pixel, through an analysis of the shadowing attenuation. Then, we use the recovered distribution of surface normals and the surface convexity to infer subpixel geometric structures on a surface of homogeneous material by spatially arranging the normals among pixels at a higher resolution than that of the input image. Finally, we optimize the arrangement of normals using a combination of belief propagation and MCMC based on a minimum description length criterion on 3D textons over the surface. The experiments demonstrate the validity of our approach and show superior geometric resolution for the recovered surfaces.
INDEX TERMS
Photometry, Subpixel, Shape, Reflectance, Radiometry
CITATION
Ping Tan, Stephen Lin, Long Quan, "Subpixel Photometric Stereo", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.30, no. 8, pp. 1460-1471, August 2008, doi:10.1109/TPAMI.2007.70789
REFERENCES
[1] R. Woodham, “Photometric Stereo: A Reflectance Map Technique for Determining Surface Orientation from Image Intensities,” Proc. SPIE 22nd Ann. Technical Symp., pp. 136-143, 1978.
[2] W. Silver, “Determining Shape and Reflectance Using Multiple Images,” PhD dissertation, Massachusetts Inst. of Tech nology, 1980.
[3] A. Shashua, “Geometry and Photometry in 3D Visual Recognition,” PhD dissertation, Massachusetts Inst. of Tech nology, 1992.
[4] E.N. Coleman and R. Jain, “Obtaining 3-Dimensional Shape of Textured and Specular Surfaces Using Four-Source Photometry,” Computer Graphics and Image Processing, vol. 18, pp. 309-328, 1982.
[5] F. Solomon and K. Ikeuchi, “Extracting the Shape and Roughness of Specular Lobe Objects Using Four Light Photometric Stereo,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 18, pp.449-454, 1996.
[6] O. Drbohlav and R. Sara, “Specularities Reduce Ambiguity of Uncalibrated Photometric Stereo,” Proc. Seventh European Conf. Computer Vision (ECCV '02), pp. 46-62, 2002.
[7] H. Tagare and R. de Figueiredo, “A Theory of Photometric Stereo for a Class of Diffuse Non-Lambertian Surfaces,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 13, pp. 133-152, 1991.
[8] A.S. Georghiades, “Incorporating the Torrance and Sparrow Model of Reflectance in Uncalibrated Photometric Stereo,” Proc. Ninth IEEE Int'l Conf. Computer Vision (ICCV '03), vol. 2, pp. 816-823, 2003.
[9] K.E. Torrance and E.M. Sparrow, “Theory for Off-Specular Reflection from Roughened Surfaces,” J. Optical Soc. of America, vol. 57, pp. 1105-1114, 1967.
[10] R.L. Cook and K.E. Torrance, “A Reflectance Model for Computer Graphics,” Proc. ACM Siggraph '81, pp. 307-316, 1981.
[11] J. Rissanen, “A Universal Prior for Integers and Estimation by Minimum Description Length,” The Annals of Statistics, vol. 11, pp.416-431, 1983.
[12] T. Leung and J. Malik, “Representing and Recognizing the Visual Appearance of Materials Using Three-Dimensional Textons,” Int'l J. Computer Vision, vol. 43, pp. 29-44, 2001.
[13] J. Pearl, Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. Morgan Kaufmann, 1988.
[14] V. Kolmogorov, “Convergent Tree-Reweighted Message Passing for Energy Minimization,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 10, pp. 1568-1583, Oct. 2006.
[15] J.S. Liu, Monte Carlo Strategies in Scientific Computing. Springer, 2001.
[16] M. Irani and S. Peleg, “Improving Resolution by Image Registration,” CVGIP: Graphical Models and Image Processing, vol. 53, pp.231-239, 1991.
[17] M. Ben-Ezra, A. Zomet, and S.K. Nayar, “Video Super-Resolution Using Controlled Subpixel Detector Shifts,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, pp. 977-987, 2005.
[18] W.T. Freeman, E.C. Pasztor, and O.T. Carmichael, “Learning Low-Level Vision,” Int'l J. Computer Vision, vol. 40, pp. 24-57, 2000.
[19] J. Sun, N.N. Zheng, H. Tao, and H.Y. Shum, “Image Hallucination with Primal Sketch Priors,” Proc. IEEE Computer Vision and Pattern Recognition (CVPR '03), pp. 729-736, 2003.
[20] S.H. Westin, J.R. Arvo, and K.E. Torrance, “Predicting Reflectance Functions from Complex Surfaces,” Proc. ACM Siggraph '92, vol. 26, pp. 255-264, 1992.
[21] M. Ashikhmin, S. Premože, and P. Shirley, “A Microfacet-Based BRDF Generator,” Proc. ACM Siggraph '00, pp. 65-74, 2000.
[22] A. Ngan, F. Durand, and W. Matusik, “Experimental Analysis of BRDF Models,” Proc. Eurographics Symp. Rendering '05, pp. 117-226, 2005.
[23] A.P. Dempster, N.M. Laird, and D.B. Rubin, “Maximum-Likelihood from Incomplete Data via the EM Algorithm,” J. Royal Statistical Soc., vol. 39, no. 1, pp. 1-38, 1977.
[24] J. Bilmes, “A Gentle Tutorial on the EM Algorithm and Its Application to Parameter Estimation for Gaussian Mixture and Hidden Markov Models,” Technical Report ICSI-TR-97-021, Univ. of California, Berkeley, 1997.
[25] R.T. Frankot and R. Chellappa, “A Method for Enforcing Integrability in Shape from Shading Algorithms,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 10, pp. 439-451, 1988.
[26] P. Kovesi, “Shapelets Correlated with Surface Normals Produce Surfaces,” Proc. 10th IEEE Int'l Conf. Computer Vision (ICCV '05), pp. 994-1001, 2005.
[27] A. Agrawal, R. Chellappa, and R. Raskar, “An Algebraic Approach to Surface Reconstruction from Gradient Fields,” Proc. 10th IEEE Int'l Conf. Computer Vision (ICCV '05), pp. 174-181, 2005.
[28] B. Horn, “Height and Gradient from Shading,” Int'l J. Computer Vision, vol. 5, no. 1, pp. 37-75, 1990.
[29] K. Ikeuchi and B.K.P. Horn, “Numerical Shape from Shading and Occluding Boundaries,” Artificial Intelligence, vol. 17, pp. 141-184, 1981.
55 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool