| | This Article | |
| |
| |
| | Share | |
| |
| |
| | Bibliographic References | |
| |
| |
| | Add to: | |
| |
 Digg
 Furl
 Spurl
 Blink
 Simpy
 Google
 Del.icio.us
 Y!MyWeb
| |
| | Search | |
| |
| |
| | |
The Radiometry of Multiple Images
January 2002 (vol. 24 no. 1)
pp. 19-33
We introduce a methodology for radiometric reconstruction, the simultaneous recovery of multiple illuminants and surface albedoes from multiple views, assuming that the geometry of the scene and of the cameras is known. We formulate the linear theory of multiple illuminants and show its similarities with the theory of geometric recovery of multiple views. Linear and nonlinear implementations are proposed, simulation results are discussed, and, finally, results on real images are presented.
[1] E. Angelopoulou and J. Williams, “Photometric Surface Analysis in a Rri-Luminal Environment.” Proc. Int'l Conf. Computer Vision, pp. 442-447, 1999.
[2] R. Baribeau, M. Rioux, and G. Godin, “Color Reflectance Modeling Using a Polychromatic Laser Range Sensor,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 14, no. 2, pp. 263-269, Feb. 1992.
[3] P.N. Belhumeur, D.J. Kriegman, and A.L. Yuille, “The Bas-Relief Ambiguity,” Int'l J. Computer Vision, vol. 35, no. 1, pp. 33-44, Nov. 1999.
[4] P. Debevec and J. Malik, “Recovering High Dynamic Range Radiance Maps from Photographs,” Proc. SIGGRAPH Computer Graphics, vol. 31, pp. 369-378, 1997.
[5] O. Faugeras, "What can be seen in three dimensions with an uncalibrated stereo rig?" Second European Conf. Computer Vision, pp. 563-578, 1992.
[6] O.D. Faugeras and Q.-T. Luong, The Geometry of Multiple Images. MIT Press, 2001.
[7] M.A. Fischler and R.C. Bolles, “Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography,” Graphics and Image Processing, vol. 24, no. 6, pp. 381–395, June 1981.
[8] D.A. Forsyth and A. Zisserman, “Reflections on Shading,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 13, no. 7, pp. 671-679, July 1991.
[9] P. Fua, “A Parallel Stereo Algorithm that Produces Dense Depth Maps and Preserves Image Features,” Machine Vision and Applications, vol. 6, no. 1, pp. 35-49, Winter 1993.
[10] P. Fua, “Regularized Bundle-Adjustment to Model Heads from Image Sequences without Calibration Data,” Int'l J. Computer Vision, vol. 38, no. 2, July 2000.
[11] P. Fua and Y.G. Leclerc, “Object-Centered Surface Reconstruction: Combining Multi-Image Stereo and Shading,” Int'l J. Computer Vision, vol. 16, pp. 35-56, Sept. 1995.
[12] A.S. Georghiades, P.N. Belhumeur, and D.J. Kriegman, “Illumination-Based Image Synthesis: Creating Novel Images of Human Faces under Differing Pose and Lighting,” Proc. IEEE Workshop Multiple-View Modeling and Analysis of Visual Scenes, pp. 47-54, 1999.
[13] A. Gruen and H.A. Beyer, “System Calibration through Self-Calibration,” Proc. Workshop Calibration and Orientation of Cameras in Computer Vision, Aug. 1992.
[14] R. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision. Cambridge Univ. Press, 2000.
[15] R.I. Hartley, In Defense of the 8-Point Algorithm IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 6, pp. 580-593, June 1997.
[16] R. Hartley, R. Gupta, and T. Chang, “Stereo from Uncalibrated Cameras,” Proc. Conf. Computer Vision and Pattern Recognition, pp. 761-764, June 1992.
[17] H. Hayakawa, “Photometric Stereo under a Light-Source with Arbitrary Motion,” J. Optical Soc. Am. A, vol. 11, no. 11, pp. 3079-3089, Nov. 1994.
[18] B.K. Horn, Robot Vision. Cambridge, Mass.: MIT Press, 1986.
[19] B.K.P. Horn and M.J. Brooks, Shape from Shading. MIT Press, 1989.
[20] K. Ikeuchi and K. Sato, “Determining Reflectance Properties of an Object Using Range and Brightness Images,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 13, no. 11, pp. 1139-1153, Nov. 1991.
[21] H.C. Longuet-Higgins, “A Computer Algorithm for Reconstructing a Scene from Two Projections,” Nature, vol. 293, pp. 133-135, 1981.
[22] Q.-T. Luong and O.D. Faugeras, “The Fundamental Matrix: Theory, Algorithms, and Stability Analysis,” Int'l J. Computer Vision, vol. 17, no. 1, pp. 43-76, 1996.
[23] Q.-T. Luong and O. Faugeras, “Camera Calibration, Scene Motion and Structure Recovery from Point Correspondences and Fundamental Matrices,” Int'l J. Computer Vision, vol. 22, no. 3, pp. 261-289, 1997.
[24] S. Marschner, “Inverse Rendering for Computer Graphics,” PhD thesis, Cornell Univ., 1998.
[25] S. Marschner and D. Greenberg, “Inverse Lighting for Photography,” Proc. IST/SID Fifth Color Imaging Conf., pp. 262-265, 1997.
[26] T. Mitsunaga and S.K. Nayar, “Radiometric Self Calibration,” Proc. Conf. Computer Vision and Pattern Recognition, vol. I, pp. 374-380, 1999.
[27] Y. Moses, “Face Recognition: Generalization to Novel Images,” PhD thesis, The Weizmann Inst. of Science, Israel, 1993.
[28] N. Mukawa, “Estimation of Shape, Reflection Coefficients and Illumination Direction from Image Sequences,” Proc. IEEE Int'l Conf. Computer Vision, pp. 507–512, 1990.
[29] W.H. Press, B.P. Flannery, S.A. Teukolsky, and W.T. Vetterling, Numerical Recipes, the Art of Scientific Computing. Cambridge, Mass.: Cambridge Univ. Press, 1986.
[30] I. Sato, Y. Sato, and K. Ikeuchi, “Illumination Distribution from Brightness in Shadows: Adaptive Estimation of Illumination Distribution with Unknown Reflectance Properties in Shadow Regions,” Proc. Int'l Conf. Computer Vision, pp. 875-883, 1999.
[31] Y. Sato, M.D. Wheeler, and K. Ikeuchi, “Object Shape and Reflectance Modeling from Observation,” Proc. SIGGRAPH '97, pp. 379-387, 1997.
[32] A. Shashua, “On Photometric Issues in 3D Visual Recognition from a Single 2D Image,” Int'l J. Computer Vision, vol. 21, nos. 1-2, pp. 99-122, Jan. 1997.
[33] W. Silver, “Determining Shape and Reflectance Using Multiple Images,” PhD thesis, Massachusetts Inst. of Tech nology, 1990.
[34] R. Szeliski, “Stereo Algorithms and Representations for Image-Based Rendering,” Proc. British Machine Vision Conf., vol. II, pp. 314-328, 1999.
[35] R.J. Woodham, “Photometric Method for Determining Surface Orientation from Multiple Images,” Optical Eng., vol. 19, no. 1, pp. 139-144, Jan. 1980.
[36] Y. Yu, P. Debevec, J. Malik, and T. Hawkins, “Inverse Global Illumination: Recovering Reflectance Models of Real Scenes from Photographs,” Proc. SIGGRAPH '99, pp. 215-224, July 1998.
[37] A.L. Yuille, D. Snow, R. Epstein, and P.N. Belhumeur, “Determining Generative Models of Objects under Varying Illumination: Shape and Albedo from Multiple Images Using SVD and Integrability,” Int'l J. Computer Vision, vol. 35, no. 3, pp. 1-20, Dec. 1999.
[38] Q. Zheng and R. Chellappa, Estimation of Illuminant Direction, Albedo, and Shape from Shading IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 13, no. 7, pp. 680-702, July 1991.
Index Terms:
Reconstruction, multiple views, linear models, radiometric recovery, Lambertian reflection, point light sources, ambiant illumination, surface albedo.
Citation:
Q.-Tuan Luong, Pascal Fua, Yvan G. Leclerc, "The Radiometry of Multiple Images," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 24, no. 1, pp. 19-33, Jan. 2002, doi:10.1109/34.982882
