This Article 
 Bibliographic References 
 Add to: 
Single Lens Stereo with a Plenoptic Camera
February 1992 (vol. 14 no. 2)
pp. 99-106

Ordinary cameras gather light across the area of their lens aperture, and the light striking a given subregion of the aperture is structured somewhat differently than the light striking an adjacent subregion. By analyzing this optical structure, one can infer the depths of the objects in the scene, i.e. one can achieve single lens stereo. The authors describe a camera for performing this analysis. It incorporates a single main lens along with a lenticular array placed at the sensor plane. The resulting plenoptic camera provides information about how the scene would look when viewed from a continuum of possible viewpoints bounded by the main lens aperture. Deriving depth information is simpler than in a binocular stereo system because the correspondence problem is minimized. The camera extracts information about both horizontal and vertical parallax, which improves the reliability of the depth estimates.

[1] J.P. Richter, ed.,The Notebooks of Leonardo da Vinci. New York: Dover, 1970, p. 39, vol. 1.
[2] W. E. L. Grimson,From Images to Surfaces: A Computational Study of the Human Early visual System. Cambridge, MA: MIT Press, 1981.
[3] M. Ito and A. Ishii, "Three-view stereo analysis,"IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-8, pp. 524-531, July 1986.
[4] N. Ayache and F. Lustman, "Fast and reliable passive trinocular stereo-vision," inProc. ICCV, pp. 422-427.
[5] R. C. Bolles, H. H. Baker, and D. H. Marimont, "Epipolar-plane image analysis: An approach to determining structure from motion,"Int. J. Camp. Vis., vol. 1, pp. 7-55, 1987.
[6] A. P. Pentland, "A new sense for depth of field,"IEEE Trans. Patt. Anal. Machine Intell., vol. PAMI-9, no. 4, pp. 523-531, July 1987.
[7] V. M. Bove, Jr., "Probabilistic method for integrating multiple sources of range data,"J. Opt. Soc. Amer. A, vol. 7, pp. 2193-2207, 1990.
[8] E. H. Adelson and J. R. Bergen, "The plenoptic function and the elements of early vision," inComputational Models of Visual Processing(M. Landy and J. A. Movshon, Eds.). Cambridge, MA: MIT Press, 1991.
[9] J. J. Gibson,The Senses Considered as Perceptual Systems. Boston: Houghton Mifflin, 1966.
[10] G. Lippmann, "Epreuves reversibles donnant la sensation du relief,"J. Phys. 7, pp. 821-825, 1908.
[11] H. E. Ives, "Parallax panoramagrams made with a large diameter lens,"J. Opt. Soc. Amer., vol. 20, pp. 332-342, 1930.
[12] T. Okoshi,Three Dimensional Imaging Techniques. New York: Academic, 1976.
[13] S. F. Ray,Applied Photographic Optics: Imaging Systems for Photography, Film, and video. Boston: Focal, 1988.
[14] B. D. Lucas and T. Kanade, "An iterative image registration technique with an application to stereo vision," inProc. Image Understanding Workshop, pp. 121-130.
[15] C. Cafforio and F. Rocca, "Methods for measuring small displacements of television images,"IEEE Trans. Inform. Theory, vol. IT-22, pp. 573-579, 1976.
[16] E. H. Adelson and J. R. Bergen, "Spatiotemporal energy models for the perception of motion,"J. Opt. Soc. Amer., vol. A2, pp. 284-299, 1985.
[17] W. E. L. Grimson, "An implementation of a computational theory of visual surface interpolation,"Comput. vision Graphics, Image Processing, vol. 22, pp. 39-69, 1983.
[18] D. Terzopoulos, "The computation of visible surface representations,"IEEE Trans. Patt. Anal. Machine Intell., vol. 10, pp. 417-439, 1988.
[19] T. Poggio, V. Torre, and C. Koch, "Computational vision and regularization theory,"Nature, vol. 317, pp. 314-319, 1985.

Index Terms:
horizontal parallax; picture processing; plenoptic camera; single lens stereo; lenticular array; lens aperture; depth information; vertical parallax; cameras; optical information processing; photographic lenses; picture processing
E.H. Adelson, J.Y.A. Wang, "Single Lens Stereo with a Plenoptic Camera," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 14, no. 2, pp. 99-106, Feb. 1992, doi:10.1109/34.121783
Usage of this product signifies your acceptance of the Terms of Use.