This Article 
 Bibliographic References 
 Add to: 
Photometric Motion
September 1991 (vol. 13 no. 9)
pp. 879-890

The author compares the photometric effects of motion (which is defined as the variation of a point's imaged intensity as a consequence of motion) and the geometric effects of motion (which is defined as the variation in projected surface geometry as a consequence of motion). It is shown that photometric motion provides a cue to surface shape that is potentially as useful as that provided by geometric motion. A simple technique for using this photometric motion information to extract both surface shape and reflectance is developed, and a biological implementation is proposed. How this photometric motion mechanism can be integrated with and used to enhance existing structure-motion algorithms is discussed. Intensity information is sometimes even more important than geometric distortion when estimating the shape of a single, continuous surface that is rotating relative to the observer's frame of reference.

[1] E. Adelson and J. Bergen, "Spatiotemporal energy models for the perception of motion,"J. Opt. Soc. Amer. A, vol. 2, no. 2, pp. 284-299, 1985.
[2] E. Adelson and A. Pentland, "Wiener filtering to improve shape from shading, unpublished Tech. Memo.
[3] J. Daugman, "Two-dimensional analysis of cortical receptive field profiles,Vision Res., vol. 20, pp. 846-856, 1980.
[4] E. Hildreth, "The computation of the velocity field,"Proc. Royal Soc. London B, no. 221, pp. 189-220, 1984.
[5] P. Kube and A. Pentland, "On the imaging of fractal surfaces,"IEEE Trans. Patt. Anal. Machine Vision, vol. 10, no. 5, pp. 704-707, 1988.
[6] B. K. P. Horn, R. J. Woodham, and W. M. Silver, "Determining shape and reflectance using multiple images, M. I. T. AI Memo 490, Aug. 1978.
[7] B. K. P. Horn and E. J. Weldon, "Direct methods for recovering motion,"Int. J. Comput. Vision, vol. 2, no. 1, pp. 51-76, 1988.
[8] B. K. P. Horn, "Height and gradient from shading,"Int. J. Comput. vision, vol. 5, no. 1, pp. 37-67, 1990.
[9] A. Pentland, "Finding the illuminant direction,"Opt. Soc. Amer., vol. 72, no. 4, pp. 448-455, 1982.
[10] A. Pentland, "Fractal-based description of natural scenes,"IEEE Trans. Patt. Anal. Machine Recognition, vol. 6, no. 6, pp. 661-674, Nov. 1984.
[11] A. Pentland, "Linear shaoe from shading,"Int. J. Comput. Vision, vol. 4, pp. 153-162, 1990.
[12] A. Pentland, "Shape information from shading: A theory of human perception,"Spatial Vision, vol. 4, nos. 3/4, pp. 165-182, 1990.
[13] A. Pentland, "Automatic extraction of deformable part models,"Int. J. Comput. Vision, vol. 4, pp. 107-126, 1990.
[14] A. Verri and T. Poggio, "Against the quantitative optical flow," inProc. First Int. Conf. Comput. vision(London), June 8-11, 1987, pp. 171-179.
[15] A. Watson and A. Ahumada, "Model of human visual motion sensing,"J. Opt. Soc. Amer. A, vol. 2, no. 2, pp. 322-342, 1985.
[16] R. J. Woodham, "Photometric method for determing surface orientation from multiple images,"Opt. Eng., vol. 19, no. 1, pp. 139-144, 1980.

Index Terms:
3D shape recovery; geometric motion; picture processing; photometric motion; reflectance; structure-motion algorithms; geometric distortion; pattern recognition; picture processing
A. Pentland, "Photometric Motion," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 13, no. 9, pp. 879-890, Sept. 1991, doi:10.1109/34.93807
Usage of this product signifies your acceptance of the Terms of Use.