| | This Article | |
| |
| |
| | Share | |
| |
| |
| | Bibliographic References | |
| |
| |
| | Add to: | |
| |
 Digg
 Furl
 Spurl
 Blink
 Simpy
 Google
 Del.icio.us
 Y!MyWeb
| |
| | Search | |
| |
| |
| | |
Time-to-Collision Estimation from Motion Based on Primate Visual Processing
August 2005 (vol. 27 no. 8)
pp. 1279-1291
A population coded algorithm, built on established models of motion processing in the primate visual system, computes the time-to-collision of a mobile robot to real-world environmental objects from video imagery. A set of four transformations starts with motion energy, a spatiotemporal frequency based computation of motion features. The following processing stages extract image velocity features similar to, but distinct from, optic flow; "translation” features, which account for velocity errors including those resulting from the aperture problem; and finally, estimate the time-to-collision. Biologically motivated population coding distinguishes this approach from previous methods based on optic flow. A comparison of the population coded approach with the popular optic flow algorithm of Lucas and Kanade against three types of approaching objects shows that the proposed method produces more robust time-to-collision information from a real world input stimulus in the presence of the aperture problem and other noise sources. The improved performance comes with increased computational cost, which would ideally be mitigated by special purpose hardware architectures.
[1] H.C. Longuet-Higgins and K. Prazdny, “The Interpretation of a Moving Retinal Image,” Proc. Royal Soc. London B, vol. 208, pp. 385-397, 1980.
[2] J.L. Barron, D.J. Fleet, and S.S. Beauchemin, “Performance of Optical Flow Techniques,” Int'l J. Computer Vision, vol. 12, no. 1, pp. 43-77, 1994.
[3] D. Coombs, M. Herman, T.-H. Hong, and M. Nashman, “Real-Time Obstacle Avoidance Using Central Flow Divergence, and Peripheral Flow,” IEEE Trans. Robotics and Automation, vol. 14, no. 1, pp. 49-59, Feb. 1998.
[4] A. Branca, E. Stella, and A. Distante, “Passive Navigation Using Egomotion Estimates,” Image and Vision Computing, vol. 18, pp. 833-841, 2000.
[5] C. Colombo, “Time to Collision from First-Order Spherical Image Motion,” Robotics and Autonomous Systems, vol. 31, pp. 5-15, 2000.
[6] F.G. Meyer, “Time-to-Collision from First-Order Models of the Motion Field,” IEEE Trans. Robotics and Automation, vol. 10, no. 6, pp. 792-798, 1994.
[7] G. Sandini and M. Tistarelli, “Active Tracking Strategy for Monocular Depth Inference over Multiple Frames,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 12, no. 1, pp. 13-27, Jan. 1990.
[8] R.C. Nelson and J.Y. Aloimonos, “Obstacle Avoidance Using Flow Field Divergence,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 11, no. 10, pp. 1102-1106, Oct. 1989.
[9] High-Level Motion Processing: Computational, Neurobiological, and Psychophysical Perspectives, T. Watanabe, ed., MIT Press, 1998.
[10] S.E. Palmer, Vision Science: Photons to Phenomenology. MIT Press, 1999.
[11] J. Galbraith, “Vision Based Obstacle Avoidance Using Biological Models,” PhD dissertation, Univ. of Arizona, 2002.
[12] M. Blanchard, F.C. Rind, and P.F. Verschure, “Collision Avoidance Using a Model of the Locust LGMD Neuron,” Robotics and Autonomous Systems, vol. 30, pp. 17-38, 2000.
[13] D.N. Lee, “The Optic Flow Field: The Foundation of Vision,” Philosophical Trans. Royal Soc. London B, vol. 290, no. 1038, pp. 169-179, 1980.
[14] L.R. Harris and M.R.M. Jenk, Computational and Psychophysical Mechanisms of Visual Coding. Cambridge Univ. Press, 1997.
[15] S.J. Nowlan and T.J. Sejnowski, “Filter Selection Model for Motion Segmentation And Velocity Integration,” J. Optical Soc. Am. A, vol. 11, no. 12, pp. 3177-3200, Dec. 1994.
[16] Y. Weiss and D.J. Fleet, Probabalistic Models of the Brain: Perceptual and Neural Function, pp. 81-100, MIT Press, 2001.
[17] J.J. Tsai and J.D. Victor, “Reading a Population Code: A Multi-Scale Neural Model for Representing Binocular Disparity,” Vision Research, vol. 43, pp. 445-466, 2003.
[18] N. Lüdtke and R.C. Wilson, “A Mixture Model for Population Codes of Gabor Filters,” IEEE Trans. Neural Networks, vol. 14, no. 4, pp. 794-803, July 2003.
[19] E.P. Simoncelli, E.H. Adelson, and D.J. Heeger, “Probability Distributions of Optical Flow,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 310-315, June 1991.
[20] J. Santos-Victor and G. Sandini, “Embedded Visual Behaviors for Navigation,” Robotics and Autonomous Systems, vol. 19, pp. 299-313, 1997.
[21] P.J. Sobey, “Active Navigation with a Monocular Robot,” Biological Cybernetics, vol. 71, pp. 433-440, 1994.
[22] H. Neven and G. Schöner, “Dynamics Parametrically Controlled by Image Correlations Organize Robot Navigation,” Biological Cybernetics, vol. 75, pp. 293-307, 1996.
[23] B. Horn and B.G. Schunck, “Determining Optic Flow,” Artificial Intelligence, vol. 17, nos. 1-3, pp. 185-203, Aug. 1981.
[24] B.D. Lucas and T. Kanade, “An Iterative Image Registration Technique with an Application to Stereo Vision,” Proc. DARPA Image Understanding Workshop, pp. 121-130, Apr. 1981.
[25] J.A. Perrone, “Model for the Computation of Self-Motion in Biological Systems,” J. Optical Soc. Am. A, vol. 9, no. 2, pp. 177-194, 1992.
[26] D.J. Fleet and K. Langley, “Recursive Filters for Optical Flow,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 17, no. 1, pp. 61-67, Jan. 1995.
[27] T. Camus, “Real-Time Quantized Optical Flow,” Real-Time Imaging, vol. 3, no. 2, pp. 71-86, Apr. 1997.
[28] M. Proesmans, L.V. Gool, E. Pauwels, and A. Oosterlinck, “Determination of Optical Flow and Its Discontinuities Using Non-Linear Diffusion,” Lecture Notes in Computer Science, vol. 801, pp. 295-304, 1994.
[29] N.M. Grzywacz and A.L. Yuille, “A Model for the Estimate of Local Image Velocity by Cells in the Visual Cortex,” Proc. Royal Soc. London B, vol. 239, pp. 129-161, 1990.
[30] S.S. Beauchemin and J.L. Barron, “The Computation of Optical Flow,” ACM Computing Surveys, vol. 27, no. 3, pp. 433-467, Sept. 1995.
[31] E.H. Adelson and J.R. Bergen, “Spatiotemporal Energy Models for the Perception of Motion,” J. Optical Soc. Am. A, vol. 2, no. 2, pp. 284-299, Feb. 1985.
[32] C.W. G. Clifford and K. Langley, “Recursive Implementations of Temporal Filters for Image Motion Computation,” Biological Cybernetics, vol. 82, pp. 383-390, 2000.
[33] D. Heeger, “Model for the Extraction of Image Flow,” J. .Optical Soc. Am. A, vol. 4, no. 8, pp. 1455-1471, Aug. 1987.
[34] C.J. Duffy and R.H. Wurtz, “Sensitivity of MST Neurons to Optic Flow Stimuli, I. A Continuum of Response Selectivity to Large-Field Stimuli,” J. Neurophysiology, vol. 65, no. 6, pp. 1329-1345, June 1991.
[35] J.A. Perrone and L.S. Stone, “A Model of Self-Motion Estimation within Primate Extrastriate Visual Cortex,” Vision Research, vol. 34, no. 21, pp. 2917-2938, 1994.
Index Terms:
Index Terms- Motion processing, autonomous robotics, neuromorphic computing, computer vision, depth cues, time-to-collision, optic flow.
Citation:
John M. Galbraith, Garrett T. Kenyon, Richard W. Ziolkowski, "Time-to-Collision Estimation from Motion Based on Primate Visual Processing," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 27, no. 8, pp. 1279-1291, Aug. 2005, doi:10.1109/TPAMI.2005.168
