This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
The Active Recovery of 3D Motion Trajectories and Their Use in Prediction
March 1997 (vol. 19 no. 3)
pp. 219-234

Abstract—This paper describes the theory and real-time implementation using an active camera platform of a method of planar trajectory recovery, and of the use of those trajectories to facilitate prediction over delays in the visual feedback loop. Image-based position and velocity demands for tracking are generated by detecting and segmenting optical flow within a central region of the image, and a projective construct is used to map the camera platform's joint angles into a Euclidean coordinate system within a plane, typically the ground plane, in the scene. A set of extended Kalman filters with different dynamics is implemented to analyze the trajectories, and these compete to provide the best description of the motion within an interacting multiple model. Prediction from the optimum motion model is used within the visual feedback loop to overcome visual latency. It is demonstrated that prediction from the 3D planar description gives better tracking performance than prediction based on a filtered description of observer-based 2D motion trajectories.

[1] P.M. Sharkey, D.W. Murray, S. Vandevelde, I.D. Reid, and P.F. McLauchlan, "A Modular Head/Eye Platform for Real-Time Reactive Vision," Mechatronics, vol. 3, no. 4, pp. 517-535, 1993.
[2] D.W. Murray, P.F. McLauchlan, I.D. Reid, and P.M. Sharkey, "Reactions to Peripheral Image Motion Using a Head/Eye Platform," Proc. Fourth Int'l Conf. Computer Vision, pp. 403-411,Berlin, 1993. Los Alamitos, Calif.: IEEE CS Press, 1993.
[3] D.W. Murray, K.J. Bradshaw, P.F. McLauchlan, I.D. Reid, and P.M. Sharkey, "Driving Saccade to Pursuit Using Image Motion," Int'l J. Computer Vision, vol. 16, no. 3, pp. 205-228, 1995.
[4] I.D. Reid and D.W. Murray, "Tracking Foveated Corner Clusters Using Affine Structure," Proc. Fourth Int'l Conf. Computer Vision, pp. 76-83,Berlin, 1993. Los Alamitos, Calif.: IEEE CS Press, 1993.
[5] I.D. Reid and D.W. Murray, "Active Tracking of Foveated Feature Clusters Using Affine Structure," Int'l J. Computer Vision, vol. 18, no. 1, pp. 1-20, 1996.
[6] K.J. Bradshaw, P.F. McLauchlan, I.D. Reid, and D.W. Murray, "Saccade and Pursuit on an Active Head/Eye Platform," Image and Vision Computing, vol. 12, no. 3, pp. 155-163, 1994.
[7] C.M. Brown, "Gaze Control with Interactions and Delays," IEEE Trans. Systems, Man and Cybernetics, vol. 63, pp. 61-70, 1990.
[8] C.M. Brown, "Prediction and Cooperation in Gaze Control," Biological Cybernetics, vol. 63, pp. 61-70, 1990.
[9] J.J. Clark and N.J. Ferrier, “Modal Control of an Attentive Vision System,” Proc. Second Int'l Conf. Computer Vision, 1988.
[10] P.M. Sharkey and D.W. Murray, "Coping With Delays for Real-Time Gaze Control," Proc. SPIE Sensor Fusion VI,Boston Mass., Sept. 1993
[11] R. H. S. Carpenter, Movements of the Eyes.London: Pion, 1988.
[12] S.M. Fairley, I.D. Reid, and D.W. Murray, "Transfer of Fixation for an Active Stereo Platform via Affine Structure Recovery," Proc. Fifth Int'l Conf. Computer Vision, pp. 1,100-1,105,Cambridge Mass., 1995. Los Alamitos, Calif.: IEEE CS Press, 1995.
[13] T.N. Tan, G.D. Sullivan, and K.D. Baker, "Structure From Motion Using Ground Plane Constraint," Proc. Second European Conf. Computer Vision, pp. 277-281,Santa Margherita, Italy, 1992. Heidelberg: Springer-Verlag.
[14] G.D. Sullivan, "Visual Interpretation of Known Objects in Constrained Scenes," Phil. Trans. Royal Soc. London, vol. B337, pp. 109-118, 1992.
[15] M. Mohnhaupt and B. Neumann, "Understanding Object Motion: Recognition, Learning, and Spatiotemporal Reasoning," Robotics and Autonomous Systems, vol. 8, pp. 65-91, 1991.
[16] D. Koller, K. Danilidis, T. Thórhallson, and H.-H. Nagel, "Model-Based Object Tracking in Traffic Scenes," Proc. Second European Conf. Computer Vision, pp. 437-452,Santa Margherita, Italy, 1992. Heidelberg: Springer-Verlag.
[17] D. Koller, D. Danilidis, and H.-H. Nagel, "Model-Based Object Tracking in Monocular Image Sequences of Road Traffic Scenes," Int'l J. Computer Vision, vol. 10, no. 3, pp. 257-281, 1993.
[18] S. Intille and A. Bobick, “Closed-World Tracking,” Proc. Fifth Int'l Conf. Computer Vision, pp 672-678, 1995.
[19] H.A.K. Blom, "An Efficient Filter for Abruptly Changing Systems," Proc. 23rd IEEE Conf. Decision Control, pp. 656-658, 1984.
[20] K. Pahlavan and J.-O. Eklundh, "A Head-Eye System-Analysis and Design," CVGIP: Image Understanding, vol. 56, no. 1, pp. 41-56, 1992.
[21] K. Pahlavan, T. Uhlin, and J.-O. Eklundh, "Dynamic Fixation," Proc. Fourth Int'l Conf. Computer Vision, pp. 412-419,Berlin, 1993. Los Alamitos Calif.: IEEE CS Press, 1993.
[22] A. Blake, R. Curwen, and A. Zisserman, "A Framework for Spatiotemporal Control in the Tracking of Visual Contours," Int'l J. Computer Vision, vol. 11, no. 2, pp. 127-146, 1993.
[23] B.K.P. Horn and B.G. Schunck, "Determining Optical Flow," Artificial Intelligence, vol. 17, pp. 185-203, 1981.
[24] J.L. Mundy and A.P. Zisserman, eds., Geometric Invariance in Computer Vision.Cambridge Mass.: MIT Press, 1992.
[25] J. Canny, "A Computational Approach to Edge Detection," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 8, no. 6, pp. 679-698, 1986.
[26] G.A. Watson and W.D. Blair, "IMM Algorithm for Tracking Targets that Maneuver Through Coordinated Turns," SPIE Proc. Signal and Data Processing of Small Targets, SPIE vol. 1,698, pp. 236-247, 1992.
[27] G.A. Watson and W.D. Blair, "The IMM Algorithm and Aperiodic Data," SPIE Proc. Acquisition, Tracking and Pointing VI, SPIE vol. 1,697, pp. 83-91, 1992.
[28] Y. Bar-Shalom, K.C. Chang, and H.A. Blom, "Tracking a Maneuvering Target Using Input Estimation Versus the Interacting Multiple Model Algorithm," IEEE Trans. Aerospace and Electronic Systems, vol. 25, no. 2, pp. 296-300, 1989.
[29] C-B. Chang and J.A. Tabaczynski, "Application of State Estimation to Target Tracking," IEEE Trans. Automatic Control, vol. 29, no. 2, pp. 98-109, 1984.
[30] P. Andersson, "Adaptive Forgetting in Recursive Identification Through Multiple Models," Int'l J. Control, vol. 42, no. 5, pp. 1,175-1,193, 1985.
[31] J. Pearl, Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference.San Mateo Calif.: Morgan Kauffman, 1988.
[32] K.J. Bradshaw, Active Visual Surveillance, DPhil Thesis, Univ. of Oxford, 1995.

Index Terms:
Active vision, active camera platform, visual tracking, ground plane motion, interacting filters, prediction.
Citation:
Kevin J. Bradshaw, Ian D. Reid, David W. Murray, "The Active Recovery of 3D Motion Trajectories and Their Use in Prediction," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 19, no. 3, pp. 219-234, March 1997, doi:10.1109/34.584099
Usage of this product signifies your acceptance of the Terms of Use.