| | This Article | |
| |
| |
| | Share | |
| |
| |
| | Bibliographic References | |
| |
| |
| | Add to: | |
| |
 Digg
 Furl
 Spurl
 Blink
 Simpy
 Google
 Del.icio.us
 Y!MyWeb
| |
| | Search | |
| |
| |
| | |
Hyperpatches for 3D Model Acquisition and Tracking
December 2001 (vol. 23 no. 12)
pp. 1391-1403
Automatic 3D model acquisition and 3D tracking of simple objects under motion using a single camera is often difficult due to the sparsity of information from which to establish the model. We have developed an automatic scheme that first computes a simple pointalistic Euclidean model of the object and then enriches this model using hyperpatches. These hyperpatches contain information on both the orientation and intensity pattern variation of roughly planar patches on an object. This information allows both the spatial and intensity distortions of the projected patch to be modeled accurately under 3D object motion. Considering human tracking as a specific application, we show that hyperpatches can not only be computed automatically during model acquisition from a monocular image sequence, but that they are also extremely appropriate for the task of visual tracking.
[1] 1391 A. Azarbayejani, B. Horowitz, and A. Pentland, “Recursive Estimation of Structure and Motion Using the Relative Orientation Constraint,” Proc. Conf. Computer Vision and Pattern Recognition, pp. 294-299, 1993.[2] S. Basu, I. Essa, and A. Pentland, “Motion Regularization for Model-Based Head Tracking,” Proc. Int'l Conf. Pattern Recognition, 1996.[3] P.A. Beardsley, P. Torr, and A.P. Zisserman, “3D Model Acquisition from Extended Image Sequences,” Proc. Fourth European Conf. Computer Vision, B.F. Buxton and R. Cipolla, eds., Apr. 1996.[4] P.N. Belhumeur and D.J. Kriegman, “What Is the Set of Images of an Object under All Possible Illumination Conditions?” Int'l J. Computer Vision, vol. 28, no. 3, pp. 245-260, 1998.[5] M.J. Black and A.D. Jepson, “Eigentracking: Robust Matching and Tracking of Articulated Objects Using a View-Based Representations,” Proc. Fourth European Conf. Computer Vision, B.F. Buxton and R. Cipolla, eds., p. 329-342, Apr. 1996.[6] M. Isard and A. Blake, “Condensation-Conditional Density Propagation for Visual Tracking,” Int'l J. Computer Vision, vol. 29, pp. 5-28, 1998.[7] M. La Cascia, S. Sclaroff, and V. Athitsos, “Fast, Reliable Head Tracking under Varying Illumination: An Approach Based on Registration of Texture Mapped 3D Models,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 4, pp. 322-336, Apr. 2000.[8] J. Costeira and T. Kanade, “A Multibody Factorization Method for Independently Moving Objects,” Int'l J. Computer Vision, vol. 29, no. 31, pp. 159-179, 1998.[9] O.D. Faugeras, Three-Dimensional Computer Vision: A Geometric Viewpoint.Cambridge, Mass.: MIT Press, 1993.[10] M.A. Fischler and R.C. Bolles, “Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography,” Graphics and Image Processing, vol. 24, no. 6, pp. 381–395, June 1981.[11] J. Gårding and T. Lindeberg, “Direct Computation of Shape Cues Using Scale-Adapted Spatial Derivative Operators,” Int'l J. Computer Vision, vol. 17, no. 2, pp. 163-191, 1996.[12] A. Gee and R. Cipolla, “Fast Visual Tracking by Temporal Consensus,” Image and Vision Computing, vol. 14, pp. 105-114, 1995.[13] G. Hager and P. Belhumeur, “Efficient Region Tracking with Parametric Models of Geometry and Illumination,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 20, no. 10, pp. 1025-1039, Oct. 1998.[14] D.P. Huttenlocher and S. Ullman, “Recognizing Solid Objects by Alignment with an Image,” Int'l J. Computer Vision, vol. 5, no. 2, pp. 195-212, 1990.[15] A. Maki, M. Watanabe, and C.S. Wiles, “Geotensity: Combining Motion and Lighting for 3D Surface Reconstruction,” Proc. Sixth Int'l Conf. Computer Vision, pp. 1053-1060, Jan. 1998.[16] Y. Moses, Y. Adini, and S. Ullman, “Face Recognition: The Problem of Compensating for Changes in Illumination Direction,” Proc. Third European Conf. Computer Vision, pp. 286-296, J.-O. Eklundh, ed., May 1994.[17] J.M. Rehg and A.P. Witkin, “Visual Tracking with Deformation Models,” Proc. Int'l Conf. Robotics and Automation, pp. 844-850, 1991.[18] D. Reynard, A. Wildenberg, A. Blake, and J. Marchant, “Learning Dynamics of Complex Motions from Image Sequences,” Proc. Fourth European Conf. Computer Vision, B.F. Buxton and R. Cipolla, eds., pp. 357-368, Apr. 1996.[19] A. Shashua, “Geometry and Photometry in 3D Visual Recognition,” PhD dissertation, Dept. of Brain and Cognitive Sciences, Massachusetts Inst. of Technology, Cambridge, Nov. 1992.[20] C. Tomasi and T. Kanade, "Shape and Motion From Image Streams Under Orthography: A Factorization Method," Int'l J. Computer Vision, vol. 9, no. 2, pp. 137-154, 1992.[21] D. Weinshall and C. Tomasi, “Linear and Incremental Acquisition of Invariant Shape Models from Image Sequences,” Proc. Fourth Int'l Conf. Computer Vision, pp. 675-682, May 1993.
Index Terms:
Pose estimation, model acquisition, model tracking, face analysis
Citation:
C.S. Wiles, A. Maki, N. Matsuda, "Hyperpatches for 3D Model Acquisition and Tracking," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 23, no. 12, pp. 1391-1403, Dec. 2001, doi:10.1109/34.977563
