The Community for Technology Leaders
Green Image
Issue No. 09 - September (2011 vol. 33)
ISSN: 0162-8828
pp: 1793-1805
Nikos Paragios , Laboratoire MAS, Ecole Centrale de Paris, Chatenay-Malabry and INRIA Saclay - Ile-de-France, Orsay
David J. Fleet , University of Toronto, Toronto
Martin de La Gorce , Laboratoire MAS, Ecole Centrale de Paris, Chatenay-Malabry
ABSTRACT
A novel model-based approach to 3D hand tracking from monocular video is presented. The 3D hand pose, the hand texture, and the illuminant are dynamically estimated through minimization of an objective function. Derived from an inverse problem formulation, the objective function enables explicit use of temporal texture continuity and shading information while handling important self-occlusions and time-varying illumination. The minimization is done efficiently using a quasi-Newton method, for which we provide a rigorous derivation of the objective function gradient. Particular attention is given to terms related to the change of visibility near self-occlusion boundaries that are neglected in existing formulations. To this end, we introduce new occlusion forces and show that using all gradient terms greatly improves the performance of the method. Qualitative and quantitative experimental results demonstrate the potential of the approach.
INDEX TERMS
Hand tracking, model based shape from shading, generative modeling, pose estimation, variational formulation, gradient descent.
CITATION
Nikos Paragios, David J. Fleet, Martin de La Gorce, "Model-Based 3D Hand Pose Estimation from Monocular Video", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol. 33, no. , pp. 1793-1805, September 2011, doi:10.1109/TPAMI.2011.33
91 ms
(Ver 3.1 (10032016))