Issue No. 05 - May (2005 vol. 27)
Cristian Sminchisescu , IEEE
Dimitris Metaxas , IEEE
Sven Dickinson , IEEE
We present a model-based framework for incremental, adaptive object shape estimation and tracking in monocular image sequences. Parametric structure and motion estimation methods usually assume a fixed class of shape representation (splines, deformable superquadrics, etc.) that is initialized prior to tracking. Since the model shape coverage is fixed a priori, the incremental recovery of structure is decoupled from tracking, thereby limiting both processes in their scope and robustness. In this work, we describe a model-based framework that supports the automatic detection and integration of low-level geometric primitives (lines) incrementally. Such primitives are not explicitly captured in the initial model, but are moving consistently with its image motion. The consistency tests used to identify new structure are based on trinocular constraints between geometric primitives. The method allows not only an increase in the model scope, but also improves tracking accuracy by including the newly recovered features in its state estimation. The formulation is a step toward automatic model building, since it allows both weaker assumptions on the availability of a prior shape representation and on the number of features that would otherwise be necessary for entirely bottom-up reconstruction. We demonstrate the proposed approach on two separate image-based tracking domains, each involving complex 3D object structure and motion.
Shape recovery, object tracking, parametric models, geometric constraints, bundle adjustment, optimization.
S. Dickinson, D. Metaxas and C. Sminchisescu, "Incremental Model-Based Estimation Using Geometric Constraints," in IEEE Transactions on Pattern Analysis & Machine Intelligence, vol. 27, no. , pp. 727-738, 2005.