Issue No. 05 - May (2014 vol. 36)
Tony Tung , Grad. Sch. of Inf., Kyoto Univ., Kyoto, Japan
Takashi Matsuyama , Grad. Sch. of Inf., Kyoto Univ., Kyoto, Japan
This paper presents a novel approach that achieves dynamic surface alignment by geodesing mapping. The surfaces are 3D manifold meshes representing non-rigid objects in motion (e.g., humans) which can be obtained by multiview stereo reconstruction. The proposed framework consists of a geodesic mapping (i.e., geodesic diffeomorphism) between surfaces which carry a distance function (namely the global geodesic distance), and a geodesic-based coordinate system (namely the global geodesic coordinates) defined similarly to generalized barycentric coordinates. The coordinates are used to recursively choose correspondence points in non-ambiguous regions using a coarse-to-fine strategy to reliably locate all surface points and define a discrete mapping. Complete point-to-point surface alignment with smooth mapping is then derived by optimizing a piecewise objective function within a probabilistic framework. The proposed technique only relies on surface intrinsic geometrical properties, and does not require prior knowledge on surface appearance (e.g., color or texture), shape (e.g., topology) or parameterization (e.g., mesh connectivity or complexity). The method can be used for numerous applications, such as visual information (e.g., texture) transfer between surface models representing different objects, dense motion flow estimation of 3D dynamic surfaces, wide-timeframe matching, etc. Experiments show compelling results on challenging publicly available real-world datasets.
stereo image processing, differential geometry, image reconstruction, probability,surface intrinsic geometrical properties, geodesic mapping, dynamic surface alignment, 3D manifold mesh, multiview stereo reconstruction, geodesic diffeomorphism, distance function, global geodesic distance, geodesic-based coordinate system, global geodesic coordinates, generalized barycentric coordinates, coarse-to-fine strategy, discrete mapping, point-to-point surface alignment, smooth mapping, piecewise objective function optimization, probabilistic framework,Surface reconstruction, Three-dimensional displays, Surface treatment, Surface texture, Shape, Topology, Robustness,MRF, Geodesic mapping, non-rigid surface alignment, dynamic surface, multiple view stereo,MRF, Geodesic mapping, surface alignment, dynamic surface, non-rigid deformation, 3D video
Tony Tung, Takashi Matsuyama, "Geodesic Mapping for Dynamic Surface Alignment", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol. 36, no. , pp. 901-913, May 2014, doi:10.1109/TPAMI.2013.179