Issue No. 08 - Aug. (2012 vol. 34)
Fengchun Huang , Dept. ofMachine Intell., Peking Univ., Beijing, China
Yuru Pei , Dept. ofMachine Intell., Peking Univ., Beijing, China
Fuhao Shi , Dept. ofMachine Intell., Peking Univ., Beijing, China
Hongbin Zha , Dept. ofMachine Intell., Peking Univ., Beijing, China
This paper challenges the issue of automatic matching between two image sets with similar intrinsic structures and different appearances, especially when there is no prior correspondence. An unsupervised manifold alignment framework is proposed to establish correspondence between data sets by a mapping function in the mutual embedding space. We introduce a local similarity metric based on parameterized distance curves to represent the connection of one point with the rest of the manifold. A small set of valid feature pairs can be found without manual interactions by matching the distance curve of one manifold with the curve cluster of the other manifold. To avoid potential confusions in image matching, we propose an extended affine transformation to solve the nonrigid alignment in the embedding space. The comparatively tight alignments and the structure preservation can be obtained simultaneously. The point pairs with the minimum distance after alignment are viewed as the matchings. We apply manifold alignment to image set matching problems. The correspondence between image sets of different poses, illuminations, and identities can be established effectively by our approach.
unsupervised learning, image matching, structure preservation, unsupervised image matching, manifold alignment, automatic matching, image sets, intrinsic structures, unsupervised manifold alignment framework, mutual embedding space, mapping function, data sets, parameterized distance curves, Manifolds, Face, Image matching, Vectors, Databases, Lighting, Optimization, parameterized distance curve., Manifold alignment, unsupervised image set matching, nonrigid transformation
Fengchun Huang, Yuru Pei, Fuhao Shi, Hongbin Zha, "Unsupervised Image Matching Based on Manifold Alignment", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol. 34, no. , pp. 1658-1664, Aug. 2012, doi:10.1109/TPAMI.2011.229