CSDL Home IEEE Transactions on Pattern Analysis & Machine Intelligence 2011 vol.33 Issue No.02 - February

Subscribe

Issue No.02 - February (2011 vol.33)

pp: 266-278

Ronen Basri , Weizmann Institute of Science, Rehovot

Tal Hassner , The Open University of Israel, Raanana

Lihi Zelnik-Manor , The Technion–Israel Institute of Technology, Haifa

ABSTRACT

Subspaces offer convenient means of representing information in many pattern recognition, machine vision, and statistical learning applications. Contrary to the growing popularity of subspace representations, the problem of efficiently searching through large subspace databases has received little attention in the past. In this paper, we present a general solution to the problem of Approximate Nearest Subspace search. Our solution uniformly handles cases where the queries are points or subspaces, where query and database elements differ in dimensionality, and where the database contains subspaces of different dimensions. To this end, we present a simple mapping from subspaces to points, thus reducing the problem to the well-studied Approximate Nearest Neighbor problem on points. We provide theoretical proofs of correctness and error bounds of our construction and demonstrate its capabilities on synthetic and real data. Our experiments indicate that an approximate nearest subspace can be located significantly faster than the nearest subspace, with little loss of accuracy.

INDEX TERMS

Approximate nearest neighbor search techniques, subspace representations.

CITATION

Ronen Basri, Tal Hassner, Lihi Zelnik-Manor, "Approximate Nearest Subspace Search",

*IEEE Transactions on Pattern Analysis & Machine Intelligence*, vol.33, no. 2, pp. 266-278, February 2011, doi:10.1109/TPAMI.2010.110REFERENCES

- [1] A. Andoni and P. Indyk, "Near-Optimal Hashing Algorithms for Approximate Nearest Neighbor in High Dimensions,"
Proc. 47th Ann. IEEE Symp. Foundations of Computer Science, pp. 459-468, 2006.- [2] A. Andoni, P. Indyk, R. Krauthgamer, and H.L. Nguyen, "Approximate Line Nearest Neighbor in High Dimensions,"
Proc. 20th Ann. ACM-SIAM Symp. Discrete Algorithms, pp. 293-301, 2009.- [3] S. Arya, D. Mount, N. Netanyahu, R. Silverman, and A. Wu, "An Optimal Algorithm for Approximate Nearest Neighbor Searching in Fixed Dimensions,"
J. ACM, vol. 45, no. 6, pp. 891-923, www.cs.umd.edu/mountANN/, 1998.- [4] J.J. Atick, P.A. Griffin, and A.N. Redlich, "Statistical Approach to Shape from Shading: Reconstruction of Three-Dimensional Face Surfaces from Single Two-Dimensional Images,"
Neural Computation, vol. 8, no. 6, pp. 1321-1340, 1996.- [5] R. Basri, T. Hassner, and L. Zelnik-Manor, "Approximate Nearest Subspace Search with Applications to Pattern Recognition,"
Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2007.- [6] R. Basri, T. Hassner, and L. Zelnik-Manor, "A General Framework for Approximate Nearest Subspace Search,"
Proc. IEEE Int'l Workshop Subspace Methods at IEEE Int'l Conf. Computer Vision, Sept. 2009.- [7] R. Basri and D. Jacobs, "Lambertian Reflectance and Linear Subspaces,"
IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, no. 2, pp. 218-233, Feb. 2003.- [8] J.L. Barron, D.J. Fleet, and S.S. Beauchemin, "Performance of Optical Flow Techniques"
Int'l J. Computer Vision, vol. 12, no. 1, pp. 43-77, 1994.- [9] M. Blank, L. Gorelick, E. Shechtman, M. Irani, and R. Basri, "Actions as Space-Time Shapes,"
Proc. 10th IEEE Int'l Conf. Computer Vision, www.cs.weizmann.ac.il/~visionSpaceTime Actions.html , pp. 1395-1402, 2005.- [10] V. Blanz and T. Vetter, "Face Recognition Based on Fitting a 3D Morphable Model,"
IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, no. 9, pp. 1063-1074, Sept. 2003.- [11] O. Boiman and M. Irani, "Similarity by Composition,"
Proc. Neural Information Processing Systems, vol. 19, pp. 177-184, 2006.- [12] E. Borenstein and S. Ullman, "Learning to Segment,"
Proc. Eighth European Conf. Computer Vision, vol. 3023, pp. 315-328, 2004.- [13] M.E. Brand, "Morphable 3D Models from Video,"
Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 2, pp. 456-463, 2001.- [14] C. Bregler, A. Hertzmann, and H. Biermann, "Recovering Non-Rigid 3D Shape from Image Streams,"
Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 2, pp. 690-696, 2000.- [15] M. Charikar, P. Indyk, and R. Panigrahy, "New Algorithms for Subset Query, Partial Match, Orthogonal Range Searching, and Related Problems,"
Proc. 29th Int'l Colloquium on Automata, Languages and Programming, pp. 451-462, 2002.- [16] M. Datar, N. Immorlica, P. Indyk, and V. Mirrokni, "Locality-Sensitive Hashing Scheme Based on P-Stable Distributions,"
Proc. 20th Ann. Symp. Computational Geometry, pp. 253-262, 2004.- [17] A. Edelman, T.A. Arias, and S.T. Smith, "The Geometry of Algorithms with Orthogonality Constraints,"
SIAM J. Matrix Analysis and Applications, vol. 20, no. 2 pp. 303-353, 1999.- [18] L. Fei-Fei and P. Perona, "A Bayesian Hierarchical Model for Learning Natural Scene Categories,"
Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2005.- [19] A. Fitzgibbon and A. Zisserman, "Joint Manifold Distance: A New Approach to Appearance Based Clustering,"
Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 26-33, 2003.- [20] A.S. Georghiades, P.N. Belhumeur, and D.J. Kriegman, "From Few to Many: Illumination Cone Models for Face Recognition under Variable Lighting and Pose,"
IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 6, pp. 643-660, June 2001.- [21] T. Hassner and R. Basri, "Example Based 3D Reconstruction from Single 2D Images,"
Proc. Beyond Patches Workshop, IEEE Conf. Computer Vision and Pattern Recognition, 2006.- [22] P. Indyk, R. Motwani, "Approximate Nearest Neighbors: Towards Removing the Curse of Dimensionality,"
Proc. 30th Ann. ACM Symp. Theory of Computing, pp. 604-613, 1998.- [23] M. Irani and P. Anandan, "Factorization with Uncertainty,"
Proc. Sixth European Conf. Computer Vision, vol. 1, pp. 539-553, 2000.- [24] W. Johnson and J. Lindenstrauss, "Extensions of Lipschitz Maps into a Hilbert Space,"
Contemporary Math, pp. 189-206, vol. 26, 1984.- [25] T. Liu, A.W. Moore, A. Gray, and K. Yang, "An Investigation of Practical Approximate Nearest Neighbor Algorithms,"
Proc. Neural Information Processing Systems, pp. 825-832, 2004.- [26] A. Magen, "Dimensionality Reductions That Preserve Volumes and Distance to Affine Spaces, and Their Algorithmic Applications,"
Randomization and Approximation Techniques in Computer Science, pp. 239-253, Springer, 2002.- [27] M. Muja and D.G. Lowe, "Fast Approximate Nearest Neighbors with Automatic Algorithm Configuration,"
Proc. Int'l Conf. Computer Vision Theory and Applications, pp. 331-340, 2009.- [28] P. Indyk and A. Naor, "Nearest Neighbor Preserving Embeddings,"
ACM Trans. Algorithms, vol. 3, no. 3, 2007.- [29] R. Ramamoorthi and P. Hanrahan, "On the Relationship between Radiance and Irradiance: Determining the Illumination from Images of Convex Lambertian Object,"
J. Optical Soc. of Am., vol. 18, no. 10, pp. 2448-2459, 2001.- [30]
Nearest-Neighbor Methods in Learning and Vision: Theory and Practice, G. Shakhnarovich, T. Darrell, and P. Indyk, eds., MIT Press, 2006.- [31] E. Shechtman and M. Irani, "Space-Time Behavior Based Correlation OR How to Tell If Two Underlying Motion Fields Are Similar without Computing Them?"
IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 29, no. 11, pp. 2045-2056, Nov. 2007.- [32] P. Simard, Y. LeCun, J. Denker, and B. Victorri, "Transformation Invariance in Pattern Recognition—Tangent Distance and Tangent Propagation,"
Neural Networks: Tricks of the Trade, pp. 227-239, Springer, 1998.- [33] C. Tomasi and T. Kanade, "Shape and Motion from Image Streams under Orthography: A Factorization Method,"
Int'l J. Computer Vision, vol. 9, no. 2, pp. 137-154, 1992.- [34] L. Torresani, D. Yang, G. Alexander, and C. Bregler, "Tracking and Modeling Non-Rigid Objects with Rank Constraints,"
Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 493-500, 2001.- [35] S. Ullman and R. Basri, "Recognition by Linear Combinations of Models,"
IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 13, no. 10, pp. 992-1006, Oct. 1991.- [36] J. Wright, A. Yang, A. Ganesh, S. Sastry, and Y. Ma, "Robust Face Recognition via Sparse Representation,"
IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 31, no. 2, pp. 210-227, Feb. 2009.- [37] O. Yamaguchi, K. Fukui, and K. Maeda, "Face Recognition Using Temporal Image Sequence,"
Proc. Third Int'l Conf. Face and Gesture Recognition, pp. a318-323, 1998.- [38] P.N. Yianilos, "Locally Lifting the Curse of Dimensionality for Nearest Neighbor Search,"
Proc. 11th Ann. ACM-SIAM Symp. Discrete Algorithms, extended abstract, pp. 361-370, 2000.- [39] H. Zhang, A.C. Berg, M. Maire, and J. Malik, "SVM-KNN: Discriminative Nearest Neighbor Classification for Visual Category Recognition,"
Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 2, pp. 2126-2136, 2006. |