This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
The Use of Force Histograms for Affine-Invariant Relative Position Description
January 2004 (vol. 26 no. 1)
pp. 1-18

Abstract—Affine invariant descriptors have been widely used for recognition of objects regardless of their position, size, and orientation in space. Examples of color, texture, and shape descriptors abound in the literature. However, many tasks in computer vision require looking not only at single objects or regions in images but also at their spatial relationships. In an earlier work, we showed that the relative position of two objects can be quantitatively described by a histogram of forces. Here, we study how affine transformations affect this descriptor. The position of an object with respect to another changes when the objects are affine transformed. We analyze the link between 1) the applied affinity, 2) the relative position before transformation (described through a force histogram), and 3) the relative position after transformation. We show that any two of these elements allow the third one to be recovered. Moreover, it is possible to determine whether (or how well) two relative positions are actually related through an affine transformation. If they are not, the affinity that best approximates the unknown transformation can be retrieved, and the quality of the approximation assessed.

[1] M.J. Swain and D.H. Ballard, “Indexing via Color Histograms,” Proc. Defense Advanced Research Projects Agency Conf., pp. 623-630, 1990.
[2] R.M. Haralick, K. Shanmugam, and I. Dinstein, “Textural Features for Image Classification,” IEEE Trans. Systems, Man, and Cybernetics, vol. 3, no. 6, pp. 610-621, 1973.
[3] M.-K. Hu, “Visual Pattern Recognition by Moment Invariants,” IRE Trans. Information Theory, vol. 8, pp. 179-187, 1962.
[4] Proc. Invariants for Recognition, ESPRIT Workshop, Second European Conf. Computer Vision, H. Burkhardt and A. Zisserman, eds., May 1992.
[5] Y. Cheng, “Analysis of Affine Invariants as Approximate Perspective Invariants,” Computer Vision & Image Understanding, vol. 63, no. 2, pp. 197-207, 1996.
[6] F. Mindru, T. Moons, and L. Van Gool, “Recognizing Color Patterns Irrespective of Viewpoint and Illumination,” IEEE Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 368-373, June 1999.
[7] F. Schaffalitzky and A. Zisserman, “Viewpoint Invariant Texture Matching and Wide Baseline Stereo,” Proc. IEEE Int'l Conf. Computer Vision, vol. 2, pp. 636-643, 2001.
[8] J. Flusser and T. Suk, “Pattern Recognition by Affine Moment Invariants,” PatternRecognition, vol. 26, no. 1, pp. 167-174, 1993.
[9] T.H. Reiss, “The Revised Fundamental Theorem of Moment Invariants,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 13, no. 8, pp. 830-834, Aug. 1991.
[10] D. Zhao and J. Chen, “Affine Curve Moment Invariants for Shape Recognition,” PatternRecognition, vol. 30, no. 6, pp. 895-901, 1997.
[11] Z. Yang and F.S. Cohen, “Cross-Weighted Moments and Affine Invariants for Image Registration and Matching,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 21, no. 8, pp. 804-814, Aug. 1999.
[12] K. Arbter, W.E. Snyder, H. Burkhardt, and G. Hirzinger, “Application of Affine-Invariant Fourier Descriptors to Recognition of 3D objects,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 12, pp. 640-647, 1990.
[13] I. Rothe, H. Susse, and K. Voss, “The Method of Normalization to Determine Invariants,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 18, no. 4, pp. 366-376, Apr. 1996.
[14] F.S. Cohen, Z. Huang, and Z. Yang, “Invariant Matching and Identification of Curves Using B-Splines Curve Representation,” IEEE Trans. Image Processing, vol. 4, no. 1, pp. 1-10, 1995.
[15] F. Mokhtarian and S. Abbasi, “Shape Similarity Retrieval under Affine Transforms,” Pattern Recognition, vol. 35, no. 1, pp. 31-41, 2002.
[16] B. Li and S. De Ma, “On the Relation between Region and Contour Representation,” Proc. IAPR Int'l Conf. Pattern Recognition, vol. 1, pp. 352-355, 1994.
[17] S.-S. Wang, P.-C. Chen, and W.-G. Lin, “Invariant Pattern Recognition by Moment Fourier Descriptor,” Pattern Recognition, vol. 27, no. 12, pp. 1735-1742, 1994.
[18] T.S. Levitt and D.T. Lawton, “Qualitative Navigation for Mobile Robots,” Artificial Intelligence, vol. 44, no. 3, pp. 305-360, 1990.
[19] S. Dutta, “Approximate Spatial Reasoning: Integrating Qualitative and Quantitative Constraints,” Int'l J. Approximate Reasoning, vol. 5, pp. 307-331, 1991.
[20] S.Y. Lee and F.J. Hsu, “Spatial Reasoning and Similarity Retrieval of Images Using 2D C-String Knowledge Representation,” Pattern Recognition, vol. 25, no. 3, pp. 305-318, 1992.
[21] J. Sharma and D.M. Flewelling, “Inferences from Combined Knowledge about Topology and Directions,” Proc. Int'l Symp. Spatial Databases, 1995.
[22] R. Krishnapuram, J.M. Keller, and Y. Ma, “Quantitative Analysis of Properties and Spatial Relations of Fuzzy Image Regions,” IEEE Trans. Fuzzy Systems, vol. 1, no. 3, pp. 222-233, 1993.
[23] K. Miyajima and A. Ralescu, “Spatial Organization in 2D Segmented Images: Representation and Recognition of Primitive Spatial Relations,” Fuzzy Sets and Systems, vol. 65, nos. 2/3, pp. 225-236, 1994.
[24] P. Matsakis, “Relations Spatiales Structurelles et Interprétation d'Images,” PhD thesis, Institut de Recherche en Informatique de Toulouse, France, 1998.
[25] P. Matsakis and L. Wendling, “A New Way to Represent the Relative Position between Areal Objects,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 21, no. 7, pp. 634-643, July 1999.
[26] P. Matsakis, “Understanding the Spatial Organization of Image Regions by Means of Force Histograms: A Guided Tour,” Applying Soft Computing in Defining Spatial Relations, P. Matsakis and L. Sztandera, eds., vol. 106, pp. 99-122, 2002.
[27] P. Matsakis, J. Keller, L. Wendling, J. Marjamaa, and O. Sjahputera, “Linguistic Description of Relative Positions in Images,” IEEE Trans. Systems, Man, and Cybernetics (Part B), vol. 31, no. 4, pp. 573-588, 2001.
[28] P. Matsakis and L. Wendling, “Orbit and Sinus Classification Based on Force Histogram Computation,” Proc. Int'l Conf. Pattern Recognition, vol. 2, pp. 451-454, Sept. 2000.
[29] M. Skubic, P. Matsakis, G. Chronis, and J. Keller, “Generating Multi-Level Linguistic Spatial Descriptions from Range Sensor Readings Using the Histogram of Forces,” Autonomous Robots, vol. 14, no. 1, pp. 51-69, 2003.
[30] C. Shyu and P. Matsakis, “Spatial Lesion Indexing for Medical Image Databases Using Force Histograms,” Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, vol. 2, pp. 603-608, Dec. 2001.
[31] J.D. Cutnell and K. Johnson, Physics, fifth ed. Wiley and Sons, 2001.
[32] S. Santini and R. Jain, “Similarity Measures,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 21, no. 9, pp. 871-883, Sept. 1999.
[33] X. Wang, B. De Baets, and E. Kerre, “A Comparative Study of Similarity Measures,” Fuzzy Sets and Systems, vol. 73, no. 2, pp. 259-268, 1995.
[34] C. Pappis and N. Karacapilidis, “A Comparative Assessment of Measures of Similarity of Fuzzy Values,” Fuzzy Sets and Systems, vol. 56, no. 2, pp. 171-174, 1993.
[35] P. Aschwanden and W. Guggenbühl, “Experimental Results from a Comparative Study on Correlation-Type Registration Algorithms,” Robust Computer Vision, W. Forstner and S. Ruwiedel, eds., pp. 268-289, 1992.
[36] M.A. Eshera and K.S. Fu, “An Image Understanding System Using Attributed Symbolic Representation and Inexact Graph-Matching,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 8, pp. 604-619, 1986.
[37] K.P. Chan and Y.S. Cheung, “Fuzzy-Attribute Graph with Application to Chinese Character Recognition,” IEEE Trans. Systems, Man, and Cybernetics, vol. 22, no. 1, pp. 153-160, 1992.
[38] S. Medasani and R. Krishnapuram, “A Fuzzy Approach to Content-Based Image Retrieval,” Proc. IEEE Int'l Conf. Fuzzy Systems, vol. 3, pp. 1251-1260, 1999.
[39] G.M. Petrakis, “Design and Evaluation of Spatial Similarity Approaches for Image Retrieval,” Image & Vision Computing, vol. 20, no. 1, pp. 59-76, 2002.

Index Terms:
Affine transformations, force histograms, spatial relations, descriptors, invariants, computer vision.
Citation:
Pascal Matsakis, James M. Keller, Ozy Sjahputera, Jonathon Marjamaa, "The Use of Force Histograms for Affine-Invariant Relative Position Description," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 26, no. 1, pp. 1-18, Jan. 2004, doi:10.1109/TPAMI.2004.10008
Usage of this product signifies your acceptance of the Terms of Use.