This Article 
 Bibliographic References 
 Add to: 
WARP: Accurate Retrieval of Shapes Using Phase of Fourier Descriptors and Time Warping Distance
January 2005 (vol. 27 no. 1)
pp. 142-147
Effective and efficient retrieval of similar shapes from large image databases is still a challenging problem in spite of the high relevance that shape information can have in describing image contents. In this paper, we propose a novel Fourier-based approach, called WARP, for matching and retrieving similar shapes. The unique characteristics of WARP are the exploitation of the phase of Fourier coefficients and the use of the Dynamic Time Warping (DTW) distance to compare shape descriptors. While phase information provides a more accurate description of object boundaries than using only the amplitude of Fourier coefficients, the DTW distance permits us to accurately match images even in the presence of (limited) phase shiftings. In terms of classical precision/recall measures, we experimentally demonstrate that WARP can gain, say, up to 35 percent in precision at a 20 percent recall level with respect to Fourier-based techniques that use neither phase nor DTW distance.

[1] T. Pavlidis, “A Review of Algorithms for Shape Analysis,” Computer Vision, Graphics, and Image Processing, vol. 7, pp. 243-258, 1978.
[2] Y. Rui, A.C. She, and T.S. Huang, “Modified Fourier Descriptors for Shape Representation— A Practical Approach,” Proc. First Int'l Workshop Image Databases and Multi Media Search, pp. 22-23, Aug. 1996.
[3] W.-Y. Ma and B.S. Manjunath, “NeTra: A Toolbox for Navigating Large Image Databases,” Multimedia Systems, vol. 7, no. 3, pp. 184-198, , May, 1999.
[4] S. Berretti, A. Del Bimbo, and P. Pala, “Retrieval by Shape Similarity with Perceptual Distance and Effective Indexing,” IEEE Trans. Multimedia, vol. 2, no. 4, pp. 225-239, Dec. 2000.
[5] P. Ciaccia, M. Patella, and P. Zezula, “M-Tree: An Efficient Access Method for Similarity Search in Metric Spaces,” Proc. 23rd Int'l Conf. Very Large Data Bases (VLDB '97), pp. 426-435, Aug. 1997.
[6] A.H.H. Ngu, Q.Z. Sheng, D.Q. Huynh, and R. Lei, “Combining Multi-Visual Features for Efficient Indexing in a Large Image Database,” The Very Large Data Bases J., vol. 9, no. 1, pp. 279-293, Mar. 2001.
[7] H. Kauppinen, T. Seppänen, and M. Pietikäinen, “An Experimental Comparison of Autoregressive and Fourier-Based Descriptors in 2D Shape Classification,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 17, no. 2, pp. 201-207, Feb. 1995.
[8] D. Rafiei and A.O. Mendelzon, “Efficient Retrieval of Similar Shapes,” The Very Large Data Bases J., vol. 11, no. 1, pp. 17-27, Aug. 2002.
[9] D. Zhang and G. Lu, “A Comparative Study of Fourier Descriptors for Shape Representation and Retrieval,” Proc. Fifth Asian Conf. Computer Vision (ACCV '02), pp. 646-651, Jan. 2002.
[10] D.J. Berndt and J. Clifford, “Using Dynamic Time Warping to Find Patterns in Time Series,” Advances in Knowledge Discovery in Databases: Papers from the 1994 AAAI Workshop, pp. 359-370, July 1994.
[11] B.-K. Yi, H.V. Jagadish, and C. Faloutsos, “Efficient Retrieval of Similar Time Sequences under Time Warping,” Proc. 14th Int'l Conf. Data Eng. (ICDE '98), pp. 201-208, Feb. 1998.
[12] E.J. Keogh, “Exact Indexing of Dynamic Time Warping,” Proc. 28th Int'l Conf. Very Large Data Bases (VLDB '02), pp. 406-417, Sept. 2002.
[13] I. Bartolini, P. Ciaccia, and M. Patella, “Using the Time Warping Distance for Fourier-Based Shape Retrieval,” Technical Report IEIIT-BO-03-02, IEIIT-BO/CNR, 2002.
[14] T.P. Wallace and P.A. Wintz, “An Efficient Three-Dimensional Aircraft Recognition Algorithm Using Normalized Fourier Descriptors,” Computer Graphics and Image Processing, vol. 13, pp. 99-126, 1980.
[15] H. Sakoe and S. Chiba, “A Dynamic Programming Algorithm Optimization for Spoken Word Recognition,” IEEE Trans. Acoustics, Speech, and Signal Processing, vol. 26, no. 1, pp. 43-49, Feb. 1978.
[16] P. Ciaccia and M. Patella, “Searching in Metric Spaces with User-Defined and Approximate Distances,” ACM Trans. Database Systems, vol. 27, no. 4, pp. 398-437, Dec. 2002.
[17] S. Abbasi, F. Mokhtarian, and J. Kittler, “SQUID Demo Dataset 1,500,” demo.html, 1997.
[18] L.J. Latecki, R. Lakämper, and U. Eckhardt, “Shape Descriptors for Non-Rigid Shapes with a Single Closed Contour,” Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition (CVPR '00), pp. 1424-1429, June 2000.
[19] F. Mokhtarian and A.K. Mackworth, “A Theory of Multiscale, Curvature-Based Shape Representation for Planar Curves,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 14, no. 8, pp. 789-805, Aug. 1992.
[20] M. Bober, “MPEG-7 Visual Shape Descriptors,” IEEE Trans. Circuits and Systems for Video Technology, vol. 11, no. 6, pp. 716-719, June 2001.
[21] L.J. Latecki, “Shape Data for the MPEG-7 Core Experiment CE-Shape-1,” mpeg7shapeB.tar.gz, 2002.
[22] F. Mokhtarian, S. Abbasi, and J. Kittler, “Robust and Efficient Shape Indexing through Curvature Scale Space,” Proc. 1996 British Machine Vision Conf., pp. 53-62, Sept. 1996.
[23] L.J. Latecki and R. Lakämper, “Shape Similarity Measure Based on Correspondence of Visual Parts,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 10, pp. 1185-1190, Oct. 2000.
[24] S. Belongie, J. Malik, and J. Puzicha, “Shape Matching and Object Recognition Using Shape Contexts,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 4, pp. 509-522, Apr. 2002.
[25] C. Grigorescu and N. Petkov, “Distance Sets for Shape Filters and Shape Recognition,” IEEE Trans. Image Processing, vol. 12, no. 10, pp. 1274-1286, Oct. 2003.
[26] S. Ardizzoni, I. Bartolini, and M. Patella, “Windsurf: Region-Based Image Retrieval Using Wavelets,” Proc. First Int'l Workshop Similarity Search (IWOSS '99), pp. 167-173, Sept. 1999.

Index Terms:
Shape matching, Dynamic Time Warping distance, discrete Fourier transform.
Ilaria Bartolini, Paolo Ciaccia, Marco Patella, "WARP: Accurate Retrieval of Shapes Using Phase of Fourier Descriptors and Time Warping Distance," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 27, no. 1, pp. 142-147, Jan. 2005, doi:10.1109/TPAMI.2005.21
Usage of this product signifies your acceptance of the Terms of Use.