This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
A Framework for Performance Characterization of Intermediate-Level Grouping Modules
November 1997 (vol. 19 no. 11)
pp. 1306-1312

Abstract—We present five performance measures to evaluate grouping modules in the context of constrained search and indexing based object recognition. Using these measures, we demonstrate a sound experimental framework, based on statistical ANOVA tests, to compare and contrast three edge based organization modules, namely, those of Etemadi et al., Jacobs, and Sarkar-Boyer in the domain of aerial objects using 50 images. With adapted parameters, the Jacobs module performs overall the best for constraint based recognition. For fixed parameters, the Sarkar-Boyer module is the best in terms of recognition accuracy and indexing speedup. Etemadi et al.'s module performs equally well with fixed and adapted parameters while the Jacobs module is most sensitive to fixed and adapted parameter choices. The overall performance ranking of the modules is Jacobs, Sarkar-Boyer, and Etemadi et al.

[1] A. Etemadi, J.-P. Schmidt, G. Matas, J. Illingworth, and J. Kittler, "Low-Level Grouping of Straight Line Segments," Proc. British Machine Vision Conf., pp. 119-126.New York: Springer-Verlag, 1991.
[2] D.W. Jacobs, "Robust and Efficient Detection of Salient Convex Groups," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 18, pp. 23-37, Jan. 1996.
[3] S. Sarkar and K.L. Boyer, "Integration, Inference, and Management of Spatial Information Using Bayesian Networks: Perceptual Organization," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 15, no. 3, pp. 256-274, Mar. 1993. Special Section on Probabilistic Reasoning.
[4] W.E.L. Grimson, "The Combinatorics of Heuristic Search Termination for Object Recognition in Cluttered Environments," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 13, no. 9, pp. 920-935, Sept. 1991.
[5] D. Clemens and D. Jacobs, "Space and time bounds on model indexing," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 13, no. 10, pp. 1,007-1,018, 1991.
[6] R. Mohan and R. Nevatia, "Perceptual Organization for Scene Segmentation and Description," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 14, no. 6, pp. 616-635, June 1992.
[7] R.M. Haralick, L. Cinque, C. Guerra, S. Levialdi, J. Weng, T.S. Huang, P. Meer, Y. Shirai, B.A. Draper, and R. Beveridge, "Performance Characterization in Computer Vision," Computer Vision, Graphics, and Image Processing: Image Understanding, vol. 60, pp. 245-265, Sept. 1994.
[8] T. Kanungo, M.Y. Jaisimha, and R.M. Haralick, "A Methodology for Quantitative Performance Evaluation of Detection Algorithms," IEEE Trans. Image Processing, vol. 4, pp. 1,667-1,674, Dec. 1995.
[9] P.L. Palmer, H. Dabis, and J. Kittler, "A Performance Measure for Boundary Detection Algorithms," Computer Vision and Image Understanding, vol. 63, pp. 476-494, May 1996.
[10] J.L. Barron, D.J. Fleet, S.S. Beauchemin, and T.A. Burkitt, "Performance of Optical Flow Techniques," Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition, pp. 236-242, 1992.
[11] R. Zhang, P.S. Tsai, J.E. Cryer, and M. Shah, "Analysis of Shape From Shading Techniques," Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition, pp. 377-384, 1994.
[12] D. Nair, A. Mitiche, and J.K. Aggarwal, "On Comparing the Performance of Object Recognition Systems," Int'l Conf. Image Processing, 1995.
[13] G. Keppel, Design of Analysis.Englewood Cliffs, N.J.: Prentice Hall, 1991.
[14] J. Canny, "A Computational Approach to Edge Detection," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 8, pp. 679-698, Nov. 1986.
[15] V.S. Nalwa and T.O. Binford, "On Detecting Edges," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 8, pp. 699-714, Nov. 1986.
[16] S. Sarkar and K.L. Boyer, "Optimal Infinite Impulse Response Zero Crossing Based Edge Detectors," Computer Vision, Graphics, and Image Processing: Image Understanding, vol. 54, pp. 224-243, Sept. 1991.

Index Terms:
Perceptual organization, performance evaluation, analysis of variance, ANOVA, experimental vision, intermediate level computer vision, feature grouping, performance characterization.
Citation:
Sudhir Borra, Sudeep Sarkar, "A Framework for Performance Characterization of Intermediate-Level Grouping Modules," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 19, no. 11, pp. 1306-1312, Nov. 1997, doi:10.1109/34.632991
Usage of this product signifies your acceptance of the Terms of Use.