This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Image Field Categorization and Edge/Corner Detection from Gradient Covariance
February 2000 (vol. 22 no. 2)
pp. 179-190

Abstract—Edges, corners, and vertices in an image correspond to 1D (one-dimensional) and 2D discontinuities in the intensity surface of the underlying scene. Ridges and peaks correspond to 1D and 2D extrema in it. All of them can be characterized by the distribution of gradients, particularly by dimensionality of it. The approach to image field categorization here is to construct a covariance matrix of the gradient vector in each small window and apply the canonical correlation analysis to it. Schwarz's inequality on the matrix determinant and the related differential equation is the key to this analysis. We obtain two operators $P_{EG}$ and $Q_{EG}$ to categorize the image field into a unidirectionally varying region (UNIVAR), an omnidirectionally varying region (OMNIVAR), and a nonvarying region. We investigate the conditions under which their absolute maximum response, i.e., $P_{EG}=1$ and $Q_{EG}=1$, occurs in the small window and show that they are, respectively, the desired 1D and 2D discontinuities/extrema and OMNIVAR, is in many cases, a 1D pattern in polar coordinates. This leads to an algorithm to obtain further classification and accurate localization of them into edges, ridges, peaks, corners, and vertices through detailed analysis in the informative (varying) axis of them. We examined and compared the performance of the operators and the localization algorithm on various types of images and various noise levels. The results indicate that the proposed method is superior with respect to stability, localization, and resolution.

[1] A. Rosenfeld and M. Thurston, “Edge and Curve Detection for Visual Scene Analysis,” IEEE Trans. Computers, vol. 20, no. 5, pp. 562-569, 1971.
[2] G. Robinson, “Edge Detection by Compass Gradient Masks,” Computer Graphics Image Processing, vol. 6, pp. 492-501, 1977.
[3] W. Frei and C.-C. Chen, “Fast Boundary Detection: A Generalized and a New Algorithm,” IEEE Trans. Computers, vol. 26, no. 10, pp. 988-998, Oct. 1977.
[4] K.S. Shanmugam, F.M. Dickey, and J.A. Green, “An Optimal Frequency Domain Filter for Edge Detection in Digital Pictures,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 1, no. 1, pp. 37-49, 1979.
[5] R. Nevatia and K.R. Babu, “Linear Feature Extraction and Description,” Computer Vision Graphics Image Processing, vol. 13, pp. 257-269, 1980.
[6] D. Marr and E.C. Hildreth, “Theory of Edge Detection,” Proc. Royal Soc. London, B, vol. 207, pp. 187-217, 1980.
[7] J. Canny, “A Computational Approach to Edge Detection,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 8, no. 6, pp. 679-698, June 1986.
[8] G. Ramponi, “Edge Extraction by a Class of Second-Order Nonlinear Filters,” Electronics Letters, vol. 22, no. 9, pp. 482-484, 1986.
[9] M. Kisworo, S. Venkatesh, and G. West, “Modeling Edges at Subpixel Accuracy Using the Local Energy Approach,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 16, no. 4, pp. 405-410, Apr. 1994.
[10] R. Machuca and A.L. Gilbert, “Finding Edges in Noisy Scenes,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 3, no. 1, pp. 103-111, 1981.
[11] O.A. Zuniga and R.M. Haralick, “Integrated Directional Derivative Gradient Operator,” IEEE Trans. Systems, Man, and Cybernetics, vol. 17, no. 3, pp. 508-517, 1987.
[12] P.H. Gregson, “Using Angular Dispersion of Gradient Direction for Detecting Edge Ribbons,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 15, no. 7, pp. 682-696, 1993.
[13] J.-B. Martens, “Local Orientation Analysis in Images by Means of the Hermite Transform,” IEEE Trans. Image Processing, vol. 6, no. 8, pp. 1,103-1,116, 1997.
[14] M. Brooks, “Rationalizing Edge Detector,” Computer Vision Graphics Image Processing, vol. 8, pp. 277-285, 1978.
[15] R.M. Haralick, “Digital Step Edges from Zero-Crossings of Second Directional Derivatives,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 6, no. 1, pp. 58-68, 1984.
[16] A.J. Tabatabai and O.R. Mitchell, “Edge Location to Subpixel Values in Digital Imagery,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 6, no. 2, pp. 188-201, 1984.
[17] V.S. Nalwa and T.O. Binford, “On Detecting Edges,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 8, no. 6, pp. 699-714, 1986.
[18] S. Ghosal and R. Mehrotra, “Detection of Composite Edges,” IEEE Trans. Image Processing, vol. 3, no. 1, pp. 14-25, 1994.
[19] G. Chen and Y.H.H. Yang, “Edge Detection by Regularized Cubic B Spline Fitting,” IEEE Trans. Systems, Man, and Cybernetics, vol. 25, no. 4, pp. 635-642, 1995.
[20] L. Kitchen and A. Rosenfeld, “Gray-Level Corner Detection,” Pattern Recognition Letters, vol. 1, pp. 95-102, 1982.
[21] J.A. Noble, “Finding Corners,” Image and Vision Computing, vol. 6, pp. 121-128, 1988.
[22] K. Rangarajan, M. Shah, and D.V. Brackle, “Optimal Corner Detector,” Computer Vision, Graphics, and Image Processing, vol. 48, pp. 230-245, 1989.
[23] A. Singh and M. Shneiner, “Gray Level Corner Detection: A Generalized and Robust Real Time Implementation,” Computer Vision, Graphics, and Image Processing, vol. 51, pp. 54-59, 1990.
[24] R. Deriche and G. Giraudon, “A Computational Approach for Corner and Vertex Detection,” Int'l J. Computer Vision, vol. 10, no. 2, pp. 101-124, 1993.
[25] J. Cooper, S. Venkatesh, and L. Kitchen, “Early Jump-Out Corer Detectors,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 15, no. 8, pp. 823-828, 1993.
[26] S. Ghosal and R. Mehrotra, “A Moment Based Unified Approach to Image Feature Detection,” IEEE Trans. Image Processing, vol. 6, no. 6, pp. 781-793, 1997.
[27] R. Machuca and K. Phillips, “Applications of Vector Fields to Image Processing,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 5, no. 3, pp. 316-329, 1983.
[28] L.M.T. Florack, B.H. Romeny, J.J. Koenderink, and M.A. Viergever, “General Intensity Transformation and Differential Invariants,” J. Math. Imaging and Vision, vol. 4, no. 2, pp. 171-187, 1994.
[29] J.B.A. Maintz, P.A. van den Elsen, and M.A. Viergever, “Evaluation of Ridge Seeking Operators for Multimodality Medical Image Matching,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 18, no. 4, pp. 353-365, Apr. 1996.
[30] C. Schmid and R. Mohr, “Local Grayvalue Invariants for Image Retrieval,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 5, pp. 530-535, May 1997.
[31] S.M. Smith and J.M. Brady, “SUSAN—A New Approach to Low Level Image Processing,” Int'l J. Computer Vision, vol. 23, no. 1, pp. 45-78, 1997.
[32] E. Deutsch and J. Fram, “A Quantitative Study of the Orientation Bias of Some Edge Detector Schemes,” IEEE Trans. Computers, vol. 27, no. 3, pp. 205-213, Mar. 1978.
[33] T. Peli and D. Malah, “A Study of Edge Detection Algorithm,” Computer Graphics and Image Processing, vol. 20, pp. 1-21, 1982.
[34] E.J. Delp and C.H. Chu, “Detecting Edge Segments,” IEEE Trans. Systems, Man, and Cybernetics, vol. 15, no. 1, pp. 144-152, 1985.
[35] E.P. Lyvers and O.R. Mitchell, “Precision Edge Contrast and Orientation Estimation,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 10, no. 6, pp. 927-937, 1988.
[36] M.M. Fleck, “Some Defects in Finite-Difference Edge Finders,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 14, no. 3, pp. 337-345, Mar. 1992.
[37] R. Kakarala and A.O. Hero, “On Achievable Accuracy in Edge Localization,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 14, no. 7, pp. 777-781, 1992.
[38] J. Koplowitz and V. Greco, “On the Edge Location Error for Local Maximum and Zero-Crossing Edge Detectors,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 16, no. 12, pp. 1,207-1,212, Dec. 1994.
[39] L. Ganesan and P. Bhattacharyya, “Edge Detection in Untextured and Textured Images—A Common Computational Framework,” IEEE Trans. Systems, Man, and Cybernetics, vol. 27, no. 5, pp. 823-834, 1997.
[40] F. Pedersini, A. Sarti, and S. Tubaro, “Estimation and Compensation of Subpixel Edge Localization Error,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 11, pp. 1,278-1,284, Nov. 1997.
[41] M. Heath, S. Sarkar, T. Sanocki, and K. Bowyer, “Comparison of Edge Detectors: A Methodology and Initial Study,” Computer Vision, Graphics, and Image Understanding, vol. 69, no. 1, pp. 38-54, 1998.
[42] S. Ando, “Texton Finders Based on Gaussian Curvatures of Correlation Functions,” IEEE Int'l Conf. Systems, Man, and Cybernetics, pp. 25-28, Beijing/Shenyang, People's Republic of China, 1988.
[43] S. Ando, “Image Feature Extraction Operators Based on Gaussian Curvature of Correlation Functions,” Trans. Soc. Instrumentation and Control Engineers, vol. 24, no. 10, pp. 1,016-1,022, 1988 (in Japanese).
[44] S. Ando, “An Intelligent Three-Dimensional Vision Sensor with Ears,” Sensors and Materials, vol. 7, no. 3, pp. 213-231, 1995.
[45] S. Ando, “An Autonomous Three-Dimensional Vision Sensor with Ears,” Trans. IEICE Information and Systems, vol. E78-D, no. 12, pp. 1,621-1,629, 1995.

Index Terms:
Image feature extraction, edge, corner, vertex, gradient covariance.
Citation:
Shigeru Ando, "Image Field Categorization and Edge/Corner Detection from Gradient Covariance," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 22, no. 2, pp. 179-190, Feb. 2000, doi:10.1109/34.825756
Usage of this product signifies your acceptance of the Terms of Use.