| | This Article | |
| |
| |
| | Share | |
| |
| |
| | Bibliographic References | |
| |
| |
| | Add to: | |
| |
 Digg
 Furl
 Spurl
 Blink
 Simpy
 Google
 Del.icio.us
 Y!MyWeb
| |
| | Search | |
| |
| |
| | |
Neural Edge Enhancer for Supervised Edge Enhancement from Noisy Images
December 2003 (vol. 25 no. 12)
pp. 1582-1596
Abstract—We propose a new edge enhancer based on a modified multilayer neural network, which is called a neural edge enhancer (NEE), for enhancing the desired edges clearly from noisy images. The NEE is a supervised edge enhancer: Through training with a set of input noisy images and teaching edges, the NEE acquires the function of a desired edge enhancer. The input images are synthesized from noiseless images by addition of noise. The teaching edges are made from the noiseless images by performing the desired edge enhancer. To investigate the performance, we carried out experiments to enhance edges from noisy artificial and natural images. By comparison with conventional edge enhancers, the following was demonstrated: The NEE was robust against noise, was able to enhance continuous edges from noisy images, and was superior to the conventional edge enhancers in similarity to the desired edges. To gain insight into the nonlinear kernel of the NEE, we performed analyses on the trained NEE. The results suggested that the trained NEE acquired directional gradient operators with smoothing. Furthermore, we propose a method for edge localization for the NEE. We compared the NEE, together with the proposed edge localization method, with a leading edge detector. The NEE was proven to be useful for enhancing edges from noisy images.
[1] 1582 A. Rosenfeld and A.C. Kak,Digital Picture Processing. Academic Press, 2nd ed., 1982[2] W.K. Pratt, Digital Image Processing. Wiley-Interscience, 1991.[3] J.C. Russ, Image Processing Handbook, second ed., pp. 225-262. Fla.: CRC Press, 1995.[4] J.R. Parker, Algorithm for Image Processing and Computer Vision, pp. 1-66. John Wiley&Sons, 1997.[5] B. Jahne, Digital Image Processing, fourth ed., pp. 322-340. Berlin: Springer-Verlag, 1997.[6] M. Kass, A. Witkin, and D. Terzopoulos, Snakes: Active Contour Models Int'l J. Computer Vision, vol. 1, no. 3, pp. 321-331, 1988.[7] R.O. Duda and P.E. Hart, Pattern Classification and Scene Analysis, pp. 267-272. Wiley, 1971.[8] M.H. Hueckel, An Operator which Locates Edges in Digitized Pictures J. ACM, vol. 18, no. 1, pp. 113-125, Jan. 1971.[9] M.H. Hueckel, A Local Visual Operator which Recognizes Edges and Lines J. ACM, vol. 20, no. 4, pp. 634-647, 1973.[10] L. Mero and Z. Vassy, A Simplified and Fast Version of the Hueckel Operator for Finding Optimal Edges in Pictures Proc. Int'l Joint Conf. Artificial Intelligence, pp. 650-655, 1977.[11] G.S. Robinson, Edge Detection by Compass Gradient Masks Computer Graphics and Image Processing, vol. 6, pp. 492-501, 1977.[12] W. Frei and C. Chen, Fast Boundary Detection: A Generalization and a New Algorithm IEEE Trans. Computers, vol. 26, no. 10, pp. 988-998, Oct. 1977.[13] K.S. Shanmugan, F.M. Dickey, and J.A. Green, An Optimal Frequency Domain Filter for Edge Detection in Digital Pictures IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 1, no. 1, pp. 37-49, Jan. 1979.[14] D. Marr and E. Hildreth, Theory of Edge Detection Proc. Royal Soc. London, vol. B207, pp. 187-21, 1980.[15] W.H.H.J. Lunsher, The Asymptotic Optimal Frequency Domain Filter for Edge Detection IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 5, pp. 678-680, 1983.[16] J. Canny, “A Computational Approach to Edge Detection,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 8, no. 6, pp. 679-698, June 1986.[17] V. Torre and T.A. Poggio, "On Edge Detection," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 8, no. 2, pp. 147-163, Mar. 1986.[18] W.H.H.J. Lunsher and M.P. Beddoes, Optimal Edge Detector Design I: Parameter Selection and Noise Effects IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 8, pp. 164-177, Mar. 1986.[19] M. Petrou and J. Kittler, "Optimal Edge Detection for Ramp Edges," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 13, pp. 483-490, 1991.[20] J. Shen,S. Castan,“An Optimal Linear Operator for Step Edge Detection,” CVGIP, Vol. 54, pp. 112-133, 1992.[21] S.M. Bhandarkar, Y. Zhang, and W.D. Potter, An Edge Detection Technique Using Genetic Algorithm-Based Optimization Pattern Recognition, vol. 27, no. 9, pp. 1159-1180, 1994.[22] S. Berchtold, C. Böhm, and H.-P. Kriegel, “Improving the Query Performance of High-Dimensional Index Structures Using Bulk-Load Operations,” Proc. Sixth Int'l Conf. Extending Database Technology (EDBT), 1998.[23] T. Lindeberg, Edge Detection and Ridge Detection with Automatic Scale Selection Int'l J. Computer Vision, vol. 30, pp. 117-154, 1998.[24] K. Arakawa and H. Harashima, A Nonlinear Digital Filter Using Multi-Layered Neural Networks Proc. IEEE Int'l Conf. Comm., vol. 2, pp. 424-428, 1990.[25] L. Yin, J. Astola, and Y. Neuvo, A New Class of Nonlinear Filters Neural Filters IEEE Trans. Signal Processing, vol. 41, no. 3, pp. 1201-1222, Mar. 1993.[26] Z.Z. Zhang and N. Ansari, Structure and Properties of Generalized Adaptive Neural Filters for Signal Enhancement IEEE Trans. Neural Networks, vol. 7, no. 4, pp. 857-868, July 1996.[27] L. Yin, J. Astola, and Y. Neuvo, Adaptive Multistage Weighted Order Statistic Filters Based on the Back Propagation Algorithm IEEE Trans. Signal Processing, vol. 42, pp. 419-422, Feb. 1994.[28] K. Suzuki, I. Horiba, N. Sugie, and M. Nanki, A Recurrent Neural Filter for Reducing Noise in Medical X-Ray Image Sequences Proc. Int'l Conf. Neural Information Processing, vol. 1, pp. 157-160, Oct. 1998.[29] K. Suzuki, I. Horiba, N. Sugie, and M. Nanki, Noise Reduction of Medical X-Ray Image Sequences Using a Neural Filter with Spatiotemporal Inputs Proc. Int'l Symp. Noise Reduction for Imaging&Comm. Systems, pp. 85-90, Nov. 1998.[30] K. Suzuki, I. Horiba, and N. Sugie, Efficient Approximation of a Neural Filter for Quantum Noise Removal in X-Ray Images Neural Networks for Signal Processing IX, Y.-H. Hu et al., eds., pp. 370-379, Aug. 1999.[31] K. Suzuki, I. Horiba, and N. Sugie, Signal-Preserving Training for Neural Networks for Signal Processing Proc. IEEE Int'l Symp. Intelligent Signal Processing and Comm. Systems, vol. 1, pp. 292-297, Nov. 2000.[32] K. Suzuki, I. Horiba, and N. Sugie, Neural Filter with Selection of Input Features and Its Application to Image Quality Improvement of Medical Image Sequences Proc. IEEE Int'l Symp. Intelligent Signal Processing and Comm. Systems, vol. 2, pp. 783-788, Nov. 2000.[33] K. Suzuki, I. Horiba, and N. Sugie, Training under Achievement Quotient Criterion Neural Networks for Signal Processing X, B. Widrow et al., eds., pp. 537-546, 2000.[34] K. Suzuki, I. Horiba, and N. Sugie, Efficient Approximation of Neural Filters for Removing Quantum Noise from Images IEEE Trans. Signal Processing, vol. 50, no. 7, pp. 1787-1799, July 2002.[35] K. Suzuki, I. Horiba, N. Sugie, and M. Nanki, Neural Filter with Selection of Input Features and Its Application to Image Quality Improvement of Medical Image Sequences IEICE Trans. Information and Systems, vol. E85-D, no. 10, pp. 1710-1718, Oct. 2002.[36] I.N. Aizenberg, Processing of Noisy and Small-Detailed Gray-Scale Image Using Cellular Neural Networks J. Electronic Imaging, vol. 6, no. 3, pp. 272-285, 1997.[37] C. Rekeczky, A. Schultz, I. Szatmari, T. Roska, and L.O. Chua, Image Segmentation and Edge Detection via Constrained Diffusion and Adaptive Morphology: A CNN Approach to Bubble/Debris Image Enhancement Proc. Int'l Symp. Nonlinear Theory and Application, pp. 209-212, 1997.[38] C. Guzelis and S. Karamahmut, Recurrent Perceptron Learning Algorithm for CNNs with Application to Edge Detection Proc. IEEE Int'l Conf. Image Proc., pp. 1134-1139, 1997.[39] I.N. Aizenberg, N.N. Aizenberg, and J. Vandewalle, Precise Edge Detection: Representation by Boolean Functions, Implementations on the CNN Proc. IEEE Int'l Workshop Cellular Neural Networks and Their Applications, pp. 301-306, Apr. 1998.[40] Cs. Rekeczky, T. Roska, and A. Ushida, CNN-Based Difference-Controlled Adaptive Nonlinear Image Filters Int'l J. Circuit Theory and Application, vol. 26, pp. 375-423, 1998.[41] D.L. Vilarino, D. Cabello, M. Balsi, and V.M. Brea, Image Segmentation Based on Active Contours Using Discrete-Time Cellular Neural Networks Proc. IEEE Int'l Workshop Cellular Neural Networks and Their Applications, pp. 331-336, 1998.[42] I.N. Aizenberg, N.N. Aizenberg, T. Bregin, C. Butakov, and E. Farberov, Image Processing Using Cellular Neural Networks Based on Multi-Valued and Universal Binary Neurons Proc. Neural Networks for Signal Processing X, B. Widrow et al., eds., pp. 557-566, 2000.[43] I.N. Aizenberg, N.N. Aizenberg, and J. Vandewalle, Multi-Valued and Universal Binary Neurons Theory, Learning and Applications. Kluwer Academic, 2000.[44] H. Nagai, Y. Miyanaga, and K. Tochinai, An Edge Detection by Using Self-Organization Proc. IEEE Int'l Conf. Acoustics, Speech, and Signal Processing, pp. 2749-2752, 1998.[45] L. Guan, S.W. Perry, R. Romagnoli, H. Wong, and H. Kong, Neural Vision System and Applications in Image Processing and Analysis Proc. IEEE Int'l Conf. Acoustics, Speech, and Signal Processing, pp. 1245-1248, 1998.[46] P.J. Toivanen, J. Ansamaki, S. Leppajarvi, and J.P.S. Parkkinen, Edge Detection of Multispectral Images Using the 1-D Self Organizing Map Proc. Int'l Conf. Artificial Neural Networks, pp. 737-742, 1998.[47] M.S. Bhuiyan, M. Sato, H. Fujimoto, and A. Iwata, Edge Detection by Neural Network with Line Process Proc. Int'l Joint Conf. Neural Networks, pp. 1223-1226, 1993.[48] M.S. Bhuiyan, M. Sato, H. Fujimoto, and A. Iwata, An Improved Neural Network Based Edge Detection Method Proc. Int'l Conf. Neural Information Processing, vol. 1, pp. 620-625, Oct. 1994.[49] H. Iwata, T. Agui, and H. Nagahashi, Boundary Detection of Color Images Using Neural Networks Proc. IEEE Int'l Conf. Neural Networks, pp. 1426-1429, 1995.[50] M. Muneyasu, K. Hotta, and T. Hinamoto, Image Restoration by Hopfield Networks Considering the Line Process Proc. IEEE Int'l Conf. Neural Networks, pp. 1703-1706, 1995.[51] G. Ohashi, A. Ohya, M. Natori, and M. Nakajima, Boundary Estimation Method for Ultrasonic 3-D Imaging Proc. SPIE Medical Imaging, Image Processing, vol. 1898, pp. 480-486, 1993.[52] G. Coppini, R. Poli, and G. Valli, Recovery of the 3-D Shape of the Left Ventricle from Echocardiographic Images IEEE Trans. Medical Imaging, vol. 14, no. 2, pp. 301-317, June 1995.[53] S.W. Lu and J. Shen, Artificial Neural Networks for Boundary Extraction Proc. IEEE Int'l Conf. Systems, Man, and Cybernetics, vol. 3, pp. 2270-2275, 1996.[54] Z. He and M.Y. Siyal, Edge Detection with BP Neural Networks Proc. Int'l Conf. Signal Processing, vol. 2, pp. 1382-1384, 1998.[55] K. Suzuki, I. Horiba, N. Sugie, and M. Nanki, Computer-Aided Diagnosis System for Coronary Artery Stenosis Using a Neural Network Proc. SPIE Medical Imaging: Image Processing, vol. 4322, pp. 1771-1782, Feb. 2001.[56] K. Suzuki, I. Horiba, K. Ikegaya, and M. Nanki, Recognition of Coronary Arterial Stenosis Using Neural Network on DSA System Systems and Computers in Japan, vol. 26, no. 8, pp. 66-74, Aug. 1995.[57] K. Funahashi, On the Approximate Realization of Continuous Mappings by Neural Networks Neural Networks, vol. 2, pp. 183-192, 1989.[58] A.R. Barron, Universal Approximation Bounds for Superpositions of a Sigmoidal Function IEEE Trans. Information Theory, vol. 39, no. 3, pp. 930-945, Mar. 1993.[59] D.E. Rumelhart, G.E. Hinton, and R.J. Williams, Learning Representations of Back-Propagation Errors Nature, vol. 323, pp. 533-536, 1986.[60] D.E. Rumelhart, G.E. Hinton, and R.J. Williams, "Learning Internal Representations by Error Propagation," Parallel Distributed Processing: Explorations in the Microstructure of Cognition, vol. 1: Foundations, D.E. Rumelhart and J.L. McClelland et al., eds., chapter 8, pp. 318-362.Cambridge, Mass.: MIT Press, 1986.[61] C.M. Bishop, Neural Networks for Pattern Recognition. Clarendon Press, 1995.[62] I.E. Adbou and W.K. Pratt, Quantitative Design and Evaluation of Enhancement/Thresholding Edge Detectors Proc. IEEE, vol. 67, no. 5, pp. 753-763, May 1979.[63] J.C. Brailean, R.P. Kleihorst, S. Efstratiadis, A.K. Katsaggelos, and R.L. Lagendijk, Noise Reduction Filters for Dynamic Image Sequences: A Review Proc. IEEE, vol. 83, no. 9, pp. 1270-1291, Sept. 1995.[64] M.R. Banham and A.K. Katsaggelos, Digital Image Restoration IEEE Signal Processing Magazine, vol. 14, no. 2, pp. 24-41, Mar. 1997.[65] K. Suzuki, I. Horiba, and N. Sugie, Designing the Optimal Structure of a Neural Filter Neural Networks for Signal Processing VIII, M. Niranjan et al., eds., pp. 323-332, Aug. 1998.[66] K. Suzuki, I. Horiba, and N. Sugie, An Approach to Synthesize Filters with Reduced Structures Using a Neural Network Quantum Information II, T. Hida and K. Saito, eds., pp. 205-218, 2000.[67] K. Suzuki, I. Horiba, and N. Sugie, A Simple Neural Network Pruning Algorithm with Application to Filter Synthesis Neural Processing Letters, vol. 13, no. 1, pp. 43-53, Feb. 2001.[68] D.H. Hubel and T.N. Wiesel, Receptive Fields, Binocular Interaction and Functional Architecture in the Cat's Visual Cortex J. Physiology (London), vol. 160, pp. 106-154, 1962.[69] C. Blakemore and G.F. Cooper, Development of the Brain Depends on the Visual Environment Nature, vol. 228, pp. 477-478, 1970.[70] K. Suzuki and I. Horiba, and N. Sugie, Linear-Time Connected-Component Labeling Based on Sequential Local Operations Computer Vision and Image Understanding, vol. 85, no. 1, pp. 1-23, Jan. 2003.[71] J.H. Elder and S.W. Zucker, Local Scale Control for Edge Detection and Blur Estimation IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 20, no. 7, pp. 699-716, July 1998.[72] J.H. Elder and S.W. Zucker, Space Scale Localization, Blur, and Contour-Based Image Coding Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 27-34, June 1996.[73] S. Hayk, Neural Networks A Comprehensive Foundation, second ed., pp. 233-234. Prentice Hall, 1999.[74] K. Suzuki, S.G. Armato III, F. Li, S. Sone, and K. Doi, Massive Training Artificial Neural Network (MTANN) for Reduction of False Positives in Computerized Detection of Lung Nodules in Low-Dose CT Medical Physics, vol. 30, no. 7, pp. 1602-1617, July 2003.[75] E.R. Hancock and J. Kittler, "Edge-Labeling Using Dictionary-Based Relaxation," IEEE Trans Pattern Analysis and Machine Intelligence, vol. 12, no. 2, pp. 165-181, 1990.
Index Terms:
Supervised edge enhancer, noisy image, robustness, neural network, edge detection, contour extraction.
Citation:
Kenji Suzuki, Isao Horiba, Noboru Sugie, "Neural Edge Enhancer for Supervised Edge Enhancement from Noisy Images," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 25, no. 12, pp. 1582-1596, Dec. 2003, doi:10.1109/TPAMI.2003.1251151
