This Article 
 Bibliographic References 
 Add to: 
A Neural Network Approach to the Labeling of Line Drawings
December 1991 (vol. 40 no. 12)
pp. 1419-1424

A solution to the labeling of the drawings using a neural network approach is presented. Line-labeling constraints are designed into a modified Hopfield networks. The design of the energy function and the updating equation is described. The energy function includes higher order terms than in the usual quadratic Hopfield model to accommodate the higher-order interactions required by the labeling constraints. The physical model is modified accordingly. An additional layer of neurons is used to synthesize a realizable circuit. The resulting network combines the standard Hopfield-network neurons with neurons performing two- and three-way Boolean AND operations. Simulation of network behavior for various trihedral scenes produced successful results.

[1] S. R. Yhann and T. Y. Young, "A multi-resolution approach to texture segmentation using neural networks," inProc. Tenth Int. Conf. Pattern Recognition, Atlantic City, NJ, vol. 1, June 1990, pp. 513-517.
[2] N. R. Dupaguntla and V. Vemuri, "A neural network architecture for texture segmentation and labeling," inProc. Int. Joint Conf. Neural Networks, Washington, DC, vol. 1, June 1989, pp. 127-133.
[3] C. Cortes and J. A. Hertz, "A network system for image segmentation," inProc. Int. Joint Conf. Neural Networks, Washington, DC, June 1989, pp. 121-125.
[4] Y. T. Zhou, R. Chellappa, A. Vaid, and B. K. Jenkins, "Image restoration using a neural network,"IEEE Trans. Acoust., Speech, Signal Processing, vol. 36, no. 7, pp. 1141-1151, 1988.
[5] J. G. Daugman, "Complete discrete 2-d Gabor transforms by neural networks tor image analysis and compression,IEEE Trans. Acoust. Speech Signal Proc., vol. 36, no. 7, pp. 1169-1179, 1988.
[6] A. Carpenter and S. Grossberg, "The art of adaptive pattern recognition by self-organizing neural networks,"IEEE Comput. Mag., vol. 21, pp. 77-88, Mar. 1988.
[7] T. A. Jamison and R. J. Schalkoff, "Image labeling: A neural network approach,"Image and Vision Comput., vol. 6, no. 4, pp. 203-213, Nov. 1988.
[8] W-C. Lin, F-Y. Liao, C-K. Tsao, and T. Lingutla, "A hierarchical multiple-view approach to three-dimensional object recognition,"IEEE Trans. Neural Networks, vol. 2, pp. 84-92, Jan. 1991.
[9] D. H. Ballard and C. M. Brown,Computer Vision. Englewood Cliffs, NJ: Prentice-Hall, 1982.
[10] M. B. Clowes, "On seeing things,"Artif. Intell., vol. 2, pp. 79-116, 1971.
[11] D. A. Huffman, "Impossible objects as nonsense sentences,"Machine Intell., vol. 6, pp. 295-323, 1971.
[12] D. Waltz, "Understanding line drawings of scenes with shadows," inThe Psychology of Computer vision, P. H. Winston, Ed. New York: McGraw-Hill, 1975.
[13] T. Kanade, "A theory of Origamy world,"Artif Intell., vol. 13, pp. 279-311, 1980.
[14] A. K. Mackworth, "Interpreting pictures of polyhedral scenes,"Artif. Intell., vol. 4, pp. 121-137, 1973.
[15] K. Sugihara, "Mathematical structure of line drawings of polyhedra toward man-machine communications by means of line drawings,"IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-4, pp. 458-469, 1982.
[16] J. Malik, "Interpreting line drawings of curved objects,"Int. J. Comput. Vision, vol. 1, pp. 73-103, 1987.
[17] B. Nudel, "Consistent-labeling problem and their algorithms: Expected complexities and theory-based heuristics,"Artif. Intell., vol. 21, pp. 135-178, 1983.
[18] A. Rosenfeld, R. A. Hummel, and S. W. Zucker, "Scene labeling by relaxation operations:IEEE Trans. Syst., Man, Cybern., vol. SMC-6, pp. 420-433, June 1976.
[19] H. Liu, T. Y. Young, and A. Das, "A multilevel parallel processing approach to scene labeling problems,"IEEE Trans. Pattern Anal. Machine Intell., vol. 10, pp. 586-590, July 1988.
[20] J. J. Hopfield, "Neurons with graded response have collective computational properties like those of two-state neurons,"Proc. Nat. Acad. Sci., vol. 81, pp. 3088-3092, May 1984.
[21] J. J. Hopfield and D. W. Tank, "Neural computation of decisions in optimization problems,"Biol. Cybern., vol. 52, pp. 141-152, 1985.
[22] A. Das, "Simulation of parallel processing in discrete scene labeling," Master's thesis, Univ. of Miami, pp. 37-43, 1987.

Index Terms:
computer vision; neural network approach; labeling of line drawings; modified Hopfield networks; energy function; updating equation; physical model; neurons; Boolean AND operations; trihedral scenes; Boolean functions; computer vision; neural nets.
G.J. Salem, T.Y. Young, "A Neural Network Approach to the Labeling of Line Drawings," IEEE Transactions on Computers, vol. 40, no. 12, pp. 1419-1424, Dec. 1991, doi:10.1109/12.106227
Usage of this product signifies your acceptance of the Terms of Use.