This Article 
 Bibliographic References 
 Add to: 
Borg: A Knowledge-Based System for Automatic Generation of Image Processing Programs
February 1999 (vol. 21 no. 2)
pp. 128-144

Abstract—This article deals with the design of a system that automates the generation of image processing applications. Users describe tasks to perform on images and the system constructs a specific plan, which, after being executed, should yield the desired results. Our approach of this problem belongs to the more general category of systems for the supervision of a library of operators. The generation of an application is here considered as the dynamic building of chains of image processing through the selection, parameter tuning and scheduling of existing operators. To develop such a system, we suggest to use a knowledge-rich resolution model and to integrate seven design rules. The Borg system has been developed following these prescriptions. It hinges on hierarchical, opportunistic and incremental planning by means of knowledge sources of the Blackboard model, which enable to take into account planning, evaluation and knowledge acquisition issues.

[1] B. Bachimont, Le contrôle dans les systèmesàbase de connaissances.Paris: Hermès, 1992.
[2] R. Bodington, "A Software Environment for the Automatic Configuration of Inspection Systems," Proc. Int'l Workshop Knowledge-Based Systems for the Reuse of Program Libraries, pp. 100-108,Sophia Antipolis, France, Nov. 1995.
[3] A. Boucher and C. Garbay, "A Multi-Agent System to Segment Living Cells," Proc. IEEE Int'l Conf. Pattern Recognition, vol. 3, pp. 558-562,Vienna, Aug. 1996.
[4] D. Carel, "Système Expert d'aideàl'utilisation d'algorithmes de traitement d'images," PhD thesis, Univ. of Rennes, France, 1989.
[5] D. Charlebois, "A Planning System Based on Plan Re-Use and Its Application to Geographical Information Systems and Remote Sensing," PhD thesis, Univ. of Ottawa, Canada, Oct. 1997.
[6] B. Charroux and S. Philipp, "Interpretation of Aerial Images Based on Potential Functions," Proc. Ninth Scandinavian Conf. Image Analysis, pp. 671-678,Uppsala, Sweden, June 1995.
[7] S.A. Chien and H.B. Mortensen, "Automating Image Processing for Scientific Data Analysis of a Large Image Database," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 18, no. 8, pp. 854-859, Aug. 1996.
[8] V. Clement and M. Thonnat, "A Knowledge-based Approach to Integration of Image Processing Procedures," Image Understanding, vol. 57, pp. 166-184, Mar. 1993.
[9] R. Clouard, M. Revenu, A. Elmoataz, and C. Porquet, "A Software Workshop for Knowledge Acquisition in Image Processing," Proc. Int'l. Workshop Design of Cooperative Systems, pp. 298-312,Juan-les-Pins, France, Jan. 1995.
[10] R. Clouard, C. Porquet, A. Elmoataz, and M. Revenu, "Why Building Knowledge-Based Image Segmentation Is So Difficult," Proc. Int'l Workshop Knowledge-Based Systems for the Reuse of Program Libraries, pp. 137-148,Sophia Antipolis, France, Nov. 1995.
[11] D. Crevier and R. Lepage, Knowledge-Based Image Understanding Systems: A Survey Computer Vision and Image Understanding, vol. 67, no. 2, pp. 161-185, 1997.
[12] P. Dejean and P. Dalle, "Image Analysis Operators as Concept Constructors," Proc. IEEE Southwest Symp. Image Analysis and Interpretation, pp. 66-70,San-Antonio, Texas, Apr. 1996.
[13] B.A. Draper, A.R. Hanson, and E.M. Riseman, "Knowledge-Directed Vision: Control, Learning and Integration," Proc. IEEE Signal Symbols, vol. 84, no. 11, pp. 1,625-1,637, Nov. 1996.
[14] A. Elmoataz, "Mécanismes opératoires d'un segmenteur d'images non dédié: Définition d'une base d'opérateurs et implantation," PhD thesis, Univ. of Caen, France, 1990.
[15] A. Elmoataz, M. Revenu, and C. Porquet, "Segmentation and Classification of Various Types of Cells in Cytological Images," Proc. IEE Image Processing and Its Applications, pp. 385-388,Maastricht, Netherlands, Apr. 1992.
[16] L. Gong and C. Kulikowski, “Composition of Image Analysis Processes through Object-Centered Hierarchical Planning,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 17, pp. 997-1009, 1995.
[17] B. A. Hayes–Roth,“Blackboard for control,”Artificial Intelligence,vol. 26, pp. 251–321, 1985.
[18] A.L. Lansky, M. Friedman, L. Getoor, S. Schmidler, and N. Short, Jr., "The Collage/Khoros Links: Planning for Image Processing Tasks," Proc. AAAI Spring Symp.: Integrated Planning Applications, pp. 67-76,Menlo Park, Calif., 1995.
[19] C.E. Liedtke and A. Blömer, "Architecture of the Knowledge-Based Configuration System for Image Analysis Conny," Proc. IEEE Int'l Conf. Pattern Recognition, pp. 375-378,The Hague, Netherlands, Aug. 1992.
[20] D. Marr, Vision: A Computational Investigation Into the Human Representation and Processing of Visual Information.San Francisco, Calif.: Freeman and Co., 1982.
[21] T. Matsuyama, "Expert Systems for Image Processing: Knowledge-Based Composition of Image Analysis Processes," Computer Vision, Graphics,&Image Processing, vol. 48, pp. 22-49, 1989.
[22] S. Moisan, R. Vincent, J. van den Elst, and F. van Harmelen, "Towards an Intelligent Failure Handling Mechanims in Program Supervision," Proc. Int'l Workshop Knowledge-Based Systems for the Reuse of Program Libraries, pp. 109-118,Sophia Antipolis, France, Nov. 1995.
[23] A.M. Nazif and M.D. Levine, "Low Level Image Segmentation: An Expert System," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 6, no. 5, pp. 555-577, Sept. 1984.
[24] H.P. Nii, "Introduction," V. Jagannathan, R. Dodhiawala, and L.S. Baum, eds., Blackboard Architecture and Applications, pp. xix-xxix.New York: Academic Press, 1989.
[25] T. Poggio, V. Torre, and C. Koch, “Computational Vision and Regularization Theory,” Nature, vol. 317, pp. 314-319, 1985.
[26] J. Rasure and S. Kubica, "The Khoros Application Development Environment," H.I. Christensen and J.L. Crowley, eds., Experimental Environments for Computer Vision and Image Processing, pp. 1-32.Singapore: World Scientific, 1994.
[27] K. Sakaue and H. Tamura, "Automatic Generation of Image Processing Programs by Knowledge Verification," Proc. IEEE Computer Vision and Pattern Recognition, pp. 189-192,San Francisco, Calif., June 1985.
[28] H.A. Simon, The Sciences of the Artificial, MIT Press, Cambridge, Mass., 1981.
[29] T. Tanaka and N. Sueda, "Knowledge Acquisition in Image Processing Expert System Explain," Proc Int'l Workshop Artificial Intelligence for Industrial Applications, pp. 267-272,Hitashi, Japan, May 1988.
[30] M. Thonnat and S. Moisan, "Knowledge-Based Systems for Program Supervision," Proc. Int'l Workshop Knowledge-Based Systems for the Reuse of Program Libraries, pp. 4-8,Sophia Antipolis, France, Nov. 1995.
[31] T. Toriu, H. Iwase, and M. Yoshida, "An Expert System for Image Processing," Fujitsu Science and Technical J., vol. 23, no. 2, pp. 111-118, June 1987.
[32] J. van den Elst, "Knowledge Modeling for Program Supervision in Image Processing," PhD thesis, Univ. of Nice, France, 1996.

Index Terms:
Image processing, artificial intelligence, knowledge-based systems, composition of image processing programs, supervision of a library of programs.
Regis Clouard, Abderrahim Elmoataz, Christine Porquet, Marinette Revenu, "Borg: A Knowledge-Based System for Automatic Generation of Image Processing Programs," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 21, no. 2, pp. 128-144, Feb. 1999, doi:10.1109/34.748822
Usage of this product signifies your acceptance of the Terms of Use.