This Article 
 Bibliographic References 
 Add to: 
A Visual Language Compiler for Information Retrieval by Visual Reasoning
October 1990 (vol. 16 no. 10)
pp. 1136-1149

When a database increases in size, retrieving the data becomes a major problem. An approach based on data visualization and visual reasoning is described. The main idea is to transform the data objects and present sample data objects in a visual space. The user can use a visual language to incrementally formulate the information retrieval request in the visual space. A prototype system is described with the following features: (1) it is built on top of the SIL-ICON visual language compiler and therefore can be customized for different application domains; (2) it supports a fuzzy icon grammar to define reasonable visual sentences; (3) it incorporates a semantic model of the database for fuzzy visual query translation; and (4) it incorporates a VisualNet which stores the knowledge learned by the system in its interaction with the user so that the VisualReasoner can adapt its behavior.

[1] S. K. Changet al., "A visual language compiler,"IEEE Trans. Software Eng., vol. 15, pp. 506-525, May 1989.
[2] N. C. Shu, Visual Programming. New York: Van Nostrand Reinhold, 1989, pp. 79-108.
[3] B. A. Myers, "Visual programming, programming by example, and program visualization: A taxonomy," inProc. SIGCHI'86, Boston, MA, Apr. 1986, pp. 59-66.
[4] K. T. Huang, "Visual interface design systems," inPrinciples of Visual Programming Systems, S. K. Chang, Ed. Englewood Cliffs, NJ: Prentice-Hall, 1990.
[5] S. Dutta, "Qualitative spatial reasoning: A semi-quantitative approach using fuzzy logic," inProc. Conf. Very Large Spatial Databases, Santa Barbara, CA, July 1989.
[6] S. N. Srihari, "Spatial knowledge representation: A tutorial," inProc. 7th Int. Workshop Expert Syst. Appl., Avignon, France, May 1987.
[7] B. J. Kuipers and T. S. Levitt, "Navigation and mapping in large-scale space,"AI Magazine, 1988.
[8] S. K. Chang,Principles of Pictorial Information Systems Design. Englewood Cliffs, NJ: Prentice-Hall, 1989.
[9] D. H. Ballard and C. M. Brown,Computer Vision. Englewood Cliffs, NJ: Prentice-Hall, 1982.
[10] D. M. McKeown, Jr. and D. R. Reddy, "A hierarchical symbolic representation for an image database," inProc IEEE Workshop Picture Data Description and Management, Chicago, IL, Apr. 1977, pp. 40-44.
[11] C. F. Herot, "Spatial management of data,"ACM TODS, vol. 5, no. 4, pp. 493-514, 1980.
[12] D. McDermott and E. Davis, "Planning and executing routes through uncertain territory,"Artificial Intell., vol. 22, pp. 107-156, 1984.
[13] N. S. V. Rao, "Algorithmic framework for learned robot navigation in unknown terrains,"IEEE Computer, vol. 22, pp. 37-43, June 1989.
[14] L. Buisson, "Reasoning on space with object-centered knowledge representations," inProc. Conf. Very Large Spatial Databases, Santa Barbara, CA, July 1989.
[15] D. C. Halbert, "Programming by example," Xerox Office Syst. Div., Rep. TR OSD-T8402, Dec. 1984.
[16] L. Gould and W. Finzer, "Programming by rehearsal,"Byte, pp. 187-210, June 1984.
[17] B. A. Myers,Creating User Interfaces by Demonstration. Boston, MA: Academic, 1988.
[18] D. C. Smith,Pygmalion: A Computer Program to Model and Stimulate Creative Thought. Stuttgart, West Germany: Birkhauser, 1977.
[19] A. Motro, "Letter from the editor," Data Eng. (Special Issue on Imprecision in Databases), vol. 12, no. 2, pp. 2-3, 1989.
[20] A. Motro, "BAROQUE: An exploratory interface to relational databases,"ACM Trans. Office Inform. Syst., vol, 4, no. 2, pp. 164-181, Apr. 1986.
[21] A. D'Atri, P. Di Felice, and M. Moscarini, "Dynamic query interpretation in relational databases,"Inform. Sci., vol. 14, no. 3, 1989.
[22] J. A. Wald and P. G. Sorenson, "Resolving the query inference problem using Steiner trees,"ACM Trans. Database Syst., vol. 9, no. 3, pp. 348-368, 1984,
[23] S. K. Chang and J. S. Ke, "Translation of fuzzy queries for relational database system,"IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-1, pp. 281-294, July 1979.
[24] M. M. Zloof, "Query by example,"IBM Syst. J., vol. 16, no. 4, pp. 324-343, 1977.
[25] M. D. Williams, "What makes RUBBIT run?,"Int. J. Man-Machine Studies, vol. 21, pp. 333-352, Oct. 1984.
[26] A. Motro, "VAGUE: A user interface to relational database that permits vague queries,"ACM Trans. Office Inform. Syst., vol. 6, pp. 187-214, July 1988.
[27] A. D'Atri and L. Tarantino, "From browsing to querying,"Data Eng., vol. 12, pp. 46-53, June 1989.
[28] S. K. Chang, "Visual reasoning for information retrieval from very large databases,"Int. J. Visual Languages Comput., vol. 1, no. 1, pp. 41-58, 1990.
[29] B. Yu and S. K. Chang, "A fuzzy visual language compiler,"in Proc. 1990 IEEE Visual Languages Workshop, Oct. 1990.
[30] S. K. Chang, "A model for information exchange,"Int. J. Policy Anal. Inform. Syst., vol. 5, pp. 67-93, June 1981.
[31] J. L. McClelland, D. E. Rumelhart, and the PDP Group,Parallel Distributed Processing. Cambridge, MA: M.I.T. Press, 1988.
[32] L. A. Zadeh, "Fuzzy sets,"Inform. Contr., vol. 8, pp. 338-353, 1965.
[33] D. E. Rose and R. K. Belew, "Legal information retrieval: A hybrid approach," inProc. Int. Conf. Artificial Intell. Law, Univ. British Columbia, Vancouver, B.C., Canada, June 1989, pp. 138-146,
[34] Y. Deng and S. K. Chang, "AG-net model for knowledge representation and reasoning,"IEEE Trans. Knowledge Data Eng., vol. 2, Sept. 1990.

Index Terms:
visual language compiler; information retrieval; visual reasoning; database; data visualization; data objects; visual language; prototype system; SIL-ICON; fuzzy icon grammar; semantic model; fuzzy visual query translation; VisualNet; VisualReasoner; data structures; information retrieval; program compilers; visual programming
S.-K. Chang, "A Visual Language Compiler for Information Retrieval by Visual Reasoning," IEEE Transactions on Software Engineering, vol. 16, no. 10, pp. 1136-1149, Oct. 1990, doi:10.1109/32.60294
Usage of this product signifies your acceptance of the Terms of Use.