This Article 
 Bibliographic References 
 Add to: 
A Three-Dimensional Iconic Environment for Image Database Querying
October 1993 (vol. 19 no. 10)
pp. 997-1011

Retrieval by contents of images from pictorial databases can be effectively performed through visual icon-based systems. In these systems, the representation of pictures with 2D strings, which are derived from symbolic projections, provides an efficient and natural way to construct iconic indexes for pictures and is also an ideal representation for the visual query. With this approach, retrieval is reduced to matching two symbolic strings. However, using 2D-string representations, spatial relationships between the objects represented in the image might not be exactly specified. Ambiguities arise for the retrieval of images of 3D scenes. In order to allow the unambiguous description of object spatial relationships, in this paper, following the symbolic projections approach, images are referred to by considering spatial relationships in the 3D imaged scene. A representation language is introduced that expresses positional and directional relationships between objects in three dimensions, still preserving object spatial extensions after projections. Iconic retrieval from pictorial databases with 3D interfaces is discussed and motivated. A system for querying by example with 3D icons, which supports this language, is also presented.

[1] N. Chang and K. Fu, "Query by pictorial example,"IEEE Trans. Software Eng., vol. SE-6, pp. 519-524, Nov. 1980.
[2] T. Joseph and A. Cardenas, "PICQUERY: A high level query language for pictorial database management,"IEEE Trans. Software Eng., vol. 14, pp. 630-638, May 1988.
[3] N. Roussopoulos, C. Faloutsos, and T. Sellis, "An efficient pictorial database system for PSQL,"IEEE Trans. Software Eng., vol. 14, pp. 639-650, May 1988.
[4] J. Orenstein and F. Manola, "PROBE: Spatial data modeling and query processing in an image database application,"IEEE Trans. Software Eng., vol. 14, pp. 611-629, May 1988.
[5] M. Tanaka and T. Ichikawa, "A visual user interface for map information retrieval based on semantic significance,"IEEE Trans. Software Eng., vol. 14, pp. 666-670, May 1988.
[6] T. Kato, "Database architecture for content-based image retrieval,"Image Storage and Retrieval Systems, SPIE, vol. 1662, pp. 611-629, 1992.
[7] S. Chang, C. Yan, D. Dimitroff, and T. Arndt, "An intelligent image database system,"IEEE Trans. Software Eng., vol. 14, pp. 681-688, May 1988.
[8] M. Chock, A. Cardenas, and A. Klinger, "Database structure and manipulation capabilities of a picture database management system (PICDMS),"IEEE Trans. Pattern Anal. Mach. Intell., vol. PAMI-6, pp. 484-492, July 1984.
[9] H. Samet, "The quadtree and related hierarchical data structures,"Comput. Surveys, vol. 16, pp. 187-260, 1984.
[10] S. -K. Chang, Q. -Y. Shi, and C. -W. Yan, "Iconic indexing by 2-D strings,"IEEE Trans. Patt. Anal. Machine Intell., vol. PAMI-9, no. 3, pp. 413-428, May 1987.
[11] S. Chang and S. Liu, "Picture indexing and abstraction techniques for pictorial database,"IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-6, pp. 475-484, July 1984.
[12] P. Holmes and E. Jungert, "Symbolic and geometric connectivity graph methods for route planning in digitized maps,"IEEE Trans. Pattern Anal. Machine Intell., vol. 14, pp. 549-565, May 1992.
[13] S.-K. Chang and Y. Li, "Representation of multi-resolution symbolic and binary pictures using 2DH strings," inProc. IEEE Workshop Languages for Automation, 1988, pp. 190-195.
[14] S. Chang and E. Jungert, "Pictorial data management based upon the theory of symbolic projections,"J. Visual Languages Comput., vol. 2, pp. 195-215, June 1991.
[15] S. Lee, M. Shan, and W. Pang, "Similarity retrieval of iconic image database,"Pattern Recognition, vol. 22, pp. 675-682, June 1989.
[16] T. Arndt and S.-K. Chang, "Image sequence compression by iconic indexing," inProc. IEEE Workshop Visual Languages, Rome, Italy, 1989, pp. 177-182.
[17] L. Cooper and R. Shepard, "Turning something over in the mind,"Sci. Amer., pp. 114-120, Dec. 1984.
[18] G. Costagliola, G. Tortora, and T. Arndt, "A unifying approach to iconic indexing for 2-D and 3-D scenes,"IEEE Trans. Knowledge Data Eng., vol. 4, pp. 205-222, June 1992.
[19] A. Del Bimbo, M. Campanai, and P. Nesi, "3D visual query language for image databases,"J. Visual Languages Comput., vol. 3, pp. 257-271, Sept. 1992.
[20] M. Stefik and D. G. Babrow, "Object-oriented programming: Themes and variations,"AI Mag., vol. 6, no. 4, pp. 40-62, Dec. 1985.
[21] ONTOS, "Object-oriented database documentation, rel. 1.42, operating system: Os/2," Ontologic Inc., MA, Tech. Rep., 1989.
[22] J. Halpern and Y. Shoham, "A propositional modal logic of time intervals,"J. Ass. Comput. Mach., vol. 38, pp. 935-962, Oct. 1991.
[23] P. J. Besl and R. C. Jain, "Three-dimensional object recognition,"ACM Comput. Surveys, vol. 17, no. 1, pp. 75-145, Mar. 1985.
[24] R. Brooks, "Model-based three-dimensional interpretation of two-dimensional images," inReadings in Computer Vision, M.A. Fischler and O. Firschein, Eds. Los Altos, CA: Morgan Kauffman, 1987, pp. 360-371.
[25] M. Herman and T. Kanade, "The 3-D MOSAIC scene understanding system: Incremental reconstruction of 3D scenes for complex images," inReadings in Computer Vision, M. A. Fischler and O. Firschein Eds. Los Altos, CA: Morgan Kauffman, 1987, pp. 471-483.
[26] G. Adiv, "Inherent ambiguities in recovering 3D motion and structure from a noisy flow field,"IEEE Trans. Pattern Anal. Machine Intell., vol. 11, pp. 477-489, May 1989.
[27] L. Mohan and R. Kashyap, "An object-oriented knowledge representation for spatial information,"IEEE Trans. Software Eng., vol. 14, no. 5, pp. 675-688, 1988.
[28] S. K. Chang, "Principles of visual languages," inVisual Programming Syst., S. K. Chang, Ed, Englewood Cliffs, NJ: Prentice Hall, 1990, pp. 1-59.
[29] A. Del Bimbo, E. Vicario, and D. Zingoni, "A spatio-temporal logic for image sequence coding and retrieval," inProc. IEEE VL92 Workshop on Visual Languages, Sept. 1992.
[30] A. Del Bimbo, E. Vicario, and D. Zingoni, "Symbolic indexing of image sequences with spatio-temporal logic," Univ. Firenze, Firenze, Italy, Tech. Rep. 8 93; also submitted toIEEE Trans. Knowledge Data Eng., Feb. 1993.

Index Terms:
three-dimensional iconic environment; image database querying; pictorial databases; visual icon-based systems; 2D strings; symbolic projections; visual query; object spatial relationships; spatial relationships; object spatial extensions; 3D interfaces; querying by example; 3D icons; graphical user interfaces; query processing; visual databases
A. Del Bimbo, M. Campanai, P. Nesi, "A Three-Dimensional Iconic Environment for Image Database Querying," IEEE Transactions on Software Engineering, vol. 19, no. 10, pp. 997-1011, Oct. 1993, doi:10.1109/32.245741
Usage of this product signifies your acceptance of the Terms of Use.