This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Symbolic Description and Visual Querying of Image Sequences Using Spatio-Temporal Logic
August 1995 (vol. 7 no. 4)
pp. 609-622
ASCII Text
x 
 
Alberto Del Bimbo, Enrico Vicario, Daniele Zingoni, "Symbolic Description and Visual Querying of Image Sequences Using Spatio-Temporal Logic," IEEE Transactions on Knowledge and Data Engineering, vol. 7, no. 4, pp. 609-622, August, 1995.
 
 
BibTex
x
 
@article{ 10.1109/69.404033,
author = {Alberto Del Bimbo and Enrico Vicario and Daniele Zingoni},
title = {Symbolic Description and Visual Querying of Image Sequences Using Spatio-Temporal Logic},
journal ={IEEE Transactions on Knowledge and Data Engineering},
volume = {7},
number = {4},
issn = {1041-4347},
year = {1995},
pages = {609-622},
doi = {http://doi.ieeecomputersociety.org/10.1109/69.404033},
publisher = {IEEE Computer Society},
address = {Los Alamitos, CA, USA},
}
 
 
RefWorks Procite/RefMan/Endnote
x 
 
TY - JOUR
JO - IEEE Transactions on Knowledge and Data Engineering
TI - Symbolic Description and Visual Querying of Image Sequences Using Spatio-Temporal Logic
IS - 4
SN - 1041-4347
SP609
EP622
EPD - 609-622
A1 - Alberto Del Bimbo,
A1 - Enrico Vicario,
A1 - Daniele Zingoni,
PY - 1995
KW - Image sequence retrieval
KW - visual querying by example
KW - image sequence symbolic description
KW - symbolic projection
KW - spatial logic
KW - temporal logic.
VL - 7
JA - IEEE Transactions on Knowledge and Data Engineering
ER -
 

Abstract—The emergence of advanced multimedia applications is emphasizing the relevance of retrieval by contents within databases of images and image sequences. Matching the inherent visuality of the information stored in such databases, visual specification by example provides an effective and natural way to express content-oriented queries. To support this querying approach, the system must be able to interpret example scenes reproducing the contents of images and sequences to be retrieved, and to match them against the actual contents of the database. In the accomplishment of this task, to avoid a direct access to raw image data, the system must be provided with an appropriate description language supporting the representation of the contents of pictorial data.

An original language for the symbolic representation of the contents of image sequences is presented. This language, referred to as Spatio-temporal Logic, comprises a framework for the qualitative representation of the contents of image sequences, which allows for treatment and operation of content structures at a higher level than pixels or image features. Organization and operation principles of a prototype system exploiting Spatio-temporal Logic to support querying by example through visual iconic interaction are expounded.

[1] G. Adiv,“Determining three-dimensional motion and structure from optical flow generated by several moving objects,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 7, no. 4, pp. 525-542, July 1985.
[2] J.F. Allen, “Maintaining Knowledge about Temporal Intervals,” Comm. ACM, vol. 26, no. 11, pp. 832–843, 1983.
[3] R. Alur and T.A. Henzinger,“Logics and models of real time: A survey,” Tech. Rep. No. 92-1262, Dept. of Computer Science, Cornell Univ., Ithaca, N.Y., 1992.
[4] T. Arndt and S.K. Chang,“Image sequence compression by iconic indexing,” IEEE VL’89 Workshop on Visual Languages, pp. 177-182,Roma, Italy, Sept. 1989.
[5] A. Barone,“Derivazione di relazioni simboliche 3D da viste monoculari,” doctoral thesis (in Italian), A. Del Bimbo and G. Bucci, advisors, Tech. Rep. No. 15-94,Dip. Sistemi e Informatica Univ. Firenze, Florence, Italy, 1994.
[6] E. Binaghi,I. Gagliardi,, and R. Schettini,“Indexing and fuzzy logic-based retrieval of color images,” Visual Database Systems, II, IFIP Trans. A-7, pp. 79-92, Elsevier Science Publishers, 1992.
[7] S.K. Chang and S.H. Liu,“Picture indexing and abstraction techniques for pictorial databases,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 6, no. 4, pp. 475-484, July 1984.
[8] S.K. Chang, Q.Y. Shi, and C.W. Yan, “Iconic Indexing by 2-D Strings,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 9, no. 3, pp. 413-427, July 1987.
[9] S.K. Chang, C.W. Yan, D.C. Dimitroff, and T. Arndt, “An Intelligent Image Database System,” IEEE Trans. Software Eng., vol. 14, no. 5, pp. 681-688, May 1988.
[10] S.K. Chang,T.Y. Hou,, and A. Hsu,“Smart image design for large image databases,” J. Visual Languages and Computing, vol. 3, no. 4, Dec. 1992.
[11] S.K. Chang and E. Jungert,“Pictorial data management based upon the theory of symbolic projections,” J. Visual Languages and Computing, vol. 2, no. 2, pp. 195-215, June 1991.
[12] E.M. Clarke, E.A. Emerson, and A.P. Sistla, "Automatic verification of finite-state concurrent systems using temporal logic specifications," ACM Trans. Programming Languages and Systems, vol. 8, no. 2, pp. 244-263, 1986.
[13] G. Costagliola, G. Tortora, and T. Arndt, “A Unifying Approach to Iconic Indexing for 2-D and 3-D Scenes,” IEEE Trans. Knowledge and Data Eng., vol. 4, no. 3, pp. 205-222, June 1992.
[14] M. Davis,“Media dtreams, an iconic visual language for video annotation,” Telektronik, no. 4, pp.5 9-71, 1993 (also appeared in reduced version in Proc. IEEE VL’93 Workshop on Visual Languages,Bergen, Norway, Aug. 1993).
[15] A.D. Bimbo, M. Campanai, and P. Nesi, “A Three-Dimensional Iconic Environment for Image Database Querying,” IEEE Trans. Software Eng., vol. 19, no. 10, pp. 997-1011, Oct. 1993.
[16] A. Del Bimbo and E. Vicario,“A logical framework for spatio-temporal indexing of image sequences,” Proc. Workshop on Spatial Reasoning,Bergen, Norway, Aug. 1993, also to appear in Spatial Reasoning, S.K. Chang, E. Jungert, eds., Plenum Press.
[17] A. Del Bimbo, P. Pala, and S. Santini, "Visual Image Retrieval by Elastic Deformation of Object Shapes," Proc. IEEE VL'94, Int'l Symp. Visual Languages,St. Louis, Mo, Oct. 1994.
[18] E. Jungert,“The observer’s point of view, an extension of symbolic projections,” Proc. Int’l Conf. Theories and Methods of Spatio-Temporal Reasoning in Geographic Space,Pisa, Italy, Sept. 1992, Lecture Notes in Computer Science, pp. 179-195, Springer Verlag, 1992.
[19] A. Hampapur,R. Jain,, and T. Weymouth,“Digital video indexing in multimedia systems,” Proc. AAAI’94 Workshop Indexing and Reuse in Multimedia, pp. 187-198,Seattle, Wash., Aug. 1994.
[20] K. Hirata and T. Kato, “Query by Visual Example,” Advances in Database Technology EDBT '92, Third Int'l Conf. Extending Database Technology, 1992.
[21] S.Y. Lee, M.K. Shan, and W.P. Yang, “Similarity Retrieval of Iconic Image Database,” Pattern Recognition, vol. 22, no. 6, pp. 675-682, 1989.
[22] Z. Manna and A. Pnueli, The Temporal Logic of Reactive and Concurrent Systems. Springer-Verlag, 1991.
[23] L. Mohan and R.L. Kashyap,“An object-oriented knowledge representation for spatial information,” IEEE Trans. Software Engineering, vol. 14, no. 5, pp. 675-681, May 1988.
[24] A. Nagasaka and Y. Tanaka, “Automatic Video Indexing and Full Video Search for Object Appearances,” IFIP Trans. Visual Database Systems II, Knuth and Wegner, eds., pp. 113-127, 1992.
[25] W. Niblack et al., “The QBIC project: Querying images by content using color, texture, and shape,” Res. Report 9203, IBM Res. Div. Almaden Res. Center, Feb. 1993.
[26] M.J. Swain and B.H. Ballard, “Color Indexing,” Int'l J. Computer Vision, vol. 7, no. 1, pp. 11-32, 1991.
[27] S.L. Tanimoto,“An iconic/symbolic data structuring scheme,” Pattern Recognition and Artificial Intelligence, C.H. Chen, ed., New York: Academic, 1976.
[28] I.M. Walter,R. Sturm,, and P.C. Lockemann,“A semantic network based deductive database system for image sequence evaluation,” IFIP Trans. Visual Database Systems II, Knuth, Wegner, eds., pp. 251-276, Elsevier, 1992.
[29] H. Zhang, A. Kankanhalli, and S. Smoliar, "Automatic Partitioning of Full-Motion Video," Multimedia Systems, Vol. 1, No. 1, 1993, pp. 10-28.

Index Terms:
Image sequence retrieval, visual querying by example, image sequence symbolic description, symbolic projection, spatial logic, temporal logic.
Citation:
Alberto Del Bimbo, Enrico Vicario, Daniele Zingoni, "Symbolic Description and Visual Querying of Image Sequences Using Spatio-Temporal Logic," IEEE Transactions on Knowledge and Data Engineering, vol. 7, no. 4, pp. 609-622, Aug. 1995, doi:10.1109/69.404033
Usage of this product signifies your acceptance of the Terms of Use.