This Article 
 Bibliographic References 
 Add to: 
Interval-Based Conceptual Models for Time-Dependent Multimedia Data
August 1993 (vol. 5 no. 4)
pp. 551-563

Multimedia data often have time dependencies that must be satisfied at presentation time. To support a general-purpose multimedia information system, these timing relationships must be managed to provide utility to both the data presentation system and the multimedia author. New conceptual models for capturing these timing relationships, and managing them as part of a database are proposed. Specifically, n-ary and reverse temporal relations are introduced and defined along with their temporal constraints. These new relations are a generalization of earlier temporal models and establish the basis for conceptual database structures and temporal access control algorithms to facilitate forward, reverse, and partial-interval evaluation during multimedia object playout. The proposed relations are defined to ensure a property of monotonically increasing playout deadlines to facilitate both real-time deadline-driven playout scheduling or optimistic interval-based process playout. A translation of the conceptual models to a structure suitable for a relational database is presented.

[1] J.F. Allen, "Maintaining Knowledge About Temporal Intervals,"Comm. ACM, Vol. 26, No. 11, Nov. 1983, pp. 832- 843.
[2] T.L. Anderson, "Modeling time at the conceptual level,"Improving Database Usability and Responsiveness, P. Scheuermann, Ed. New York: Academic Press, 1982, pp. 273-297.
[3] D.P. Anderson and G. Homsy, "A continuous media I/O server and its synchronization mechanism,"Computer, vol. 24, pp. 51-57, Oct. 1991.
[4] M.C. Buchanan and P.T. Zellweger, "Specifying temporal behavior in hypermedia documents," inProc. European Conf. on Hypertext'92, Dec. 1992.
[5] D.C.A. Bulterman, G. van Rossum, and R. van Liere, "A structure for transportable, dynamic multimedia documents," inProc. Summer 1991 Usenix Conf., June 1991, pp. 137-155.
[6] D.C.A. Bulterman and R. van Liere, "Multimedia Synchronization and Unix,"Proc. 2nd Int'l Workshop on Network and Operating System Support for Digital Audio and Video, Heidelberg, Germany, Nov. 1991, pp. 108-119.
[7] S. Christodoulakis and C. Faloutsos, "Design and Performance Considerations for an Optical Disk Based Multimedia Object Server,"Computer, Dec. 1986, pp. 45-56.
[8] Committee Draft International Standard, "Information Technology-Standard Music Description Language (SMDL)," ISO/IEC CD 10743, April 1, 1991.
[9] D.J. Gemmell and S. Christodoulakis, "Principles of Delay-Sensitive Multimedia Data Storage and Retrieval,"ACM Trans. Information Systems, Vol. 10, No. 1, Jan. 1992, pp. 51-90.
[10] S. Gibbs, "Composite Multimedia and Active Objects,"Proc. OOPSLA, ACM Press, New York, Oct. 1991, pp. 97-112.
[11] C.L. Hamblin, "Instants and intervals," inProc. 1st Conf. Int. Society for the Study of Time, J.T. Fraser,et al., Eds. New York: Springer-Verlag, 1972, pp. 324-331.
[12] R.G. Herrtwich, "Time capsules: An abstraction for access to continuousmedia data," inProc. 11th Real-Time Systems Symp., Lake Buena Vista, FL, December 1990, pp. 11-20.
[13] R.G. Herrtwich and L. Delgrossi, "ODA-based data modeling in multimedia systems,"Int. Computer Science Institute Tech. Rep.TR-90-043, Aug. 1990.
[14] W.C. Hou, G. Ozsoyoglu, and B.K. Taneja, "Processing aggregate relational queries with hard time constraints," inProc. ACM SIGMOD Int. Conf. Management of Data, June 1989.
[15] L. Li, A. Karmouch, and N.D. Georganas, "Real-time synchronization control in multimedia distributed systems," inProc. 4th IEEE ComSoc Int. Workshop on Multimedia Communications (Multimedia '92), Apr. 1992, pp. 294-305.
[16] T.D.C. Little et al., "A Video-on-Demand System Supporting Content Based Queries,"Proc. ACM Multimedia, ACM Press, New York, 1993, pp. 427- 436.
[17] T.D.C. Little and A. Ghafoor, "Synchronization and Storage Models for Multimedia Objects,"IEEE J. on Selected Areas in Communications, Vol. 8, No. 3, April 1990, IEEE Press, New York, pp. 413-427.
[18] T.D.C. Little and A. Ghafoor, "Multimedia Synchronization Protocols for Broadband Integrated Services," to be published inIEEE J. Selected Areas Comm., Dec. 1991.
[19] T.D.C. Little and A. Ghafoor, "Scheduling of bandwidth-constrained multimedia traffic,"Computer Commun., vol. 15, pp. 381-387, July/Aug. 1992.
[20] J. Nakajima, M. Yazaki, and H. Matsumoto, "Multimedia/realtime extensiohs for the Mach operating system,"Proc. Summer 1991 Usenix Conf., pp. 183-198, June 1991.
[21] M. Pasieka, P. Crumley, A. Marks, and A. Infortuna, "Distributed multimedia: How can the necessary data rates be supported?" inProc. Summer Usenix Conf., pp. 169-182, June 1991.
[22] H.M. Vin and P.V. Rangan, "Designing File Systems for Digital Video and Audio,"Proc. 13th ACM Symp. Operating System Principles, ACM Press, New York, 1991, pp. 81-94.
[23] C. Schramm and M. Goldberg, "Multimedia radiological reports: Creation and playback," inProc. SPIE Medical Imaging III: Image Capture and Display, SPIE Vol. 1091, pp. 191-201, Jan. 1989.
[24] P.D. Stotts and R. Furuta, "Petri-Net-Based Hypertext: Document Structure with Browsing Semantics,"ACM Trans. Office Automation Systems, Vol. 7. No. 1, Jan. 1989, pp. 3-29.
[25] R. Snodgrass, "The temporal query language TQuel,"ACM Trans. Database Syst., vol. 12, no. 2, June 1987.
[26] B.I. Szabo and G.K. Wallace, "Design considerations for JPEG video and synchronized audio in a Unix workstation," inProc. Summer Usenix Conf., pp. 353-368, June 1991.
[27] A.U. Tansel, M.E. Arkun, and G. Ozsoyoglu, "Time-by-example query language for historical databases,"IEEE Trans. Software Eng., vol. 15, pp. 464-478, Apr. 1989.
[28] J. Wells, Q. Yang, and C. Yu, "Placement of audio data on optical disks," inProc. 1st Int. Conf. Multimedia Information Systems '91, Jan. 1991, pp. 123-134.
[29] L.C. Wolf, "A runtime environment for multimedia communications," presented at the 2nd Int. Workshop on Network and Operating Support for Digital Audio and Video, Nov. 1991.
[30] C. Yu et al., "Efficient Placement of Audio Data on Optical Discs for Real-Time Applications,"Comm. ACM, Vol. 32, No. 7, July 1989, pp. 862-871.

Index Terms:
interval-based conceptual models; time-dependent multimedia data; multimedia information system; timing relationships; n-ary; reverse temporal relations; temporal access control algorithms; real-time deadline-driven playout scheduling; optimistic interval-based process playout; relational database; multimedia systems; relational databases; scheduling; synchronisation; temporal databases
T.D.C. Little, A. Ghafoor, "Interval-Based Conceptual Models for Time-Dependent Multimedia Data," IEEE Transactions on Knowledge and Data Engineering, vol. 5, no. 4, pp. 551-563, Aug. 1993, doi:10.1109/69.234768
Usage of this product signifies your acceptance of the Terms of Use.