This Article 
 Bibliographic References 
 Add to: 
SynchRuler: A Rule-Based Flexible Synchronization Model with Model Checking
December 2005 (vol. 17 no. 12)
pp. 1706-1720
Flexible synchronization models cannot provide a proper way of managing user interactions that change the course of a presentation. In this paper, we present a flexible synchronization model, termed SynchRuler, which allows such user interactions including backward and skip. The synchronization rules, which are based on Event-Condition-Action (ECA) rules, are maintained to handle relationships among streams in SynchRuler. The synchronization rules are manipulated by the Receiver-Controller-Actor (RCA) scheme, where receivers, controllers, and actors are objects to receive events, to check conditions, and to execute actions, respectively. The verification of a multimedia presentation specification is performed with the synchronization model. The correctness of the model and the presentation is controlled with a technique called model checking. Model checker PROMELA/SPIN tool is used for automatic verification of the correctness of LTL (Linear Temporal Logic) formulas.

[1] J. Allen, “Maintaining Knowledge about Temporal Intervals,” Comm. ACM, vol. 26, no. 11, pp. 823-843, Nov. 1983.
[2] R. Aygun and A. Zhang, “Interactive Multimedia Presentation Management in Distributed Multimedia Systems,” Proc. Int'l Conf. Information Technology: Coding and Computing, pp. 275-279, Apr. 2001.
[3] R. Aygun and A. Zhang, “Middle-Tier for Multimedia Synchronization,” Proc. 2001 ACM Multimedia Conf., pp. 471-474, Oct. 2001.
[4] R. Aygun and A. Zhang, “Management of Backward-Skip Interactions Using Synchronization Rules,” Proc. Sixth World Conf. Integrated Design & Process Technology, June 2002.
[5] R. Aygun and A. Zhang, “Modeling and Verification of Interactive Flexible Multimedia Presentations Using Promela/Spin,” Proc. Ninth Int'l SPIN Workshop, pp. 205-212, Apr. 2002.
[6] B. Bailey, J. Konstan, R. Cooley, and M. Dejong, “Nsync— A Toolkit for Building Interactive Multimedia Presentations,” Proc. ACM Multimedia Conf., pp. 257-266, Sept. 1998.
[7] M.C. Buchanan and P.T. Zellweger, “Scheduling Multimedia Documents Using Temporal Constraints,” Proc. Third Int'l Workshop Network and Operating Systems Support for Digital Audio and Video, pp. 237-249, Nov. 1992.
[8] J.P. Courtiat and R.C.D. Oliveira, “Proving Temporal Consistency in a New Multimedia Synchronization Model,” Proc. ACM Multimedia Conf., pp. 141-152, Nov. 1996.
[9] S. Gibbs, C. Breiteneder, and D. Tsichritzis, “Data Modeling of Time-Based Media,” Proc. ACM-SIGMOD Int'l Conf. Management of Data, pp. 91-102, May 1994.
[10] R. Hamakawa and J. Rekimoto, “Object Composition and Playback Models for Handling Multimedia Data,” Multimedia Systems, vol. 2, pp. 26-35, 1994.
[11] I. Herman, N. Correira, D.A. Duce, D.J. Duke, G.J. Reynolds, and J.V. Loo, “A Standard Model for Multimedia Synchronization: Premo Synchronization Objects,” Multimedia Systems, vol. 6, no. 2, pp. 88-101, 1998.
[12] N. Hirzalla, B. Falchuk, and A. Karmouch, “A Temporal Model for Interactive Multimedia Scenario,” IEEE Multimedia, vol. 2, no. 3, pp. 24-31, 1995.
[13] G. Holzmann, Design and Validation of Computer Protocols. Englewood Cliffs, N.J.: Prentice Hall, 1991.
[14] G.J. Holzmann, “The Model Checker Spin,” IEEE Trans. Software Eng., vol. 23, no. 5, pp. 279-295, May 1997.
[15] W. Hurst and R. Muller, “A Synchronization Model for Recorded Presentations and Its Relevance for Information Retrieval,” Proc. ACM Multimedia Conf., pp. 333-342, Oct. 1999.
[16] M. Jourdan, N. Layaida, C. Roisin, L. Sabry-Ismail, and L. Tardif, “Madeus, An Authoring Environment for Interactive Multimedia Documents,” Proc. ACM Multimedia Conf., pp. 267-272, Sept. 1998.
[17] T. Little and A. Ghafoor, “Synchronization and Storage Models for Multimedia Objects,” IEEE J. Selected Areas in Comm., vol. 8, no. 3, pp. 413-427, Apr. 1990.
[18] T. Little and A. Ghafoor, “Interval-Based Conceptual Models for Time-Dependent Multimedia Data,” IEEE Trans. Knowledge and Data Eng., vol. 5, no. 4, pp. 551-563, 1993.
[19] D. McCarthy and U. Dayal, “The Architecture of an Active Data Base Management System,” Proc. ACM SIGMOD Conf. Management of Data, pp. 215-224, 1989.
[20] I. Mirbel, B. Pernici, T. Sellis, S. Tserkezoglou, and M. Vazirgiannis, “Checking Temporal Integrity of Interactive Multimedia Documents,” Very Large Data Bases J., vol. 9, no. 2, pp. 111-130, 2000.
[21] J. Nang and S. Kang, “A New Multimedia Synchronization Specification Method for Temporal and Spatial Events,” Proc. Int'l Conf. Multimedia Computing and Systems, pp. 236-243, June 1997.
[22] B. Prabhakaran and S. Raghavan, “Synchronization Models for Multimedia Presentation with User Participation,” Multimedia Systems, vol. 2, no. 2, 1994.
[23] P. Pzandak and J. Srivastava, “Interactive Multi-User Multimedia Environments on the Internet: An Overview of Damsel and Its Implementation,” Proc. Int'l Conf. Multimedia Computing and Systems, pp. 287-290, June 1996.
[24] L. Rutledge and L. Hardman, “The Rise and Fall of Multimedia Authoring,” Proc. Int'l Conf. Media Futures, pp. 17-20, May 2001.
[25] J. Schnepf, J. Konstan, and D. Du, “FLIPS: Flexible Interactice Presentation Synchronization,” IEEE Selected Areas of Comm., vol. 14, no. 1, pp. 114-125, 1996.
[26] SMIL, http://www.w3.orgAudioVideo, 2005.
[27] M. Vazirgiannis, Y. Theodoridis, and T. Sellis, “Spatio-Temporal Composition and Indexing for Large Multimedia Applications,” Multimedia Systems, vol. 6, no. 4, pp. 284-298, 1998.
[28] K. Yoon and P.B. Berra, “TOCPN: Interactive Temporal Model for Interactive Multimedia Documents,” Proc. Int'l Conf. Multimedia Computing and Systems, pp. 136-144, June 1998.
[29] A. Zhang, Y. Song, and M. Mielke, “NetMedia: Streaming Multimedia Presentations in Distributed Environments,” IEEE Multimedia, vol. 9, no. 1, pp. 56-73, 2002.

Index Terms:
Index Terms- Multimedia synchronization, model checking, synchronization rules, multimedia presentations.
Ramazan Savas Ayg?, Aidong Zhang, "SynchRuler: A Rule-Based Flexible Synchronization Model with Model Checking," IEEE Transactions on Knowledge and Data Engineering, vol. 17, no. 12, pp. 1706-1720, Dec. 2005, doi:10.1109/TKDE.2005.205
Usage of this product signifies your acceptance of the Terms of Use.