This Article 
 Bibliographic References 
 Add to: 
STRPN: A Petri-Net Approach for Modeling Spatial-Temporal Relations between Moving Multimedia Objects
January 2003 (vol. 29 no. 1)
pp. 63-76

Abstract—A multimedia presentation model provides designers a tool to formally specify the temporal and spatial relationships of objects. The formality helps designers to communicate with others, to check the integrity of designs, and provides a chance to simulate the designs. Although much research has been devoted to this subject, to the best of our knowledge, no multimedia models are able to describe the spatial-temporal relations of moving objects that may refer to each other for computing displaying addresses. The addresses may be recomputed several times during the objects' lifetimes to reflect their movements. Without a formal model, designers are forced to specify the relationships in an ad hoc manner that causes misunderstanding and hampers integrity check. The check includes if an object gets its addresses in time from another object, if an object is displayed in the right places, etc. The difficulty of designing such a formal model lies in integrating temporal constraints of objects with a real-time address transferring mechanism. In this paper, we present an extended Petri-Net model, which models concurrent relationships of objects with new places, transitions, and firing rules to transfer and transform addresses in real time. Its descriptive power and correctness is demonstrated by five patterns of multimedia presentations and a sample play scripts.

[1] J.F. Allen, “Maintaining Knowledge about Temporal Intervals,” Comm. ACM, vol. 26, no. 11, pp. 832–843, 1983.
[2] N.A. Anisimov, A.A. Kovalenko, P.A. Postupalski, and S.T. Vuong, “A Compositional Approach to the Specification of Multimedia Objects Using Petri Nets,” Proc. First Ann. Conf. Emerging Technologies and Applications in Comm., 1996.
[3] K.S. Candan, B. Prabhakaran, and V.S. Subrahmanian, “Retrieval Schedules Based on Resource Availability and Flexible Presentation Specifications,” Multimedia Systems, vol. 6, pp. 232-250, 1998.
[4] M. Diaz and P. Senac, “Time Stream Petri Nets: A Model for Multimedia Streams Synchronization,” Proc. Int'l Conf. Multi-Media Modeling, Nov. 1993.
[5] A.U. Frank, “Qualitative Spatial Reasoning about Distances and Directions in Geographic Space,” Int'l J. Geographic Information Systems, 1994.
[6] I. Herman, N. Correia, D.A. Duce, D.J. Duke, G.J. Reynolds, and J.V. Loo, “A Standard Model for Multimedia Synchronization: PREMO Synchronization Objects,” Multimedia Systems, vol. 6, pp. 88-101, 1998.
[7] M. Iino, Y.F. Day, and A. Ghafoor, "An Object-Oriented Model for Spatiotemporal Synchronization of Multimedia Information," Proc. of the IEEE Multimedia Conf., IEEE CS Press, Los Alamitos, Calif., 1994, pp. 110-119.
[8] T. Little and A. Ghafoor, "Synchronization and Storage for Multimedia Objects," IEEE J. Selected Areas in Comm., vol. 8, no. 3, pp. 413-427, Apr. 1990.
[9] D. Papadias and Y. Theodorisdis, “Spatial Relations, Minimum Bounding Rectangles, and Spatial Data Structures,” Int'l J. Geographic Information Systems, vol. 11, no. 2, 1997.
[10] M.J. Perez-Luque and T.D.C. Little, “A Temporal Reference Framework for Multimedia Synchronization,” IEEE J. Selected Areas in Comm., vol. 14, no. 1, pp. 36-51, 1996.
[11] B. Prabhakaran and S.V. Raghavan, "Synchronization Models for Multimedia Presentation with User Interaction," Proc. ACM Multimedia'93, pp. 157-166,California, 1993.
[12] C. Ramchandani,“Analysis of asynchronous concurrent systems by Petri nets.”Cambridge, MA: MIT, Project MAC, TR-120, Feb. 1974.
[13] J. Song, G. Ramalingam, R. Miller, and B. Yi, “Interactive Authoring of Multimedia Documents in a Constraint-Based Authoring System,” Multimedia Systems, vol. 7, pp. 424-437, 1999.
[14] M. Vazirgiannis, Y. Theodoridis, and T. Sellis, “Spatio-Temporal Composition and Indexing for Large Multimedia Applications,” ACM/Springer Multimedia Systems, vol. 6, no. 4, pp. 284-298, July 1998.
[15] M. Vazirgiannis, I. Kostalas, and T. Sellis, “Specifying and Authoring Multimedia Scenarios,” IEEE Multimedia, vol. 6, no. 3, pp. 24-37, July-Sept. 1999.
[16] S. Vuong, K. Cooper, and M. Ito, “Petri Net Models for Describing Multimedia Synchronization Requirements,” Proc. Int'l Conf. Network Protocols, 1996.
[17] M. Woo, N. Qazi, and A. Ghafoor, "A Synchronization Framework for Communication of Pre-Orchestrated Multimedia Information," IEEE Network, Jan.-Feb. 1994.
[18] R. Drath, “Visual Object Net++,” visual_E.h, Oct. 1999.

Index Terms:
Petri Net, multimedia, spatial-temporal relations, two-phase firing conditions, valid firing sequences, relative coordination.
Ping-Yu Hsu, Yuan-Bin Chang, Yen-Liang Chen, "STRPN: A Petri-Net Approach for Modeling Spatial-Temporal Relations between Moving Multimedia Objects," IEEE Transactions on Software Engineering, vol. 29, no. 1, pp. 63-76, Jan. 2003, doi:10.1109/TSE.2003.1166589
Usage of this product signifies your acceptance of the Terms of Use.