We propose a novel framework that employs correlated digital video and audio watermarking where the watermarking sequence contains video interaction information and media features as a basis towards constructing a secure, self-contained, format independent stream-based scheme for interactive media authoring. We have detailed our methods and illustrate the advantages of this scheme over the traditional meta-tag approach for interactive video authoring. We also identify many of the potential applications that can benefit from this approach. We outline the prototype application and demonstrate the successful implementation within our existing real-time multimedia authoring system, where the new post production video delivering module is based on this framework.