The Community for Technology Leaders
RSS Icon
Issue No.01 - January-March (2011 vol.18)
pp: 88-95
Ching-Wei Chen , Gracenote
Phillip Popp , Gracenote
Bob Coover , Gracenote
<p>Editor's Note</p><p>True multimedia experience involves multimodal media and their intrinsic interactions. This article identifies rhythm as the link between physical movement, other visual stimuli, and the musical art form. It describes two example interactive multimedia applications in which visual rhythm is extracted for synchronization of music and video to allow more intuitive interaction between a user and both audio and video content, leaving the door open for many potential innovative applications.</p><p align="right">&#x2014;<it>Wenjun Zeng</it></p>
visual rhythm, visual tempo, beat detection, novelty detection, time stretching
Ching-Wei Chen, Phillip Popp, Bob Coover, "Visual Rhythm Detection and Its Applications in Interactive Multimedia", IEEE MultiMedia, vol.18, no. 1, pp. 88-95, January-March 2011, doi:10.1109/MMUL.2011.19
1. J.P. Bello et al., "A Tutorial on Onset Detection in Music Signals," IEEE Trans. Speech and Audio Processing, vol. 13, no. 5, 2005.
2. T.P. Chen et al., "VRAPS: Visual Rhythm-Based Audio Playback System," Proc. Int'l Conf. Multimedia and Expo (ICME), IEEE Press, 2010.
3. F. Gouyon and S. Dixon, "Computational Rhythm Description," Proc. 7th Int'l Conf. Music Information Retrieval, Int'l Soc. Music Information Retrieval, 2006.
4. J.-Y. Bouguet, Pyramidal Implementation of the Lucas Kanade Feature Tracker Description of the Algorithm, OpenCV distribution package 2000, Microprocessor Research Labs, Intel Corp., 2000.
5. G.T. Beauregard, S.K. Subramanian, and P.R. Kellock, Creating a New Music Video by Intercutting User-Supplied Visual Data with a Pre-Existing Music Video, US patent 2008/0016114 A1, Patent and Trademark Office, 17 January 2008.
6 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool