This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Visual Rhythm Detection and Its Applications in Interactive Multimedia
January-March 2011 (vol. 18 no. 1)
pp. 88-95
Trista P. Chen, Gracenote
Ching-Wei Chen, Gracenote
Phillip Popp, Gracenote
Bob Coover, Gracenote

Editor's Note

True multimedia experience involves multimodal media and their intrinsic interactions. This article identifies rhythm as the link between physical movement, other visual stimuli, and the musical art form. It describes two example interactive multimedia applications in which visual rhythm is extracted for synchronization of music and video to allow more intuitive interaction between a user and both audio and video content, leaving the door open for many potential innovative applications.

Wenjun Zeng

1. J.P. Bello et al., "A Tutorial on Onset Detection in Music Signals," IEEE Trans. Speech and Audio Processing, vol. 13, no. 5, 2005.
2. T.P. Chen et al., "VRAPS: Visual Rhythm-Based Audio Playback System," Proc. Int'l Conf. Multimedia and Expo (ICME), IEEE Press, 2010.
3. F. Gouyon and S. Dixon, "Computational Rhythm Description," Proc. 7th Int'l Conf. Music Information Retrieval, Int'l Soc. Music Information Retrieval, 2006.
4. J.-Y. Bouguet, Pyramidal Implementation of the Lucas Kanade Feature Tracker Description of the Algorithm, OpenCV distribution package 2000, Microprocessor Research Labs, Intel Corp., 2000.
5. G.T. Beauregard, S.K. Subramanian, and P.R. Kellock, Creating a New Music Video by Intercutting User-Supplied Visual Data with a Pre-Existing Music Video, US patent 2008/0016114 A1, Patent and Trademark Office, 17 January 2008.

Index Terms:
visual rhythm, visual tempo, beat detection, novelty detection, time stretching
Citation:
Trista P. Chen, Ching-Wei Chen, Phillip Popp, Bob Coover, "Visual Rhythm Detection and Its Applications in Interactive Multimedia," IEEE Multimedia, vol. 18, no. 1, pp. 88-95, Jan.-March 2011, doi:10.1109/MMUL.2011.19
Usage of this product signifies your acceptance of the Terms of Use.