The Community for Technology Leaders
Green Image
Issue No. 02 - April-June (2013 vol. 20)
ISSN: 1070-986X
pp: 52-60
Youngmoo E. Kim , Drexel University
David Grunberg , Drexel University
Alex Hrybyk , Drexel University
Matthew Prockup , Drexel University
ABSTRACT
Many people enjoy the symphony, but those without prior training often find it difficult to relate to the music. The authors have developed a system that guides listeners through orchestral performances in real time by presenting time-relevant annotations in a manner similar to that of a personal museum guide. These annotations are authored in partnership with musical experts prior to a performance to provide appropriate contextual information for a given concert program. Using acoustic features of the music, they align the live performance with that of a previously time-stamped recording. The aligned position is transmitted to an application on the users' handheld devices, which present the annotations using an intuitive and unobtrusive interface. To assess its utility, the system underwent a user beta testing stage accompanying orchestra concert broadcasts. It has since been adopted by the Philadelphia Orchestra for use during live concerts in its 2012–2013 subscription season and beyond.
INDEX TERMS
Music, Information analysis, Performance evaluation, User interfaces, Acoustical engineering, dynamic time warping, multimedia, multimedia applications, score tracking, app development, music-information retrieval, music education
CITATION
Youngmoo E. Kim, David Grunberg, Alex Hrybyk, Matthew Prockup, "Orchestral Performance Companion: Using Real-Time Audio to Score Alignment", IEEE MultiMedia, vol. 20, no. , pp. 52-60, April-June 2013, doi:10.1109/MMUL.2013.26
100 ms
(Ver )