Issue No. 02 - April-June (2013 vol. 20)
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/MMUL.2013.26
Matthew Prockup , Drexel University
David Grunberg , Drexel University
Alex Hrybyk , Drexel University
Youngmoo E. Kim , Drexel University
Many people enjoy the symphony, but those without prior training often find it difficult to relate to the music. The authors have developed a system that guides listeners through orchestral performances in real time by presenting time-relevant annotations in a manner similar to that of a personal museum guide. These annotations are authored in partnership with musical experts prior to a performance to provide appropriate contextual information for a given concert program. Using acoustic features of the music, they align the live performance with that of a previously time-stamped recording. The aligned position is transmitted to an application on the users' handheld devices, which present the annotations using an intuitive and unobtrusive interface. To assess its utility, the system underwent a user beta testing stage accompanying orchestra concert broadcasts. It has since been adopted by the Philadelphia Orchestra for use during live concerts in its 2012–2013 subscription season and beyond.
Music, Information analysis, Performance evaluation, User interfaces, Acoustical engineering, dynamic time warping, multimedia, multimedia applications, score tracking, app development, music-information retrieval, music education
Y. E. Kim, D. Grunberg, A. Hrybyk and M. Prockup, "Orchestral Performance Companion: Using Real-Time Audio to Score Alignment," in IEEE MultiMedia, vol. 20, no. , pp. 52-60, 2013.