Ninth International Conference on Information Visualisation (IV'05)
MotionLab Sonify: A Framework for the Sonification of Human Motion Data
London, England
July 06-July 08
ISBN: 0-7695-2397-8
Sonification of human movement offers a wide range of new kinds of information for supporting motor learning in sports and rehabilitation. Even though motor learning is dominated visually, auditory perception offers unique subtle temporal resolution as well as enormous integrative capacity — both are important features on perception of human movement patterns. But how to address the auditory system adequately? A sonification based on kinematic movement data can mediate structural features of movement via the auditory system, like polyrhythms of movement etc. And sonification of dynamicmovement data makes muscle forces audible approximately. Here a flexible framework for the sonification of human movement data is presented, capable of processing standard kinematic motion capture data as well as derived quantities such as force data. Force data are computed by inverse dynamics algorithms and can be used as input parameters for real time sonification. Simultaneous visualization is provided using OpenGL.
Index Terms:
Sonification, MIDI, Motion Capture, Inverse Dynamics
Citation:
Alfred Effenberg, Joachim Melzer, Andreas Weber, Arno Zinke, "MotionLab Sonify: A Framework for the Sonification of Human Motion Data," iv, pp.17-23, Ninth International Conference on Information Visualisation (IV'05), 2005