The Community for Technology Leaders
RSS Icon
Issue No.02 - April-June (2011 vol.4)
pp: 187-195
J C P Chan , Dept. of Comput. Sci., City Univ. of Hong Kong, Kowloon, China
H Leung , Dept. of Comput. Sci., City Univ. of Hong Kong, Kowloon, China
J K T Tang , Dept. of Comput. Sci., City Univ. of Hong Kong, Kowloon, China
T Komura , Sch. of Inf., Edinburgh Univ., Edinburgh, UK
In this paper, a new dance training system based on the motion capture and virtual reality (VR) technologies is proposed. Our system is inspired by the traditional way to learn new movements-imitating the teacher's movements and listening to the teacher's feedback. A prototype of our proposed system is implemented, in which a student can imitate the motion demonstrated by a virtual teacher projected on the wall screen. Meanwhile, the student's motions will be captured and analyzed by the system based on which feedback is given back to them. The result of user studies showed that our system can successfully guide students to improve their skills. The subjects agreed that the system is interesting and can motivate them to learn.
virtual reality, computer aided instruction, humanities, virtual teacher, virtual reality dance training system, motion capture technology, movement learning, Joints, Training, Three dimensional displays, Color, Games, Animation, Rendering (computer graphics), motion analysis., Animation, computer uses in education
J C P Chan, H Leung, J K T Tang, T Komura, "A Virtual Reality Dance Training System Using Motion Capture Technology", IEEE Transactions on Learning Technologies, vol.4, no. 2, pp. 187-195, April-June 2011, doi:10.1109/TLT.2010.27
[1] S. Bakogianni, E. Kavakli, V. Karkou, and M. Tsakogianni, "Teaching Traditional Dance Using E-Learning Tools: Experience from the WebDANCE Project," Proc. 21st World Congress on Dance Research: Dancers without Frontiers (CID '07), Sept. 2007.
[2] N. Magnenat-Thalmann and C. Joslin, "Learning How to Dance on the Internet," Proc. Sixth Int'l Conf. Web-Based Learning (ICWL '07), Aug. 2007.
[3] Dance Dance Revolutions Hottest Party, Commercial Dancing Video Game,, 2009.
[4] T. Komura, B. Lam, R.W.H. Lau, and H. Leung, "E-Learning Martial Arts," Proc. Fifth Int'l Conf. Web-Based Learning, pp. 239-248, July 2006.
[5] R. Sidharta and C. Cruz-Neira, "Cyclone Uppercut, a Boxing Game for an Immersive Environment," Proc. ACM SIGCHI, pp. 363-364, June 2005.
[6] Z. Yang, B. Yu, R. Diankov, W. Wu, and R. Bajscy, "Collaborative Dancing in Tele-Immersive Environment," Proc. Ann. ACM Int'l Conf. Multimedia, pp. 723-726, Oct. 2006.
[7] M.R. Lepper and D.I. Cordova, "A Desire to Be Taught: Instructional Consequences of Intrinsic Motivation," Motivation and Emotion, vol. 16, no. 3, pp. 187-208, Springer, 1992.
[8] P.T. Chua, R. Crivella, B. Daly, N. Hu, R. Schaaf, D. Ventura, T. Camill, J. Hodgins, and R. Pausch, "Tai Chi: Training for Physical Tasks in Virtual Environments," Proc. IEEE Virtual Reality Conf., pp. 87-94, Mar. 2003.
[9] D. Davcev, V. Trajkovic, S. Kalajdziski, and S. Celakoski, "Augmented Reality Environment for Dance Learning," Proc. Int'l Conf. Information Technology: Research and Education, pp. 189-193, Aug. 2003.
[10] A. Soga, B. Umino, and M. Hirayama, "Automatic Composition for Contemporary Dance Using 3D Motion Clips: Experiment on Dance Training and System Evaluation," Proc. Int'l Conf. CyberWorlds, pp. 171-176, Sept. 2009.
[11] A. Nakamura, S. Tabata, T. Ueda, S. Kiyofuji, and Y. Kuno, "Dance Training System with Active Vibro-Devices and a Mobile Image Display," Proc. IEEE/RSJ Int'l Conf. Intelligent Robots and Systems (IROS '05), pp. 3075-3080, Aug. 2005.
[12] K. Hachimura, H. Kato, and H. Tamura, "A Prototype Dance Training Support System with Motion Capture and Mixed Reality Technologies," Proc. IEEE Int'l Workshop Robot and Human Interactive Comm., pp. 217-222, 2004.
[13] K. Hachimura, K. Takashina, and M. Yoshimura, "Analysis and Evaluation of Dancing Movement Based on LMA," Proc. IEEE Int'l Workshop Robots and Human Interactive Comm., pp. 294-299, 2005.
[14] M. Yoshimura, N. Mine, T. Kai, and L. Yoshimura, "Quantification of Characteristic Features of Japanese Dance for Individuality Recognition," Proc. IEEE Int'l Workshop Robot and Human Interactive Comm., pp. 193-199, Sept. 2001.
[15] G. Qian, F. Guo, T. Ingalls, L. Olson, J. James, and T. Rikakis, "A Gesture-Driven Multimodal Interactive Dance System," Proc. IEEE Int'l Conf. Multimedia and Expo (ICME '04), pp. 1579-1582, June 2004.
[16] D.Y. Kwon and M. Cross, "Combining Body Sensors and Visual Sensors for Motion Training," Proc. ACM SIGCHI, pp. 94-101, 2005.
[17] N. Magnenat-Thalmann, D. Protopsaltou, and E. Kavakli, "Learning How to Dance Using a Web 3D Platform," Proc. Sixth Int'l Conf. Web-Based Learning, pp. 1-12, Aug. 2007.
[18] G. Alankus, A.A. Bayazit, and O.B. Bayazit, "Automated Motion Synthesis for Dancing Characters: Motion Capture and Retrieval," Computer Animation and Virtual Worlds, vol. 16, nos. 3-4, pp. 259-271, July 2005.
[19] T.H. Kim, S.I. Park, and S.Y. Shin, "Rhythmic-Motion Synthesis Based on Motion-Beat Analysis," ACM Trans. Graphics, vol. 22, no. 3, pp. 392-401, 2003.
[20] T. Shiratori, A. Nakazawa, and K. Ikeuchi, "Dancing-To-Music Character Animation," Computer Graphics Forum, vol. 25, no. 3, pp. 449-458, 2006.
[21] R. Suzuki, Y. Iwadate, M. Inoue, and W. Woo, "MIDAS: MIC Interactive Dance System," Proc. IEEE Int'l Conf. Systems, Man, and Cybernetics, vol. 2, pp. 751-756, 2000.
[22] P.R. De Silva and N. Bianchi-Berthouze, "Modeling Human Affective Postures: An Information Theoretic Characterization of Posture Features," Computer Animation and Virtual Worlds, vol. 15, nos. 3/4, pp. 269-276, 2004.
360 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool