The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.03 - May/June (2008 vol.14)
pp: 707-720
ABSTRACT
In this paper, we deal with the problem of synthesizing novel motions of standing-up martial arts such as Kickboxing, Karate, and Taekwondo performed by a pair of human-like characters while reflecting their interactions. Adopting an example-based paradigm, we address three non-trivial issues embedded in this problem: motion modeling, interaction modeling, and motion synthesis. For the first issue, we present a semi-automatic motion labeling scheme based on force-based motion segmentation and learning-based action classification. We also construct a pair of motion transition graphs each of which represents an individual motion stream. For the second issue, we propose a scheme for capturing the interactions between two players. A dynamic Bayesian network is adopted to build a motion transition model on top of the coupled motion transition graph that is constructed from an example motion stream. For the last issue, we provide a scheme for synthesizing a novel sequence of coupled motions, guided by the motion transition model. Although the focus of the present work is on martial arts, we believe that the framework of the proposed approach can be conveyed to other two-player motions as well.
INDEX TERMS
Animation, Statistical
CITATION
Taesoo Kwon, Young-Sang Cho, Sang I Park, Sung Yong Shin, "Two-Character Motion Analysis and Synthesis", IEEE Transactions on Visualization & Computer Graphics, vol.14, no. 3, pp. 707-720, May/June 2008, doi:10.1109/TVCG.2008.22
REFERENCES
[1] L. Kovar, M. Gleicher, and F. Pighin, “Motion Graphs,” Proc. ACM SIGGRAPH '02, pp. 473-482, 2002.
[2] M. Gleicher, H.J. Shin, L. Kovar, and A. Jepsen, “Snap-TogetherMotion: Assembling Run-Time Animations,” ACM Trans. Graphics, vol. 22, no. 3, p. 702, July 2003.
[3] T.H. Kim, S.I. Park, and S.Y. Shin, “Rhythmic-Motion Synthesis Based on Motion-Beat Analysis,” ACM Trans. Graphics, (Proc. ACM SIGGRAPH '03), vol. 22, no. 3, pp. 392-401, July 2003.
[4] E. Hsu, S. Gentry, and J. Popović, “Example-Based Control of Human Motion,” Proc. ACM SIGGRAPH/Eurographics Symp. Computer Animation (SCA '04), pp. 69-77, 2004.
[5] O. Arikan, D.A. Forsyth, and J.F. O'Brien, “Motion Synthesis from Annotations,” ACM Trans. Graphics, Proc. ACM SIGGRAPH '03, vol. 22, no. 3, pp. 402-408, July 2003.
[6] J. Lee, J. Chai, P.S.A. Reitsma, J.K. Hodgins, and N.S. Pollard, “Interactive Control of Avatars Animated with Human Motion Data,” ACM Trans. Graphics, (Proc. ACM SIGGRAPH '02), vol. 21, no. 3, pp. 491-500, July 2002.
[7] L.M. Tanco and A. Hilton, “Realistic Synthesis of Novel Human Movements from a Database of Motion Capture Examples,” Proc. IEEE Workshop Human Motion, pp. 137-142, 2000.
[8] T. Kwon and S.Y. Shin, “Motion Modeling for On-Line Locomotion Synthesis,” Proc. ACM SIGGRAPH/Eurographics Symp. Computer Animation (SCA '05), pp. 29-38, 2005.
[9] S.I. Park, H.J. Shin, and S.Y. Shin, “On-Line Motion Blending for Real-Time Locomotion Generation,” Computer Animation and Virtual Worlds, vol. 15, pp. 125-138, Sept. 2004.
[10] B. D'Ambrosio, “Inference in Bayesian Networks,” AI Magazine, vol. 20, no. 2, pp. 21-36, 1999.
[11] K.P. Murphy, An Introduction to Graphical Models, unpublished, May 2001.
[12] L. Kovar, M. Gleicher, and J. Schreiner, “Footskate Cleanup for Motion Capture Editing,” Proc. ACM SIGGRAPH Symp. Computer Animation, July 2002.
[13] J. Lee and K.H. Lee, “Precomputing Avatar Behavior from HumanMotion Data,” Proc. ACM SIGGRAPH/Eurographics Symp. Computer Animation (SCA '04), pp. 79-87, 2004.
[14] Y. Li, T. Wang, and H. Shum, “Motion Texture: A Two-Level Statistical Model for Character Motion Synthesis,” ACM Trans. Graphics, (Proc. ACM SIGGRAPH '02), vol. 21, no. 3, pp. 465-472, July 2002.
[15] Y. Abe, C.K. Liu, and Z. Popović, “Momentum-Based Parameterization of Dynamic Character Motion,” Proc. ACM SIGGRAPH/Eurographics Symp. Computer Animation (SCA '04), pp. 173-182, 2004.
[16] S. Guo and J. Robergé, “A High-Level Control Mechanism for Human Locomotion Based on Parametric Frame Space Interpolation,” Proc. Eurographics Workshop Computer Animation and Simulation, pp. 95-107, Aug. 1996.
[17] C. Rose, M.F. Cohen, and B. Bodenheimer, “Verbs and Adverbs: Multidimensional Motion Interpolation,” IEEE Computer Graphics and Applications, vol. 18, no. 5, pp. 32-40, Sept./Oct. 1998.
[18] A. Safonova and J.K. Hodgins, “Analyzing the Physical Correctness of Interpolated Human Motion,” Proc. ACM SIGGRAPH/Eurographics Symp. Computer Animation (SCA '05), pp. 171-180, 2005.
[19] T. Mukai and S. Kuriyama, “Geostatistical Motion Interpolation,” ACM Trans. Graphics, vol. 24, no. 3, pp. 1062-1070, 2005.
[20] A. Safonova and J.K. Hodgins, “Construction and Optimal Search of Interpolated Motion Graphs,” ACM Trans. Graphics, vol. 26, no. 3, p. 106, 2007.
[21] R. Heck and M. Gleicher, “Parametric Motion Graphs,” Proc. Symp. Interactive 3D Graphics and Games (I3D '07), pp. 129-136, 2007.
[22] H.J. Shin and H.S. Oh, “Fat Graphs: Constructing an Interactive Character with Continuous Controls,” Proc. ACM SIGGRAPH/Eurographics Symp. Computer Animation (SCA '06), pp. 291-298, 2006.
[23] J. Assa, Y. Caspi, and D. Cohen-Or, “Action Synopsis: Pose Selection and Illustration,” ACM Trans. Graphics, vol. 24, no. 3, pp. 667-676, 2005.
[24] J. Barbic, A. Safonova, J. Pan, C. Faloutsos, J. Hodgins, and N. Pollard, “Segmenting Motion Capture Data into Distinct Behaviors,” Proc. Graphics Interface, pp. 185-194, 2004.
[25] R. Bindiganavale and N.I. Badler, “Motion Abstraction and Mapping with Spatial Constraints,” Proc. Int'l Workshop Modellingand Motion Capture Techniques for Virtual Environments (CAPTECH'98), pp. 70-82, 1998.
[26] A. Fod, M.J. Mataric, and O.C. Jenkins, “Automated Derivation ofPrimitives for Movement Classification,” Autonomous Robots, vol. 12, no. 1, pp. 39-54, 2002.
[27] K. Forbes and E. Fiume, “An Efficient Search Algorithm for Motion Data Using Weighted PCA,” Proc. ACM SIGGRAPH/Eurographics Symp. Computer Animation (SCA '05), pp. 67-76, 2005.
[28] O.C. Jenkins and M.J. Mataric, “Automated Derivation of Behavior Vocabularies for Autonomous Humanoid Motion,” Proc. Second Int'l Joint Conf. Autonomous Agents and Multiagent Systems (AAMAS '03), pp. 225-232, 2003.
[29] M. Müller, T. Röder, and M. Clausen, “Efficient Content-Based Retrieval of Motion Capture Data,” ACM Trans. Graphics, vol. 24, no. 3, pp. 677-685, 2005.
[30] V.B. Zordan and J.K. Hodgins, “Motion Capture-Driven Simulations that Hit and React,” Proc. ACM SIGGRAPH/Eurographics Symp. Computer Animation (SCA '02), pp. 89-96, 2002.
[31] V.B. Zordan, A. Majkowska, B. Chiu, and M. Fast, “Dynamic Response for Motion Capture Animation,” ACM Trans. Graphics, vol. 24, no. 3, pp. 697-701, 2005.
[32] O. Arikan, D.A. Forsyth, and J.F. O'Brien, “Pushing People Around,” Proc. ACM SIGGRAPH/Eurographics Symp. Computer Animation (SCA '05), July 2005.
[33] Y.C. Lai, S. Chenney, and S. Fan, “Group Motion Graphs,” Proc.ACM SIGGRAPH/Eurographics Symp. Computer Animation (SCA '05), pp. 281-290, 2005.
[34] D.L. James, C.D. Twigg, A. Cove, and R.Y. Wang, “Mesh Ensemble Motion Graphs: Data-Driven Mesh Animation with Constraints,” ACM Trans. Graphics, 2007
[35] C.K. Liu, A. Hertzmann, and Z. Popović, “Composition ofComplex Optimal Multi-Character Motions,” Proc. ACM SIGGRAPH/Eurographics Symp. Computer Animation (SCA '06), pp. 215-222, 2006.
[36] M. Brand, “Coupled Hidden Markov Models for Modeling Interacting Processes,” Technical Report 405, MIT Media Lab, http://xenia.media.mit.edu/ brandPublications.html , 1996.
[37] M. Brand, N. Oliver, and A. Pentland, “Coupled Hidden Markov Models for Complex Action Recognition,” Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, pp. 994-999, 1997.
[38] S.M. Chu and T.S. Huang, “Audio-Visual Speech Modeling Using Coupled Hidden Markov Models,” Proc. IEEE Int'l Conf. Acoustics, Speech, and Signal Processing, pp. 2009-2012, 2002.
[39] D.A. Winter, Biomechanics and Motor Control of Human Movement. John Wiley & Sons, 1990.
[40] A. Sulejmanpašić and J. Popović, “Adaptation of Performed Ballistic Motion,” ACM Trans. Graphics, vol. 24, no. 1, pp. 165-179, 2005.
[41] K.-B. Duan and S.S. Keerthi, “Which Is the Best Multiclass SVMMethod? An Empirical Study,” Multiple Classifier Systems, LNCS 3541, N.C. Oza, R. Polikar, J. Kittler, and F. Roli, eds., Springer, pp. 278-285, 2005.
[42] C.-C. Chang and C.-J. Lin, LIBSVM: A Library for Support Vector Machines (Version 2.31), Sept. 2001.
[43] M.H. DeGroot, Optimal Statistical Decisions. McGraw Hill, 1970.
[44] E.T. Jaynes, Probability Theory: The Logic of Science. Cambridge Univ. Press, 2003.
[45] G.I. Webb, J.R. Boughton, and Z. Wang, “Not So Naive Bayes: Aggregating One-Dependence Estimators,” Machine Learning, vol. 58, no. 1, pp. 5-24, 2005.
[46] M. Gales, “Semi-Tied Covariance Matrices for Hidden Markov Models,” IEEE Trans. Speech and Audio Processing, vol. 7, pp.272-281, 1999.
[47] H.J. Shin, J. Lee, S.Y. Shin, and M. Gleicher, “Computer Puppetry: An Importance-Based Approach,” ACM Trans. Graphics, vol. 20, no. 2, pp. 67-94, 2001.
[48] AGEIA, Physx sdk 2.6, http:/ageia.com, 2008.
6 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool