This Article 
 Bibliographic References 
 Add to: 
Example-Based Human Motion Denoising
September/October 2010 (vol. 16 no. 5)
pp. 870-879
Hui Lou, Texas A&M University, College Station
Jinxiang Chai, Texas A&M University, College Station
With the proliferation of motion capture data, interest in removing noise and outliers from motion capture data has increased. In this paper, we introduce an efficient human motion denoising technique for the simultaneous removal of noise and outliers from input human motion data. The key idea of our approach is to learn a series of filter bases from precaptured motion data and use them along with robust statistics techniques to filter noisy motion data. Mathematically, we formulate the motion denoising process in a nonlinear optimization framework. The objective function measures the distance between the noisy input and the filtered motion in addition to how well the filtered motion preserves spatial-temporal patterns embedded in captured human motion data. Optimizing the objective function produces an optimal filtered motion that keeps spatial-temporal patterns in captured motion data. We also extend the algorithm to fill in the missing values in input motion data. We demonstrate the effectiveness of our system by experimenting with both real and simulated motion data. We also show the superior performance of our algorithm by comparing it with three baseline algorithms and to those in state-of-art motion capture data processing software such as Vicon Blade.

[1] O. Arikan, "Compression of Motion Capture Databases," ACM Trans. Graphics, vol. 25, no. 3, pp. 890-897, 2006.
[2] M. Brand and A. Hertzmann, "Style Machines," Proc. ACM SIGGRAPH, pp. 183-192, 2000.
[3] J. Chai and J. Hodgins, "Performance Animation from Low-Dimensional Control Signals," ACM Trans. Graphics, vol. 24, no. 3, pp. 686-696, 2005.
[4] J. Chai and J. Hodgins, "Constraint-Based Motion Optimization Using a Statistical Dynamic Model," ACM Trans. Graphics, vol. 26, no. 3, 2007.
[5] Y.-L. Chen, J. Min, and J. Chai, "Flexible Registration of Human Motion Data with Parameterized Motion Models," ACM Symp. Interactive 3D Graphics and Games (i3D '09), pp. 183-190, 2009.
[6] Y. Fang, C.C. Hsieh, M.J. Kim, J.J. Chang, and T.C. Woo, "Real Time Motion Fairing with Unit Quaternions," Computer-Aided Design, vol. 30, no. 3, pp. 191-198, 1998.
[7] S. Fleishman, D. Cohen-or, and C.T. Silva, "Robust Moving Least-Squares Fitting with Sharp Features," ACM Trans. Graphics, vol. 24, no. 3, pp. 554-552, 2005.
[8] M. Ghil, M.R. Allen, M.D. Dettinger, K. Ide, D. Kondrashov, M.E. Mann, A.W. Robertson, A. Saunders, Y. Tian, F. Varadi, and P. Piou, "Advanced Spectral Methods for Climatic Time Series," Rev. of Geophysics, vol. 40, no. 1, pp. 3.1-3.41, 2002.
[9] K. Grochow, S.L. Martin, A. Hertzmann, and Z. Popović, "Style-Based Inverse Kinematics," ACM Trans. Graphics, vol. 23, no. 3, pp. 522-531, 2004.
[10] F.R. Hampel, E.M. Ronchetti, P.J. Rousseeuw, and W.A. Stahel, Robust Statistics: The Approach Based on Influence Functions. Wiley, 1964.
[11] P. Huber, Robust Statistics. Wiley, 1981.
[12] L. Ikemoto, O. Arikan, and D. Forsyth, "Knowing When to Put Your Foot Down," Proc. ACM Symp. Interactive 3D Graphics and Games (i3D '06), pp. 49-53, 2006.
[13] T.R. Jones, F. Durand, and M. Desbrun, "Noniterative, Feature-Preserving Mesh Smoothing," ACM Trans. Graphics, vol. 22, no. 3, pp. 943-949, 2003.
[14] L. Kovar, J. Schreiner, and M. Gleicher, "Footskate Cleanup for Motion Capture Editing," Proc. ACM SIGGRAPH/Eurographics Symp. Computer Animation, pp. 97-104, 2002.
[15] J. Lee and S.Y. Shin, "Motion Fairing," Proc. Computer Animation, pp. 136-143, 1996.
[16] J. Lee and S.Y. Shin, "A Coordinate Invariant Approach to Multiresolution Motion Analysis," Graphical Models and Image Processing, vol. 63, no. 2, pp. 87-105, 2001.
[17] J. Lee and S.Y. Shin, "General Construction of Timedomain Filters for Orientation Data," IEEE Trans. Visualization and Computer Graphics, vol. 8, no. 2, pp. 119-128, 2002.
[18] Y. Li, T. Wang, and H.-Y. Shum, "Motion Texture: A Two-Level Statistical Model for Character Synthesis," ACM Trans. Graphics, vol. 21, no. 3, pp. 465-472, 2002.
[19] W.H. Press, B.P. Flannery, S.A. Teukolsky, and W.T. Vetterling, Numerical Recipes in C: The Art of Scientific Computing, second ed. Cambridge Univ. Press, 1992.
[20] L. Ren, A. Patrick, A.A. Efros, J.K. Hodgins, and J.M. Rehg, "A Data-Driven Approach to Quantifying Natural Human Motion," ACM Trans. Graphics, vol. 24, no. 3, pp. 1090-1097, 2005.
[21] K.W. Sok, M. Kim, and J. Lee, "Simulating Biped Behaviors from Human Motion Data," ACM Trans. Graphics, vol. 26, no. 3, p. 107, 2007.
[22] H.J. Shin, J. Lee, M. Gleicher, and S.Y. Shin, "Computer Puppetry: An Importance-Based Approach," ACM Trans. Graphics, vol. 20, no. 2, pp. 67-94, 2001.
[23] H.V. Storch and F.W. Zwiers, Statistical Analysis in Climate Research. Cambridge Univ. Press, 1999.
[24] S. Tak and H.-S. Ko, "A Physically-Based Motion Retargeting Filter," ACM Trans. Graphics, vol. 24, no. 1, pp. 98-117, 2005.
[25] G. Welch and G. Bishop, "An Introduction to the Kalman Filter," Proc. ACM SIGGRAPH, 2001.
[26] J. Wang, S. Drucker, M. Agrawala, and M. Cohen, "The Cartoon Animation Filter," ACM Trans. Graphics, vol. 25, no. 3, pp. 1169-1173, 2006.
[27] K. Yamane and Y. Nakamura, "Dynamics Filter—Concept and Implementation of Online Motion Generator for Human Figures," IEEE Trans. Robotics and Automation, vol. 19, no. 3, pp. 421-432, June 2003.
[28] Vicon blade,, 2009.
[29] Vicon Systems, http:/, 2009.

Index Terms:
Motion capture, data-driven character animation, motion denoising, statistical motion models, numerical optimization.
Hui Lou, Jinxiang Chai, "Example-Based Human Motion Denoising," IEEE Transactions on Visualization and Computer Graphics, vol. 16, no. 5, pp. 870-879, Sept.-Oct. 2010, doi:10.1109/TVCG.2010.23
Usage of this product signifies your acceptance of the Terms of Use.