The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.05 - May (2013 vol.19)
pp: 762-773
Dan Casas , Centre for Vision Speech & Signal Process., Univ. of Surrey, Guildford, UK
M. Tejera , Centre for Vision Speech & Signal Process., Univ. of Surrey, Guildford, UK
J. Guillemaut , Centre for Vision Speech & Signal Process., Univ. of Surrey, Guildford, UK
A. Hilton , Centre for Vision Speech & Signal Process., Univ. of Surrey, Guildford, UK
ABSTRACT
A 4D parametric motion graph representation is presented for interactive animation from actor performance capture in a multiple camera studio. The representation is based on a 4D model database of temporally aligned mesh sequence reconstructions for multiple motions. High-level movement controls such as speed and direction are achieved by blending multiple mesh sequences of related motions. A real-time mesh sequence blending approach is introduced, which combines the realistic deformation of previous nonlinear solutions with efficient online computation. Transitions between different parametric motion spaces are evaluated in real time based on surface shape and motion similarity. Four-dimensional parametric motion graphs allow real-time interactive character animation while preserving the natural dynamics of the captured performance.
INDEX TERMS
Animation, Real-time systems, Databases, Aerospace electronics, Interpolation, Mesh generation, Shape,4D performance capture, Character animation, 3D video, real-time animation, multiview reconstruction, video-based animation, 4D modeling
CITATION
Dan Casas, M. Tejera, J. Guillemaut, A. Hilton, "Interactive Animation of 4D Performance Capture", IEEE Transactions on Visualization & Computer Graphics, vol.19, no. 5, pp. 762-773, May 2013, doi:10.1109/TVCG.2012.314
REFERENCES
[1] O. Arikan and D. Forsyth, "Synthesizing Constrained Motions from Examples," Proc. ACM SIGGRAPH '02, 2002.
[2] L. Kovar, M. Gleicher, and F. Pighin, "Motion Graphs," Proc. ACM SIGGRAPH '02, pp. 473-482, 2002.
[3] J. Lee, J. Chai, P. Reitsma, J. Hodgins, and N. Pollard, "Interactive Control of Avatars Animated with Human Motion Data," Proc. ACM SIGGRAPH '02, pp. 491-500, 2002.
[4] R. Heck and M. Gleicher, "Parametric Motion Graphs," Proc. ACM Symp. Interactive 3D Graphics, 2007.
[5] C. Rose, M. Cohen, and B. Bodenheimer, "Verbs and Adverbs: Multidimensional Motion Interpolation," IEEE Computer Graphics and Applications, vol. 18, no. 5, pp. 32-40, Sept. 1998.
[6] E. de Aguiar, C. Stoll, C. Theobalt, N. Ahmed, H.-P. Seidel, and S. Thrun, "Performance Capture from Sparse Multi-View Video," Proc. ACM SIGGRAPH '08, vol. 27, no. 3, 2008.
[7] D. Vlasic, I. Baran, W. Matusik, and J. Popović, "Articulated Mesh Animation from Multi-View Silhouettes," Proc. ACM SIGGRAPH '08, 2008.
[8] J. Starck and A. Hilton, "Surface Capture for Performance-Based Animation," IEEE Computer Graphics and Applications, vol. 27, no. 3, pp. 21-31, May/June 2007.
[9] F. Xu, Y. Liu, C. Stoll, J. Tompkin, G. Bharaj, Q. Dai, H.-P. Seidel, J. Kautz, and C. Theobalt, "Video-Based Characters - Creating New Human Performances from a Multi-View Video Database," Proc. ACM SIGGRAPH '11, 2011.
[10] C. Zitnick, S. Kang, M. Uyttendaele, S. Winder, and R. Szeliski, "High-Quality Video View Interpolation Using a Layered Representation," Proc. ACM SIGGRAPH '04, 2004.
[11] I. Baran, D. Vlasic, E. Grinspun, and J. Popovic, "Semantic Deformation Transfer," Proc. ACM SIGGRAPH '09, 2009.
[12] C. Stoll, J. Gall, E. de Aguiar, S. Thrun, and C. Theobalt, "Video-Based Reconstruction of Animatable Human Characters," Proc. ACM SIGGRAPH ASIA '10, 2010.
[13] D. Casas, M. Tejera, J.-Y. Guillemaut, and A. Hilton, "4d Parametric Motion Graphs for Interactive Animation," Proc. ACM SIGGRAPH Symp. Interactive 3D Graphics and Games (I3D '12), pp. 103-110, 2012.
[14] T. Kanade and P. Rander, "Virtualized Reality: Constructing Virtual Worlds from Real Scenes," IEEE MultiMedia, vol. 4, no. 1, pp. 34-47, Jan.-Mar. 1997.
[15] J. Carranza, C. Theobalt, M. Magnor, and H.-P. Seidel, "Free-Viewpoint Video of Human Actors," Proc. ACM SIGGRAPH '03, pp. 565-577, 2003.
[16] C. Cagniart, E. Boyer, and S. Ilic, "Free-Form Mesh Tracking: A Patch-Based Approach," Proc. IEEE Conf. Computer Vision and Pattern Recognition '10, pp. 1339-1346, 2010.
[17] S. Vedula, S. Baker, P. Rander, R. Collins, and T. Kanade, "Three-Dimensional Scene Flow," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 3, pp. 475-480, Mar. 2005.
[18] M. Wand, B. Adams, M. Ovsianikov, A. Berner, M. Bokeloh, P. Jenke, L. Guibas, H.-P. Seidel, and A. Schilling, "Efficient Reconstruction of Non-Rigid Shape and Motion from Real-Time 3D Scanner Data," ACM Trans. Graphics, vol. 28, no. 2,article 15, 2009.
[19] P. Huang, C. Budd, and A. Hilton, "Global Temporal Registration of Multiple Non-Rigid Surface Sequences," Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition '11, 2011.
[20] T. Tung and T. Matsuyama, "Dynamic Surface Matching by Geodesic Mapping for Animation Transfer," Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition '10, 2010.
[21] C. Budd, P. Huang, M. Klaudiny, and A. Hilton, "Global Non-Rigid Alignment of Surface Sequences," Int'l J. Computer Vision, pp. 1-15, http://dx.doi.org/10.1007s11263-012-0553-4 , 2012.
[22] P. Huang, A. Hilton, and J. Starck, "Human Motion Synthesis from 3d Video," Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition '09, 2009.
[23] J. Starck, G. Miller, and A. Hilton, "Video-Based Character Animation," Proc. ACM Symp. Computer Animation, 2005.
[24] C. Bregler, M. Covell, and M. Slaney, "Video Rewrite: Driving Visual Speech with Audio," Proc. ACM SIGGRAPH '97, pp. 1-8, 1997.
[25] A. Schodl, D. Szeliski, R. amd Salesin, and I. Essa, "Video Textures," Proc. ACM SIGGRAPH '00, 2000.
[26] M. Flagg, A. Nakazawa, Q. Zhang, S.-B. Kang, Y. Ryu, I. Essa, and J. Rehg, "Human Video Textures," Proc. ACM Symp. Interactive 3D Graphics, 2009.
[27] S. Kircher and M. Garland, "Free-Form Motion Processing," ACM Trans. Graphics, vol. 27, no. 2, pp. 1-13, 2008.
[28] W. Xu, K. Zhou, Y. Yu, Q. Peng, and B. Guo, "Gradient Domain Editing of Deforming Mesh Sequences," Proc. ACM SIGGRAPH '07, vol. 26, no. 3, 2007.
[29] M. Gleicher, "Motion Editing with Spacetime Constraints," Proc. ACM Symp. Interactive 3D Graphics, 1997.
[30] J. Lee and S. Shin, "A Hierarchical Approach to Interactive Motion Editing for Human-Like Figures," Proc. ACM SIGGRAPH '99, pp. 39-48, 1999.
[31] Z. Popovic and A. Witkin, "Physically Based Motion Transformation," Proc. ACM SIGGRAPH '99, 1999.
[32] J. Min, Y.-L. Chen, and J. Chai, "Interactive Generation of Human Animation with Deformable Motion Models," ACM Trans. Graphics, vol. 29, no. 1, pp. 9:1-9:12, Dec. 2009.
[33] A. Brundelin and L. Williams, "Motion Signal Processing," Proc. ACM SIGGRAPH '95, pp. 97-104, 1995.
[34] D. Wiley and J. Hahn, "Interpolation Synthesis for Articulated Figure Motion," Proc. IEEE Virtual Reality Int'l Symp., pp. 157-160, 1997.
[35] L. Kovar and M. Gleicher, "Automated Extraction and Parameterization of Motions in Large Date Sets," Proc. ACM SIGGRAPH '04, vol. 23, no. 3, pp. 559-568, 2004.
[36] T. Mukai and S. Kuriyama, "Geostatistical Motion Interpolation," Proc. ACM SIGGRAPH '05, 2005.
[37] L. Zhao and A. Safonova, "Achieving Good Connectivity in Motion Graphs," Proc. ACM SIGGRAPH/Eurographics Symp. Computer Animation (SCA'08), pp. 127-136, 2008.
[38] O. Sorkine, "Differential Representations for Mesh Processing," Computer Graphics Forum, vol. 25, no. 4, pp. 789-806, 2006.
[39] R. Sumner and J. Popovic, "Deformation Transfer for Triangle Meshes," Proc. ACM SIGGRAPH '04, vol. 23, no. 3, pp. 399-405, 2004.
[40] A. Witkin and Z. Popovic, "Motion Warping," Proc. ACM SIGGRAPH '95, 1995.
[41] C. Budd and A. Hilton, "Temporal Alignment of 3d Video Sequences Using Shape and Appearance," Proc. European Conf. Visual Media Production (CVMP '10), pp. 114-122, 2010.
[42] M. Tejera and A. Hilton, "Space-Time Editing of 3d Video Sequences," Proc. Conf. Visual Media Production, pp. 148-157, http://dx.doi.org/10.1109CVMP.2011.23, 2011.
[43] A. Ahmed, F. Mokhtarian, and A. Hilton, "Parametric Motion Blending through Wavelet Analysis," Proc. Eurographics '01 Short Paper, pp. 347-353, Sept. 2001.
53 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool