Issue No. 10 - October (2011 vol. 17)
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/TVCG.2010.254
Hanqing Jiang , Zhejiang University, Hangzhou
Guofeng Zhang , Zhejiang University, Hangzhou
Jin Huang , Zhejiang University, Hangzhou
Hujun Bao , Zhejiang University, Hangzhou
Jiaya Jia , The Chinese University of Hong Kong, Hong Kong
Tien-Tsin Wong , The Chinese University of Hong Kong, Hong Kong
Kun Zhou , Zhejiang University, Hangzhou
In this paper, we present a novel method to extract motion of a dynamic object from a video that is captured by a handheld camera, and apply it to a 3D character. Unlike the motion capture techniques, neither special sensors/trackers nor a controllable environment is required. Our system significantly automates motion imitation which is traditionally conducted by professional animators via manual keyframing. Given the input video sequence, we track the dynamic reference object to obtain trajectories of both 2D and 3D tracking points. With them as constraints, we then transfer the motion to the target 3D character by solving an optimization problem to maintain the motion gradients. We also provide a user-friendly editing environment for users to fine tune the motion details. As casual videos can be used, our system, therefore, greatly increases the supply source of motion data. Examples of imitating various types of animal motion are shown.
Motion imitation, motion gradient, mesh deformation, depth recovery, motion tracking.
Hanqing Jiang, Guofeng Zhang, Jin Huang, Hujun Bao, Jiaya Jia, Tien-Tsin Wong, Kun Zhou, "Motion Imitation with a Handheld Camera", IEEE Transactions on Visualization & Computer Graphics, vol. 17, no. , pp. 1475-1486, October 2011, doi:10.1109/TVCG.2010.254