The Community for Technology Leaders
Green Image
Issue No. 05 - May (2012 vol. 18)
ISSN: 1077-2626
pp: 729-740
Tong-Yee Lee , Dept. of Comput. Sci. & Inf. Eng., Nat. Cheng Kung Univ., Tainan, Taiwan
Min-Wen Chao , Dept. of Comput. Sci. & Inf. Eng., Nat. Cheng Kung Univ., Tainan, Taiwan
Chao-Hung Lin , Dept. of Geomatics, Nat. Cheng Kung Univ., Tainan, Taiwan
J. Assa , Tel Aviv Univ., Tel Aviv, Israel
ABSTRACT
The rapid growth of motion capture data increases the importance of motion retrieval. The majority of the existing motion retrieval approaches are based on a labor-intensive step in which the user browses and selects a desired query motion clip from the large motion clip database. In this work, a novel sketching interface for defining the query is presented. This simple approach allows users to define the required motion by sketching several motion strokes over a drawn character, which requires less effort and extends the users' expressiveness. To support the real-time interface, a specialized encoding of the motions and the hand-drawn query is required. Here, we introduce a novel hierarchical encoding scheme based on a set of orthonormal spherical harmonic (SH) basis functions, which provides a compact representation, and avoids the CPU/processing intensive stage of temporal alignment used by previous solutions. Experimental results show that the proposed approach can well retrieve the motions, and is capable of retrieve logically and numerically similar motions, which is superior to previous approaches. The user study shows that the proposed system can be a useful tool to input motion query if the users are familiar with it. Finally, an application of generating a 3D animation from a hand-drawn comics strip is demonstrated.
INDEX TERMS
user interfaces, computer animation, database management systems, query processing, hand-drawn comics strip, human motion retrieval, hand-drawn sketch, motion capture data, query motion clip, motion clip database, sketching interface, query definition, user browsing, user selection, drawn character, user expressiveness, hand-drawn query, motion encoding, hierarchical encoding scheme, orthonormal spherical harmonic basis function, temporal alignment stage, 3D animation, Joints, Trajectory, Encoding, Three dimensional displays, Databases, Harmonic analysis, Ellipsoids, sketching interface., Motion retrieval, spherical harmonic function
CITATION
Tong-Yee Lee, Min-Wen Chao, Chao-Hung Lin, J. Assa, "Human Motion Retrieval from Hand-Drawn Sketch", IEEE Transactions on Visualization & Computer Graphics, vol. 18, no. , pp. 729-740, May 2012, doi:10.1109/TVCG.2011.53
101 ms
(Ver )