The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.05 - May (2012 vol.18)
pp: 729-740
Min-Wen Chao , Dept. of Comput. Sci. & Inf. Eng., Nat. Cheng Kung Univ., Tainan, Taiwan
Chao-Hung Lin , Dept. of Geomatics, Nat. Cheng Kung Univ., Tainan, Taiwan
J. Assa , Tel Aviv Univ., Tel Aviv, Israel
Tong-Yee Lee , Dept. of Comput. Sci. & Inf. Eng., Nat. Cheng Kung Univ., Tainan, Taiwan
ABSTRACT
The rapid growth of motion capture data increases the importance of motion retrieval. The majority of the existing motion retrieval approaches are based on a labor-intensive step in which the user browses and selects a desired query motion clip from the large motion clip database. In this work, a novel sketching interface for defining the query is presented. This simple approach allows users to define the required motion by sketching several motion strokes over a drawn character, which requires less effort and extends the users' expressiveness. To support the real-time interface, a specialized encoding of the motions and the hand-drawn query is required. Here, we introduce a novel hierarchical encoding scheme based on a set of orthonormal spherical harmonic (SH) basis functions, which provides a compact representation, and avoids the CPU/processing intensive stage of temporal alignment used by previous solutions. Experimental results show that the proposed approach can well retrieve the motions, and is capable of retrieve logically and numerically similar motions, which is superior to previous approaches. The user study shows that the proposed system can be a useful tool to input motion query if the users are familiar with it. Finally, an application of generating a 3D animation from a hand-drawn comics strip is demonstrated.
INDEX TERMS
user interfaces, computer animation, database management systems, query processing, hand-drawn comics strip, human motion retrieval, hand-drawn sketch, motion capture data, query motion clip, motion clip database, sketching interface, query definition, user browsing, user selection, drawn character, user expressiveness, hand-drawn query, motion encoding, hierarchical encoding scheme, orthonormal spherical harmonic basis function, temporal alignment stage, 3D animation, Joints, Trajectory, Encoding, Three dimensional displays, Databases, Harmonic analysis, Ellipsoids, sketching interface., Motion retrieval, spherical harmonic function
CITATION
Min-Wen Chao, Chao-Hung Lin, J. Assa, Tong-Yee Lee, "Human Motion Retrieval from Hand-Drawn Sketch", IEEE Transactions on Visualization & Computer Graphics, vol.18, no. 5, pp. 729-740, May 2012, doi:10.1109/TVCG.2011.53
REFERENCES
[1] G. Baciu and B.K.C. Iu, "Motion Retargeting in the Presence of Topological Variations," J. Visualization and Computer Animation, vol. 17, no. 1, pp. 41-57, 2006.
[2] J. Assa, D. Cohen-Or, I.-C. Yeh, and T.-Y. Lee, "Motion Overview of Human Actions," ACM Trans. Graphics, vol. 27, no. 5, pp. 115:1-115:10, 2008.
[3] K. Pullen and C. Bregler, "Motion Capture Assisted Animation: Texturing and Synthesis," ACM Trans. Graphics, vol. 21, no. 3, pp. 501-508, 2002.
[4] Y. Li, Y.L.T. Wang, and H.-Y. Shum, "Motion Texture: A Two-Level Statistical Model for Character Motion Synthesis," ACM Trans. Graphics, vol. 21, no. 3, pp. 465-472, 2002.
[5] L. Kovar, M. Gleicher, and F. Pighin, "Motion Graphs," ACM Trans. Graphics, vol. 21, no. 3, pp. 473-482, 2002.
[6] J. Lee, J.K. Hodgins, J. Chai, N.S. Pollard, and P.S.A. Reitsma, "Interactive Control of Avatars Animated with Human Motion Data," ACM Trans. Graphics, vol. 21, no. 3, pp. 491-500, 2002.
[7] M. Thorne and D. Burke, "Motion Doodles: An Interface for Sketching Character Motion," ACM Trans. Graphics, vol. 23, no. 3, pp. 424-431, 2004.
[8] R. Heck and M. Gleicher, "Parametric Motion Graphs," I3D '07: Proc. Symp. Interactive 3D Graphics and Games, pp. 129-136, 2007.
[9] Y.-Y. Tsai, W.-C. Lin, K.-B. Cheng, J. Lee, and T.-Y. Lee, "Real-Time Physics-Based Third Biped Character Animation Using an Inverted Pendulum Model," IEEE Trans. Visualization and Computer Graphics, vol. 16, no. 2, pp. 325-337, Mar. 2010.
[10] C.-Y. Chiu, S.-P. Chao, M.-Y. Wu, S.-N. Yang, and H.-C. Lin, "Content-Based Retrieval for Human Motion Data," J. Visual Comm. and Image Representation, vol. 15, no. 3, pp. 446-466, 2004.
[11] K. Forbes and E. Fiume, "An Efficient Search Algorithm for Motion Data Using Weighted PCA," SCA '05: Proc. ACM SIGGRAPH/Eurographics Symp. Computer Animation, pp. 67-76, 2005.
[12] B. Demuth, T. Röder, M. Müller, and B. Eberhardt, "An Information Retrieval System for Motion Capture Data," Proc. 28th European Conf. Information Retrieval, pp. 373-384, 2006.
[13] M. Müller, T. Röder, and M. Clausen, "Efficient Content-Based Retrieval of Motion Capture Data," ACM Trans. Graphics, vol. 24, no. 3, pp. 677-685, 2005.
[14] Z. Deng, Q. Gu, and Q. Li, "Perceptually Consistent Example-Based Human Motion Retrieval," I3D '09: Proc. Symp. Interactive 3D Graphics and Games, pp. 191-198, 2009.
[15] W. Eisner, Comics and Sequential Art. W.W. Norton, 2008.
[16] L. Kovar and M. Gleicher, "Automated Extraction and Parameterization of Motions in Large Data Sets," ACM Trans. Graphics, vol. 23, no. 3, pp. 559-568, 2004.
[17] E. Keogh, T. Palpanas, V.B. Zordan, D. Gunopulos, and M. Cardle, "Indexing Large Human-Motion Databases," VLDB '04: Proc. 30th Int'l Conf. Very Large Data Bases, pp. 780-791, 2004.
[18] M. Kazhdan, T. Funkhouser, and S. Rusinkiewicz, "Rotation Invariant Spherical Harmonic Representation of Third Shape Descriptors," SGP '03: Proc. Eurographics/ACM SIGGRAPH Symp. Geometry Processing, pp. 156-164, 2003.
[19] T. Funkhouser, P. Min, M. Kazhdan, J. Chen, A. Halderman, D. Dobkin, and D. Jacobs, "A Search Engine for Third Models," ACM Trans. Graphics, vol. 22, no. 1, pp. 83-105, 2003.
[20] E. Keogh, "Exact Indexing of Dynamic Time Warping," VLDB '02: Proc. 28th Int'l Conf. Very Large Data Bases, pp. 406-417, 2002.
[21] Y. Gao, L. Ma, Y. Chen, and J. Liu, "Content-Based Human Motion Retrieval with Automatic Transition," Proc. Computer Graphics Int'l Conf., pp. 360-371, 2006.
[22] Y. Gao, L. Ma, J. Liu, X. Wu, and Z. Chen, "An Efficient Algorithm for Content-Based Human Motion Retrieval," Proc. First Int'l Conf. Technologies for E-Learning and Digital Entertainment, pp. 970-979, 2006.
[23] Y. Lin, "Efficient Human Motion Retrieval in Large Databases," GRAPHITE '06: Proc. Fourth Int'l Conf. Computer Graphics and Interactive Techniques in Australasia and Southeast Asia, pp. 31-37, 2006.
[24] M. Müller and T. Röder, "Motion Templates for Automatic Classification and Retrieval of Motion Capture Data," SCA '06: Proc. ACM SIGGRAPH/Eurographics Symp. Computer Animation, pp. 137-146, 2006.
[25] E.S.L. Ho and T. Komura, "Indexing and Retrieving Motions of Characters in Close Contact," IEEE Trans. Computer Graphics and Visualization, vol. 15, no. 3, pp. 481-492, May/June 2009.
[26] T. Igarashi, S. Matsuoka, and H. Tanaka, "Teddy: A Sketching Interface for Third Freeform Design," Proc. ACM SIGGRAPH, pp. 409-416, 1999.
[27] O. Karpenko and J. Hughes, "Smoothsketch: Third Free-Form Shapes from Complex Sketches," ACM Trans. Graphics, vol. 25, no. 3, pp. 589-598, 2006.
[28] A. Nealen, T. Igarashi, O. Sorkine, and M. Alexa, "Fibermesh: Designing Freeform Surfaces with 3D Curves," ACM Trans. Graphics, vol. 26, no. 3, p. 41, 2007.
[29] J. Davis, M. Agrawala, E. Chuang, Z. Popović, and D. Salesin, "A Sketching Interface for Articulated Figure Animation," SCA '03: Proc. ACM SIGGRAPH/Eurographics Symp. Computer Animation, pp. 320-328, 2003.
[30] Q.L. Li, W.D. Geng, T. Yu, X.J. Shen, N. Lau, and G. Yu, "Motionmaster: Authoring and Choreographing Kung-Fu Motions by Sketch Drawings," SCA '06: Proc. ACM SIGGRAPH/Eurographics Symp. Computer Animation, pp. 233-241, 2006.
[31] J. Barbič, A. Safonova, J.-Y. Pan, C. Faloutsos, J.K. Hodgins, and N.S. Pollard, "Segmenting Motion Capture Data into Distinct Behaviors," GI '04: Proc. Graphics Interface, pp. 185-194, 2004.
[32] L. Shen and M.K. Chung, "Large-Scale Modeling of Parametric Surfaces Using Spherical Harmonics," 3DPVT '06: Proc. Third Int'l Symp. 3D Data Processing, Visualization, and Transmission, pp. 294-301, 2006.
[33] C. Brechbühler, G. Gerig, and O. Kübler, "Parametrization of Closed Surfaces for 3-D Shape Description," Computer Vision and Image Understanding, vol. 61, no. 2, pp. 154-170, 1995.
[34] J. de Souza's, "An Illustrated Review of How Motion Is Represented in Static Instructional Graphics," Proc. STC's 55th Conf., pp. 1-4, 2008.
[35] J.-Y. Kwon and I.-K. Lee, "Determination of Camera Parameters for Character Motions Using Motion Area," The Visual Computer, vol. 24, no. 7, pp. 475-483, 2008.
[36] CMU 2003. Motion Capture Database, http:/mocap.cs.cmu.edu/, 2011.
[37] F. Liu, Y. Zhuang, F. Wu, and Y. Pan, "3D Motion Retrieval with Motion Index Tree," Computer Vision and Image Understanding, vol. 92, nos. 2/3, pp. 265-284, 2003.
[38] L. Kovar and M. Gleicher, "Flexible Automatic Motion Blending with Registration Curves," SCA '03: Proc. ACM SIGGRAPH/Eurographics Symp. Computer Animation, pp. 214-224, 2003.
[39] Y. Sakamoto, S. Kuriyama, and T. Kaneko, "Motion Map: Image-Based Retrieval and Segmentation of Motion Data," Proc. ACM SIGGRAPH/Eurographics Symp. Computer Animation (SCA '04), pp. 259-266, 2004.
1368 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool