Subscribe

Issue No.11 - Nov. (2012 vol.18)

pp: 1979-1991

Juncong Lin , Software Sch., Xiamen Univ., Xiamen, China

T. Igarashi , Dept. of Comput. Sci., Univ. of Tokyo, Tokyo, Japan

Jun Mitani , Dept. of Comput. Sci., Univ. of Tsukuba, Tsukuba, Japan

Minghong Liao , Software Sch., Xiamen Univ., Xiamen, China

Ying He , Sch. of Comput. Eng., Nanyang Technol. Univ., Singapore, Singapore

DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/TVCG.2012.61

ABSTRACT

Character pose design is one of the most fundamental processes in computer graphics authoring. Although there are many research efforts in this field, most existing design tools consider only character body structure, rather than its interaction with the environment. This paper presents an intuitive sketching interface that allows the user to interactively place a 3D human character in a sitting position on a chair. Within our framework, the user sketches the target pose as a 2D stick figure and attaches the selected joints to the environment (e.g., the feet on the ground) with a pin tool. As reconstructing the 3D pose from a 2D stick figure is an ill-posed problem due to many possible solutions, the key idea in our paper is to reduce solution space by considering the interaction between the character and environment and adding physics constraints, such as balance and collision. Further, we formulated this reconstruction into a nonlinear optimization problem and solved it via the genetic algorithm (GA) and the quasi-Newton solver. With the GPU implementation, our system is able to generate the physically correct and visually pleasing pose at an interactive speed. The promising experimental results and user study demonstrates the efficacy of our method.

INDEX TERMS

virtual reality, genetic algorithms, graphical user interfaces, graphics processing units, image reconstruction, nonlinear programming, pose estimation, graphics processing unit, sketching interface, sitting pose design, virtual environment, character pose design, computer graphics authoring, character body structure, 3D human character, 2D stick figure, 3D pose reconstruction, nonlinear optimization problem, genetic algorithm, quasi-Newton solver, GPU implementation, Joints, Three dimensional displays, Educational institutions, Bones, Switches, Mathematical model, Equations, GPU, Sketching interface, sitting pose design, virtual environment, genetic algorithm, quasi-Newton solver

CITATION

Juncong Lin, T. Igarashi, Jun Mitani, Minghong Liao, Ying He, "A Sketching Interface for Sitting Pose Design in the Virtual Environment",

*IEEE Transactions on Visualization & Computer Graphics*, vol.18, no. 11, pp. 1979-1991, Nov. 2012, doi:10.1109/TVCG.2012.61REFERENCES

- [1] G. Saul, M. Lau, J. Mitani, and T. Igarashi, "Sketchchair: An All-In-One Chair Design System for End-Users,"
Proc. Fifth Int'l Conf. Tangible, Embedded and Embodied Interaction, 2011.- [2] J. Lin, T. Igarashi, J. Mitani, and G. Saul, "A Sketching Interface for Sitting-Pose Design,"
Proc. Eurographics Symp. Sketch-Based Interfaces and Modeling, pp. 111-118, 2010.- [3] J. Zhao and N. Badler, "Inverse Kinematics Positioning Using Nonlinear Programming for Highly Articulated Figures,"
ACM Trans. Graphics, vol. 13, no. 4, pp. 313-336, 1994.- [4] K. Grochow, S.L. Martin, A. Hertzmann, and Z. Popovic, "Style-Based Inverse Kinematics,"
ACM Trans. Graphics, vol. 23, no. 3, pp. 522-531, 2004.- [5] J. Chai and J.K. Hodgins, "Performance Animation from Low-Dimensional Control Signals,"
ACM Trans. Graphics, vol. 24, no. 3, pp. 686-696, 2005.- [6] J. Davis, M. Agrawala, E. Chuang, Z. Popovic, and D. Salesin, "A Sketching Interface for Articulated Figure Animation,"
Proc. ACM SIGGRAPH/Eurographics Symp. Computer Animation, pp. 320-328, 2003.- [7] X. Wei and J. Chai, "Intuitive Interactive Human-Character Posing with Millions of Example Poses,"
IEEE Computer Graphics and Applications, vol. 31, no. 4, pp. 78-88, July/Aug. 2011.- [8] E. Jain, Y. Sheikh, and J.K. Hodgins, "Leveraging the Talent of Hand Animators to Create Three-Dimensional Animation,"
Proc. ACM SIGGRAPH/EUROGRAPHICS Symp. Computer Animation, pp. 93-102, 2009.- [9] W. Yoshizaki, Y. Sugiura, A.C. Chiou, S. Hashimoto, H. Inami, T. Igarashi, Y. Akazawa, K. Kawauchi, S. Kagami, and M. Mochimaru, "An Actuated Physical Puppet as an Input Device for Controlling Digital Manikin,"
Proc. ACM CHI Conf. Human Factors in Computing Systems, 2011.- [10] C. Barron and I.A. Kakadiaris, "Estimating Anthropometry and Pose from a Single Image,"
Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 669-676, 2000.- [11] C. Taylor, "Reconstruction of Articulated Objects from Point Correspondences in a Single Uncalibrated Image,"
Computer Vision and Image Understanding, vol. 80, no. 3, pp. 349-363, 2000.- [12] X.K. Wei and J. Chai, "Modeling 3D Human Poses from Uncalibrated Monocular Images,"
Proc. IEEE Conf. Computer Vision, pp. 1873-1880, 2009.- [13] A. Agarwal and B. Triggs, "Recovering 3D Human Pose from Monocular Images,"
IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 1, pp. 44-58, Jan. 2006.- [14] F.S. Grassia, "Practical Parameterization of Rotations Using the Exponential Map,"
J. Graphics Tools, vol. 3, no. 3, pp. 29-48, 1998.- [15] C.B. Phillips and N.I. Badler, "Interactive Behaviors for Bipedal Articulated Figures,"
Computer Graphics, vol. 25, no. 4, pp. 359-362, 1991.- [16] S. Tabandeh, W.W. Melek, and C.M. Clark, "An Adaptive Niching Genetic Algorithm Approach for Generating Multiple Solutions of Serial Manipulator Inverse Kinematics with Applications to Modular Robots,"
J. Robotica, vol. 28, pp. 493-507, 2010.- [17] J. Zhao, L. Li, and K.C. Keong, "3D Posture Reconstruction and Human Animation from 2D Feature Points,"
Computer Graphics Forum, vol. 24, no. 4, pp. 759-771, 2005.- [18] K. Deb and R. Agrawal, "Simulated Binary Crossover for Continuous Search Space,"
Complex System, vol. 9, no. 2, pp. 115-148, 1995.- [19] M. Tomassini, "A Survey of Parallel Genetic Algorithms,"
Annual Reviews of Computational Physics, pp. 87-118, World Scientific, 1995.- [20] M.-L. Wong and T.-T. Wong, "Parallel Hybrid Genetic Algorithms on Consumer-Level Graphics Hardware,"
IEEE Congress Evolutionary Computation, pp. 2973-2980, 2006.- [21] H. Nguyen,
GPU Gems 3. Addison-Wesley Professional, 2007.- [22] A. Rukhin, J. Soto, J. Nechvatal, M. Smid, E. Barker, S. Leigh, M. Levenson, M. Vangel, D. Banks, A. Heckert, J. Dray, and S. Vo, "A Statistical Test Suite for Random and Pseudorandom Number Generators for Cryptographic Applications," technical report, Nat'l Inst. of Standards and Tech nology, 2010.
- [23] COLDET, "Free 3D Collision Detection Library," http:// sourceforge.net/projectscoldet, 2012.
- [24] X. Shi, K. Zhou, Y. Tong, H. Bao, and B. Guo, "Mesh Puppetry: Cascading Optimization of Mesh Deformation with Inverse Kinematics,"
ACM Trans. Graphics, vol. 26, no. 3,article 81, 2007.- [25] R. Smith, "Ode: Open Dynamic Engine," http:/www.ode.org/, 2010.
- [26] Y. Nakamura and K. Yamane, "Dynamics Computation of Structure-Varying Kinematic Chains and Its Application to Human Figures,"
IEEE Trans. Robotics and Automation, vol. 16, no. 2, pp. 124-134, Apr. 2000. |