Subscribe

Issue No.03 - March (2011 vol.17)

pp: 368-379

Taehyun Rhee , Samsung Electronics Co., Ltd., Giheung-gu

J.P. Lewis , Weta Digital, Wellington

Ulrich Neumann , University of Southern California, Los Angeles

Krishna S. Nayak , University of Southern California, Los Angeles

DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/TVCG.2010.39

ABSTRACT

This paper describes a complete system to create anatomically accurate example-based volume deformation and animation of articulated body regions, starting from multiple in vivo volume scans of a specific individual. In order to solve the correspondence problem across volume scans, a template volume is registered to each sample. The wide range of pose variations is first approximated by volume blend deformation (VBD), providing proper initialization of the articulated subject in different poses. A novel registration method is presented to efficiently reduce the computation cost while avoiding strong local minima inherent in complex articulated body volume registration. The algorithm highly constrains the degrees of freedom and search space involved in the nonlinear optimization, using hierarchical volume structures and locally constrained deformation based on the biharmonic clamped spline. Our registration step establishes a correspondence across scans, allowing a data-driven deformation approach in the volume domain. The results provide an occlusion-free person-specific 3D human body model, asymptotically accurate inner tissue deformations, and realistic volume animation of articulated movements driven by standard joint control estimated from the actual skeleton. Our approach also addresses the practical issues arising in using scans from living subjects. The robustness of our algorithms is tested by their applications on the hand, probably the most complex articulated region in the body, and the knee, a frequent subject area for medical imaging due to injuries.

INDEX TERMS

Registration, deformation, volume animation.

CITATION

Taehyun Rhee, J.P. Lewis, Ulrich Neumann, Krishna S. Nayak, "Scan-Based Volume Animation Driven by Locally Adaptive Articulated Registrations",

*IEEE Transactions on Visualization & Computer Graphics*, vol.17, no. 3, pp. 368-379, March 2011, doi:10.1109/TVCG.2010.39REFERENCES

- [1] B. Allen, B. Curless, and Z. Popović, "Articulated Body Deformation from Range Scan Data,"
Proc. ACM SIGGRAPH '02, pp. 612-619, 2002.- [2] B. Allen, B. Curless, and Z. Popović, "The Space of Human Body Shapes: Reconstruction and Parameterization from Range Scans,"
ACM Trans. Graphics, vol. 22, no. 3, pp. 587-594, 2003.- [3] H. Seo, F. Cordier, and N. Magnenat-Thalmann, "Synthesizing Animatable Body Models with Parameterized Shape Modifications,"
Proc. ACM SIGGRAPH/Eurographics Symp. Computer Animation (SCA '03), pp. 120-125, 2003.- [4] D. Anguelov, P. Srinivasan, D. Koller, S. Thrun, J. Rodgers, and J. Davis, "Scape: Shape Completion and Animation of People,"
Proc. ACM SIGGRAPH '05, pp. 408-416, 2005.- [5] S.I. Park and J.K. Hodgins, "Capturing and Animating Skin Deformation in Human Motion,"
ACM Trans. Graphics, vol. 25, no. 3, pp. 881-889, 2006.- [6] "Visible Human Project," National Library of Medicine, http://www.nlm.nih.gov/researchvisible, 1986.
- [7] J. Teran, E. Sifakis, S.S. Blemker, V. Ng-Thow-Hing, C. Lau, and R. Fedkiw, "Creating and Simulating Skeletal Muscle from the Visible Human Data Set,"
IEEE Trans. Visualization and Computer Graphics, vol. 11, no. 3, pp. 317-328, May 2005.- [8] N. Gagvani and D. Silver, "Animating Volumetric Models,"
Graphical Models, vol. 63, no. 6, pp. 443-458, 2001.- [9] V. Singh and D. Silver, "Interactive Volume Manipulation with Selective Rendering for Improved Visualization,"
Proc. IEEE Symp. Volume Visualization and Graphics (VV '04), pp. 95-102, 2004.- [10] T. Kurihara and N. Miyata, "Modeling Deformable Human Hands from Medical Images,"
Proc. ACM Symp. Computer Animation (SCA '04), pp. 357-366, 2004.- [11] T. Rhee, J. Lewis, U. Neumann, and K. Nayak, "Soft-Tissue Deformation for In-Vivo Volume Animation,"
Proc. Pacific Conf. Computer Graphics, pp. 435-438, 2007.- [12] I. Albrecht, J. Haber, and H.P. Seidel, "Construction and Animation of Anatomically Based Human Hand Models,"
Proc. ACM SIGGRAPH/Eurographics Symp. Computer Animation (SCA '03), pp. 98-109, 2003.- [13] L. Kavan and J. Zara, "Spherical Blend Skinning: A Real-Time Deformation of Articulated Models,"
Proc. ACM SIGGRAPH Symp. Interactive 3D Graphics and Games (SI3D '05), pp. 9-16, Apr. 2005.- [14] D.L. James and C.D. Twigg, "Skinning Mesh Animations,"
ACM Trans. Graphics, vol. 24, no. 3, pp. 399-407, Aug. 2005.- [15] B. Merry, P. Marais, and J. Gain, "Animation Space: A Truly Linear Framework for Character Animation,"
ACM Trans. Graphics, vol. 25, no. 4, pp. 1400-1423, 2006.- [16] Y. Kurzion and R. Yagel, "Space Deformation Using Ray Deflectors,"
Proc. Sixth Eurographics Workshop Rendering (Rendering Techniques '95), pp. 21-30, 1995.- [17] R. Westermann and C. Rezk-Salama, "Real-Time Volume Deformations,"
Computer Graphics Forum, vol. 20, no. 3, pp. 443-451, 2001.- [18] C. Rezk-Salama, M. Scheuering, G. Soza, and G. Greiner, "Fast Volumetric Deformation on General Purpose Hardware,"
Proc. ACM SIGGRAPH/EUROGRAPHICS Workshop Graphics Hardware (HWWS '01), pp. 17-24, 2001.- [19] K. Engel, M. Hadwiger, J. Kniss, C. Rezk-Salama, and D. Weiskopf,
Real-Time Volume Graphics. A.K. Peters, 2006.- [20] M. Chen, C. Correa, S. Islam, M.W. Jones, P.-Y. Shen, D. Silver, S.J. Walton, and P.J. Willis, "Manipulating, Deforming and Animating Sampled Object Representations,"
Computer Graphics Forum, vol. 26, no. 4, pp. 824-852, 2007.- [21] J.V. Hajnal, D.L. Hill, and D.J. Hawkes,
Medical Image Registration. CRC Press, 2001.- [22] J.P.W. Pluim, J.B.A. Maintz, and M.A. Viergever, "Mutual Information Based Registration of Medical Images: A Survey,"
IEEE Trans. Medical Imaging, vol. 22, no. 8, pp. 986-1004, Aug. 2003.- [23] W.R. Crum, T. Hartkens, and D.L.G. Hill, "Non-Rigid Image Registration: Theory and Practice,"
The British J. Radiology, vol. 77, pp. 141-153, 2004.- [24] M. Holden, "A Review of Geometric Transformations for Nonrigid Body Registration,"
IEEE Trans. Medical Imaging, vol. 27, no. 1, pp. 111-128, Jan. 2008.- [25] D. Rueckert, L.I. Sonoda, C. Hayes, D.L. Hill, M.O. Leach, and D.J. Hawkes, "Nonrigid Registration Using Free-Form Deformations: Application to Breast MR Images,"
IEEE Trans. Medical Imaging, vol. 18, no. 8, pp. 712-721, Aug. 1999.- [26] G.K. Rohde, A. Aldroubi, and B.M. Dawant, "The Adaptive Bases Algorithm for Intensity-Based Nonrigid Image Registration,"
IEEE Trans. Medical Imaging, vol. 22, no. 11, pp. 1470-1479, Nov. 2003.- [27] Z. Wu, "Solving PDE with Radial Basis Function and the Error Estimation,"
Lecture Notes on Pure and Applied Mathematics, p. 202, Springer, 1998.- [28] H. Park, P.H. Bland, K.K. Brock, and C.R. Meyer, "Adaptive Registration Using Local Information Measures,"
Medical Image Analysis, vol. 8, no. 4, pp. 465-473, 2004.- [29] G.E. Marai, D.H. Laidlaw, and J.J. Crisco, "Super-Resolution Registration Using Tissue-Classified Distance Fields,"
IEEE Trans. Medical Imaging, vol. 25, no. 2, pp. 177-187, Feb. 2006.- [30] X. Papademetris, D. Dione, L. Dobrucki, L. Staib, and A. Sinusas, "Articulated Rigid Registration for Serial Lower-Limb Mouse Imaging,"
Proc. Conf. Medical Image Computing and Computer-Assisted Intervention (MICCAI '05), pp. 919-926, 2005.- [31] X. Li, T. Peterson, J. Gore, and B. Dawant, "Automatic Registration of Whole Body Serial Micro CT Images with a Combination of Point-Based and Intensity-Based Registration Techniques,"
Proc. IEEE Int'l Symp. Biomedical Imaging (ISBI '06), pp. 454-457, Apr. 2006.- [32] A.B. D'Aische, M.D. Craene, B. Macq, and S. Warfield, "An Improved Articulated Registration Method for Neck Images,"
Proc. Conf. IEEE Eng. in Medicine and Biology, pp. 7668-7671, Sept. 2005.- [33] T. Rhee, J. Lewis, K. Nayak, and U. Neumann, "Adaptive Non-Rigid Registration of 3D Knee MRI in Different Pose Spaces,"
Proc. IEEE Int'l Symp. Biomedical Imaging (ISBI '08), Mar. 2008.- [34] S. Boyd and L. Vandenberghe,
Convex Optimization. Cambridge Univ. Press, 2004.- [35] S. Marsland and C.J. Twining, "Constructing Diffeomorphic Representations for the Groupwise Analysis of Nonrigid Registrations of Medical Images,"
IEEE Trans. Medical Imaging, vol. 23, no. 8, pp. 1006-1020, Aug. 2004.- [36] S. Komojima, N. Miyata, and J. Ota, "Identification of Position and Orientation of Hand Bones from mr Images by Bone Model Registration,"
Proc. IEEE/RSJ Int'l Conf. Intelligent Robots and Systems, 2004.- [37] N. Miyata, M. Kouchi, M. Mouchimaru, and T. Kurihara, "Finger Joint Kinematics from mr Images,"
Proc. IEEE/RSJ Int'l Conf. Intelligent Robots and Systems, 2005.- [38] C. Rother, V. Kolmogorov, and A. Blake, "GrabCut: Interactive Foreground Extraction Using Iterated Graph Cuts,"
Proc. ACM SIGGRAPH '04, pp. 309-314, 2004.- [39] N. Magnenat-Thalmann, R. Laperrière, and D. Thalmann, "Joint-Dependent Local Deformations for Hand Animation and Object Grasping,"
Proc. Graphics Interface Conf. '88, pp. 26-33, June 1988.- [40] J.P. Lewis, M. Cordner, and N. Fong, "Pose Space Deformation: A Unified Approach to Shape Interpolation and Skeleton-Driven Deformation,"
Proc. ACM SIGGRAPH '00, pp. 165-172, 2000.- [41] P. Viola and I.W.M. Wells, "Alignment by Maximization of Mutual Information,"
Proc. Int'l Conf. Computer Vision (ICCV '95), pp. 16-23, 1995.- [42] H. Wendland, "Piecewise Polynomial, Positive Definite and Compactly Supported Radial Functions of Minimal Degree,"
Advances in Computational Math., vol. 4, no. 1, pp. 389-396, 1995.- [43] R. Szeliski, "Motion Estimation with Quadtree Splines,"
IEEE Trans. Pattern Analysis and Matching Intelligence, vol. 18, no. 12, pp. 1199-1210, Dec. 1996.- [44] P.-P.J. Sloan, C.F. Rose, and M.F. Cohen, "Shape by Example,"
Proc. ACM Symp. Interactive 3D Graphics (SI3D '01), pp. 135-143, 2001.- [45] P.G. Kry, D.L. James, and D.K. Pai, "EigenSkin: Real Time Large Deformation Character Skinning in Hardware,"
Proc. ACM SIGGRAPH Symp. Computer Animation (SCA-02), pp. 153-160, 2002.- [46] T. Rhee, J. Lewis, and U. Neumann, "Real-Time Weighted Pose-Space Deformation on the GPUs,"
Computer Graphics Forum, vol. 25, no. 3, pp. 439-448, 2006.- [47] L. Zagorchev and A. Goshtasby, "A Comparative Study of Transformation Functions for Nonrigid Image Registration,"
IEEE Trans. Image Processing, vol. 15, no. 3, pp. 529-538, Mar. 2006.- [48] R.H. Clewley, J.M. Guckenheimer, and F.J. Valero-Cuevas, "Estimating Effective Degrees of Freedom in Motor Systems,"
IEEE Trans. Biomedical Eng., vol. 55, no. 2, pp. 430-442, Feb. 2008.- [49] J. Kniss, G. Kindlmann, and C. Hansen, "Interactive Volume Rendering Using Multi-Dimensional Transfer Functions and Direct Manipulation Widgets,"
Proc. IEEE Conf. Visualization, pp. 255-262, 2001. |