This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Frequency-Based Nonrigid Motion Analysis: Application to Four Dimensional Medical Images
November 1996 (vol. 18 no. 11)
pp. 1067-1079

Abstract—We present a method for nonrigid motion analysis in time sequences of volume images (4D data). In this method, nonrigid motion of the deforming object contour is dynamically approximated by a physically-based deformable surface. In order to reduce the number of parameters describing the deformation, we make use of a modal analysis which provides a spatial smoothing of the surface. The deformation spectrum, which outlines the main excited modes, can be efficiently used for deformation comparison. Fourier analysis on time signals of the main deformation spectrum components provides a temporal smoothing of the data. Thus a complex nonrigid deformation is described by only a few parameters: the main excited modes and the main Fourier harmonics. Therefore, 4D data can be analyzed in a very concise manner. The power and robustness of the approach is illustrated by various results on medical data. We believe that our method has important applications in automatic diagnosis of heart diseases and in motion compression.

[1] A.A. Amini, R. Curwen, R.T. Constable, and J.C. Gore, "MR Physics-Based Snake Tracking and Dense Deformations from Tagged Cardiac Images," AAAI 1994 Spring Symp. Series. Application of Computer Vision in Medical Image Processing, Stanford Univ., March 1994.
[2] A.A. Amini and J.S. Duncan, "Bending and Stretching Models for LV Wall Motion Analysis Form Curves and Surfaces," Image and Vision Computing, vol. 10, no. 6, pp. 418-430, 1992.
[3] N.W. Ashcroft and M.D. Mermin, Solid State Physics. Saunders College Publishing Int'l Ed., 1976.
[4] N. Ayache, Artificial Vision for Mobile Robots—Stereo-Vision and Multisensory Perception. MIT Press, 1991.
[5] N. Ayache, "Medical Computer Vision, Virtual Reality and Robotics—Promising Research," Image and Vision Computing, vol. 13, no. 4, pp. 295-313, May 1995.
[6] N. Ayache, I. Cohen, and I. Herlin, "Medical Image Tracking," Active Vision, chapter 17. MIT Press, Dec. 1992.
[7] E. Bardinet, L.D. Cohen, and N. Ayache, “Superquadrics and Free-Form Deformations: A Global Model to Fit and Track 3D Medical Data,” Proc. Computer Visualization and Pattern Recognition in Medicine, N. Ayache, ed., pp. 319-326, 1995.
[8] K.J. Bathe, Finite Element Procedures in Engineering Analysis. Prentice-Hall, 1982.
[9] S. Benayoun, N. Ayache, and I. Cohen, "Adaptive Meshes and Nonrigid Motion Computation," Int'l Conf. Pattern Recognition,Jerusalem, Israel, March 1994.
[10] S. Benayoun, C. Nastar, and N. Ayache, "Dense Non-Rigid Motion Estimation in Sequences of 3D Images Using Differential Constraints," First Conf. Computer Vision, Virtual Reality and Robotics in Medicine (CVRMed '95), N. Ayache, ed., vol. 905, Nice, France, Apr. 1995. Springer Verlag.
[11] A. Blake, R. Curwen, and A. Zisserman, "Affine-Invariant Contour Tracking with Automatic Control of Spatiotemporal Scale," IEEE Proc. Fourth Int'l Conf. Computer Vision, pp. 66-75,Berlin, Germany, May 1993.
[12] L. Bookstein, "Principal Warps: Thin-Plate Splines and the Decomposition of Deformations," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 11, no. 6, pp. 567-585, June 1989.
[13] C.W. Chen,T.S. Huang, and M. Arrott,“Modeling, analysis, and visualization of left ventricle shape and motion by hierarchical decomposition,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 16, pp. 342-356, Apr. 1994.
[14] I. Cohen, L.D. Cohen, and N. Ayache, "Using Deformable Surfaces to Segment 3D Images and Infer Differential Structures," Computer Vision, Graphics, and Image Processing, vol. 26, no. 2, pp. 242-263, 1992.
[15] T.F. Cootes, C.J. Taylor, D.H. Cooper, and J. Graham, "Active Shape Models—Their Training and Application," Computer Vision and Image Understanding, vol. 61, no. 1, pp. 38-59, Jan. 1995.
[16] T.F Cootes, A. Hill, C.J Taylor, and J. Haslam, "The Use of Active Shape Models for Locating Structures in Medical Images," Proc. 13th Int'l Conf. Information Processing in Medical Imaging,Flagstaff, Ariz., June 1993.
[17] T.F. Cootes and C.J. Taylor, "Combining Point Distribution Models with Shape Models Based on Finite Element Analysis," Image and Vision Computing, vol. 13, no. 5, 1995.
[18] L.L. Creswell, S.G. Wyers, J.S. Pirolo, W.H. Perman, M.W. Vannier, and M.K. Pasque, "Mathematical Modeling of the Heart Using Magnetic Resonance Imaging," IEEE Trans. Medical Imaging, vol. 11, no. 4, pp. 581-589, 1992.
[19] P.E. Danielsson, "Euclidean Distance Mapping," Computer Vision, Graphics, and Image Processing, vol. 14, pp. 227-248, 1980.
[20] H. Delingette, M. Hebert, and K. Ikeuchi, "Shape Representation and Image Segmentation Using Deformable Surfaces," IEEE Proc. Computer Vision and Pattern Recognition, pp. 467-472,Lahaina, Maui, Hawaii, June 1991.
[21] R.O. Duda and P.E. Hart, Pattern Classification and Scene Analysis. John Wiley and Sons, 1973.
[22] A. Guéziec, "Large Deformable Splines: Crest Lines and Matching," Proc. Fourth Int'l Conf. Computer Vision,Berlin, May 1993.
[23] W.C. Huang and D. Goldgof, “Adaptive-Size Physically-Based Models for Non-rigid Motion Analysis,” Proc. Conf. Computer Vision and Pattern Recognition, pp. 833-835, June 1992.
[24] M. Kass, A. Witkin, and D. Terzopoulos, "Snakes: Active Contour Models," Int'l J. Computer Vision, vol. 1, pp. 321-331, 1987.
[25] F. Leitner, I. Marque, S. Lavallée, and P. Cinquin, "Dynamic Segmentation: Finding the Edge with Snake-Splines," Proc. Int'l Conf. Curves and Surfaces, pp. 1-4,Chamonix, France, June 1990. Academic Press.
[26] T. McInerney and D. Terzopoulos, "A Dynamic Finite Element Surface Model for Segmentation and Tracking in Multidimensional Images with Application to Cardiac 4D Image Analysis," J. Computerized Medical Imaging and Graphics, vol. 19, no. 1, pp. 69-83, 1995.
[27] D. Metaxas and D. Terzopoulos, “Shape and Non-Rigid Motion Estimation through Physics-Based Synthesis,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 15, no. 6, pp. 580-591, June 1993.
[28] O. Monga and R. Deriche, “3D Edge Detection Using Recursive Filtering,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 28-35, June 1989.
[29] O. Monga, R. Deriche, G. Malandain, and J-P. Cocquerez, "Recursive Filtering and Edge Closing: Two Primary Tools for 3D Edge Detection," Proc. First European Conf. Computer Vision (ECCV), Antibes, France, Apr. 1990.
[30] C. Nastar, "Vibration Modes for Nonrigid Motion Analysis in 3D Images," Proc. Third European Conf. Computer Vision (ECCV '94), Stockholm, May 1994.
[31] C. Nastar and N. Ayache, "Fast Segmentation, Tracking, and Analysis of Deformable Objects," Proc. Fourth Int'l Conf. Computer Vision (ICCV '93), Berlin, May 1993.
[32] C. Nastar and N. Ayache, "Non-Rigid Motion Analysis in Medical Images: A Physically Based Approach," Proc. 13th Int'l Conf. Information Processing in Medical Imaging (IPMI '93), Flagstaff, Ariz., June 1993.
[33] C. Nastar and N. Ayache, "Classification of Nonrigid Motion in 3D Images Using Physics-Based Vibration Analysis," Proc. IEEE Workshop Biomedical Image Analysis,Seattle, June 1994.
[34] C. Nastar and N. Ayache, "Time Representation of Deformations: Combining Vibration Modes and Fourier Analysis," Lecture Notes in Computer Science 994: Object Representation in Computer Vision. Springer-Verlag, 1995.
[35] J. Park, D. Metaxas, and L. Axel, "Volumetric Deformable Models with Parametric Functions: A New Approach to the 3D Motion Analysis of the LV from MRI-SPAMM," Proc. Fifth Int'l Conf. Computer Vision (ICCV '95), Boston, June 1995.
[36] A. Pentland and B. Horowitz, “Recovery of Non-Rigid Motion and Structure,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 13, no. 7, pp. 730-742, July 1991.
[37] A. Pentland and S. Sclaroff, "Closed-Form Solutions for Physically-Based Shape Modeling and Recognition," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 13, no. 7, pp. 715-729, July 1991.
[38] A. Pentland and J. Williams, “Good Vibrations: Modal Dynamics for Graphics and Animation,” Proc. ACM SIGGRAPH, pp. 215-222, 1989.
[39] P. Shi, G. Robinson, A. Chakraborty, L. Staib, R. Constable, A. Sinuasa, and J. Duncan, "A Unified Framework to Assess Myocardial Function from 4D Images," Proc. First Conf Computer Vision, Virtual Reality, and Robotics in Medicine (CVRMed '95), N. Ayache, ed., vol. 905, Nice, France, Apr. 1995. Springer Verlag.
[40] P. Shi, A. Amini, G. Robinson, A. Sinusas, C.T. Constable, and J. Duncan, "Shape-Based 4D Left Ventricular Myocardial Function Analysis, Proc IEEE Workshop on Biomedical Image Analysis,Seattle, Wash., June 1994.
[41] R. Szeliski and S. Lavallée, "Matching 3D Anatomical Surfaces with Non-Rigid Volumetric Deformations," Proc. AAAI 1994 Spring Symp. Series. Application of Computer Vision in Medical Image Processing, Stanford Univ., March 1994.
[42] D. Terzopoulos and K. Fleischer, "Deformable Models," The Visual Computer, vol. 4, pp. 306-331, 1988.
[43] D. Terzopoulos and K. Waters, Physically Based Facial Modeling, Analysis, and Animation," J. Visualization and Computer Animation, vol 1, pp. 73-80, 1990.
[44] D. Terzopoulos and K. Waters, "Analysis and Synthesis of Facial Image Sequences Using Physical and Anatomical Models," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 15, no. 6, pp. 569-579, 1993.
[45] D. Terzopolous, A. Witkin, and M. Kass, "Constraints on deformable models: Recovering 3D shape and nonrigid motion, AI, no. 36, pp. 91-123, 1988.
[46] M. Vasilescu and D. Terzopoulos, “Adaptive Meshes and Shells: Irregular Triangulation, Discontinuities and Hierarchical Subdivision,” Proc. Conf. Computer Vision and Pattern Recognition, pp. 829-832, June 1992.
[47] Q.Z. Ye, "The Signed Euclidean Distance Transform and Its Applications," Int'l Conf. Pattern Recognition, pp. 495-499, 1988.
[48] A.L. Yuille, D.S. Cohen, and P.W. Hallinan, "Feature Extraction from Faces Using Deformable Templates," Proc. Computer Vision and Pattern Recognition,San Diego, June 1989.

Index Terms:
Medical image analysis, nonrigid motion, deformable models, modal analysis, Fourier analysis, compression, dynamic data, four-dimensional images, cardiac imagery, automatic diagnosis.
Citation:
Chahab Nastar, Nicholas Ayache, "Frequency-Based Nonrigid Motion Analysis: Application to Four Dimensional Medical Images," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 18, no. 11, pp. 1067-1079, Nov. 1996, doi:10.1109/34.544076
Usage of this product signifies your acceptance of the Terms of Use.