This Article 
 Bibliographic References 
 Add to: 
Direct Estimation of Range Flow on Deformable Shape From a Video Rate Range Camera
January 1993 (vol. 15 no. 1)
pp. 82-89

A method of estimating range flow (space displacement vector field) on nonrigid as well as rigid objects from a sequence of range images is described. This method can directly estimate the deformable motion parameters by solving a system of linear equations that are obtained from substituting a linear transformation of nonrigid objects expressed by the Jacobian matrix into motion constraints based on an extension of the conventional scheme used in intensity image sequences. The range flow is directly computed by substituting these estimated motion parameters into the linear transformation. The algorithm is supported by experimental estimations of range flow on a sheet of paper, a piece of cloth, human skin, and a rubber balloon being inflated, using real range image sequences acquired by a video rate range camera.

[1] M. Asada and S. Tsuji, "Utilization of stripe pattern for dynamic scene analysis," inProc. 9th IJCAI, 1985, pp. 895-897.
[2] D. H. Ballard and O. A. Kimball, "Rigid body motion from depth and optical flow,"Comput. Vision Graphics Image Processing, vol. 22, pp. 95-115, 1983.
[3] A. H. Barr, "Global and local deformations of solid primitives,"Comput. Graphics, vol. 18, no. 3, pp. 21-30, 1984.
[4] K. B. Benson, Ed.,Television Engineering Handbook. New York: McGraw-Hill, 1986.
[5] J. -A. Beraldin, F. Blais, M. Rioux, J. Domey, and L. Cournoyer, "A video rate laser range camera for electronic boards inspection," inProc. Vision 90(Detroit, MI), Nov. 12-15, 1990.
[6] J. -A. Beraldin, M. Rioux, F. Blais, L. Cournoyer, and J. Domey, "Registered intensity and range imaging at 10 Megasamples per second," to be published inApplied Opt.
[7] C. Cafforio and F. Rocca, "Methods for measuring small displacements of television images,"IEEE Trans. Inform. Theory, vol. IT-22, pp. 573-579, 1976.
[8] S. Chaudhuri and S. Chatterjee, "Estimation of motion parameters for a deformable object from range data," inProc. Comput. Vision Patt. Recogn. 89', 1989, pp. 291-295.
[9] S. Chen and M. Penna, "Shape and motion of nonrigid bodies,"Comput. Vision Graphics Image Processing, vol. 36, pp. 175-207, 1986.
[10] B. K. P. Horn and E. J. Weldon Jr., "Direct methods for recovering motion,"Int. J. Comput. Vision, vol. 2, pp. 51-76, 1988.
[11] B. K. P. Horn and J. G. Harris, "Rigid body motion from range image sequences,"CVGIP: Image Understanding, vol. 53, no. 1, pp. 1-13, 1991.
[12] R. Jasinschi and A. Yuille, "Nonrigid motion and Regge calculus,"J. Opt. Soc. Amer. A, vol. 6, no. 7, pp. 1085-1095, 1989.
[13] N. Kehtarnavaz and S. Mohan, "A framework for estimation of motion parameters from range images,"Comput. Vision Graphics Image Processing, vol. 45, pp. 88-105, 1989.
[14] J.J. Koenderink and A. J. van Doom, "Depth and shape from differential perspective in the presence of bending deformations,"J. Opt. Soc. Amer. A, vol. 3, no. 2, pp. 242-249, 1986.
[15] R.P. Paul,Robot Manipulators: Mathematics, Programming, and Control, MIT Press, Cambridge, Mass., 1981.
[16] M. Rioux, "Laser range finder based on synchronized scanners,"Applied Opt., vol. 23, no. 21, pp. 3837-3855, 1984.
[17] M. Subbarao, "Interpretation of image flow: A spatio-temporal approach,"IEEE Trans. Patt. Anal. Machine Intell., vol. 11, no. 3, pp. 266-278, 1989.
[18] D. Terzopoulos, A. Witkin, and M. Kass, "Constraints on deformable models: Recovering 3D shape and nonrigid motion,"Artificial Intell., vol. 36, pp. 91-123, 1988.
[19] S. Ullman, "Maximizing rigidity: The incremental recovery of 3- D structure from rigid and nonrigid motion,Perception, vol. 13, pp. 255-274, 1984.
[20] M. Yamamoto, "Direct estimation of three-dimensional motion parameters from image sequence and depth,Trans. Inst. Electron. Commun. Eng. Japan, vol. J68-D, no. 4, pp. 562-569, 1985.
[21] M. Yamamoto, "A general aperture problem for direct estimation of 3D motion parameters,"IEEE Trans. Patt. Anal. Machine Intell., vol. 11, no. 5. pp. 528-536, 1989.
[22] M. Yamamoto, P. Boulanger, J. -A. Beraldin, M. Rioux, and J. Domey, "Direct estimation of deformable motion parameters from range image sequence," inProc. 3rd Int. Conf. Comput. Vision(Osaka), 1990, pp. 460-464.

Index Terms:
deformable shape range flow estimation; motion estimation; parameter estimation; video rate range camera; space displacement vector field; linear equations; motion constraints; intensity image sequences; image sequences; motion estimation; parameter estimation; video cameras
M. Yamamoto, P. Boulanger, J.A. Beraldin, M. Rioux, "Direct Estimation of Range Flow on Deformable Shape From a Video Rate Range Camera," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 15, no. 1, pp. 82-89, Jan. 1993, doi:10.1109/34.184776
Usage of this product signifies your acceptance of the Terms of Use.