The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.04 - July/August (2010 vol.16)
pp: 676-689
Yi Xu , Purdue University, West Lafayette
Daniel G. Aliaga , Purdue University, West Lafayette
ABSTRACT
Obtaining models of dynamic 3D objects is an important part of content generation for computer graphics. Numerous methods have been extended from static scenarios to model dynamic scenes. If the states or poses of the dynamic object repeat often during a sequence (but not necessarily periodically), we call such a repetitive motion. There are many objects, such as toys, machines, and humans, undergoing repetitive motions. Our key observation is that when a motion-state repeats, we can sample the scene under the same motion state again but using a different set of parameters; thus, providing more information of each motion state. This enables robustly acquiring dense 3D information difficult for objects with repetitive motions using only simple hardware. After the motion sequence, we group temporally disjoint observations of the same motion state together and produce a smooth space-time reconstruction of the scene. Effectively, the dynamic scene modeling problem is converted to a series of static scene reconstructions, which are easier to tackle. The varying sampling parameters can be, for example, structured-light patterns, illumination directions, and viewpoints resulting in different modeling techniques. Based on this observation, we present an image-based motion-state framework and demonstrate our paradigm using either a synchronized or an unsynchronized structured-light acquisition method.
INDEX TERMS
Three-dimensional graphics and realism, digitization and image capture, geometric modeling.
CITATION
Yi Xu, Daniel G. Aliaga, "Modeling Repetitive Motions Using Structured Light", IEEE Transactions on Visualization & Computer Graphics, vol.16, no. 4, pp. 676-689, July/August 2010, doi:10.1109/TVCG.2009.207
REFERENCES
[1] A. Agarwala, K.C. Zheng, C. Pal, M. Agrawala, M. Cohen, B. Curless, D. Salesin, and R. Szeliski, "Panoramic Video Textures," ACM Trans. Graphics, vol. 24, no. 3, pp. 821-827, 2005.
[2] C. Buehler, M. Bosse, L. McMillan, S. Gortler, and M. Cohen, "Unstructured Lumigraph Rendering," Proc. ACM SIGGRAPH, pp. 425-432, 2001.
[3] D. Bradley, T. Popa, A. Sheffer, W. Heidrich, and T. Boubekeur, "Markerless Garment Capture," ACM Trans. Graphics, vol. 27, no. 3, pp. 1-9, 2008.
[4] J. Carranza, C. Theobalt, M.A. Magnor, and H.P. Seidel, "Free-Viewpoint Video of Human Actors," ACM Trans. Graphics, vol. 22, no. 3, pp. 569-577, 2003.
[5] D. Caspi, N. Kiryati, and J. Shamir, "Range Imaging with Adaptive Color Structured Light," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 20, no. 5, pp. 470-480, May 1998.
[6] R. Cutler and L. Davis, "Robust Real-Time Periodic Motion Detection, Analysis, and Applications," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 8, pp. 781-796, Aug. 2000.
[7] J. Davis, D. Nehab, R. Ramamoorthi, and S. Rusinkiewicz, "Spacetime Stereo: A Unifying Framework for Depth from Triangulation," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 2, pp. 296-302, Feb. 2005.
[8] E. de Aguiar, C. Stoll, C. Theobalt, N. Ahmed, H. Seidel, and S. Thrun, "Performance Capture from Sparse Multi-View Video," ACM Trans. Graphics, vol. 27, no. 3, pp. 1-10, 2008.
[9] P. Einarsson, C.F. Chabert, A. Jones, W.C. Ma, B. Lamond, T. Hawkins, M. Bolas, S. Sylwan, and P. Debevec, "Relighting Human Locomotion with Flowed Reflectance Fields," Proc. Eurographics Symp. Rendering, pp. 183-194, 2006.
[10] P. Fong and F. Buron, "High-Resolution 3-Dimensional Sensing of Fast Deforming Objects," Proc. Intelligent Robots and Systems, pp. 1606-1611, 2005.
[11] C. Frueh and A. Zakhor, "Capturing 2${1\over 2}$ D Depth and Texture of Time-Varying Scenes Using Structured Infrared Light," Proc. Int'l Conf. 3D Imaging and Modeling, pp. 318-325, 2005.
[12] C. Hernandez, G. Vogiatzis, G.J. Brostow, B. Stenger, and R. Cipolla, "Non-Rigid Photometric Stereo with Colored Lights," Proc. Int'l Conf. Computer Vision, pp. 1-8, 2007.
[13] G.J. Iddan and G. Yahav, "Three-Dimensional Imaging in the Studio and Elsewhere," Proc. SPIE, pp. 48-55, 2001.
[14] S. Inokuchi, K. Sato, and F. Matsuda, "Range Imaging System for 3-D Object Recognition," Proc. Int'l Conf. Pattern Recognition, pp. 806-808, 1984.
[15] A. Jones, A. Gardner, M. Bolas, I. McDowall, and P. Debevec, "Simulating Spatially Varying Lighting on a Live Performance," Proc. Third European Conf. Visual Media Production, pp. 127-133, 2006.
[16] S.B. Kang, J. Webb, C. Zitnick, and T. Kanade, "A Multibaseline Stereo System with Active Illumination and Real-Time Image Acquisition," Proc. Int'l Conf. Computer Vision, pp. 88-93, 1995.
[17] T.P. Koninckx, I. Geys, T. Jaeggli, and L. van Gool, "A Graph Cut Based Adaptive Structured Light Approach for Real-Time Range Acquisition," Proc. Int'l Symp. 3D Data Processing, Visualization and Transmission, pp. 413-421, 2004.
[18] T.P. Koninckx, A. Griesser, and L. van Gool, "Real-Time Range Scanning of Deformable Surfaces by Adaptively Coded Structured Light," Proc. Int'l Conf. 3D Imaging and Modeling, pp. 293-300, 2003.
[19] T. Koninckx, P. Peers, P. Dutre, and L. Van Gool, "Scene-Adapted Structured Light," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 611-618, 2005.
[20] L. Kovar, M. Gleicher, and F. Pighin, "Motion Graphs," ACM Trans. Graphics, vol. 21, no. 3, pp. 473-482, 2002.
[21] I. Laptev, S. Belongie, P. Perez, and J. Wills, "Periodic Motion Detection and Segmentation via Approximate Sequence Alignment," Proc. Int'l Conf. Computer Vision, pp. 816-823, 2005.
[22] C. Lee, S. Ghyme, C. Park, and K. Wohn, "The Control of Avatar Motion Using Hand Gesture," Proc. ACM Symp. Virtual Reality Software and Technology, pp. 59-65, 1998.
[23] W. Matusik, C. Buehler, R. Raskar, S.J. Gortler, and L. McMillan, "Image-Based Visual Hulls," Proc. ACM SIGGRAPH, pp. 369-374, 2000.
[24] C. Rocchini, P. Cignoni, C. Montani, P. Pingi, and R. Scopigno, "A Low Cost 3D Scanner Based on Structured Light," Computer Graphics Forum, vol. 20, no. 3, pp. 299-308, 2001.
[25] S. Rusinkiewicz, O. Hall-Holt, and M. Levoy, "Real-Time 3D Model Acquisition," ACM Trans. Graphics, vol. 21, no. 3, pp. 438-446, 2002.
[26] F. Sadlo, T. Weyrich, R. Peikert, and M. Gross, "A Practical Structured Light Acquisition System for Point-Based Geometry and Texture," Proc. Symp. Point-Based Graphics, pp. 89-98, 2005.
[27] P. Sand, L. McMillian, and J. Popovic, "Continuous Capture of Skin Deformation," ACM Trans. Graphics, vol. 22, no. 3, pp. 578-586, 2003.
[28] A. Schödl, R. Szeliski, D. Salesin, and I. Essa, "Video Textures," Proc. ACM SIGGRAPH, pp. 489-498, 2000.
[29] S. Seitz, B. Curless, J. Diebel, D. Scharstein, and R. Szeliski, "A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 519-526, 2006.
[30] S. Seitz and C. Dyer, "View-Invariant Analysis of Cyclic Motion," Int'l J. Computer Vision, vol. 3, pp. 231-251, 1997.
[31] J. Starck, G. Miller, and A. Hilton, "Video-Based Character Animation," Proc. Symp. Computer Animation, pp. 49-58, 2005.
[32] S. Vedula, S. Baker, and T. Kanade, "Image-Based Spatio-Temporal Modeling and View Interpolation of Dynamic Events," ACM Trans. Graphics, vol. 24, no. 2, pp. 240-261, 2005.
[33] M. Waschbüsch, S. Würmlin, D. Cotting, F. Sadlo, and M. Gross, "Scalable 3D Video of Dynamic Scenes," Visual Computer, vol. 21, nos. 8-10, pp. 629-638, 2005.
[34] T. Weise, B. Leibe, and L. van Gool, "Fast 3D Scanning with Automatic Motion Compensation," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1-8, 2007.
[35] A. Wenger, A. Gardner, C. Tchou, J. Unger, T. Hawkins, and P. Debevec, "Performance Relighting and Reflectance Transformation with Time-Multiplexed Illumination," ACM Trans. Graphics, vol. 24, no. 3, pp. 756-764, 2005.
[36] Y. Xu and D. Aliaga, "Efficient Multi-Viewpoint Acquisition of 3D Objects Undergoing Repetitive Motions," Proc. ACM Symp. Interactive 3D Graphics and Games, pp. 113-120, 2007.
[37] Y. Xu and D. Aliaga, "Dense Depth and Color Acquisition of Repetitive Motions," Proc. Int'l Conf. 3D Imaging and Modeling, pp. 141-148, 2007.
[38] L. Zhang, B. Curless, and S. Seitz, "Rapid Shape Acquisition using Color Structured Light and Multi-Pass Dynamic Programming," Proc. Int'l Symp. 3D Data Processing, Visualization and Transmission, pp. 24-36, 2002.
[39] L. Zhang, B. Curless, and S. Seitz, "Spacetime Stereo: Shape Recovery for Dynamic Scenes," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 367-374, 2003.
[40] L. Zhang, N. Snavely, B. Curless, and S.M. Seitz, "Spacetime Faces: High-Resolution Capture for Modeling and Animation," ACM Trans. Graphics, vol. 23, no. 3, pp. 548-558, 2004.
[41] C. Zitnick, S.B. Kang, M. Uyttendaele, S. Winder, and R. Szeliski, "High-Quality Video View Interpolation Using a Layered Representation," ACM Trans. Graphics, vol. 23, no. 3, pp. 600-608, 2004.
5 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool