Issue No. 09 - Sept. (2014 vol. 36)
Ryusuke Sagawa , Intelligent Systems Research Institute, National Institute of Advanced Industrial Science and Technology, Tsukuba Central 2, 1-1-1 Umezono, Tsukuba, Japan
Ryo Furukawa , Graduate School of Information Science, Hiroshima City University, Hiroshima, Japan
Hiroshi Kawasaki , Department of Information and Biomedical Engineering, Kagoshima University, Kagoshima, Japan
Dense 3D reconstruction of fast moving objects could contribute to various applications such as body structure analysis, accident avoidance, and so on. In this paper, we propose a technique based on a one-shot scanning method, which reconstructs 3D shapes for each frame of a high frame-rate video capturing the scenes projected by a static pattern. To avoid instability of image processing, we restrict the number of colors used in the pattern to less than two. The proposed technique comprises (1) an efficient algorithm to eliminate ambiguity of projected parallel-line patterns by using intersection points, (2) a batch reconstruction algorithm of multiple frames by using spatio-temporal constraints, and (3) an efficient detection method of color-encoded grid pattern based on de Bruijn sequence. In the experiments, the line detection algorithm worked effectively and the dense reconstruction algorithm produces accurate and robust results. We also show the improved results by using temporal constraints. Finally, the dense reconstructions of fast moving objects in a high frame-rate video are presented.
Three-dimensional displays, Shape, Image reconstruction, Equations, Cameras, Mathematical model, Image color analysis,spatio-temporal analysis, Dense 3D reconstruction, projector-camera systems, grid patterns
Ryusuke Sagawa, Ryo Furukawa, Hiroshi Kawasaki, "Dense 3D Reconstruction from High Frame-Rate Video Using a Static Grid Pattern", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol. 36, no. , pp. 1733-1747, Sept. 2014, doi:10.1109/TPAMI.2014.2300490