The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.03 - March (2013 vol.35)
pp: 1
Jinwei Gu , Center for Imaging Sci., Rochester Inst. of Technol., Rochester, NY, USA
S. K. Nayar , Columbia Univ., New York, NY, USA
E. Grinspun , Columbia Univ., New York, NY, USA
P. N. Belhumeur , Columbia Univ., New York, NY, USA
R. Ramamoorthi , Univ. of California, Berkeley, Berkeley, CA, USA
ABSTRACT
We propose a new method named compressive structured light for recovering inhomogeneous participating media. Whereas conventional structured light methods emit coded light patterns onto the surface of an opaque object to establish correspondence for triangulation, compressive structured light projects patterns into a volume of participating medium to produce images which are integral measurements of the volume density along the line of sight. For a typical participating medium encountered in the real world, the integral nature of the acquired images enables the use of compressive sensing techniques that can recover the entire volume density from only a few measurements. This makes the acquisition process more efficient and enables reconstruction of dynamic volumetric phenomena. Moreover, our method requires the projection of multiplexed coded illumination, which has the added advantage of increasing the signal-to-noise ratio of the acquisition. Finally, we propose an iterative algorithm to correct for the attenuation of the participating medium during the reconstruction process. We show the effectiveness of our method with simulations as well as experiments on the volumetric recovery of multiple translucent layers, 3D point clouds etched in glass, and the dynamic process of milk drops dissolving in water.
INDEX TERMS
Image reconstruction, Cameras, Media, Atmospheric measurements, Particle measurements, Volume measurement, Spatial resolution, Image Representation, Image reconstruction, Cameras, Media, Atmospheric measurements, Particle measurements, Volume measurement, Spatial resolution, Volumetric, Computing Methodologies, Image Processing and Computer Vision, Scene Analysis, Photometry, Artificial Intelligence, Applications and Expert Knowledge-Intensive Systems, Computer vision, Vision and Scene Understanding, Modeling and recovery of physical attributes
CITATION
Jinwei Gu, S. K. Nayar, E. Grinspun, P. N. Belhumeur, R. Ramamoorthi, "Compressive Structured Light for Recovering Inhomogeneous Participating Media", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.35, no. 3, pp. 1, March 2013, doi:10.1109/TPAMI.2012.130
REFERENCES
[1] E.J. Candes, J. Romberg, and T. Tao, "Stable Signal Recovery from Incomplete and Inaccurate Measurements," Comm. Pure and Applied Math., vol. 59, no. 8, pp. 1207-1223, 2006.
[2] S. Deusch and T. Dracos, "Time Resolved 3D Passive Scalar Concentration-Field Imaging by Induced Fluorescence (LIF) in Moving Liquids," Measurement Science and Technology, vol. 12, no. 2, 188-200, 2001.
[3] D.L. Donoho, "Compressed Sensing," IEEE Trans. Information Theory, vol. 52, no. 4, pp. 1289-1306, Apr. 2006.
[4] M. Elad and M. Aharon, "Image Denoising via Sparse and Redundant Representations over Learned Dictionaries," IEEE Trans. Image Processing, vol. 15, no. 12, pp. 3736-3745, Dec. 2006.
[5] C. Fuchs, T. Chen, M. Goesele, H. Theisel, and H.-P. Seidel, "Density Estimation for Dynamic Volumes," Computers and Graphics, vol. 31, no. 2, pp. 205-211, 2007.
[6] C. Gini, "Measurement of Inequality of Incomes," The Economic J., vol. 31, pp. 124-126, 1921.
[7] J. Gu, S. Nayar, E. Grinspun, P. Belhumeur, and R. Ramamoorthi, "Compressive Structured Light For Recovering Inhomogenous Participating Media," Proc. European Conf. Computer Vision, pp. 845-858, 2008.
[8] S.W. Hasinoff and K.N. Kutulakos, "Photo-Consistent Reconstruction of Semi-Transparent Scenes by Density Sheet Decomposition," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 29, no. 5, pp. 870-885, May 2007.
[9] T. Hawkins, P. Einarsson, and P. Debevec, "Acquisition of Time-Varying Participating Media," ACM Trans. Graphics (Proc. Siggraph), vol. 24, no. 3, pp. 812-815, 2005.
[10] Y. Hitomi, J. Gu, M. Gupta, T. Mitsunaga, and S.K. Nayar, "Video from a Singe Coded Exposure Photograph Using a Learned Over-Complete Dictionary," Proc. IEEE Int'l Conf. Computer Vision, 2011.
[11] N.P. Hurley and S.T. Rickard, "Comparing Measures of Sparsity," IEEE Trans. Information Theory, vol. 55, no. 10, pp. 4723-4741, Oct. 2009.
[12] I. Ihrke and M. Magnor, "Image-Based Tomographic Reconstruction of Flames," Proc. ACM Siggraph/Eurographics Symp. Computer Animation, pp. 367-375, 2004.
[13] I. Ihrke and M. Magnor, "Adaptive Grid Optical Tomography," Graphical Models, vol. 68, no. 5, pp. 484-495, 2006.
[14] I. Ihrke, K.N. Kutulakos, H.P.A. Lensch, M. Magnor, and W. Heidrich, "State of the Art in Transparent and Specular Object Reconstruction," Proc. Eurographics, 2008.
[15] A. Ishimaru, Wave Propagation and Scattering in Random Media, IEEE/OUP Series on Electromagnetic Wave Theory. IEEE Press, 1978.
[16] M. Lustig, D. Donoho, and J.M. Pauly, "Sparse MRI: The Application of Compressed Sensing for Rapid MRI Imaging," Magnetic Resonance in Medicine, vol. 58, no. 6, pp. 1182-1195, 2007.
[17] J. Mairal, F. Bach, J. Ponce, G. Sapiro, and A. Zisserman, "Non-Local Sparse Models for Image Restoration," Proc. 12th IEEE Int'l Conf. Computer Vision, pp. 2272-2279, 2009.
[18] S.G. Narasimhan, S.K. Nayar, B. Sun, and S.J. Koppal, "Structured Light in Scattering Media," Proc. IEEE Int'l Conf. Computer Vision, pp. 420-427, 2005.
[19] S.K. Nayar, G. Krishnan, M.D. Grossberg, and R. Raskar, "Fast Separation of Direct and Global Components of a Scene Using High Frequency Illumination," ACM Trans. Graphics (Proc. Siggraph), vol. 25, no. 3, pp. 935-944, 2006.
[20] B.A. Olshausen and D.J. Field, "Emergence of Simple-Cell Receptive Field Properties by Learning A Sparse Code for Natural Images," Nature, vol. 381, pp. 607-609, 1996.
[21] P. Peers, D.K. Mahajan, B. Lamond, A. Ghosh, W. Matusik, R. Ramamoorthi, and P. Debevec, "Compressive Light Transport Sensing," ACM Trans. Graphics, vol. 28, no. 3:1-3:18, pp. 1289-1306, 2009.
[22] M. Protter and M. Elad, "Image Sequence Denoising via Sparse and Redundant Representations," IEEE Trans. Image Processing, vol. 18, no. 1, pp. 27-35, Jan. 2009.
[23] L.I. Rudin, S. Osher, and E. Fatemi, "Nonlinear Total Variation Based Noise Removal Algorithms," Physica D, vol. 60, nos. 1-4, pp. 259-268, 1992.
[24] J. Salvi, J. Pages, and J. Batlle, "Pattern Codification Strategies in Structured Light Systems," Pattern Recognition, vol. 37, pp. 827-849, 2004.
[25] A.C. Sankaranarayanan, P.K. Turaga, R.G. Baraniuk, and R. Chellappa, "Compressive Acquisition of Dynamic Scenes," Proc. European Conf. Computer Vision, 2010.
[26] Y.Y. Schechner, S.K. Nayar, and P.N. Belhumeur, "Multiplexing for Optimal Lighting," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 29, no. 8, pp. 1339-1354, Aug. 2007.
[27] W. Schroeder, K. Martin, and B. Lorensen, The Visualization Toolkit: An Object-Oriented Approach to 3D Graphics, fourth ed. Pearson Eduction, Inc., 2006.
[28] P. Sen and S. Darabi, "Compressive Dual Photography," Computer Graphics Forum, vol. 28, no. 2, pp. 609-618, Mar. 2009.
[29] E.P Simoncelli, "Statistical Models for Images: Compression, Restoration and Synthesis," Proc. Asilomar Conf. Signals, Systems and Computers, pp. 673-678, 1997.
[30] D. Takhar, J. Laska, M. Walkin, M. Durate, and D. Baron, "A New Compressive Imaging Camera Architecture Using Optical-Domain Compression," Proc. Computational Imaging IV at SPIE Electronic Imaging, 2006.
[31] B. Trifonov, D. Bradley, and W. Heidrich, "Tomographic Reconstruction of Transparent Objects," Proc. Eurographics Symp. Rendering, pp. 51-60, 2006.
[32] A. Veeraraghavan, D. Reddy, and R. Raskar, "Coded Strobing Photography: Compressive Sensing of High-Speed Periodic Events," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 33, no. 4, pp. 671-686, Apr. 2011.
[33] R. Willett, M. Gehm, and D. Brady, "Multiscale Reconstruction for Computational Spectral Imaging," Proc. Computational Imaging V at SPIE Electronic Imaging, 2007.
[34] J. Wright, A.Y. Yang, A. Ganesh, S.S. Sastry, and Y. Ma, "Robust Face Recognition via Sparse Representation," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 31, no. 2, pp. 210-227, Feb. 2009.
7 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool