The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.12 - December (2011 vol.33)
pp: 2423-2435
Xun Cao , Tsinghua Unviersity, Beijing
Hao Du , University of Washington, Seattle
Xin Tong , Microsoft Research Asia, Beijing
Qionghai Dai , Tsinghua Unviersity, Beijing
Stephen Lin , Microsoft Research Asia, Beijing
ABSTRACT
This paper presents a prism-mask system for capturing multispectral videos. The system is composed of a triangular prism, a monochrome camera, and an occlusion mask. Incoming light beams from the scene are sampled by the occlusion mask, dispersed into their constituent spectra by the triangular prism, and then captured by the monochrome camera. Our system is capable of capturing frames with high spectral resolution at video rates. It also allows for different trade-offs between spectral and spatial resolution by adjusting the focal length of the camera. We demonstrate multispectral video acquisition with various spectral resolutions and spatial resolutions, as well as different frame rates. The effectiveness of our system is further evaluated with several applications, including human skin detection, physical material recognition, video segmentation, RGB video generation, and illumination identification.
INDEX TERMS
Multispectral imaging, multispectral video, prism, occlusion mask.
CITATION
Xun Cao, Hao Du, Xin Tong, Qionghai Dai, Stephen Lin, "A Prism-Mask System for Multispectral Video Acquisition", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.33, no. 12, pp. 2423-2435, December 2011, doi:10.1109/TPAMI.2011.80
REFERENCES
[1] J. James, Spectrograph Design Fundamentals. Cambridge Univ. Press, 2007.
[2] N. Gat, "Imaging Spectoscopy Using Tunable Filters: A Review," Proc. SPIE Conf. Wavelet Appl. VII, vol. 4056, 2000.
[3] Y.Y. Schechner and S.K. Nayar, "Generalized Mosaicing: Wide Field of View Multispectral Imaging," IEEE Trans. Pattern Analayis and Machine Intelligence, vol. 24, no. 10, pp. 1334-1348, Oct. 2002.
[4] M. Descour and E. Dereniak, "Computed-Tomography Imaging Spectrometer: Experimental Calibration and Reconstruction Results," Applied Optics, vol. 34, pp. 4817-4826, 1995.
[5] C. Vandervlugt, H. Masterson, N. Hagen, and E.L. Dereniak, "Reconfigurable Liquid Crystal Dispersing Element for a Computed Tomography Imaging Spectrometer," Proc. Conf. SPIE, vol. 6565, 2007.
[6] M.E. Gehm, S.T. McCain, N.P. Pitsianis, D.J. Brady, P. Potuluri, and M.E. Sullivan, "Static Two-Dimensional Aperture Coding for Multimodal, Multiplex Spectroscopy," Applied Optics, vol. 45, pp. 2965-2974, 2006.
[7] D.J. Brady and M.E. Gehm, "Compressive Imaging Spectrometers Using Coded Apertures," Proc. Conf. SPIE, vol. 6246, 2006.
[8] J.-I. Park, M.-H. Lee, M.D. Grossberg, and S.K. Nayar, "Multispectral Imaging Using Multiplexed Illumination," Proc. IEEE Int'l Conf. Computer Vision, pp. 1-8, 2007.
[9] K. Kidono and Y. Ninomiya, "Visibility Estimation under Night-Time Conditions Using a Multiband Camera," Proc. IEEE Intelligent Vehicles Symp., 2007.
[10] H. Du, X. Tong, X. Cao, and S. Lin, "A Prism-Based System for Multispectral Video Acquisition," Proc. IEEE Int'l Conf. Computer Vision, pp. 175-182, 2009.
[11] M. Yamaguchi, H. Haneishi, H. Fukuda, J. Kishimoto, H. Kanazawa, M. Tsuchida, R. Iwama, and N. Ohyama, "High-Fidelity Video and Still-Image Communication Based on Spectral Information: Natural Vision System and Its Applications," Proc. Conf. SPIE/IS&T Electronic Imaging, vol. 6062, 2006.
[12] M. Rosen and X. Jiang, "Lippmann2000: A Spectral Image Database under Construction," Proc. Int'l Symp. Multispectral Imaging and Color Reproduction for Digital Archives, pp. 117-122, 1999.
[13] H. Morris, C. Hoyt, and P. Treado, "Imaging Spectrometers for Fluorescence and Raman Microscopy: Acousto-Optic and Liquid Crystal Tunable Filters," Proc. Conf. Applied Spectroscopy, vol. 48, pp. 857-866, 1994.
[14] Spectral Imaging LTD, http:/www.specim.fi, 2011.
[15] R.O. Green, M.L. Eastwood, C.M. Sarture, T.G. Chrien, M. Aronsson, B.J. Chippendale, J.A. Faust, B.E. Pavri, C.J. Chovit, M. Solis, M.R. Olah, and O. Williams, "Imaging Spectroscopy and the Airborne Visible Infrared Imaging Spectrometer (AVIRIS)," Proc. Remote Sensing Environment Conf., vol. 65, pp. 227-248, 1998.
[16] E. Herrala, J.T. Okkonen, T.S. Hyvarinen, M. Aikio, and J. Lammasniemi, "Imaging Spectrometer for Process Industry Applications," Proc. Conf. SPIE, vol. 2248, pp. 33-40, 1994.
[17] A. Mohan, R. Raskar, and J. Tumblin, "Agile Spectrum Imaging: Programmable Wavelength Modulation for Cameras and Projectors," Computer Graphics Forum, vol. 27, no. 2, pp. 709-717, 2008.
[18] A.R. Harvey, D. Fletcher-Holmes, and A. Gorman, "Spectral Imaging in a Snapshot," Proc. Conf. SPIE, vol. 5694, 2005.
[19] W. Liu, G. Barbastathis, and D. Psaltis, "Volume Holographic Hyperspectral Imaging," Applied Optics, vol. 43, pp. 3581-3599, 2004.
[20] Z. Li, D. Psaltis, W. Liu, W.R. Johnson, and G. Bearman, "Volume Holographic Spectral Imaging," Proc. Conf. SPIE, vol. 5694, no. 33, Jan. 2005.
[21] D.W. Fletcher-Holmes and A.R. Harvey, "Real-Time Imaging with a Hyperspectral Fovea," J. Optics A: Pure Applied Optics, vol. 7, no. 6, pp. S298-S302, Jun. 2005.
[22] T. Okamoto, A. Takahashi, and I. Yamaguchi, "Simultaneous Acquisition of Spectral and Spatial Intensity Distribution," Applied Spectroscopy, vol. 47, pp. 1198-1202, 1993.
[23] M.R. Descour, C.E. Volin, E.L. Dereniak, T.M. Gleeson, M.F. Hopkins, D.W. Wilson, and P.D. Maker, "Demonstration of a Computed-Tomography Imaging Spectrometer Using a Computer-Generated Hologram Disperser," Applied Optics, vol. 36, pp. 3694-3698, 1997.
[24] J.M. Mooney, V.E. Vickers, M. An, and A.K. Brodzik, "High Throughput Hyperspectral Infrared Camera," J. Optical Soc. Am. A, vol. 14, pp. 2951-2961, 1997.
[25] C. Volin, MWIR Spectrometer Operating Theory. Univ. of Arizona Press, 2000.
[26] W.R. Johnson, D.W. Wilson, and G. Bearman, "Spatial-Spectral Modulating Snapshot Hyperspectral Imager," Applied Optics, vol. 45, pp. 1898-1908, 2006.
[27] N.A. Hagen, E.L. Dereniak, and D.T. Sass, "Maximizing the Resolution of a CTIS Instrument," Proc. Conf. SPIE, vol. 6302, 2006.
[28] N. Hagen and E.L. Dereniak, "Analysis of Computed Tomographic Imaging Spectrometers. I. Spatial and Spectral Resolution," Applied Optics, vol. 47, pp. F85-F95, 2008.
[29] M.J.E. Golay, "Multislit Spectrometry," J. Optical Soc. Am, vol. 39, pp. 437-444, 1949.
[30] S.B. Mende, E.S. Claflin, R.L. Rairden, and G.R. Swenson, "Hadamard Spectroscopy with a Two-Dimensional Detecting Array," Applied Optics, vol. 32, pp. 7095-7105, 1993.
[31] Q. Hanley, P. Verveer, D. Arndt-Jovin, and T. Jovin, "Three Dimensional Spectral Imaging by Hadamard Transform Spectroscopy in a Programmable Array Microscope," J. Microscopy, vol. 197, pp. 5-14, 2000.
[32] M.E. Gehm, R. John, R. Willett, T. Schultz, and D. Brady, "Single-Shot Compressive Spectral Imaging with a Dual Disperser Architecture," Optics Express, vol. 15, pp. 14 013-14 027, 2007.
[33] A. Wagadarikar, R. John, R. Willett, and D. Brady, "Single Disperser Design for Coded Aperture Snapshot Spectral Imaging," Applied Optics, vol. 47, no. 10, pp. B44-B51, 2008.
[34] A.A. Wagadarikar, N.P. Pitsianis, X.B. Sun, and D.J. Brady, "Video Rate Spectral Imaging Using a Coded Aperture Snapshot Spectral Imager," Optics Express, vol. 17, no. 8, pp. 6368-6388, 2009.
[35] J. James, Spectrograph Design Fundamentals. Cambridge Univ. Press, 2007.
[36] J. Allington-Smith, R. Content, and R. Haynes, "New Developments in Integral Field Spectroscopy," Proc. Conf. SPIE, vol. 3355, 1998.
[37] R. Content, "Image Slicer for Integral Field Spectroscopy with Ngst," Proc. Conf. SPIE, vol. 3356, 1998.
[38] Photo Research, "PR-650 Spectra Scan Spectra Colorimeter Instruction Manual," Proc. Conf. Photo Research, 1999.
[39] G.D. Finlayson, S.D. Hordley, and P.M. Morovic, "Using the Spectra Cube to Build a Multispectral Image Database," Proc. Second Computer Graphics, Imaging and Vision Conf. IS and T/STD, Apr. 2004.
[40] D.J. Schroeder, Astronomical Optics. Academic Press, 1987.
[41] Wikipedia, http://en.wikipedia.org/wikiKeystone_effect , 2011.
[42] Wiki, http://en.wikipedia.org/wikiDepth_of_field , 2011.
[43] Wikipedia, http://en.wikipedia.org/wikiFluorescent_lamp , 2011.
[44] E. Angelopoulou, "Understanding the Color of Human Skin," Proc. SPIE Conf. Human Vision and Electronic Imaging, vol. 4299, pp. 243-251, 2001.
[45] N.J.W. Morris, S. Avidan, W. Matusik, and H. Pfister, "Statistics of Infrared Images," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1-7, 2007.
16 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool