This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Generalized Mosaicing: Polarization Panorama
April 2005 (vol. 27 no. 4)
pp. 631-636
Yoav Y. Schechner, IEEE Computer Society
We present an approach to image the polarization state of object points in a wide field of view, while enhancing the radiometric dynamic range of imaging systems by generalizing image mosaicing. The approach is biologically-inspired, as it emulates spatially varying polarization sensitivity of some animals. In our method, a spatially varying polarization and attenuation filter is rigidly attached to a camera. As the system moves, it senses each scene point multiple times, each time filtering it through a different filter polarizing angle, polarizance, and transmittance. Polarization is an additional dimension of the generalized mosaicing paradigm, which has recently yielded high dynamic range images and multispectral images in a wide field of view using other kinds of filters. The image acquisition is as easy as in traditional image mosaics. The computational algorithm can easily handle nonideal polarization filters (partial polarizers), variable exposures, and saturation in a single framework. The resulting mosaic represents the polarization state at each scene point. Using data acquired by this method, we demonstrate attenuation and enhancement of specular reflections and semireflection separation in an image mosaic.

[1] M. Aggarwal and N. Ahuja, “High Dynamic Range Panoramic Imaging,” Proc. IEEE Int'l Conf. Computer Vision, vol. 1, pp. 2-9, July 2001.
[2] F.M. Candocia, “Jointly Registering Images in Domain and Range by Piecewise Linear Comparametric Analysis,” IEEE Trans. Image Processing, vol. 12, pp. 409-419, Apr. 2003.
[3] F.M. Candocia, “Simultaneous Homographic and Comparametric Alignment of Multiple Exposure-Adjusted Pictures of the Same Scene,” IEEE Trans. Image Processing, vol. 12, pp. 1458-1494, Dec. 2003.
[4] D. Capel and A. Zisserman, “Automated Mosaicing with Super-Resolution Zoom,” Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, pp. 885-891, June 1998.
[5] R.A. Chipman, “Polarimetry,” Handbook of Optics, M. Bass, ed., second ed., vol. 2, chapter 22, New York: McGraw-Hill, 1995.
[6] S. Coorg and S. Teller, “Spherical Mosaics with Quaternions and Dense Correlation,” Int'l J. Computer Vision, vol. 37, pp. 259-273, June 2000.
[7] T.W. Cronin and J. Marshall, “Parallel Processing and Image Analysis in the Eyes of the Mantis Shrimp,” Biology Bull., vol. 200, pp. 177-183, Apr. 2001.
[8] T.W. Cronin, N. Shashar, R. Caldwell, J. Marshall, A.G. Cheroske, and T.H. Chiou, “Polarization Vision and Its Role in Biological Signaling,” Integrative and Comperative Biology, vol. 43, pp. 549-558, Aug. 2003.
[9] T.W. Cronin, N. Shashar, and L. Wolff, “Portable Imaging Polarimeters,” Proc. Int'l Conf. Pattern Recognition, vol. 1, pp. 606-609, Oct. 1994.
[10] S.G. Demos and R.R. Alfano, “Optical Polarization Imaging,” Applied Optics, vol. 36, pp. 150-155, Jan. 1997.
[11] L.J. Denes, M. Gottlieb, B. Kaminsky, and P. Metes, “AOTF Polarization Difference Imaging,” Proc. SPIE, vol. 3584, pp. 106-115, 1999.
[12] M. Eckmann and T.E. Boult, “Tubular Mosaics [Path Planning],” Proc. SPIE, vol. 4195, pp. 192-203, 2001.
[13] R. Eustice, O. Pizarro, H. Singh, and J. Howland, “UWIT: Underwater Image Toolbox for Optical Image Processing and Mosaicing in MATLAB,” Proc. IEEE Int'l Symp. Underwater Technology, pp. 141-145, Apr. 2002.
[14] H. Farid and E.H. Adelson, “Separating Reflections from Images by Use of Independent Component Analysis,” J. Optical Soc. Am. A, vol. 16, no. 2136-2145, Sept. 1999.
[15] R. Garcia, J. Batlle, X. Cufi, and J. Amat, “Positioning an Underwater Vehicle through Image Mosaicing,” Proc. IEEE Int'l Conf. Robotics and Automation, pp. 2779-2784, May 2001.
[16] A.S. Glassner, Principles of Digital Image Synthesis, appendix G.4, Morgan-Kaufmann, 1995.
[17] C.K. Harnett and H.G. Craighead, “Liquid-Crystal Micropolarizer Array for Polarization-Difference Imaging,” Applied Optics, vol. 41, pp. 1291-1296, Mar. 2002.
[18] S. Harsdorf, R. Reuter, and S. Tönebön, “Contrast-Enhanced Optical Imaging of Submersible Targets,” Proc. SPIE, vol. 3821, pp. 378-383, 1999.
[19] Hermanto, A.K. Barros, T. Yamamura, and N. Ohnishi, “Separating Virtual and Real Objects Using Independent Component Analysis,” IEICE Trans. Information and Systems, vol. E84-D, no. 9, pp. 1241-1248, Sept. 2001.
[20] S. Hsu, H.S. Sawhney, and R. Kumar, “Automated Mosaics via Topology Inference,” IEEE Computer Graphics and Application, vol. 22, no. 2, pp. 44-54, Mar./Apr. 2002.
[21] M. Irani and P. Anandan, “Robust Multi-Sensor Image Alignment,” Proc. IEEE Int'l Conf. Computer Vision, pp. 959-966, Jan. 1998.
[22] M. Irani, P. Anandan, J. Bergen, R. Kumar, and S. Hsu, “Efficient Representations of Video Sequences and Their Application,” Signal Processing: Image Comm., vol. 8, pp. 327-351, May 1996.
[23] G.P. Können, Polarized Light in Nature. Cambridge Univ. Press, 1985.
[24] S. Lin and S.W. Lee, “Detection of Specularity Using Stereo in Color and Polarization Space,” Computer Vision and Image Understanding, vol. 65, pp. 336-346, Feb. 1997.
[25] S. Mann, “Joint Parameter Estimation in Both Domain and Range of Functions in Same Orbit of the Projective-Wyckoff Group,” Proc. IEEE Int'l Conf. Image Processing, pp. 193-196, Sept. 1996.
[26] H. Nicolas, “New Methods for Dynamic Mosaicing,” IEEE Trans. Image Processing, vol. 10, pp. 1239-1251, Aug. 2001.
[27] S.K. Nayar, X.S. Fang, and T. Boult, “Separation of Reflection Components Using Color and Polarization,” Int'l J. Computer Vision, vol. 21, pp. 163-186, Feb. 1997.
[28] S. Negahdaripour, X. Xu, A. Khemene, and Z. Awan, “3-D Motion and Depth Estimation from Sea-Floor Images for Mosaic-Based Station-Keeping and Navigation of ROV's/AUV's and High-Resolution Sea-Floor Mapping,” Proc. IEEE Workshop Autonomous Underwater Vehicles, pp. 191-200, Aug. 1998.
[29] S. Peleg, M. Ben-Ezra, and Y. Pritch, “Omnistereo: Panoramic Stereo Imaging,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 3, pp. 279-290, Mar. 2001.
[30] S. Rahmann and N. Canterakis, “Reconstruction of Specular Surfaces Using Polarization Imaging,” Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 149-155, Dec. 2001.
[31] M. Saito, Y. Sato, K. Ikeuchi, and H. Kashiwagi, “Measurement of Surface Orientations of Transparent Objects by Use of Polarization in Highlight,” J. Optical Soc. Am. A, vol. 16, pp. 2286-2293, Sept. 1999.
[32] H.S. Sawhney, R. Kumar, G. Gendel, J. Bergen, D. Dixon, and V. Paragano, “VideoBrush: Experiences with Consumer Video Mosaicing,” Proc. IEEE Workshop Applications of Computer Vision, pp. 52-62, Oct. 1998.
[33] Y.Y. Schechner and N. Karpel, “Clear Underwater Vision,” Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 536-543, June 2004.
[34] Y.Y. Schechner, N. Kiryati, and J. Shamir, “Separation of Transparent Layers by Polarization Analysis,” Proc. Scandinavian Conf. Image Analysis, vol. 1, pp. 235-242, June 1999.
[35] Y.Y. Schechner, S.G. Narasimhan, and S.K. Nayar, “Instant Dehazing of Images Using Polarization,” Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 325-332, Dec. 2001.
[36] Y.Y. Schechner and S.K. Nayar, “Generalized Mosaicing,” Proc. IEEE Int'l Conf. Computer Vision, vol. 1, pp. 17-24, July 2001.
[37] Y.Y. Schechner and S.K. Nayar, “Generalized Mosaicing: Wide Field of View Multispectral Imaging,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 10, pp. 1334-1348, Oct. 2002.
[38] Y.Y. Schechner and S.K. Nayar, “Generalized Mosaicing: High Dynamic Range in a Wide Field of View,” Int'l J. Computer Vision, vol. 53, pp. 245-267, Aug. 2003.
[39] Y.Y. Schechner, J. Shamir, and N. Kiryati, “Polarization and Statistical Analysis of Scenes Containing a Semireflector,” J. Optical Soc. Am. A, vol. 17, pp. 276-284, Feb. 2000.
[40] H.Y. Shum and R. Szeliski, “Systems and Experiment Paper: Construction of Panoramic Image Mosaics with Global and Local Alignment, ” Int'l J. Computer Vision, vol. 36, pp. 101-130, Feb. 2000.
[41] W.A. Shurcliff and S.S. Ballard, Polarized Light. D. van Nostrand Co., 1964.
[42] A.M. Shutov, “Videopolarimeters,” Soviet J. Optical Technology, vol. 60, pp. 295-301, May 1993.
[43] A. Smolić and T. Wiegand, “High-Resolution Image Mosaicing,” Proc. IEEE Int'l Conf. Image Processing, vol. 3, pp. 872-875, Oct. 2001.
[44] R. Szeliski, “Image Mosaicing for Telereality Applications,” Proc. IEEE Workshop Applications of Computer Vision, pp. 44-53, Dec. 1994.
[45] J.S. Talyor Jr. and L.B. Wolff, “Partial Polarization Signature Results from the Field Testing of the Shallow Water Real-Time Imaging Polarimeter (SHRIMP),” MTS/IEEE Oceans, vol. 1, pp. 107-116, Nov. 2001.
[46] J.S. Tyo, M.P. Rowe, E.N. Pugh Jr., and N. Engheta, “Target Detection in Optically Scattering Media by Polarization-Difference Imaging,” Applied Optics, vol. 35, pp. 1855-1870, Apr. 1996.
[47] J.M. Uson, S.P. Boughn, and J.R. Kuhn, “The Central Galaxy in Abell 2029: An Old Supergiant,” Science, vol. 250, pp. 539-540, Oct. 1990.
[48] A.R. Vasavada, A.P. Ingersoll, D. Banfield, M. Bell, P.J. Gierasch, and M.J.S. Belton, “Galileo Imaging of Jupiter's Atmosphere: The Great Red Spot, Equatorial Region, and White Ovals,” Icarus, vol. 135, no. 265-275, Sept. 1998.
[49] P. Viola and W.M. Wells III, “Alignment by Maximization of Mutual Information,” Int'l J. Computer Vision, vol. 24, pp. 137-154, Sept. 1997.
[50] A.M. Wallace, B. Laing, E. Trucco, and J. Clark, “Improving Depth Image Acquisition Using Polarized Light,” Int'l J. Computer Vision, vol. 32, pp. 87-109, Sept. 1999.
[51] L.B. Wolff, “Polarization Camera for Computer Vision with a Beam Splitter,” J. Optical Soc. Am. A, vol. 11, no. 11, pp. 2935-2945, Nov. 1994.
[52] L.B. Wolff, “Polarization Vision: A New Sensory Approach to Image Understanding,” Image and Vision Computing, vol. 15, pp. 81-93, Feb. 1997.

Index Terms:
Mosaicing, color, image fusion, physics-based vision, illumination, transparent layers, biology-inspired.
Citation:
Yoav Y. Schechner, Shree K. Nayar, "Generalized Mosaicing: Polarization Panorama," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 27, no. 4, pp. 631-636, April 2005, doi:10.1109/TPAMI.2005.79
Usage of this product signifies your acceptance of the Terms of Use.