This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Multiview Panoramic Cameras Using Mirror Pyramids
July 2004 (vol. 26 no. 7)
pp. 941-946
Hong Hua, IEEE Computer Society

Abstract—A mirror pyramid consists of a set of planar mirror faces arranged around an axis of symmetry and inclined to form a pyramid. By strategically positioning a number of conventional cameras around a mirror pyramid, the viewpoints of the cameras' mirror images can be located at a single point within the pyramid and their optical axes pointed in different directions to effectively form a virtual camera with a panoramic field of view. Mirror pyramid-based panoramic cameras have a number of attractive properties, including single-viewpoint imaging, high resolution, and video rate capture. It is also possible to place multiple viewpoints within a single mirror pyramid, yielding compact designs for simultaneous multiview panoramic video rate imaging. Nalwa [4] first described some of the basic ideas behind mirror pyramid cameras. In this paper, we analyze the general class of multiview panoramic cameras, provide a method for designing these cameras, and present experimental results using a prototype we have developed to validate single-pyramid multiview designs. We first give a description of mirror pyramid cameras, including the imaging geometry, and investigate the relationship between the placement of viewpoints within the pyramid and the cameras' field of view (FOV), using simulations to illustrate the concepts. A method for maximizing sensor utilization in a mirror pyramid-based multiview panoramic camera is also presented. Images acquired using the experimental prototype for two viewpoints are shown.

[1] R. Benosman, S.B. Kang, and O. Faugeras, Panoramic Vision. Springer-Verlag, 2001.
[2] V.S. Nalwa, Stereo Panoramic Viewing System US patent, vol. 6,141,145, 2000.
[3] V.S. Nalwa, Panoramic Viewing System with Offset Virual Optical Centers US patent, vol. 6,219,090, 2001.
[4] V.S. Nalwa, A True Omnidirectional Viewer Bell Laboratories technical report, 1996.
[5] P.I. Anderson, From Telepresence to True Immersive Imaging: Into Real-Life Video-Now! Advanced Imaging, vol. 10, no. 7, pp. 48-50, 1995.
[6] R. Swaminathan and S.K. Nayar, Nonmetric Calibration of Wide-Angle Lenses and Polycameras IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 10, Oct. 2000.
[7] K. Miyamoto, Fish Eye Lens J. Optical Soc. of Am., vol. 64, pp. 1060-1061, 1964.
[8] Y. Xiong and K. Turkowski, Creating Image-Based Virtual Reality Using a Self-Calibrating Fisheye Lens Proc. IEEE Computer Soc. Conf. Computer Vision and Pattern Recognition, 1997.
[9] S. Zimmerman and D. Kuban, A Video Pan/Tilt/Magnify/Rotate System with No Moving Parts Proc. IEEE/AIAA Digital Avionics Systems Conf., 1992.
[10] A. Castano and N. Ahuja, Omnifocused 3D Display Using the Nonfrontal Imaging Camera Proc. Workshop Computer Vision for Virtual Reality Based Human Comm., 1998.
[11] A. Krishnan and N. Ahuja, Range Estimation from Focus Using a Non-Frontal Imaging Camera Proc. Nat'l Conf. Artificial Intelligence, 1993.
[12] A. Krishnan and N. Ahuja, Range Estimation from Focus Using a Nonfrontal Imaging Camera Int'l J. Computer Vision, vol. 20, no. 3, pp. 169-185, 1996.
[13] A. Krishnan and N. Ahuja, “Panoramic Image Acquisition,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 379-384, June 1996.
[14] M. Aggarwal and N. Ahuja, On Generating Seamless Mosaics with Large Depth of Field Proc. Int'l Conf. Pattern Recognition, 2000.
[15] M. Aggarwal and N. Ahuja, A New Imaging Model Proc. IEEE Int'l Conf. Computer Vision, 2001.
[16] M. Aggarwal and N. Ahuja, High Dynamic Range Panoramic Imaging Proc. IEEE Int'l Conf. Computer Vision, 2001.
[17] S. Peleg and J. Herman, “Panoramic Mosaics by Manifold Projection,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 338-343, June 1997.
[18] J.S. Chahl and M.V. Srinivasan, Reflective Surfaces for Panoramic Imaging Applied Optics, vol. 36, no. 31, pp. 8275-8285, 1997.
[19] J.S. Chahl and M.V. Srinivasan, A Complete Panoramic Vision System, Incorporating Imaging, Ranging, and Three Dimensional Navigation Proc. Workshop Omnidirectional Vision, pp. 104-111, 2000.
[20] R.A. Hicks, Reflective Surfaces as Computational Sensors Proc. Workshop Perception for Mobile Agents, 1999.
[21] R.A. Hicks and R. Bajcsy, Catadioptric Sensors that Approximate Wide-Angle Perspective Projections Proc. Workshop Omnidirectional Vision, pp. 97-103, 2000.
[22] H. Ishiguro, M. Yamamoto, and S. Tsuji, Omni-Directional Stereo IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 14, no. 2, pp. 257-262, 1992.
[23] S.K. Nayar, “Catadioptric Omnidirectional Cameras,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 482-488, June 1997.
[24] S.K. Nayar and V. Peri, Folded Catadioptric Cameras Proc. IEEE Computer Soc. Conf. Computer Vision and Pattern Recognition, 1999.
[25] K. Yamazawa, Y. Yagi, and M. Yachida, Omnidirectional Imaging with Hyperboloidal Projection Proc. Int'l Conf. Intelligent Robots and Systems, 1993.
[26] Z. Zhu, K.D. Rajasekar, E.M. Riseman, and A.R. Hanson, Panoramic Virtual Stereo Vision of Cooperative Mobile Robots for Localizing 3D Moving Objects Proc. Workshop Omnidirectional Vision, 2000.
[27] S. Peleg, M. Ben-Ezra, and Y. Pritch, Omnistereo: Panoramic Stereo Imaging IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 3, pp. 279-290, 2001.
[28] T. Kawanishi, et al. Generation of High Resolution Stereo Panoramic Images by Omnidirectional Imaging Sensor Using Hexagonal Pyramidal Mirrors Proc. Int'l Conf. Pattern Recognition, 1998.
[29] H. Hua and N. Ahuja, A Uniform-Resolution Panoramic Camera Proc. IEEE Computer Soc. Conf. Computer Vision and Pattern Recognition, 2001.
[30] K.-H. Tan, H. Hua, and N. Ahuja, Multiview Panoramic Cameras Using a Mirror Pyramid Proc. IEEE Workshop Omnidirectional Vision, 2002.
[31] M. Aggarwal and N. Ahuja, Split Aperture Imaging for High Dynamic Range Proc. IEEE Int'l Conf. Computer Vision, 2001.
[32] S. Coorg, N. Master, and S. Teller, Acquisition of a Large Pose-Mosaic Dataset Proc. IEEE Computer Soc. Conf. Computer Vision and Pattern Recognition, 1998.
[33] S.K. Nayar and A. Karmarkar, 360x360 Mosaics Proc. IEEE Computer Soc. Conf. Computer Vision and Pattern Recognition, 2000.
[34] H.-Y. Shum and R. Szeliski, Panoramic Image Mosaics Microsoft Research Technical Report, vol. MSR-TR-97-23, 1997.
[35] V.S. Nalwa, http:/www.fullview.com, 1999.
[36] Z. Zhang, A Flexible New Technique for Camera Calibration IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 11, pp. 1330-1334, Nov. 2000.

Index Terms:
Panoramic cameras, mirror pyramids, catadioptric systems, omnidirectional imaging and video capture, multiview panoramic imaging, stereoscopic cameras.
Citation:
Kar-Han Tan, Hong Hua, Narendra Ahuja, "Multiview Panoramic Cameras Using Mirror Pyramids," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 26, no. 7, pp. 941-946, July 2004, doi:10.1109/TPAMI.2004.33
Usage of this product signifies your acceptance of the Terms of Use.