This Article 
 Bibliographic References 
 Add to: 
Autostereoscopic 3D Display with Long Visualization Depth Using Referential Viewing Area-Based Integral Photography
November 2011 (vol. 17 no. 11)
pp. 1690-1701
Hongen Liao, The University of Tokyo, Tokyo
Takeyoshi Dohi, The University of Tokyo, Tokyo
Keisuke Nomura, The University of Tokyo, Tokyo
We developed an autostereoscopic display for distant viewing of 3D computer graphics (CG) images without using special viewing glasses or tracking devices. The images are created by employing referential viewing area-based CG image generation and pixel distribution algorithm for integral photography (IP) and integral videography (IV) imaging. CG image rendering is used to generate IP/IV elemental images. The images can be viewed from each viewpoint within a referential viewing area and the elemental images are reconstructed from rendered CG images by pixel redistribution and compensation method. The elemental images are projected onto a screen that is placed at the same referential viewing distance from the lens array as in the image rendering. Photographic film is used to record the elemental images through each lens. The method enables 3D images with a long visualization depth to be viewed from relatively long distances without any apparent influence from deviated or distorted lenses in the array. We succeeded in creating an actual autostereoscopic images with an image depth of several meters in front of and behind the display that appear to have 3D even when viewed from a distance.

[1] M.G. Lippmann, “Preuves Reversibles Donnant La Sensation Du Relief,” J. de Physique, vol. 7, pp. 821-825, 1908.
[2] F. Okano, H. Hoshino, J. Arai, and I. Yuyama, “Realtime Pickup Method for a Three-Dimensional Image Based on Integral Photography,” Applied Optics, vol. 36, pp. 1598-1603, 1997.
[3] J. Arai, F. Okano, H. Hoshino, and I. Yuyama, “Gradient-Index Lens-Array Method Based on Realtime Integral Photography for Three-Dimensional Images,” Applied Optics, vol. 37, pp. 2034-2045, 1998.
[4] Y. Igarashi, H. Murata, and M. Ueda, “3D Display System Using a Computer Generated Integral Photograph,” Japan J. Applied Physics, vol. 17, pp. 1683-1684, 1978.
[5] J.-H. Park, S.-W. Min, S. Jung, and B. Lee, “Analysis of Viewing Parameters for Two Display Methods Based on Integral Photography,” Applied Optics, vol. 40, pp. 5217-5232, 2001.
[6] H. Liao, S. Nakajima, M. Iwahara, E. Kobayashi, I. Sakuma, N. Yahagi, and T. Dohi, “Development of Real-Time 3D Navigation System for Intra-operative Information by Integral Videography;” J. Japan Soc. of Computer Aided Surgery, vol. 2, no. 4, pp. 245-252, 2000.
[7] T. Okoshi, “Optimum Design and Depth Resolution of Lens Sheet and Projection-Type Three-Dimensional Displays,” Applied Optics, vol. 10, pp. 2284-2291, 1971.
[8] H. Hoshino, F. Okano, H. Isono, and I. Yuyama, “Analysis of Resolution Limitation of Integral Photography,” J. Optical Soc. of Am., vol. 15, pp. 2059-2065, 1998.
[9] S. Kishk and B. Javidi, “Improved Resolution 3D Object Sensing and Recognition Using Time Multiplexed Computational Integral Imaging,” Optics Express, vol. 11, pp. 3528-3541, 2003.
[10] J-S. Jang and B. Javidi, “Improved Viewing Resolution of Three-Dimensional Integral Imaging with Nonstationary Micro-Optics,” Optics Letters, vol. 27, pp. 324-326, 2002.
[11] L. Erdmann and K.J. Gabriel, “High-Resolution Digital Integral Photography by Use of a Scanning Microlens Array,” Applied Optics, vol. 40, pp. 5592-5599, 2001.
[12] S.H. Hong and B. Javidi, “Improved Resolution 3D Object Reconstruction Using Computational Integral Imaging with Time Multiplexing,” Optics Express, vol. 12, no. 19, pp. 4579-4588, 2004.
[13] H. Liao, M. Iwahara, N. Hata, I. Sakuma, T. Dohi, T. Koike, Y. Momoi, T. Minakawa, M. Yamasaki, F. Tajima, and H. Takeda, “High-Resolution Integral Videography Autostereoscopic Display Using Multi-Projector,” Proc. Ninth Int'l Display Workshops (IDW' 02), pp. 1229-1232, Dec. 2002.
[14] J.S. Jang and Y.S. Oh, “Spatiotemporally Multiplexed Integral Imaging Projector for Large-Scale High-Resolution Three-Dimensional Display,” Optics Express, vol. 12, no. 4, pp. 557-563, 2004.
[15] H. Liao, M. Iwahara, N. Hata, and T. Dohi, “High-Quality Integral Videography Using a Multi-Projector,” Optics Express, vol. 12, no. 6, pp. 1067-1076, 2004.
[16] H. Choi, S.W Min, S. Jung, J.H. Park, and B. Lee, “Multiple-Viewing-Zone Integral Imaging Using a Dynamic Barrier Array for Three-Dimensional Displays,” Optics Express, vol. 11, no. 8, pp. 927-932, 2003.
[17] B. Lee, S. Jung, and J.H. Park, “Viewing-Angle-Enhanced Integral Imaging by Lens Switching,” Optics Letters, vol. 27, no. 10, pp. 818-820, 2002.
[18] J.-H. Park, S. Jung, H. Choi, and B. Lee, “Viewing-Angle-Enhanced Integral Imaging by Elemental Image Resizing and Elemental Lens Switching,” Applied Optics, vol. 41, pp. 6875-6883, 2002.
[19] S.-W. Min, S. Jung, J.-H. Park, and B. Lee, “Study for Wide-Viewing Integral Photography Using an Aspheric Fresnel-Lens Array,” Optical Eng. vol. 41, pp. 2572-2576, 2002.
[20] S. Jung, J.-H. Park, H. Choi, and B. Lee, “Wide-Viewing Integral Three-Dimensional Imaging by Use of Orthogonal Polarization Switching,” Applied Optics, vol. 42, pp. 2513-2520, 2003.
[21] H. Choi, Y. Kim, J.H. Park, J. Kim, S.W. Cho, and B. Lee, “Layered-Panel Integral Imaging without the Translucent Problem,” Optics Express, vol. 13, no. 15, pp. 5769-5776, July 2005.
[22] H. Choi, J.H. Park, J. Hong, and Y. Lee, “Depth-Enhanced Integral Imaging with a Stepped Lens Array or a Composite Lens Array for Three-Dimensional Display,” Japanese J. Applied Physics Part 1-Regular Papers, Short Noets, and Rev. Papers, vol. 43, no. 8A, pp. 5330-5336, 2004.
[23] M. Martinez-Corral, B. Javidi, R. Martinez-Cuenca, and G. Saavedra, “Integral Imaging with Improved Depth of Field by Use of Amplitude-Modulated Microlens Arrays,” Applied Optics, vol. 43, no. 31, pp. 5806-5813, 2004.
[24] R. Martinez-Cuenca, G. Saavedra, M. Martinez-Corral, and B. Javidi, “Enhanced Depth of Field Integral Imaging with Sensor Resolution Constraints,” Optics Express, vol. 12, no. 21, pp. 5237-5242, 2004.
[25] J.H. Park, S. Jung, H. Choi, and B. Lee, “Integral Imaging with Multiple Image Planes Using a Uniaxial Crystal Plate,” Optics Express, vol. 11, pp. 1862-1873, 2003.
[26] J. Hong, J.H. Park, S. Jung, and B. Lee, “Depth-Enhanced Integral Imaging by Use of Optical Path Control,” Optics Letters, vol. 29, no. 15, pp. 1790-1792, 2004.
[27] S.W. Min, B. Javidi, and B. lee, “Enhanced Three-Dimensional Integral Imaging System by Use of Double Display Devices,” Applied Optics, vol. 42, pp. 4186-4159, 2003.
[28] H. Liao, M. Iwahara, Y. Katayama, N. Hata, and T. Dohi, “Three-Dimensional Display with a Long Viewing Distance by Use of Integral Photography,” Optics Letter, vol. 30, no. 6, pp. 613-615, Mar. 2005.
[29] M. Levoy and P. Hanrahan, “Light Field Rendering,” Proc. ACM SIGGRAPH '96, pp. 31-42, 1996.
[30] S.J. Gortler, R. Grzeszczuk, R. Szeliski, and M.F. Cohen, “The Lumigraph,” Proc. 23rd Ann. Conf. Computer Graphics and Interactive Techniques (SIGGRAPH '96), pp. 43-54, 1996.
[31] T. Naemura, T. Yoshida, and H. Harashima, “3D Computer Graphics Based on Integral Photography,” Optics Express, vol. 8, no. 2, pp. 255-262, 2001.
[32] H. Liao, D. Tamura, M. Iwahara, N. Hata, and T. Dohi, “High Quality Autostereoscopic Surgical Display of Integral Videography Imaging,” Proc. Seventh Int'l Conf. Medical Image Computing and Computer-Assisted Intervention (MICCAI '04), pp. 462-469, Sept. 2004.
[33] H.E. Ives, “Optical Properties of a Lippmann Lenticulated Sheet,” J. Optical Soc. of Am. vol. 21, pp. 170-176, 1931.
[34] C.B. Burckhardt, R.J. Collier, and E.T. Doherty, “Formation and Inversion of Pseudoscopic Images,” Applied Optics vol.7, no. 3, pp. 627-631, 1968.
[35] H. Liao, M. Iwahara, T. Koike, Y. Momoi, N. Hata, I. Sakuma, and T. Dohi, “Scalable High-Resolution Integral Videography Autostereoscopic Display by Use of Seamless Multi-Projection,” Applied Optics, vol. 44, no. 3, pp. 305-315, Jan. 2005.
[36] A. Stern and B. Javidi, “Three-Dimensional Image Sensing and Reconstruction with Time-Division Multiplexed Computational Integral Imaging,” Applied Optics, vol. 42, no. 35, pp.7036-7042, 2003.
[37] H. Liao, N. Hata, S. Nakajima, M. Iwahara, I. Sakuma, and T. Dohi, “Surgical Navigation by Autostereoscopic Image Overlay of Integral Videography,” IEEE Trans. Information Technology in Biomedicine, vol. 8, no. 2, pp. 114-121, June 2004.
[38] H. Liao, T. Inomata, I. Sakuma, and T. Dohi, “3D Augmented Reality for MRI-guided Surgery Using Integral Videography Autostereoscopic Image Overlay,” IEEE Trans. Biomedical Eng., vol. 57, no. 6, pp. 1476-1486, June 2010.

Index Terms:
Autostereoscopic display, 3D, integral photography, integral videography, long visualization depth, referential viewing area, computer graphics.
Hongen Liao, Takeyoshi Dohi, Keisuke Nomura, "Autostereoscopic 3D Display with Long Visualization Depth Using Referential Viewing Area-Based Integral Photography," IEEE Transactions on Visualization and Computer Graphics, vol. 17, no. 11, pp. 1690-1701, Nov. 2011, doi:10.1109/TVCG.2010.267
Usage of this product signifies your acceptance of the Terms of Use.