This Article 
 Bibliographic References 
 Add to: 
Real-Time Depth-of-Field Rendering Using Anisotropically Filtered Mipmap Interpolation
May/June 2009 (vol. 15 no. 3)
pp. 453-464
Sungkil Lee, Pohang University of Science and Technology (POSTECH), Pohang
Gerard Jounghyun Kim, Korea University, Seoul
Seungmoon Choi, Pohang University of Science and Technology (POSTECH), Pohang
This article presents a real-time GPU-based post-filtering method for rendering acceptable depth-of-field effects suited for virtual reality. Blurring is achieved by nonlinearly interpolating mipmap images generated from a pinhole image. Major artifacts common in the post-filtering techniques such as bilinear magnification artifact, intensity leakage, and blurring discontinuity are practically eliminated via magnification with a circular filter, anisotropic mipmapping, and smoothing of blurring degrees. The whole framework is accelerated using GPU programs for constant and scalable real-time performance required for virtual reality. We also compare our method to recent GPU-based methods in terms of image quality and rendering performance.

[1] E.B. Goldstein, Sensation and Perception, fifth ed. Brooks/Cole, 1998.
[2] B. Erickson and F. Romano, Professional Digital Photography. Prentice Hall, 1999.
[3] B. London, J. Upton, and B. Brill, Photography. Prentice Hall, 2002.
[4] J. Marshall, C. Burbeck, D. Ariely, J. Rolland, and K. Martin, “Occlusion Edge Blur: A Cue to Relative Visual Depth,” J. Optical Soc. Am., vol. 13, pp. 681-688, 1996.
[5] G. Mather, “The Use of Image Blur as a Depth Cue,” Perception, vol. 26, pp. 1147-1158, 1997.
[6] J. Demers, “Depth of Field in the ‘Toys’ Demo,” Proc. Game Developers Conf. (GDC), 2003.
[7] G. Riguer, N. Tatarchuk, and J. Isidoro, “Real-Time Depth of Field Simulation,” $ShaderX^{2}$ : Shader Programming Tips and Tricks with DirectX 9, W.F. Engel, ed., chapter 4, pp. 529-556, Wordware, 2003.
[8] T. Scheuermann, “Advanced Depth of Field,” Proc. Game Developers Conf. (GDC), 2004.
[9] D. Gillham, “Real-Time Depth-of-Field Implemented with a Postprocessing-Only Technique,” $ShaderX^{5}$ : Advanced Rendering Techniques, W. Engel, ed., chapter 3.1, pp.163-175, Charles River Media, 2006.
[10] J. Hammon, “Practical Post-Process Depth of Field,” GPU Gems 3, H. Nguyen, ed, chapter 28, pp. 583-606, Addison-Wesley, 2007.
[11] M. Potmesil and I. Chakravarty, “A Lens and Aperture Camera Model for Synthetic Image Generation,” Proc. ACM SIGGRAPH '81, vol. 15, no. 3, pp. 297-305, 1981.
[12] M. Bertalmío, P. Fort, and D. Sánchez-Crespo, “Real-Time, Accurate Depth of Field Using Anisotropic Diffusion and Programmable Graphics Cards,” Proc. Second Int'l Symp. 3D DataProcessing, Visualization, and Transmission (3DPVT '04), pp.767-773, 2004.
[13] M. Kass, A. Lefohn, and J. Owens, “Interactive Depth of Field Using Simulated Diffusion on a GPU,” technical report, Pixar Animation Studios, 2006.
[14] T.J. Kosloff and B.A. Barsky, “An Algorithm for Rendering Generalized Depth of Field Effects Based on Simulated Heat Diffusion,” Proc. Int'l Conf. Computational Science and Its Applications (ICCSA '07), pp. 1124-1140, 2007.
[15] P. Perona and J. Malik, “Scale-Space and Edge Detection Using Anisotropic Diffusion,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 12, no. 7, pp. 629-639, July 1990.
[16] S.T. Acton, “Edge Enhancement of Infrared Imagery by Way of the Anisotropic Diffusion Pyramid,” Proc. IEEE Int'l Conf. Image Processing (ICIP '96), pp. 865-868, 1996.
[17] P. Fearing, “Importance Ordering for Real-Time Depth of Field,” Proc. Third Int'l Computer Science Conf. Image Analysis Applications and Computer Graphics (ICSC '96), pp. 372-380, 1996.
[18] R.L. Cook, T. Porter, and L. Carpenter, “Distributed Ray Tracing,” Computer Graphics, vol. 18, no. 3, pp. 137-145, July 1984.
[19] P. Haeberli and K. Akeley, “The Accumulation Buffer: Hardware Support for High-Quality Rendering,” Proc. ACM SIGGRAPH '90, pp. 309-318, 1990.
[20] M. Shinya, “Post-Filtering for Depth of Field Simulation with RayDistribution Buffer,” Proc. Graphics Interface Conf. (GI '94), pp.59-66, May 1994.
[21] P. Rokita, “Generating Depth-of-Field Effects in Virtual Reality Applications,” IEEE Computer Graphics and Its Application, vol. 16, no. 2, pp. 18-21, 1996.
[22] J.D. Mulder and R. van Liere, “Fast Perception-Based Depth of Field Rendering,” Proc. ACM Symp. Virtual Reality Software and Technology (VRST '00), pp. 129-133, 2000.
[23] T. Zhou, J.X. Chen, and M. Pullen, “Accurate Depth of Field Simulation in Real Time,” Computer Graphics Forum, vol. 26, no. 1, 2007.
[24] C. Scofíeld, “2.5d Depth-of-Field Simulation for Computer Animation,” Graphics Gems III, D. Kirk, ed., chapter 1.8, pp. 36-38, Morgan Kauffman, 1994.
[25] B.A. Barsky, A.W. Bargteil, D.D. Garcia, and S.A. Klein, “Introducing Vision-Realistic Rendering,” Proc. Eurographics Rendering Workshop, pp. 26-28, 2002.
[26] B.A. Barsky, “Vision-Realistic Rendering: Simulation of the Scanned Foveal Image from Wavefront Data of Human Subjects,” Proc. First Symp. Applied Perception in Graphics and Visualization (APGV '04), pp. 73-81, 2004.
[27] M. Kraus and M. Strengert, “Depth-of-Field Rendering by Pyramidal Image Processing,” Computer Graphics Forum, vol. 26, no. 3, 2007.
[28] B. Barsky, M. Tobias, D. Chu, and D. Horn, “Elimination of Artifacts Due to Occlusion and Discretization Problems in Image Space Blurring Techniques,” Graphical Models, vol. 67, pp. 584-599, 2005.
[29] Y. LeGrand, Light, Color and Vision, second ed. Chapman and Hall, 1968.
[30] Y.C. Chen, “Lens Effect on Synthetic Image Generation Based on Light Particle Theory,” The Visual Computer, vol. 3, no. 3, pp. 125-136, 1987.
[31] K. Bjorke, “High-Quality Filtering,” GPU Gems: Programming Techniques, Tips and Tricks for Real-Time Graphics, R. Fernando, ed., chapter 24, pp. 391-415, Addison-Wesley Professional, 2004.
[32] V. Aurich and J. Weule, “Non-Linear Gaussian Filters Performing Edge Preserving Diffusion,” Proc. 17th DAGM-Symp., pp. 538-545, 1995.
[33] S. Smith and J. Brady, “Susan—A New Approach to Low Level Image Processing,” Int'l J. Computer Vision, vol. 23, no. 1, pp. 45-78, 1997.
[34] J. Kessenich, D. Baldwin, and R. Rost, The OpenGL Shading Language, version 1.10.59, 3Dlabs, 2004.
[35] G. Mather and D.R. Smith, “Blur Discrimination and Its Relation to Blur-Mediated Depth Perception,” Perception, vol. 31, no. 10, pp.1211-1219, 2002.
[36] H.M. Merklinger, “A Technical View of Bokeh,” Photo Techniques, 1997.
[37] J. Buhler and D. Wexler, “A Phenomenological Model for Bokeh Rendering,” ACM SIGGRAPH Abstracts and Applications, 2002.
[38] S. Lee, G.J. Kim, and S. Choi, “Real-Time Tracking of Visually Attended Objects in Virtual Environments and Its Application to LOD,” IEEE Trans. Visualization and Computer Graphics, vol. 15, no. 1, pp. 6-19, Jan./Feb. 2009.
[39] Taschen, 500 3D Objects, 2002.

Index Terms:
Picture/Image Generation, Three-Dimensional Graphics and Realism
Sungkil Lee, Gerard Jounghyun Kim, Seungmoon Choi, "Real-Time Depth-of-Field Rendering Using Anisotropically Filtered Mipmap Interpolation," IEEE Transactions on Visualization and Computer Graphics, vol. 15, no. 3, pp. 453-464, May-June 2009, doi:10.1109/TVCG.2008.106
Usage of this product signifies your acceptance of the Terms of Use.