The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.04 - April (2013 vol.19)
pp: 576-582
M. Knecht , Vienna Univ. of Technol., Vienna, Austria
C. Traxler , VRVis - Zentrum fur Virtual Reality und Visualisierung Forschungs-GmbH, Germany
C. Winklhofer , Vienna Univ. of Technol., Vienna, Austria
M. Wimmer , Vienna Univ. of Technol., Vienna, Austria
ABSTRACT
In this paper, we present a novel rendering method which integrates reflective or refractive objects into a differential instant radiosity (DIR) framework usable for mixed-reality (MR) applications. This kind of objects are very special from the light interaction point of view, as they reflect and refract incident rays. Therefore they may cause high-frequency lighting effects known as caustics. Using instant-radiosity (IR) methods to approximate these high-frequency lighting effects would require a large amount of virtual point lights (VPLs) and is therefore not desirable due to real-time constraints. Instead, our approach combines differential instant radiosity with three other methods. One method handles more accurate reflections compared to simple cubemaps by using impostors. Another method is able to calculate two refractions in real-time, and the third method uses small quads to create caustic effects. Our proposed method replaces parts in light paths that belong to reflective or refractive objects using these three methods and thus tightly integrates into DIR. In contrast to previous methods which introduce reflective or refractive objects into MR scenarios, our method produces caustics that also emit additional indirect light. The method runs at real-time frame rates, and the results show that reflective and refractive objects with caustics improve the overall impression for MR scenarios.
INDEX TERMS
Virtual reality, Image color analysis, Rendering (computer graphics), Lighting, Equations, Cameras, Streaming media,caustics., Mixed reality, reflections, refractions
CITATION
M. Knecht, C. Traxler, C. Winklhofer, M. Wimmer, "Reflective and Refractive Objects for Mixed Reality", IEEE Transactions on Visualization & Computer Graphics, vol.19, no. 4, pp. 576-582, April 2013, doi:10.1109/TVCG.2013.39
REFERENCES
[1] T. Akenine-Möller, E. Haines,, and N. Hoffman., Real-Time Rendering 3rd Edition. A. K. Peters, Ltd., Natick, MA, USA, 2008.
[2] C. Dachsbacher and M. Stamminger., Reflective shadow maps. In Proceedings of the 2005 symposium on Interactive 3D graphics and games, I3D '05, pages 203-231, New York, NY, USA, 2005. ACM.
[3] C. Dachsbacher and M. Stamminger., Splatting indirect illumination. In Proceedings of the 2006 symposium on Interactive 3D graphics and games, I3D '06, pages 93-100, New York, NY, USA, 2006. ACM.
[4] P. Debevec., Rendering synthetic objects into real scenes: bridging traditional and image-based graphics with global illumination and high dynamic range photography. In Proceedings of the 25th annual conference on Computer graphics and interactive techniques, SIGGRAPH '98, pages 189-198, New York, NY, USA, 1998. ACM.
[5] T. Grosch., Differential photon mapping: Consistent augmentation of photographs with correction of all light paths. In Eurographics 2005 Short Papers, pages 53-56, Trinity College, Dublin, Ireland, 2005. Eurographics Association.
[6] P. S. Heckbert., Simulating Global Illumination Using Adaptive Meshing. PhD thesis, EECS Department, University of California, June 1991.
[7] K. Jacobs and C. Loscos., Classification of illumination methods for mixed-reality. Computer Graphics Forum, 25: 29-51, March 2006.
[8] P. Kán and H. Kaufmann., High-quality reflections, refractions, and caustics in augmented reality and their contribution to visual coherence. In Proceedings of International Symposium on Mixed and Augmented Reality (ISMAR). ACM Press, 2012.
[9] K. Karsch, V. Hedau, D. Forsyth,, and D. Hoiem., Rendering synthetic objects into legacy photographs. In Proceedings of the 2011 SIGGRAPH Asia Conference, SA '11, pages 157:1-157:12, New York, NY, USA, 2011. ACM.
[10] A. Keller., Instant radiosity. In Proceedings of the 24th annual conference on Computer graphics and interactive techniques, SIGGRAPH '97, pages 49-56, New York, NY, USA, 1997. ACM Press/Addison-Wesley Publishing Co.
[11] M. Knecht, C. Traxler, O. Mattausch, W. Purgathofer,, and M. Wimmer., Differential instant radiosity for mixed reality. In Proceedings of the 9th IEEE International Symposium on Mixed and Augmented Reality, ISMAR '10, pages 99-108, Washington, DC, USA, 2010. IEEE Computer Society.
[12] M. Knecht, C. Traxler, O. Mattausch,, and M. Wimmer., Reciprocal shading for mixed reality. Computers & Graphics, 36(7): 846-856, Nov. 2012.
[13] G. Nichols and C. Wyman., Interactive indirect illumination using adaptive multiresolution splatting. IEEE Transactions on Visualization and Computer Graphics, 16(5): 729-741, Sept. 2010.
[14] S. A. Pessoa,G. de S. Moura, J. P. S. M. Lima, V. Teichrieb,, and J. Kelner., Photorealistic rendering for augmented reality: A global illumination and brdf solution. In VR'10, pages 3-10, 2010.
[15] S. Pirk., Gpu-based rendering of reflective and refractive objects in augmented reality environments. Master's thesis, University of Applied Sciences, Oldenburg, Germany, 2007.
[16] V. Popescu, C. Mei, J. Dauble,, and E. Sacks., Reflected-scene impostors for realistic reflections at interactive rates. Computer Graphics Forum, 25(3): 313-322, 2006.
[17] M. A. Shah, J. Konttinen,, and S. Pattanaik., Caustics mapping: An imagespace technique for real-time caustics. IEEE Transactions on Visualization and Computer Graphics, 13(2): 272-280, Mar. 2007.
[18] A. State, G. Hirota, D. T. Chen, W. F. Garrett,, and M. A. Livingston., Superior augmented reality registration by integrating landmark tracking and magnetic tracking. In Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, SIGGRAPH '96, pages 429-438, New York, NY, USA, 1996. ACM.
[19] T. Tawara and K. Ono., An application of photo realistic water surface interaction using mixed reality. In H. Prautzsch, A. A. Schmitt, J. Bender, and M. Teschner, editors, VRIPHYS, pages 59-65. Eurographics Association. 2009.
[20] T. Umenhoffer, G. Patow, and L. Szirmay-Kalos., Robust multiple specular reflections and refractions. In H. Nguyen, editor, GPU Gems 3, pages 387-407. Addison-Wesley, 2008.
[21] Y. Uranishi, A. Ihara, H. Sasaki, Y. Manabe,, and K. Chihara., Real-time representation of inter-reflection for cubic marker. In Proceedings of the 2009 8th IEEE International Symposium on Mixed and Augmented Reality, ISMAR '09, pages 217-218, Washington, DC, USA, 2009. IEEE Computer Society.
[22] C. Wyman., Interactive image-space refraction of nearby geometry. In Proceedings of the 3rd international conference on Computer graphics and interactive techniques in Australasia and South East Asia, GRAPHITE '05, pages 205-211, New York, NY, USA, 2005. ACM.
[23] C. Wyman., Hierarchical caustic maps. In Proceedings of the 2008 symposium on Interactive 3D graphics and games, I3D '08, pages 163-171, New York, NY, USA, 2008. ACM.
[24] C. Wyman and S. Davis., Interactive image-space techniques for approximating caustics. In Proceedings of the 2006 symposium on Interactive 3D graphics and games, I3D '06, pages 153-160, New York, NY, USA, 2006. ACM.
[25] C. Wyman and G. Nichols., Adaptive caustic maps using deferred shading. Computer Graphics Forum, 28(2): 309-318, 2009.
7 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool