The Community for Technology Leaders
RSS Icon
Issue No.01 - January (2011 vol.17)
pp: 38-50
Yu Sheng , Rensselaer Polytechnic Institute, Troy, NY
Theodore C. Yapo , Rensselaer Polytechnic Institute, Troy, NY
Christopher Young , Rensselaer Polytechnic Institute, Troy, NY
Barbara Cutler , Rensselaer Polytechnic Institute, Troy, NY
We present an application of interactive global illumination and spatially augmented reality to architectural daylight modeling that allows designers to explore alternative designs and new technologies for improving the sustainability of their buildings. Images of a model in the real world, captured by a camera above the scene, are processed to construct a virtual 3D model. To achieve interactive rendering rates, we use a hybrid rendering technique, leveraging radiosity to simulate the interreflectance between diffuse patches and shadow volumes to generate per-pixel direct illumination. The rendered images are then projected on the real model by four calibrated projectors to help users study the daylighting illumination. The virtual heliodon is a physical design environment in which multiple designers, a designer and a client, or a teacher and students can gather to experience animated visualizations of the natural illumination within a proposed design by controlling the time of day, season, and climate. Furthermore, participants may interactively redesign the geometry and materials of the space by manipulating physical design elements and see the updated lighting simulation.
Spatially augmented reality, global illumination, radiosity, and daylighting design.
Yu Sheng, Theodore C. Yapo, Christopher Young, Barbara Cutler, "A Spatially Augmented Reality Sketching Interface for Architectural Daylighting Design", IEEE Transactions on Visualization & Computer Graphics, vol.17, no. 1, pp. 38-50, January 2011, doi:10.1109/TVCG.2009.209
[1] E. Donoff, "Schermerhorn Symphony Center," Architectural Lighting Magazine, http://www.archlighting.comindustry-news.asp? articleID=460542&sectionID=1331 , Mar. 2007.
[2] C. Cruz-Neira, D. Sandin, T. DeFanti, R. Kenyon, and J. Hart, "The Cave: Audio Visual Experience Automatic Virtual Environment," Comm. ACM, vol. 35, no. 6, pp. 65-72, June 1992.
[3] O. Staadt, M. Gross, A. Kunz, and M. Meier, "The Blue-C: Integrating Real Humans into a Networked Immersive Environment," Proc. ACM Collaborative Virtual Environments 2000, pp. 201-202, 2000.
[4] P. Dunston, J. McGlothlin, and L. Arns, "An Immersive Virtual Reality Mock-Up for Design Review of Hospital Patient Rooms," Proc. Conf. Construction Applications of Virtual Reality, 2007.
[5] C. Mackie, J. Cowden, D. Bowman, and W. Thabet, "Desktop and Immersive Tools for Residential Home Design," Proc. Conf. Construction Applications of Virtual Reality, 2004.
[6] K. Dmitriev, T. Annen, G. Krawczyk, K. Myszkowski, and H. Seidel, "A Cave System for Interactive Modeling of Global Illumination in Car Interior," Proc. ACM Symp. Virtual Reality Software and Technology, pp. 137-145, 2004.
[7] O. Bimber and R. Raskar, Spatial Augmented Reality: Merging Real and Virtual Worlds. A K Peters, Ltd., 2005.
[8] R. Raskar, G. Welch, M. Cutts, A. Lake, L. Stesin, and H. Fuchs, "The Office of the Future: A Unified Approach to Image-Based Modeling and Spatially Immersive Displays," Proc. ACM SIGGRAPH '98, pp. 179-188, July 1998.
[9] J. Underkoffler, B. Ullmer, and H. Ishii, "Emancipated Pixels: Real-World Graphics in the Luminous Room," Proc. ACM SIGGRAPH '99, Aug. 1999.
[10] C. Pinhanez, "The Everywhere Displays Projector: A Device to Create Ubiquitous Graphical Interfaces," Proc. Ubiquitous Computing (Ubicomp), Sept. 2001.
[11] R. Raskar, G. Welch, K.-L. Low, and D. Bandyopadhyay, "Shader Lamps: Animating Real Objects with Image-Based Illumination" Proc. 12th Eurographics Workshop Rendering (Rendering Techniques '01), pp. 89-102, June 2001.
[12] R. Raskar, R. Ziegler, and T. Willwacher, "Cartoon Dioramas in Motion: Apparent Motion Effects on Real Objects with Image-Based Illumination," Proc. Int'l Symp. Nonphotorealistic Animation and Rendering (NPAR), June 2002.
[13] S.H. Han, J.H. Kim, T.S. Yun, and D.H. Lee, "Extensible Interface Using Projector-Based Augmentation," Proc. Int'l Conf. Computer Graphics & Virtual Reality (CGVR), pp. 132-137, 2006.
[14] R. Raskar and P. Beardsley, "A Self-Correcting Projector," Proc. 2001 Conf. Computer Vision and Pattern Recognition (CVPR '01), pp. 504-508, Dec. 2001.
[15] M. Ashdown, M. Flagg, R. Sukthankar, and J.M. Rehg, "A Flexible Projector-Camera System for Multi-Planar Displays," Proc. 2004 Conf. Computer Vision and Pattern Recognition (CVPR '04), pp. 165-172, June 2004.
[16] J.C. Lee, P.H. Dietz, D. Maynes-Aminzade, and S.E. Hudson, "Automatic Projector Calibration with Embedded Light Sensors," Proc. ACM Symp. User Interface Software and Technology (UIST), 2004.
[17] R. Sukthankar, R.G. Stockton, and M.D. Mullin, "Smarter Presentations: Exploiting Homography in Camera-Projector Systems," Proc. Int'l Conf. Computer Vision, 2001.
[18] P. Beardsley, J.V. Baar, R. Raskar, and C. Forlines, "Interaction Using a Handheld Projector," IEEE Computer Graphics and Applications, vol. 25, no. 1, pp. 39-43, Jan. 2005.
[19] S. Audet and J.R. Cooperstock, "Shadow Removal in Front Projection Environments Using Object Tracking," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1-8, June 2007.
[20] A. Grundhofer and O. Bimber, "Real-Time Adaptive Radiometric Compensation," IEEE Trans. Visualization and Computer Graphics, vol. 14, no. 1, pp. 97-108, Jan./Feb. 2008.
[21] O. Bimber, A. Grundhofer, T. Zeidler, D. Danch, and P. Kapakos, "Compensating Indirect Scattering for Immersive and Semi Immersive Projection Displays," Proc. IEEE Conf. Virtual Reality (VR '06), pp. 151-158, 2006.
[22] Y. Mukaigawa, T. Kakinuma, and Y. Ohta, "Analytical Compensation of Inter-Reflection for Pattern Projection," Proc. ACM Symp. Virtual Reality Software and Technology (VRST '06), pp. 265-268, 2006.
[23] A. Fournier, A.S. Gunawan, and C. Romanzin, "Common Illumination between Real and Computer Generated Scenes," Proc. Graphics Interface, pp. 254-263, 1993.
[24] G. Drettakis, L. Robert, and S. Bougnoux, "Interactive Common Illumination for Computer Augmented Reality," Proc. Eurographics Rendering Workshop 1997, pp. 45-56, June 1997.
[25] S. Gibson and A. Murta, "Interactive Rendering with Real-World Illumination," Proc. Eurographics Workshop Rendering (Rendering Techniques), June 2000.
[26] O. Cossairt, S. Nayar, and R. Ramamoorthi, "Light-Field Transfer: Global Illumination between Real and Synthetic Objects," ACM Trans. Graphics, vol. 27, no. 3, July 2008.
[27] CIE Int'l Commission on Illumination, "Spatial Distribution of Daylight—Luminance Distributions of Various Reference Skies," Technical Report CIE 110-1994, 1994.
[28] C.M. Goral, K.E. Torrance, D.P. Greenberg, and B. Battaile, "Modelling the Interaction of Light between Diffuse Surfaces," Proc. ACM SIGGRAPH '84, vol. 18, no. 3, pp. 213-222, July 1984.
[29] G.J. Ward, F.M. Rubinstein, and R.D. Clear, "A Ray Tracing Solution for Diffuse Interreflection," Proc. ACM SIGGRAPH '88, pp. 85-92, 1988.
[30] P.-P. Sloan, J. Kautz, and J. Snyder, "Precomputed Radiance Transfer for Real-Time Rendering in Dynamic, Low-Frequency Lighting Environments," ACM Trans. Graphics, vol. 21, no. 3, pp. 527-536, July 2002.
[31] M. Nijasure, S. Pattanaik, and V. Goel, "Interactive Global Illumination in Dynamic Environments Using Commodity Graphics Hardware," Proc. 11th Pacific Conf. Computer Graphics and Applications (PG '03), p. 450, 2003.
[32] P. Gautron, J. Krivánek, K. Bouatouch, and S. Pattanaik, "Radiance Cache Splatting: A GPU-Friendly Global Illumination Algorithm," Proc. 16th Eurographics Workshop Rendering (Rendering Techniques '05), pp. 55-64, June 2005.
[33] C. Dachsbacher, M. Stamminger, G. Drettakis, and F. Durand, "Implicit Visibility and Antiradiance for Interactive Global Illumination," ACM Trans. Graphics, vol. 26, no. 3, pp. 61:1-61:10, July 2007.
[34] B. Cutler, Y. Sheng, S. Martin, D. Glaser, and M. Andersen, "Interactive Selection of Optimal Fenestration Materials for Schematic Architectural Daylighting Design," Automation in Construction, vol. 17, no. 7, pp. 809-823, Sept. 2008.
[35] T. Heidmann, "Real Shadows, Real Time," Iris Universe, vol. 18, pp. 28-31, 1991.
[36] C. Reinhart, D. Bourgeois, F. Dubrous, A. Laouadi, P. Lopez, and O. Stelescu, "Daylight 1-2-3—A State-of-the-Art Daylighting/Energy Analysis Software for Initial Design Investigations," Proc. Building Simulation, 2007.
[37] M.A. Lehar and L.R. Glicksman, "Rapid Algorithm for Modeling Daylight Distributions in Office Buildings," Building and Environment, vol. 42, pp. 2908-2919, 2007.
[38] S. Bund and E.Y.-L. Do, "Spot Fetch Light Interactive Navigable 3D Visualization of Direct Sunlight," Automation in Construction, vol. 14, pp. 181-188, 2005.
[39] Google, "SketchUp: 3D Modeling Software," http:/www. , 2008.
[40] The IESNA Lighting Handbook—Reference & Application, M. Rea, ed., ninth ed. Illuminating Eng. Soc. North Am., 2000.
[41] G.W. Larson and R. Shakespeare, Rendering with Radiance—The Art and Science of Lighting Visualization. Morgan Kaufmann Publishers, Inc., 1998.
[42] Y. Sheng, T.C. Yapo, C. Young, and B. Cutler, "Virtual Heliodon: Spatially Augmented Reality for Architectural Daylighting Design," Proc. IEEE Virtual Reality 2009, 2009.
[43] B. Cutler, T.C. Yapo, and Y. Sheng, "Inferring Architectural Designs from Physical Sketches: Application to Daylighting Analysis," Proc. Intelligent User Interfaces (IUI) Sketch Recognition Workshop, Feb. 2009.
[44] H. Kato and M. Billinghurst, "Marker Tracking and HMD Calibration for a Video-Based Augmented Reality Conferencing System," Proc. Second Int'l Workshop Augmented Reality (IWAR '99), Oct. 1999.
[45] R.I. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision. Cambridge Univ. Press, 2000.
[46] M.A. Fischler and R.C. Bolles, "Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography," Comm. ACM, vol. 24, no. 6, pp. 381-395, 1981.
[47] H. Hoppe, T. De Rose, T. Duchamp, J. McDonald, and W. Stuetzle, "Mesh Optimization," Proc. ACM SIGGRAPH '93, pp. 19-26, Aug. 1993.
[48] F. Durand, G. Drettakis, and C. Puech, "Fast and Accurate Hierarchical Radiosity Using Global Visibility," ACM Trans. Graphics, vol. 18, no. 2, pp. 128-170, Apr. 1999.
[49] Khronos Group, "The OpenGL Graphics System: A Specification," , Aug. 2008.
[50] Z. Zhang, "A Flexible New Technique for Camera Calibration," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 11, pp. 1330-1334, Nov. 2000.
[51] J. Mallon and P.F. Whelan, "Which Pattern? Biasing Aspects of Planar Calibration Patterns and Detection Methods," Pattern Recognition Letters, vol. 28, no. 8, pp. 921-930, June 2007, .
[52] L. Lucchese and S. Mitra, "Using Saddle Points for Subpixel Feature Detection in Camera Calibration Targets," Proc. 2002 Asia-Pacific Conf. Circuits and Systems (APCCAS '02), vol. 2, pp. 191-195, 2002.
[53] R.Y. Tsai, "A Versatile Camera Calibration Technique for High-Accuracy 3D Machine Vision Metrology Using Off-the-Shelf TV Cameras and Lenses," IEEE J. Robotics and Automation, vol. RA-3, no. 4, pp. 323-344, Aug. 1987.
[54] Sanyo, "XGA Multimedia Projector PLC-XF47," http://www. xf47xf47.html, 2007.
[55] G.W. Larson, H. Rushmeier, and C. Piatko, "A Visibility Matching Tone Reproduction Operator for High Dynamic Range Scenes," IEEE Trans. Visualization and Computer Graphics, vol. 3, no. 4, pp. 291-306, Oct.-Dec. 1997.
[56] F. Raab, E. Blood, T. Steiner, and H. Jones, "Magnetic Position and Orientation Tracking System," IEEE Trans. Aerospace and Electronic Systems, vol. AES-15, no. 5, pp. 709-718, Sept. 1979.
451 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool