The Community for Technology Leaders
RSS Icon
Issue No.01 - January/February (2010 vol.16)
pp: 28-42
Ferdi Alexander Smit , Centrum Wiskunde and Informatica (CWI), Amsterdam
Robert van Liere , Centrum Wiskunde and Informatica (CWI), Amsterdam
Bernd Froehlich , Bauhaus-Universität Weimar, Weimar
Display systems typically operate at a minimum rate of 60 Hz. However, existing VR-architectures generally produce application updates at a lower rate. Consequently, the display is not updated by the application every display frame. This causes a number of undesirable perceptual artifacts. We describe an architecture that provides a programmable display layer (PDL) in order to generate updated display frames. This replaces the default display behavior of repeating application frames until an update is available. We will show three benefits of the architecture typical to VR. First, smooth motion is provided by generating intermediate display frames by per-pixel depth-image warping using 3D motion fields. Smooth motion eliminates various perceptual artifacts due to judder. Second, we implement fine-grained latency reduction at the display frame level using a synchronized prediction of simulation objects and the viewpoint. This improves the average quality and consistency of latency reduction. Third, a crosstalk reduction algorithm for consecutive display frames is implemented, which improves the quality of stereoscopic images. To evaluate the architecture, we compare image quality and latency to that of a classic level-of-detail approach.
Display algorithms, virtual reality, image-based rendering.
Ferdi Alexander Smit, Robert van Liere, Bernd Froehlich, "A Programmable Display Layer for Virtual Reality System Architectures", IEEE Transactions on Visualization & Computer Graphics, vol.16, no. 1, pp. 28-42, January/February 2010, doi:10.1109/TVCG.2009.75
[1] M.R. Mine, “Characterization of End-to-End Delays in Head-Mounted Display Systems,” technical report, 1993.
[2] M. Olano, J. Cohen, M. Mine, and G. Bishop, “Combatting Rendering Latency,” Proc. ACM Symp. Interactive 3D Graphics (SI3D), pp. 19-24, 1995.
[3] F. Smit, R. van Liere, and B. Froehlich, “Non-Uniform Crosstalk Reduction for Dynamic Scenes,” Proc. IEEE Virtual Reality (VR) Conf., pp. 139-146, 2007.
[4] P.J. Bex, G.K. Edgar, and A.T. Smith, “Multiple Images Appear When Motion Energy Detection Fails,” J. Experimental Psychology: Human Perception and Performance, vol. 21, pp. 231-238, 1995.
[5] W. Bles and A. Wertheim, “Appropriate Use of Virtual Environments to Minimise Motion Sickness,” RTO MP58, pp. 7.1-7.9, 2000.
[6] J.P. Springer, S. Beck, F. Weiszig, D. Reiners, and B. Froehlich, “Multi-Frame Rate Rendering and Display,” Proc. IEEE Virtual Reality (VR) Conf., pp. 195-202, 2007.
[7] C. Shaw, M. Green, J. Liang, and Y. Sun, “Decoupled Simulation in Virtual Reality with the MR Toolkit,” Information Systems, vol. 11, no. 3, pp. 287-317, 1993.
[8] R. Kijima and T. Ojika, “Reflex HMD to Compensate Lag and Correction of Derivative Deformation,” Proc. IEEE Virtual Reality (VR) Conf., pp. 172-179, 2002.
[9] J. Stewart, E.P. Bennett, and L. McMillan, “Pixelview: A View Independent Graphics Rendering Architecture,” Proc. ACM SIGGRAPH/Eurographics Workshop Graphics Hardware (HWWS), pp. 75-84, 2004.
[10] M. Regan and R. Pose, “Priority Rendering with a Virtual Reality Address Recalculation Pipeline,” Proc. ACM SIGGRAPH, pp. 155-162, 1994.
[11] R. Pose and M. Regan, “Techniques for Reducing Virtual Reality Latency with Architectural Support and Consideration on Human Factors,” Proc. Int'l Conf. Hypermedia, Multimedia, and Virtual Reality: Models, Systems, and Applications (MHVR), pp. 117-129, 1994.
[12] J. Torborg and J.T. Kajiya, “Talisman: Commodity Realtime 3D Graphics for the PC,” Proc. ACM SIGGRAPH, pp. 353-363, 1996.
[13] J.W. Shade, S.J. Gortler, L.-W. He, and R. Szeliski, “Layered Depth Images,” Proc. Ann. Conf. Computer Graphics, pp. 231-242, 1998.
[14] L. McMillan and G. Bishop, “Plenoptic Modeling: An Image-Based Rendering System,” Proc. Ann. Conf. Computer Graphics, vol. 29, pp. 39-46, 1995.
[15] W.R. Mark, L. McMillan, and G. Bishop, “Post-Rendering 3D Warping,” Proc. Symp. Int'l 3D Graphics, vol. 180, pp. 7-16, 1997.
[16] F. Smit, R. van Liere, S. Beck, and B. Froehlich, “An Image-Warping Architecture for VR: Low Latency versus Image Quality,” Proc. IEEE Virtual Reality Conf., Mar. 2009.
[17] W.R. Mark, “Post-Rendering 3D Image Warping: Visibility, Reconstruction, and Performance for Depth Image Warping,” PhD dissertation, Univ. of North Carolina at Chapel Hill, 1999.
[18] J.E. Farrell, M. Pavel, and G. Sperling, “The Visible Persistence of Stimuli in Stroboscopic Motion,” Vision Research, vol. 30, no. 6, pp.921-936, 1990.
[19] A.J. Woods and S.S. Tan, “Characteristic Sources of Ghosting in Time-Sequential Stereoscopic Video Displays,” Proc. SPIE, pp. 66-77, 2002.
[20] F. Smit, R. van Liere, and B. Froehlich, “Three Extensions to Subtractive Crosstalk Reduction,” Proc. Eurographics Symp. Virtual Environments (EGVE), pp. 85-92, 2007.
[21] P. Cignoni, M. Corsini, and G. Ranzuglia, “Meshlab: An Open-Source 3D Mesh Processing System,” ERCIM News, vol. 73, pp. 45-46, Apr. 2008.
[22] A. Steed, “A Simple Method for Estimating the Latency of Interactive, Real-Time Graphics Simulations,” Proc. ACM Symp. Virtual Reality Software and Technology (VRST), pp. 123-129, 2008.
[23] S. Daly, “The Visible Differences Predictor: An Algorithm for the Assessment of Image Fidelity,” Digital Images and Human Vision, pp. 179-206, MIT Press, 1993.
38 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool