| | This Article | |
| |
| |
| | Share | |
| |
| |
| | Bibliographic References | |
| |
| |
| | Add to: | |
| |
 Digg
 Furl
 Spurl
 Blink
 Simpy
 Google
 Del.icio.us
 Y!MyWeb
| |
| | Search | |
| |
| |
| | |
Data Streaming in Telepresence Environments
November/December 2005 (vol. 11 no. 6)
pp. 637-348
In this paper, we discuss data transmission in telepresence environments for collaborative virtual reality applications. We analyze data streams in the context of networked virtual environments and classify them according to their traffic characteristics. Special emphasis is put on geometry-enhanced (3D) video. We review architectures for real-time 3D video pipelines and derive theoretical bounds on the minimal system latency as a function of the transmission and processing delays. Furthermore, we discuss bandwidth issues of differential update coding for 3D video. In our telepresence system—the blue-c—we use a point-based 3D video technology which allows for differentially encoded 3D representations of human users. While we discuss the considerations which lead to the design of our three-stage 3D video pipeline, we also elucidate some critical implementation details regarding decoupling of acquisition, processing and rendering frame rates, and audio/video synchronization. Finally, we demonstrate the communication and networking features of the blue-c system in its full deployment. We show how the system can possibly be controlled to face processing or networking bottlenecks by adapting the multiple system components like audio, application data, and 3D video.
[1] F.P. Brooks, “What's Real about Virtual Reality,” IEEE Computer Graphics and Applications, vol. 19, no. 6, pp. 16-27, Nov./Dec. 1999.
[2] C. Cruz-Neira, D.J. Sandin, and T.A. DeFanti, “Surround-Screen Projection-Based Virtual Reality: The Design and Implementation of the CAVE,” Proc. SIGGRAPH, pp. 135-142, 1993.
[3] S.J. Gibbs, C. Arapis, and C.J. Breiteneder, “TELEPORT— Towards Immersive Copresence,” Multimedia Systems, vol. 7, no. 3, pp. 214-221, 1999.
[4] C.M. Greenhalgh and S.D. Benford, “Massive: A Virtual Reality System for Teleconferencing,” ACM Trans. Computer Human Interfaces, vol. 2, no. 3, pp. 239-261, 1995.
[5] M. Gross, S. Wuermlin, M. Naef, E. Lamboray, C. Spagno, A. Kunz, E. Koller-Meier, T. Svoboda, L.V. Gool, S. Lang, K. Strehlke, A.V. Moere, and O. Staadt, “blue-c: A Spatially Immersive Display and 3D Video Portal for Telepresence,” ACM Trans. Graphics, Proc. SIGGRAPH 2003 (Conf. Issue), pp. 819-827, July 2003.
[6] T. Kanade, P.W. Rander, and P. Narayanan, “Virtualized Reality: Constructing Virtual Worlds from Real Scenes,” IEEE MultiMedia, vol. 4, no. 1, pp. 43-54, Jan.-Mar. 1997.
[7] P. Kauff and O. Schreer, “An Immersive 3D Video-Conferencing System Using Shared Virtual Team User Environments,” Proc. Fourth Int'l Conf. Collaborative Virtual Environments, pp. 105-112, 2002.
[8] N. Kitawaki and K. Itoh, “Pure Delay Effects on Speech Quality in Telecommunications,” IEEE J. Selected Areas in Comm., vol. 9, no. 4, pp. 586-593, May 1991.
[9] E. Lamboray, S. Wuermlin, and M. Gross, “Real-Time Streaming of Point-Based 3D Video,” Proc. IEEE Virtual Reality 2004 Conf., pp. 91-98, Mar. 2004.
[10] J. Leigh, O. Yu, D. Schonfeld, R. Ansari, E. He, A. Nayak, J. Ge, N. Krishnaprasad, K. Park, Y. joo Cho, L. Hu, R. Fang, A. Verlo, L. Winkler, and T.A. DeFanti, “Adaptive Networking for Tele-Immersion,” Proc. Immersive Projection Technology/Eurographics Virtual Environments Workshop (IPT/EGVE), pp. 199-208, May 2001.
[11] M.R. Macedonia, M.J. Zyda, D.R. Pratt, P.T. Barham, and S. Zeswitz, “NPSNET: A Network Software Architecture for Large Scale Virtual Environments,” Presence, vol. 3, no. 4, Fall 1994.
[12] W. Matusik, C. Buehler, R. Raskar, S.J. Gortler, and L. McMillan, “Image-Based Visual Hulls,” SIGGRAPH 2000 Conf. Proc., pp. 369-374, 2000.
[13] M. Naef, E. Lamboray, O. Staadt, and M. Gross, “The blue-c Distributed Scene Graph,” Proc. Seventh Int'l Workshop Immersive Projection Technology, Ninth Eurographics Workshop Virtual Enviroments (IPT/EGVE) 2003, J. Deisinger and A. Kunz, eds., pp. 125-133, May 2003.
[14] K.S. Park and R.V. Kenyon, “Effects of Network Characteristics on Human Performance in a Collaborative Virtual Environment,” Proc. IEEE Virtual Reality 1999 Conf., pp. 104-111, 1999.
[15] S. Prince, A.D. Cheok, F. Farbiz, T. Williamson, N. Johnson, M. Billinghurst, and H. Kato, “3-D Live: Real Time Interaction for Mixed Reality,” Proc. 2002 ACM Conf. Computer Supported Cooperative Work, pp. 364-371, 2002.
[16] R. Raskar, G. Welch, M. Cutts, A. Lake, L. Stesin, and H. Fuchs, “The Office of the Future: A Unified Approach to Image-Based Modeling and Spatially Immersive Displays,” Proc. 25th Ann. Conf. Computer Graphics and Interactive Techniques, pp. 179-188, 1998.
[17] A. Sadagic, H. Towles, J. Lanier, H. Fuchs, A. van Dam, K. Daniilidis, J. Mulligan, L. Holden, and B. Zeleznik, “National Tele-Immersion Initiative: Towards Compelling Tele-Immersive Collaborative Environments,” presentation given at Medicine Meets Virtual Reality 2001 Conf., Jan. 2001.
[18] I. Vaghi, C. Greenhalgh, and S. Benford, “Coping with Inconsistency Due to Network Delays in Collaborative Virtual Environments,” Proc. ACM Symp. Virtual Reality Software and Technology, Dec. 1999.
[19] S. Wuermlin, E. Lamboray, and M. Gross, “3D Video Fragments: Dynamic Point Samples for Real-Time Free-Viewpoint Video,” Computers & Graphics, special issue on coding, compression, and streaming techniques for 3D and multimedia data, vol. 28, no. 1, 2004.
Index Terms:
Index Terms- Computer conferencing, teleconferencing, and videoconferencing, distributed/network graphics, three-dimensional graphics and realism.
Citation:
Edouard Lamboray, Stephan W?rmlin, Markus Gross, "Data Streaming in Telepresence Environments," IEEE Transactions on Visualization and Computer Graphics, vol. 11, no. 6, pp. 637-348, Nov./Dec. 2005, doi:10.1109/TVCG.2005.98
