The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.06 - November/December (2008 vol.28)
pp: 20-36
Doug A. Bowman , Virginia Tech
Bernd Froehlich , Bauhaus-Universit?t Weimar
Michitaka Hirose , University of Tokyo
Yoshifumi Kitamura , Osaka University
Kiyoshi Kiyokawa , Osaka University
Wolfgang Stuerzlinger , York University
ABSTRACT
Three-dimensional user interfaces (3D UIs) let users interact with virtual objects, environments, or information using direct 3D input in the physical and/or virtual space. In this article, the founders and organizers of the IEEE Symposium on 3D User Interfaces reflect on the state of the art in several key aspects of 3D UIs and speculate on future research.
INDEX TERMS
3D user interfaces, 3D UI, input devices, biosignal interfaces, pseudo-haptics, multidisplay environments, collaborative 3D user interfaces, virtual reality, augmented reality
CITATION
Doug A. Bowman, Sabine Coquillart, Bernd Froehlich, Michitaka Hirose, Yoshifumi Kitamura, Kiyoshi Kiyokawa, Wolfgang Stuerzlinger, "3D User Interfaces: New Directions and Perspectives", IEEE Computer Graphics and Applications, vol.28, no. 6, pp. 20-36, November/December 2008, doi:10.1109/MCG.2008.109
REFERENCES
1. K. Hinckley et al., "A Survey of Design Issues in Spatial Input," Proc. 1994 ACM Symp. User Interface Software and Technology, ACM Press, 1994, pp. 213–222.
2. R. Jacob et al., "Integrality and Separability of Input Devices," ACM Trans. Computer-Human Interaction, vol. 1, no. 1, 1994, pp. 3–26.
3. B. Froehlich et al., "The GlobeFish and the GlobeMouse: Two New Six Degree of Freedom Input Devices for Graphics Applications," Proc. 2006 ACM Conf. Human Factors in Computing Systems, ACM Press, 2006, pp. 191–199.
4. A. Kulik, R. Blach, and B. Froehlich, "Two-4-Six''—a Handheld Device for 3D-Presentations," Proc. 2006 IEEE Symp. 3D User Interfaces, IEEE Press, 2006, pp. 167–170.
5. M. Middendorf et al. "Brain Computer Interfaces Based on the Steady State Visual Evoked Response," IEEE Trans. Rehabilitation Eng., vol. 8, no. 2, 2008, pp. 211–214.
6. L.A. Farewell and E. Donchin, "Taking off the Top of Your Head: Toward a Mental Prothesis Utilizing Event-Related Brain Potentials," Electroencephalography and Clinical Neurophysiology, vol. 70, no. 6, 1988, pp. 510–523.
7. G. Pfurtscheller and C. Neuper, "Motor Imagery Activates Primary Sensorimotor Area in Humans," Neuroscience Letters, vol. 239, nos. 2–3, 1997, pp. 65–68.
8. H. Touyama, M. Aotsuka, and M. Hirose, "A Pilot Study on Virtual Camera Control via Steady-State VEP in Immersing Virtual Environment," Proc. Human-Computer Interaction 2008, ACTA Press, 2008, track 611–065.
9. M. Hirose et al., "Development and Evaluation of the Cabin Immersive Multiscreen Display," Systems and Computers in Japan, vol. 30, no. 1, 1999, pp. 13–22.
10. Y. Wang et al. "Common Spatial Pattern Method for Channel Selection in Motor Imagery Based Brain-Computer Interface," Proc. 27th Ann. Conf. IEEE Eng. in Medicine and Biology Soc., vol. 5, 2005, pp. 5392–5395.
11. J. Fujisawa, H. Touyama, and M. Hirose, "EEG Based Navigation of Immersing Virtual Environments Using Common Spatial Patterns," Proc. 2008 IEEE Int'l Conf. Virtual Reality, IEEE Press, 2008, pp. 251–252.
12. F. Biocca, J. Kim, and Y. Choi, "Visual Touch in Virtual Environments: An Exploratory Study of Presence, Multimodal Interfaces and Cross-modal Sensory Illusions," Presence, vol. 10, no. 3, 2001, pp. 247–265.
13. L. Lécuyer et al., "Boundary of Illusion: An Experiment of Sensory Integration with a Pseudo-haptic System," Proc. 2001 IEEE Int'l Conf. Virtual Reality, IEEE Press, 2001, pp. 115–122.
14. A. Lécuyer et al., "Pseudo-haptic Feedback: Can Isometric Input Devices Simulate Force Feedback?" Proc. IEEE Int'l Conf. Virtual Reality, IEEE Press, 2000, pp. 83–90.
15. A. Lécuyer, J.M. Burkhardt, and L. Etienne, "Feeling Bumps and Holes without a Haptic Interface: The Perception of Pseudo-haptic Textures," Proc. 2004 ACM Conf. Human Factors in Computing Systems, ACM Press, 2004, pp. 239–246.
16. K. van Mensvoort, "What You See Is What You Feel: Exploiting the Dominance of the Visual over the Haptic Domain to Simulate Force-Feedback with Cursor Displacements," Proc. Designing Interactive Systems 2002, ACM Press, 2002, pp. 345–348.
17. A. Pusch, O. Martin, and S. Coquillart, "HEMP—Hand Displacement-Based Pseudo-haptics: A Study of a Force Field Application," Proc. 2008 IEEE Symp. 3D User Interfaces, IEEE Press, 2008, pp. 59–66.
18. J. Martín et al., "Haptic Wrists: An Alternative Design Strategy Based on User Perception," submitted to J. Computing and Information Science in Eng; available from jmamezaga@ceit.es.
19. A. Paljic, J.M. Burkhardt, and S. Coquillart, "Evaluation of Pseudo-Haptic Feedback for Simulating Torque: A Comparison between Isometric and Elastic Input Devices," Proc. 12th Symp. Haptic Interfaces for Virtual Environment and Teleoperator Systems, IEEE CS Press, 2004, pp. 216–223.
20. L. Dominjon et al., "Influence of Control/Display Ratio on the Perception of Mass of Manipulated Objects in Virtual Environments," Proc. 2005 IEEE Int'l Conf. Virtual Reality, IEEE Press, 2005, pp. 19–25.
21. M. Sugimoto and I. Fujishiro, "Enhancement of Virtual Interaction Devices Using Pseudo Force Sensation," Siggraph 2000 Sketches &Applications, ACM Press, 2000, p. 200.
22. R.L. Mandryk, M.E. Rodgers, and K.M. Inkpen, "Sticky Widgets: Pseudo-haptic Widget Enhancements for Multi-monitor Displays," Proc. 2005 ACM Conf. Human Factors in Computing Systems, ACM Press, 2005, pp. 1621–1624.
23. F. Crison et al., "Virtual Technical Trainer: Learning How to Use Milling Machines with Multi-sensory Feedback in Virtual Reality," Proc. IEEE Int'l Conf. Virtual Reality, IEEE Press, 2005, pp. 139–146.
24. D. Wigdor et al., "Perception of Elementary Graphical Elements in Tabletop and Multi-surface Environments," Proc. 2007 ACM Conf. Human Factors in Computing Systems, ACM Press, 2007, pp. 473–482.
25. M.A. Nacenta et al., "Perspective Cursor: Perspective-Based Interaction for Multi-display Environments," Proc. 2006 ACM Conf. Human Factors in Computing Systems, ACM Press, 2006, pp. 289–298.
26. P. Baudisch and R. Rosenholtz, "Halo: A Technique for Visualizing Off-Screen Locations," Proc. 2003 ACM Conf. Human Factors in Computing Systems, ACM Press, 2003, pp. 481–488.
27. M. Nacenta et al., "E-conic: A Perspective-Aware Interface for Multi-display Environments," Proc. ACM Symp. User Interface Software and Technology (UIST 07), ACM Press, 2007, pp. 279–288.
28. N. Govindaraju et al., "Cullide: Interactive Collision Detection between Complex Models in Large Environments Using Graphics Hardware," Proc. Siggraph Workshop Graphics Hardware, ACM Press, 2003, pp. 25–32.
29. Y. Kitamura and F. Kishino, "Consolidated Manipulation of Virtual and Real Objects," Proc. 1997 ACM Symp. Virtual Reality Software and Technology, ACM Press, 1997, pp. 133–138.
30. C. Ware and K. Lowther, "Selection Using a One-Eyed Cursor in a Fish Tank VR Environment," ACM Trans. Computer-Human Interaction, vol. 4, no. 4, 1997, pp. 309–322.
31. I. Poupyrev et al., "Egocentric Object Manipulation in Virtual Environments: Empirical Evaluation of Interaction Techniques," Proc. 1998 ACM Siggraph/Eurographics Workshop Graphics Hardware, ACM Press, 1998, pp. 41–52.
32. C. Wickens and J. Hollands, Engineering Psychology and Human Performance, 3rd ed., Prentice-Hall, 1999.
33. Z. Wartell, L.F. Hodges, and W. Ribarsky, "A Geometric Comparison of Algorithms for Fusion Control in Stereoscopic HTDs," IEEE Trans. Visualization &Computer Graphics, vol. 8, no. 2, 2002, pp. 129–143.
34. J.-Y. Oh and W. Stuerzlinger, "Moving Objects with 2D Input Devices in CAD Systems and Desktop Virtual Environments," Proc. Graphics Interface 2005, ACM Press, 2005, pp. 195–202.
35. G. Smith, T. Salzman, and W. Stuerzlinger, "3D Scene Manipulation with 2D Devices and Constraints," Proc. Graphics Interface 2001, ACM Press, 2001, pp. 135–142.
36. Z. Szalavári and M. Gervautz, "The Personal Interaction Panel—a Two-Handed Interface for Augmented Reality," Computer Graphics Forum, vol. 16, no. 3, 1997, pp. 335–346.
37. R. Teather and W. Stuerzlinger, "Assessing the Effects of Orientation and Device on (Constrained) 3D Movement Techniques," Proc. 2008 IEEE Symp. 3D User Interfaces, IEEE Press, 2008, pp. 43–50.
38. A. Simon and S. Scholz, "Multi-viewpoint Images for Multi-user Interaction," Proc. 2005 IEEE Virtual Reality Conf., IEEE Press, 2005, pp. 107–113.
39. M. Agrawala et al., "The Two-User Responsive Workbench: Support for Collaboration through Individual Views of a Shared Space," Proc. Siggraph, ACM Press, 1997, pp. 327–332.
40. K. Riege et al., "The Bent Pick Ray: An Extended Pointing Technique for Multi-user Interaction," Proc. 2006 IEEE Symp. 3D User Interfaces, IEEE Press, 2006, pp. 63–66.
41. O. Bimber et al., "The Virtual Showcase," IEEE Computer Graphics and Applications, vol. 21, no. 6, 2001, pp. 48–55.
42. Y. Kitamura et al., "Interactive Stereoscopic Display for Three or More Users," Proc. Siggraph, ACM Press, 2001, pp. 231–239.
43. K. Kiyokawa, H. Takemura, and N. Yokoya, "SeamlessDesign for 3D Object Creation," IEEE MultiMedia, vol. 7, no. 1, 2000, pp. 22–33.
44. R. Ruddle, J. Savage, and D. Jones, "Symmetric and Asymmetric Action Integration during Cooperative Object Manipulation in Virtual Environments," ACM Trans. Computer-Human Interaction, vol. 9, no. 4, 2002, pp. 285–308.
45. K. Kiyokawa et al., "An Occlusion-Capable Optical See-Through Head Mount Display for Supporting Colocated Collaboration," Proc. 2003 IEEE Int'l Symp. Mixed and Augmented Reality, IEEE Press, 2003, pp. 133–141.
46. T. Duval, A. Lécuyer, and S. Thomas, "SkeweR: A 3D Interaction Technique for 2-User Collaborative Manipulation of Objects in Virtual Environments," Proc. 2006 IEEE Symp. 3D User Interfaces, IEEE Press, 2006, pp. 71–74.
47. M. Pinho, D. Bowman, and C. Freitas, "Cooperative Object Manipulation in Immersive Virtual Environments: Framework and Techniques," Proc. 2002 ACM Symp. Virtual Reality Software and Technology, ACM Press, 2002, pp. 171–178.
48. I. Heldal et al., "Immersiveness and Symmetry in Copresent Scenarios," Proc. 2005 IEEE Virtual Reality Conf., IEEE Press, 2005, pp. 171–178.
49. K. Kiyokawa, "A Wide Field-of-View Head Mounted Projective Display Using Hyperbolic Half-Silvered Mirrors," Proc. 2007 IEEE Int'l Symp. Mixed and Augmented Reality, IEEE Press, 2007, pp. 207–210.
50. H. Ishii, M. Kobayashi, and K. Arita, "Iterative Design of Seamless Collaboration Media," Comm. ACM, vol. 37, no. 8, 1994, pp. 83–97.
51. K. Kiyokawa, H. Takemura, and N. Yokoya, "Collaborative Immersive Workspace through a Shared Augmented Environment," Proc. SPIE, vol. 3517, 1998, pp. 2–13.
52. K. Kiyokawa et al., "Communication Behaviors of Colocated Users in Collaborative AR Interfaces," Proc. 2002 IEEE Int'l Symp. Mixed and Augmented Reality, IEEE Press, 2002, pp. 139–148.
53. H. Takemura and F. Kishino, "Cooperative Work Environment Using Virtual Workspace," Proc. 1992 ACM Conf. Computer-Supported Cooperative Work, ACM Press, 1992, pp. 226–232.
54. J. Leigh and A.E. Johnson, "Calvin: An Immersive Design Environment Utilizing Heterogeneous Perspectives," Proc. 3rd IEEE Int'l Conf. Multimedia Computing and Systems, IEEE Press, 1996, pp. 20–23.
55. M. Billinghurst, H. Kato, and I. Poupyrev, "The MagicBook—Moving Seamlessly between Reality and Virtuality," IEEE Computer Graphics and Applications, vol. 21, no. 3, 2001, pp. 6–8.
56. R. Grasset, P. Lamb, and M. Billinghurst, "Evaluation of Mixed-Space Collaboration," Proc. 2005 IEEE Int'l Symp. Mixed and Augmented Reality, IEEE Press, 2005, pp. 90–99.
57. S. Yamamoto et al., "Symmetric Model of Remote Collaborative MR Using Tangible Replicas," Proc. 2008 IEEE Virtual Reality Conf., IEEE Press, 2008, pp. 71–74.
58. D. Bowman et al., 3D User Interfaces: Theory and Practice, Addison-Wesley, 2005.
59. F. Brooks, "What's Real about Virtual Reality?" IEEE Computer Graphics and Applications, vol. 19, no. 6, 1999, pp. 16–27.
60. R. McMahan et al., "Separating the Effects of Level of Immersion and 3D Interaction Techniques," Proc. ACM Symp. Virtual Reality Software and Technology, ACM Press, 2006, pp. 108–111.
61. T. Ni, R. McMahan, and D. Bowman, "rapMenu: Remote Menu Selection Using Freehand Gestural Input," Proc. IEEE Symp. 3D User Interfaces, IEEE Press, 2008, pp. 55–58.
15 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool