The Community for Technology Leaders
2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR) (2014)
Munich, Germany
Sept. 10, 2014 to Sept. 12, 2014
ISBN: 978-1-4799-6184-9
pp: 73-82
Thammathip Piumsomboon , HIT Lab NZ, University of Canterbury, Christchurch, New Zealand
David Altimira , HIT Lab NZ, University of Canterbury, Christchurch, New Zealand
Hyungon Kim , HIT Lab NZ, University of Canterbury, Christchurch, New Zealand
Adrian Clark , HIT Lab NZ, University of Canterbury, Christchurch, New Zealand
Gun Lee , HIT Lab NZ, University of Canterbury, Christchurch, New Zealand
Mark Billinghurst , HIT Lab NZ, University of Canterbury, Christchurch, New Zealand
ABSTRACT
In order for natural interaction in Augmented Reality (AR) to become widely adopted, the techniques used need to be shown to support precise interaction, and the gestures used proven to be easy to understand and perform. Recent research has explored free-hand gesture interaction with AR interfaces, but there have been few formal evaluations conducted with such systems. In this paper we introduce and evaluate two natural interaction techniques: the free-hand gesture based Grasp-Shell, which provides direct physical manipulation of virtual content; and the multi-modal Gesture-Speech, which combines speech and gesture for indirect natural interaction. These techniques support object selection, 6 degree of freedom movement, uniform scaling, as well as physics-based interaction such as pushing and flinging. We conducted a study evaluating and comparing Grasp-Shell and Gesture-Speech for fundamental manipulation tasks. The results show that Grasp-Shell outperforms Gesture-Speech in both efficiency and user preference for translation and rotation tasks, while Gesture-Speech is better for uniform scaling. They could be good complementary interaction methods in a physics-enabled AR environment, as this combination potentially provides both control and interactivity in one interface. We conclude by discussing implications and future directions of this research.
INDEX TERMS
Speech, Cameras, Thumb, Kinematics, Grasping, Three-dimensional displays, Shape,multi-modal interface, Augmented reality, natural interaction
CITATION
Thammathip Piumsomboon, David Altimira, Hyungon Kim, Adrian Clark, Gun Lee, Mark Billinghurst, "Grasp-Shell vs gesture-speech: A comparison of direct and indirect natural interaction techniques in augmented reality", 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), vol. 00, no. , pp. 73-82, 2014, doi:10.1109/ISMAR.2014.6948411
178 ms
(Ver 3.3 (11022016))