Issue No. 03 - July-Sept. (2017 vol. 16)
Ville Makela , University of Tampere, Finland
Jobin James , University of Tampere, Finland
Tuuli Keskinen , University of Tampere, Finland
Jaakko Hakulinen , University of Tampere, Finland
Markku Turunen , University of Tampere, Finland
Mid-air gestures have been largely overlooked for transferring content between large displays and personal mobile devices. To fully utilize the ubiquitous nature of mid-air gestures for this purpose, the authors developed SimSense, a smart space system that automatically pairs users with their mobile devices based on location data. Users can then interact with a gesture-controlled large display and move content onto their handheld devices. In a user study, the authors investigated two mid-air gestures for content transfer: grab-and-pull and grab-and-drop. Their results show that mid-air gestures are well suited for content-retrieval scenarios and offer an impressive user experience; grab-and-pull is the preferred for scenarios when content is transferred to the user, whereas grab-and-drop is presumably ideal when the recipient is another person or a device; and distinct gestures can be successfully combined with common point-and-dwell mechanics prominent in many gesture-controlled applications.
Mobile handsets, Mobile applications, Mobile communication, Visualization, Navigation, Content management, Avatars, Ubiquitous computing, Internet of Things, Virtualization
V. Makela, J. James, T. Keskinen, J. Hakulinen and M. Turunen, ""It's Natural to Grab and Pull": Retrieving Content from Large Displays Using Mid-Air Gestures," in IEEE Pervasive Computing, vol. 16, no. 3, pp. 70-77, 2017.