2013 IEEE International Conference on Multimedia and Expo Workshops (ICMEW) (2013)
San Jose, CA, USA
July 15, 2013 to July 19, 2013
Teng Li , College of Electrical Engineering and Automation, Auhui University, China
Wei Hu , Media Research Lab, Huawei Corp., Beijing, China
Jun Wu , Institute of Software Application Technology, Guangzhou & Chinese Academy of Sciences, China
Jinfeng Bai , Institute of Automation, Chinese Academy of Sciences, China
Heterogeneous devices with large displays have become pervasive in people lives. While conveying public information, most of them are lack of support for human interaction. This paper proposes a cross devices interaction system for users to conveniently manipulate the content on public displays through personal mobile phones with camera. Users can acquire, insert, and act on elements of the displayed content with simple operations on mobile phones. Cross device elements targeting is done with an efficient visual based object matching and tracking algorithm when users capture the displayed contents as a live video. Augmented information for the elements is shown on the mobile phone screen. The content in the large displays can then be operated by clicking and dragging, etc., on the mobile phone. The proposed system can be applied to interactive advertisements, multi-user games, and conference discussions. An evaluation consisting of a series of experiments demonstrated the usability and efficiency of the proposed system.
augmented reality, Large display, mobile phone, object matching and tracking
Teng Li, Wei Hu, Jun Wu and Jinfeng Bai, "Camera based cross devices manipulating with augmented reality," 2013 IEEE International Conference on Multimedia and Expo Workshops (ICMEW), San Jose, CA, USA, 2013, pp. 1-6.