This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
A Camera-Based Input Device for Large Interactive Displays
July/August 2005 (vol. 25 no. 4)
pp. 52-57
Gerald D. Morrison, Smart Technologies
Human?computer interaction using large-format displays is an active area of research that focuses on how humans can better work with computers or other machines. For this to happen, there must be an enabling technology that creates the interface between man and machine. Touch capabilities in a large-format display would be advantageous as a large display area is informationally dense and touch provides a natural, life-size interface to that information. This article describes a new enabling technology in the form of a camera-based man-machine input device that uses smart cameras to analyze a scene directly in front of a large-format computer display. The analysis determines where a user has touched the display, and then treats that information as a mouse click, thereby controlling the computer. Significant technological problems have been overcome to make the system robust enough for commercialization. The article also describes camera-based system architecture and presents some interesting advantages as well as new capabilities. The technology is ideally suited to large-format computer displays, thus creating a natural interface with familiar usage paradigms for human?computer interaction.

1. A. Wilson, "Smart Cameras Embed Processor Power," Vision Systems Design, 2003, pp. 95-99.
2. G. Morrison, M. Singh, and D. Holmgren, "Machine Vision Passive Touch Technology for Interactive Displays," Proc. Soc. for Information Display 2001 Int'l Symp., 2001.
3. I. MacKenzie and C. Ware, "Lag as a Determinant of Human Performance in Interactive Systems," Proc. Conf. Human Factors in Computing Systems, 1993, pp. 448-493.
4. T. Starner et al., "The Perceptive Workbench: Computer-Vision-Based Gesture Tracking, Object Tracking, as 3D Reconstruction for Augmented Desks," Machine Vision and Application, 2003, pp. 59-71.
5. G. Morrison and D. Holmgren, "Toward a Touch-Sensitive Display Wall," Proc. Soc. for Information Displays 2003 Int'l Symp., 2003.
6. V. Cheng and N. Kehtarnavaz, "A Smart Camera Application: DSP-Based People Detection and Tracking," SPIE J. Electronic Imaging, 2000.
7. J. Summet et al., "Increasing the Usability of Virtual Rear Projection," Int'l Workshop on Projector-Camera Systems, 2003.
8. T. Funkhouser and K. Li, "Large Format Displays," IEEE Computer Graphics and Applications, vol. 20, no. 4, 2000, pp. 20-21.
1. P. Wellner, "Interacting with Paper on the DigitalDesk," Comm. ACM, no. 7, 1993, pp. 87-96.
2. W. Freeman, D. Anderson, and P. Beardsley, "Computer Vision for Interactive Computer Graphics," IEEE Computer Graphics and Applications, vol. 18, no. 3, 1998, pp. 42-53.
3. F. Quek, T. Mysliwiec, and M. Zhao, "Finger Mouse: A Freehand Pointing Interface," Proc. Int'l Workshop on Automatic Face and Gesture Recognition, 1995.
4. J. Crowley, J. Bérard, and J. Coutaz, "Finger Tracking as an Input Device for Augmented Reality," Proc. Int'l Workshop on Gesture and Face Recognition, 1995.
5. C. Jennings, "Robust Finger Tracking with Multiple Cameras," Proc. IEEE Int'l Workshop Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems, 1999, pp. 152-160.
6. J. Crowley, J. Coutaz, and F. Bérard, "Things That See," Comm. ACM, 2000, pp. 54-64.
7. C. Hardenberg and F. Bérard, "Bare-Hand Human–Computer Interaction," Proc. ACM Workshop on Perceptive User Interfaces, 2001.
8. Z. Zhang et al., "Visual Panel: Virtual Mouse Keyboard and 3D Controller with an Ordinary Piece of Paper," Workshop on Perceptive User Interfaces, ACM Press, Nov. 2001.
9. T. Starner et al., "The Perceptive Workbench: Computer-Vision-Based Gesture Tracking, Object Tracking, as 3D Reconstruction for Augmented Desks," Machine Vision and Application, 2003, pp. 59-71.
10. B. Stenger et al., "Filtering Using a Tree Based Estimator," Proc. 9th IEEE Int'l Conf. Computer Vision, vol. 2, 2003, pp. 1063-1070.
11. J. Letessier and F. Bérard, "Visual Tracking of Bare Fingers for Interactive Surfaces," Proc. User Interface Software and Technology (UIST), 2004.
12. J. Rekimoto and N. Matsushita, "Perceptual Surfaces: Toward a Human and Object Sensitive Interactive Display," Proc. Workshop on Perceptual User Interfaces, 1997.
13. A. Wilson, "TouchLight: An Imaging Touch Screen and Display for Gesture-Based Interaction," Proc. Int'l Conf. Multimodal Interfaces, 2004.

Index Terms:
human-computer interaction, machine vision, large-format touch display, computer vision, smart cameras
Citation:
Gerald D. Morrison, "A Camera-Based Input Device for Large Interactive Displays," IEEE Computer Graphics and Applications, vol. 25, no. 4, pp. 52-57, July-Aug. 2005, doi:10.1109/MCG.2005.72
Usage of this product signifies your acceptance of the Terms of Use.