This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Perceptive Presence
September/October 2003 (vol. 23 no. 5)
pp. 26-36
Frank Bentley, Massachusetts Institute of Technology
Konrad Tollmar, Massachusetts Institute of Technology
David Demirdjian, Massachusetts Institute of Technology
Kimberle Koile, Massachusetts Institute of Technology
Trevor Darrell, Massachusetts Institute of Technology

Perceptive presence systems automatically convey awareness of user states to a remote location or application without the user having to perform explicit commands or mode selection. The article describes a component-based architecture for creating presence applications using perceptual user interface widgets. Each widget performs a machine perception function, such as tracking a face or monitoring activity in a specific 3D location. Widgets provide an abstraction barrier between the perception algorithms and the needs of application writers. Two example applications developed using this framework are presented: one uses a luminous display to express a user's availability for communication to a colleague at a remote location, and a second uses activity to control devices in a context-aware environment.

1. C.A. DeUafera et al., "The Zephyr Notification Service," Proc. USENIX, USENIX Assoc., 1988, pp. 213-220.
2. P. Dourish and S. Bly, "Portholes: Supporting Awareness in a Distributed Work Group," Proc. Conf. Human Factors in Computing Systems, ACM Press, New York, 1992, pp. 541-547.
3. M. Turk and G. Robertson, "Perceptual User Interfaces," Comm. ACM, vol. 43, no. 3, 2000, pp. 32-34.
4. M. Lombard and T.B. Ditton, "At the Heart of it All: The Concept of Presence," J. Computer Mediated Comm., vol. 2, no. 3, Sept. 1997.
5. M. Lombard et al., "Measuring Presence: A Literature-Based Approach to the Development of a Standardized Paper-and-Pencil Instrument," Presence 2000: Proc. 3rd Int'l Workshop on Presence, 2000; http://www.graphicsinterface.org/proceedings/ 2001/158/http://doi.acm.org/10.1145/ 340916.340924http://www.cs.utah.edu/npr/ papers.htmlhttp://astro.temple.edu/~lombard p2000.htm.
6. C. Steinfield, C.-Y. Jang, and B. Pfaff, "Supporting Virtual Team Collaboration: The Teamscope System," Proc. Int'l ACM Siggroup Conf. Supporting Group Work (Group 99), ACM Press, 1999, pp. 81-90.
7. T. Darrell et al., "Face-Responsive Interfaces: From Direct Manipulation to Perceptive Presence," Proc. Ubiquitous Computing (UbiComp 2002), G. Borriello and L.E. Holmquist, eds., Springer-Verlag, 2002, pp. 135-151.
8. D. Demirdjian et al., "Activity Maps for Location-Aware Computing," Proc. IEEE Workshop Applications of Computer Vision, IEEE Press, 2002, p. 79.
9. P. Chou et al., Bluespace: Creating a Personalized and Context-Aware Workspace, tech. report RC 22281, IBM Research, 2001.
10. K. Tollmar and S. Junestrand, "Video Mediated Communication for Domestic Environments—Architectural and Technological Design," Proc. 2nd Int'l Workshop Cooperative Buildings—Integrating Information, Organizations, and Architecture (CoBuild 99), LNCS 1670, N. Streitz, et al., eds., Springer-Verlag, 1999, pp. 176-189.
1. M. Coen et al., "Meeting the Computational Needs of Intelligent Environments: The Metaglue System," Proc. 1st Int'l Conf. Workshop Managing Interactions in Smart Environments (Manse 99), Springer Verlag, 1999, pp. 201-212.
2. A.K. Dey, Providing Architectural Support for Building Context-Aware Applications, doctoral dissertation, College of Computing, Georgia Inst. of Technology, 2000.
3. B. Brumitt et al., "EasyLiving: Technologies for Intelligent Environments," Proc. 2nd Int'l Symp. Handheld and Ubiquitous Computing (HUC2K), Lecture Notes in Computer Science, vol. 1927, Springer-Verlag, Berlin, 2000, pp. 12-29.
4. A.K. Dey, D. Salber, and G.D. Abowd, "A Conceptual Framework and a Toolkit for Supporting the Rapid Prototyping of Context-Aware Applications," Human-Computer Interaction (HCI) J., vol. 16, nos. 2-4, 2001, pp. 97-166.
5. E.D. Mynatt et al., "Digital Family Portraits: Providing Peace of Mind for Extended Family Members," Proc. 2001 ACM Conf. Human Factors in Computing Systems (CHI 2001), ACM Press, New York, 2001, pp. 333-340.
6. K. Tollmar and J. Persson, "Understanding Remote Presence," Proc. NordiCHI (Computer Human Interaction) 02, ACM Press, 2002, pp. 41-50.
7. W. Gaver et al., "Realizing a Video Environment: EuroPARC's Rave System," Proc. Conf. Computer-Human Interaction (CHI 92), ACM Press, 1992, pp. 27-35.
8. P. Chou et al., Bluespace: Creating a Personalized and Context-Aware Workspace, tech. report RC 22281, IBM Research, 2001.
1. D. Demirdjian et al., "Activity Maps for Location-Aware Computing," Proc. IEEE Workshop Applications of Computer Vision, IEEE Press, 2002, p. 79.
2. P. Viola and M. Jones, Rapid Object Detection Using a Boosted Cascade of Simple Features Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2001.
3. L.-P. Morency et al., "Fast Stereo-Based Head Tracking for Interactive Environments," Proc. 5th Int'l IEEE Conf. Automatic Face and Gesture Recognition, IEEE CS Press, 2002, pp. 396-401; .

Citation:
Frank Bentley, Konrad Tollmar, David Demirdjian, Kimberle Koile, Trevor Darrell, "Perceptive Presence," IEEE Computer Graphics and Applications, vol. 23, no. 5, pp. 26-36, Sept.-Oct. 2003, doi:10.1109/MCG.2003.1231175
Usage of this product signifies your acceptance of the Terms of Use.