This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Pfinder: Real-Time Tracking of the Human Body
July 1997 (vol. 19 no. 7)
pp. 780-785

Abstract—Pfinder is a real-time system for tracking people and interpreting their behavior. It runs at 10Hz on a standard SGI Indy computer, and has performed reliably on thousands of people in many different physical locations. The system uses a multiclass statistical model of color and shape to obtain a 2D representation of head and hands in a wide range of viewing conditions. Pfinder has been successfully used in a wide range of applications including wireless interfaces, video databases, and low-bandwidth coding.

[1] A. Azarbayejani and A. Pentland, "Recursive Estimation of Motion, Structure and Focal Length," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 17, no. 6, pp. 562-575, June 1995.
[2] A. Baumberg and D. Hogg, "An Efficient Method for Contour Tracking Using Active Shape Models," Proc. Workshop Motion of Nonrigid and Articulated Objects.Los Alamitos, Calif.: IEEE CS Press, 1994.
[3] M. Bichsel, "Segmenting Simply Connected Moving Objects in a Static Scene," Trans. Pattern Analysis and Machine Intelligence, vol. 16, no. 11, pp. 1,138-1,142, Nov. 1994.
[4] T. Darrell, B. Blumberg, S. Daniel, B. Rhodes, P. Maes, and A. Pentland, "Alive: Dreams and Illusions," ACM SIGGraph, Computer Graphics Visual Proc., July 1995.
[5] T. Darrell and A. Pentland, "Cooperative Robust Estimation Using Layers of Support," Trans. Pattern Analysis and Machine Intelligence, vol. 17, no. 5, pp. 474-487, May 1995.
[6] W.D. Ellis, A Source Book of Gestalt Psychology.New York: Harcourt, Brace, 1938.
[7] D.M. Gavrila and L.S. Davis, "Towards 3D Model-Based Tracking and Recognition of Human Movement: A Multi-View Approach," Int'l Workshop Automatic Face- and Gesture-Recognition, Zurich. Los Alamitos, Calif.: IEEE CS Press, 1995.
[8] R.J. Kauth, A.P. Pentland, and G.S. Thomas, "Blob: An Unsupervised Clustering Approach to Spatial Preprocessing of Manuscripts Imagery," Proc. 11th Int'l Symp. Remote Sensing of the Environment,Ann Arbor, Mich., Apr. 1977.
[9] P. Maes, B. Blumberg, T. Darrell, and A. Pentland, "The ALIVE System: Full-Body Interaction With Animated Autonomous Agents," ACM Multimedia Systems, to appear.
[10] S. Mann and R.W. Picard, "Video Orbits: Characterizing the Coordinate Transformation Between Two Images Using the Projective Group," IEEE Trans. Image Processing, to appear.
[11] D. Metaxas and D. Terzopoulos, “Shape and Non-Rigid Motion Estimation through Physics-Based Synthesis,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 15, no. 6, pp. 580-591, June 1993.
[12] A. Pentland, "Classification by Clustering," Proc. Symp. Machine Processing of Remotely Sensed Data,Los Alamitos, Calif.: IEEE CS Press, June 1976.
[13] A. Pentland and B. Horowitz, “Recovery of Non-Rigid Motion and Structure,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 13, no. 7, pp. 730-742, July 1991.
[14] J. Rehg and T. Kanade, "Visual Tracking of High DOF Articulated Structures: An Application to Human Hand Tracking, European Conf. Computer Vision, pp. B:35-46, 1994.
[15] K. Rohr, "Towards Model-Based Recognition of Human Movements in Image Sequences," CVGIP: Image Understanding, vol. 59, no. 1, pp. 94-115, Jan. 1994.
[16] H.S. Sawhney and S. Ayer, "Compact Representations of Videos Through Dominant and Multiple Motion Estimation," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 18, no. 8, pp. 814-831, 1996.
[17] T. Starner and A. Pentland, "Real-Time American Sign Language Recognition From Video Using Hidden Markov Models," Proc. Int'l Symp. Computer Vision, Coral Gables, Fla., 1995.Los Alamitos, Calif.: IEEE CS Press.
[18] C. Wren, F. Sparacino, A. Azarbayejani, T. Darrell, T. Starner, K.A.C. Chao, M. Hlavac, K. Russell, and A. Pentland, "Perceptive Spaces for Peformance and Entertainment: Untethered Interaction Using Computer Vision and Audition," Applied Artificial Intelligence, vol. 11, no. 4, pp. 267-284, June 1997.

Index Terms:
Blobs, blob tracking, real-time, person tracking, 3D person tracking, segmentation, gesture recognition, mixture model, MDL.
Citation:
Christopher Richard Wren, Ali Azarbayejani, Trevor Darrell, Alex Paul Pentland, "Pfinder: Real-Time Tracking of the Human Body," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 19, no. 7, pp. 780-785, July 1997, doi:10.1109/34.598236
Usage of this product signifies your acceptance of the Terms of Use.