This Article 
 Bibliographic References 
 Add to: 
First Sight: A Human Body Outline Labeling System
April 1995 (vol. 17 no. 4)
pp. 359-377

Abstract—First Sight, a vision system in labeling the outline of a moving human body, is proposed in this paper. The emphasis of First Sight is on the analysis of motion information gathered solely from the outline of a moving human object. Two main processes are implemented in First Sight. The first process uses a novel technique to extract the outline of a moving human body from an image sequence. The second process, which employs a new human body model, interprets the outline and produces a labeled two-dimensional human body stick figure for each frame of the image sequence. Extensive knowledge of the structure, shape, and posture of the human body is used in the model. The experimental results of applying the technique on unedited image sequences with self-occlusions and missing boundary lines are encouraging.

[1] J.K. Aggarwal,L.S. Davis,, and W.N. Martin,“Survey: Representation methods for three-dimensional objects,” Progress in Pattern Recognition, pp. 377-391, 1981.
[2] G.J. Agin and T.O. Binford,“Computer description of curved objects,” IEEE Trans. Computers, vol. 25, no. 4, pp. 439-449, 1976.
[3] K. Akita,“Image sequence analysis of real world human motion,” Pattern Recognition, vol. 17, no. 1, pp. 73-83, 1984.
[4] N.I. Badler,J. O’Rourke,, and H. Toltzis,“A spherical representation of a human body for visualizing movement,” Proc IEEE, vol. 67, no. 10, pp. 1397-1403, 1979.
[5] N. Badler and S. Smoliar, “Digital Representations of Human Movement,” ACM Computing Surveys, vol. 11, no. 1, pp. 19-38, 1979.
[6] J.M. Brady and H. Asada,“Smoothed local symmetries and their implementation,” Int’l J. Robotics Research, vol. 3, no. 3, pp. 36-61, 1984.
[7] R.A. Brooks,“Goal directed edge linking and ribbon finding,” Proc. DARPA Image Understanding Workshop,Menlo Park, Calif., SRI, pp. 72-76, 1979.
[8] R.A. Brooks,“Symbolic reasoning among 3D models and 2D images,” Artificial Intelligence, vol. 17, pp. 285-348, 1981.
[9] D. DiFranco,Visual Processing of Human Movement, PhD thesis, Dept. of Psychology, Queen’s Univ., Kingston, Canada, 1980.
[10] D.P. Huttenlocher, G.A. Klanderman, and W.J. Rucklidge, “Comparing Images Using the Hausdorff Distance,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 15, no. 9, pp. 850-863, Sept. 1993.
[11] D. Huttenlocher, G. Klanderman, and W. Rucklidge, "Comparing Images Using the Hausdorff Distance Under Translation," Proc. IEEE Computer Vision and Pattern Recognition, pp. 654-656, 1992.
[12] M. Herman,Understanding Body Postures of Human Stick Figures, PhD thesis, Univ. of Maryland, 1979.
[13] D. Hogg,“Finding a known object using a generate and test strategy,” J. Parallel Architectures and Computer Vision, Oxford Science Publications, pp. 119-132, 1988.
[14] D.C. Hogg,“Model-based vision: A program to see a walking person,” Image and Vision Computing, vol. 1, no. 1, pp. 5-20, 1983.
[15] R. Jain,“Extraction of motion information from peripheral processes,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 3, no. 5, pp. 489-503, 1981.
[16] R. Jain and H.-H. Nagel,“On the analysis of accumulative difference pictures from image sequences of real-world scenes,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 1, no. 2, pp. 206-214, 1979.
[17] G. Johansson,“Visual perception of biological motion and a model for its analysis,” Perception and Psychophysics, vol. 14, no. 2, pp. 201-211, 1973.
[18] R. Laban,Laban’s Principles of Dance and Movement Notation, MacDonald&Evans Ltd., London, 1975.
[19] H.J. Lee and Z. Chen,Computer Vision for 3D Human Motion Analysis, PhD thesis, Inst. of Computer Eng., College of Eng., Nat’l ChiaoTung Univ., 1984.
[20] M.K. Leung and Y.H. Yang,“Human body motion segmentation in a complex scene,” Pattern Recognition, vol. 20, no. 1, pp. 55-64, 1987.
[21] M.K. Leung and Y.H. Yang,“A region-based approach for human body motion analysis,” Pattern Recognition, vol. 20, no. 3, pp. 321-339, 1987.
[22] M.K. Leung,First Sight: Towards a System in Human Body Motion Recognition and Understanding, PhD thesis, Univ. of Saskatchewan, Saskatoon, Canada, 1992.
[23] W. Long and Y.H. Yang,“Background generation: An alternative to the difference of two images,” Pattern Recognition, vol. 23, no. 5, pp. 1351-1359, 1990.
[24] W. Long and Y.H. Yang,“Log-tracker: An attribute-based approach to tracking human body motion,” Int’l J. of Pattern Recognition and Artificial Intellignce, vol. 5, pp. 439-458, 1991.
[25] R. Nevatia and K.R. Babu,“Linear feature extraction and description,” Computer Vision, Graphics, and Image Processing, vol. 13, no. 3, pp. 257-269, 1980.
[26] R. Nevatia and T.O. Binford,“Description and recognition of curved objects,” Artificial Intelligence, vol. 8, pp. 77-98, 1977.
[27] J. O’Rourke and N.I. Badler,“Model-based image analysis of human motion using constraint propagation,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 2, no. 6, pp. 522-536, 1980.
[28] J. Ponce,“On characterizing ribbons and finding skewed symmetries,” Computer Vision, Graphics, and Image Processing, vol. 52, pp. 328-340, 1990.
[29] K. Rao and R. Nevatia,“Computing volume descriptions from sparse 3D data,” Int’l J. of Computer Vision, vol. 2, pp. 33-50, 1988.
[30] R.F. Rashid,“Towards a system for the interpretation of moving light display,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 2, no. 6, pp. 574-581, 1980.
[31] K. Rohr, “Towards Model Based Recognition of Human Movements in Image Sequences,” CVGIP: Image Understanding, vol. 59, 1994.
[32] A. Rosenfeld, “Axial Representations of Shape,” Computer Vision, Graphics, and Image Processing, vol. 33, pp. 156-173, 1986.
[33] J.A. Webb and J.K. Aggarwal,“Visually interpreting the motion of objects in space,” Computer, vol. 14, no. 8, pp. 40-46, 1981.
[34] Y. Yang and M. Levine, The Background Primal Sketch: An Approach for Tracking Moving Objects Machine Vision and Applications, vol. 5, pp. 17-34, 1992.

Index Terms:
Coincidence edge, difference picture, human body, human body model, labeling, model, motion, outline, pose, posture, ribbon, stick figure.
Maylor K. Leung, Yee-Hong Yang, "First Sight: A Human Body Outline Labeling System," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 17, no. 4, pp. 359-377, April 1995, doi:10.1109/34.385981
Usage of this product signifies your acceptance of the Terms of Use.