This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
The HumanID Gait Challenge Problem: Data Sets, Performance, and Analysis
February 2005 (vol. 27 no. 2)
pp. 162-177
Identification of people by analysis of gait patterns extracted from video has recently become a popular research problem. However, the conditions under which the problem is "solvable” are not understood or characterized. To provide a means for measuring progress and characterizing the properties of gait recognition, we introduce the HumanID Gait Challenge Problem. The challenge problem consists of a baseline algorithm, a set of 12 experiments, and a large data set. The baseline algorithm estimates silhouettes by background subtraction and performs recognition by temporal correlation of silhouettes. The 12 experiments are of increasing difficulty, as measured by the baseline algorithm, and examine the effects of five covariates on performance. The covariates are: change in viewing angle, change in shoe type, change in walking surface, carrying or not carrying a briefcase, and elapsed time between sequences being compared. Identification rates for the 12 experiments range from 78 percent on the easiest experiment to 3 percent on the hardest. All five covariates had statistically significant effects on performance, with walking surface and time difference having the greatest impact. The data set consists of 1,870 sequences from 122 subjects spanning five covariates (1.2 Gigabytes of data). The gait data, the source code of the baseline algorithm, and scripts to run, score, and analyze the challenge experiments are available at http://www.GaitChallenge.org. This infrastructure supports further development of gait recognition algorithms and additional experiments to understand the strengths and weaknesses of new algorithms. The more detailed the experimental results presented, the more detailed is the possible meta-analysis and greater is the understanding. It is this potential from the adoption of this challenge problem that represents a radical departure from traditional computer vision research methodology.

[1] M.W. Whittle, “Clinical Gait Analysis: A Review,” Human Movement Science, vol. 15, pp. 369-387, June 1996.
[2] G. Johansson, “Visual Motion Perception,” Scientific Am., vol. 232, pp. 75-88, June 1976.
[3] J.E. Cutting and L.T. Kozlowski, “Recognition of Friends by Their Walk,” Bull. of the Psychonomic Soc., vol. 9, pp. 353-356, 1977.
[4] S.V. Stevenage, M.S. Nixon, and K. Vince, “Visual Analysis of Gait as a Cue to Identity,” Applied Cognitive Psychology, vol. 13, pp. 513-526, Dec. 1999.
[5] B. Flinchbaugh and B. Chandrasekaran, “A Theory of Spatio-Temporal Aggregation for Vision,” Artificial Intelligence, vol. 17, pp. 387-407, 1981.
[6] J.A. Webb and J.K. Aggarwal, “Structure from Motion of Rigid and Jointed Objects,” Artificial Intelligence, vol. 19, pp. 107-130, 1982.
[7] A. Hilton and P. Fua, “Modeling People toward Vision-Based Understanding of a Person's Shape, Appearance, and Movement,” Computer Vision and Image Understanding, vol. 81, pp. 227-230, Mar. 2001.
[8] J. Aggarwal and Q. Cai, “Human Motion Analysis: A Review,” Computer Vision and Image Understanding, vol. 73, pp. 428-440, Mar. 1999.
[9] D. Gavrila, “The Visual Analysis of Human Movement: A Survey,” Computer Vision and Image Understanding, vol. 73, pp. 82-98, Jan. 1999.
[10] T. Moeslund and E. Granum, “A Survey of Computer Vision-Based Human Motion Capture,” Computer Vision and Image Understanding, vol. 81, pp. 231-268, Mar. 2001.
[11] Motion-Based Recognition, M. Shah and R. Jain, eds. Kluwer, 1997.
[12] S. Niyogi and E. Adelson, “Analyzing Gait with Spatiotemporal Surfaces,” Computer Vision and Pattern Recognition, 1994.
[13] J. Little and J. Boyd, “Recognizing People by Their Gait: The Shape of Motion,” Videre, vol. 1, no. 2, pp. 1-33, 1998.
[14] J. Shutler, M. Nixon, and C. Carter, “Statistical Gait Description via Temporal Moments,” Proc. Fourth IEEE Southwest Symp. Image Analysis and Interpretation, pp. 291-295, 2000.
[15] A. Bobick and A. Johnson, “Gait Recognition Using Static, Activity-Specific Parameters,” Computer Vision and Pattern Recognition, pp. I:423-430, 2001.
[16] R. Tanawongsuwan and A. Bobick, “Gait Recognition from Time-Normalized Joint-Angle Trajectories in the Walking Plane,” Computer Vision and Pattern Recognition, pp. II:726-731, 2001.
[17] G. Shakhnarovich, L. Lee, and T. Darrell, “Integrated Face and Gait Recognition from Multiple Views,” Computer Vision and Pattern Recognition, pp. I:439-446, 2001.
[18] J. Hayfron-Acquah, M. Nixon, and J. Carter, “Automatic Gait Recognition by Symmetry Analysis,” Proc. Int'l Conf. Audio- and Video-Based Biometric Person Authentication, pp. 272-277, 2001.
[19] C. BenAbdelkader, R. Cutler, and L. Davis, “Motion-Based Recognition of People in Eigengait Space,” Proc. Int'l Conf. Automatic Face and Gesture Recognition, pp. 267-272, 2002.
[20] L. Lee and W. Grimson, “Gait Analysis for Recognition and Classification,” Proc. Int'l Conf. Automatic Face and Gesture Recognition, pp. 155-162, 2002.
[21] A. Kale, A. Rajagopalan, N. Cuntoor, and V. Kruger, “Gait-Based Recognition of Humans Using Continuous HMMs,” Proc. Int'l Conf. Automatic Face and Gesture Recognition, pp. 336-341, 2002.
[22] R. Collins, R. Gross, and J. Shi, “Silhouette-Based Human Identification from Body Shape and Gait,” Proc. Int'l Conf. Automatic Face and Gesture Recognition, pp. 366-371, 2002.
[23] L. Wang, W. Hu, and T. Tan, “A New Attempt to Gait-Based Human Identification,” Proc. Int'l Conf. Pattern Recognition, vol. 1, pp. 115-118, 2002.
[24] D. Tolliver and R. Collins, “Gait Shape Estimation for Identification,” Proc. Int'l Conf. Audio- and Video-Based Biometric Person Authentication, 2003.
[25] A. Kale, N. Cuntoor, and R. Chellappa, “A Framework for Activity Specific Human Identification,” Proc. Int'l Conf. Acoustics, Speech, and Signal Processing, 2002.
[26] A. Sunderesan, A.K.R. Chowdhury, and R. Chellappa, “A Hidden Markov Model Based Framework for Recognition of Humans from Gait Sequences,” Proc. IEEE Int'l Conf. Image Processing, 2003.
[27] N. Cuntoor, A. Kale, and R. Chellappa, “Combining Multiple Evidences for Gait Recognition,” Proc. IEEE Int'l Conf. Acoustics, Speech, and Signal Processing, 2003.
[28] R. Tanawongsuwan and A. Bobick, “Performance Analysis of Time-Distance Gait Parameters under Different Speeds,” Proc. Int'l Conf. Audio- and Video-Based Biometric Person Authentication, 2003.
[29] A. Johnson and A. Bobick, “A Multi-View Method for Gait Recognition Using Static Body Parameters,” Proc. Int'l Conf. Audio- and Video-Based Biometric Person Authentication, pp. 301-311, 2001.
[30] A. Kale, N. Cuntoor, B. Yegnanarayana, A.N. Rajagopalan, and R. Chellappa, “Gait Analysis for Human Identification,” Proc. Int'l Conf. Audio- and Video-Based Biometric Person Authentication, 2003.
[31] L. Lee, G. Dalley, and K. Tieu, “Learning Pedestrian Models for Silhouette Refinement,” Proc. Int'l Conf. Computer Vision, 2003.
[32] L. Wang, T. Tan, H. Ning, and W. Hu, “Silhouette Analysis-Based Gait Recognition for Human Identification,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, no. 12, pp. 1505-1518, Dec. 2003.
[33] I.R. Vega and S. Sarkar, “Representation of the Evolution of Feature Relationship Statistics: Human Gait-Based Recognition,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, no. 10, pp. 1323-1328, Oct. 2003.
[34] P.J. Phillips, S. Sarkar, I. Robledo, P. Grother, and K. Bowyer, “The Gait Identification Challenge Problem: Data Sets and Baseline Algorithm,” Proc. Int'l Conf. Pattern Recognition, pp. 385-388, 2002.
[35] R. Gross and J. Shi, “The CMU Motion of Body MOBO Database,” technical report, Carnegie Mellon Univ., 2001.
[36] P.J. Phillips, H. Moon, S. Rizvi, and P. Rauss, “The FERET Evaluation Methodology for Face-Recognition Algorithms,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 10, pp. 1090-1104, Oct. 2000.
[37] R. Duda, P. Hart, and D. Stork, Pattern Classification. Wiley, 2001.
[38] P.J. Phillips, D. Blackburn, M. Bone, P. Grother, R. Micheals, and E. Tabassi, “Face Recogntion Vendor Test,” http:/www.frvt.org, 2002.
[39] F. Wilcoxon, “Individual Comparisons by Ranking Methods,” Biometrics, vol. 1, pp. 80-83, 1945.
[40] J. Jaccard and C.K. Wan, LISREL Approach to Interaction Effects in Multiple Regression. Sage Publications, 1996.

Index Terms:
Gait recognition, human motion analysis, biometrics, human identification, silhouette detection, spatiotemporal correlation.
Citation:
"The HumanID Gait Challenge Problem: Data Sets, Performance, and Analysis," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 27, no. 2, pp. 162-177, Feb. 2005, doi:10.1109/TPAMI.2005.39
Usage of this product signifies your acceptance of the Terms of Use.