The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.03 - March (2013 vol.35)
pp: 653-668
Wei-Shi Zheng , Sch. of Inf. Sci. & Technol., Sun Yat-sen Univ., Guangzhou, China
Shaogang Gong , Sch. of Electron. Eng. & Comput. Sci., Queen Mary, Univ. of London, London, UK
Tao Xiang , Sch. of Electron. Eng. & Comput. Sci., Queen Mary, Univ. of London, London, UK
ABSTRACT
Matching people across nonoverlapping camera views at different locations and different times, known as person reidentification, is both a hard and important problem for associating behavior of people observed in a large distributed space over a prolonged period of time. Person reidentification is fundamentally challenging because of the large visual appearance changes caused by variations in view angle, lighting, background clutter, and occlusion. To address these challenges, most previous approaches aim to model and extract distinctive and reliable visual features. However, seeking an optimal and robust similarity measure that quantifies a wide range of features against realistic viewing conditions from a distance is still an open and unsolved problem for person reidentification. In this paper, we formulate person reidentification as a relative distance comparison (RDC) learning problem in order to learn the optimal similarity measure between a pair of person images. This approach avoids treating all features indiscriminately and does not assume the existence of some universally distinctive and reliable features. To that end, a novel relative distance comparison model is introduced. The model is formulated to maximize the likelihood of a pair of true matches having a relatively smaller distance than that of a wrong match pair in a soft discriminant manner. Moreover, in order to maintain the tractability of the model in large scale learning, we further develop an ensemble RDC model. Extensive experiments on three publicly available benchmarking datasets are carried out to demonstrate the clear superiority of the proposed RDC models over related popular person reidentification techniques. The results also show that the new RDC models are more robust against visual appearance changes and less susceptible to model overfitting compared to other related existing models.
INDEX TERMS
Image color analysis, Vectors, Cameras, Data models, Computer aided instruction, Optimization, Feature extraction, relative distance comparison, Person reidentification, feature quantification, feature selection
CITATION
Wei-Shi Zheng, Shaogang Gong, Tao Xiang, "Reidentification by Relative Distance Comparison", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.35, no. 3, pp. 653-668, March 2013, doi:10.1109/TPAMI.2012.138
REFERENCES
[1] S. Bak, E. Corvee, F. Brémond, and M. Thonnat, "Person Re-Identification Using Spatial Covariance Regions of Human Body Parts," Proc. IEEE Int'l Conf. Advanced Video and Signal Based Surveillance, pp. 435-440, 2010.
[2] O. Chapelle and S.S. Keerthi, "Efficient Algorithms for Ranking with SVMS," Information Retrieval, vol. 13, pp. 201-215, June 2010.
[3] K. Chen, C. Lai, Y. Hung, and C. Chen, "An Adaptive Learning Method for Target Tracking across Multiple Cameras," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2008.
[4] D. Cheng, M. Cristani, M. Stoppa, L. Bazzani, and V. Murino, "Custom Pictorial Structures for Re-Identification," Proc. British Machine Vision Conf., 2011.
[5] J. Davis, B. Kulis, P. Jain, S. Sra, and I. Dhillon, "Information-Theoretic Metric Learning," Proc. Int'l Conf. Machine Learning, 2007.
[6] P. Dollar, Z. Tu, H. Tao, and S. Belongie, "Feature Mining for Image Classification," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2007.
[7] A. Ess, B. Leibe, and L. Van Gool, "Depth and Appearance for Mobile Scene Analysis," Proc. IEEE Int'l Conf. Computer Vision, 2007.
[8] M. Farenzena, L. Bazzani, A. Perina, M. Cristani, and V. Murino, "Person Re-Identification by Symmetry-Driven Accumulation of Local Features," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2010.
[9] Y. Freund, R. Iyer, R.E. Schapire, and Y. Singer, "An Efficient Boosting Algorithm for Combining Preferences," J. Machine Learning Research, no. 4, pp. 933-969, 2003.
[10] N. Gheissari, T. Sebastian, and R. Hartley, "Person Reidentification Using Spatiotemporal Appearance," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2006.
[11] A. Gilbert and R. Bowden, "Tracking Objects Across Cameras by Incrementally Learning Inter-Camera Colour Calibration and Patterns of Activity," Proc. European Conf. Computer Vision, 2006.
[12] A. Gilbert and R. Bowden, "Incremental, Scalable Tracking of Objects Inter Camera," Computer Vision and Image Understanding, vol. 111, no. 1, pp. 43-58, 2008.
[13] A. Globerson and S. Roweis, "Metric Learning by Collapsing Classes," Proc. Advances in Neural Information Processing Systems, 2005.
[14] D. Gray, S. Brennan, and H. Tao, "Evaluating Appearance Models for Recognition Reacquisition, and Tracking," Proc. IEEE Int'l Workshop Performance Evaluation of Tracking and Surveillance, 2007.
[15] D. Gray and H. Tao, "Viewpoint Invariant Pedestrian Recognition with an Ensemble of Localized Features," Proc. European Conf. Computer Vision, 2008.
[16] R. Herbrich, T. Graepel, and K. Obermayer, "Large Margin Rank Boundaries for Ordinal Regression," Proc. Advances in Neural Information Processing Systems, pp. 115-132, 1999.
[17] W. Hu, M. Hu, X. Zhou, J. Lou, T. Tan, and S. Maybank, "Principal Axis-Based Correspondence between Multiple Cameras for People Tracking," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 4, pp. 663-671, Apr. 2006.
[18] O. Javed, K. Shafique, Z. Rasheed, and M. Shah, "Modeling Inter-Camera Space-Time and Appearance Relationships for Tracking across Non-Overlapping Views," Computer Vision and Image Understanding, vol. 109, no. 2, pp. 146-162, 2008.
[19] O. Javed, K. Shafique, and M. Shah, "Appearance Modeling for Tracking in Multiple Non-Overlapping Cameras," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2005.
[20] J. Lee, R. Jin, and A. Jain, "Rank-Based Distance Metric Learning: An Application to Image Retrieval," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2008.
[21] H. Li, T. Jiang, and K. Zhang, "Efficient and Robust Feature Extraction by Maximum Margin Criterion," IEEE Trans. Neural Networks, vol. 17, no. 1, pp. 157-165, Jan. 2006.
[22] G. Lian, J. Lai, and W.-S. Zheng, "Spatial-Temporal Consistent Labeling of Tracked Pedestrians across Non-Overlapping Camera Views," Pattern Recognition, vol. 44, no. 5, pp. 1121-1136, 2011.
[23] C.-J. Lin, "Projected Gradient Methods for Nonnegative Matrix Factorization," Neural Computation, vol. 19, no. 10, pp. 2756-2779, 2007.
[24] C. Loy, T. Xiang, and S. Gong, "Time-Delayed Correlation Analysis for Multi-Camera Activity Understanding," Int'l J. Computer Vision, vol. 90, no. 1, pp. 106-129, 2010.
[25] D. Makris, T. Ellis, and J. Black, "Bridging the Gaps between Cameras," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2004.
[26] U. Park, A. Jain, I. Kitahara, K. Kogure, and N. Hagita, "Vise: Visual Search Engine Using Multiple Networked Cameras," Proc. Int'l Conf. Pattern Recognition, 2006.
[27] B. Prosser, S. Gong, and T. Xiang, "Multi-Camera Matching under Illumination Change over Time," Proc. ECCV Workshop Multi-Camera and Multi-Modal Sensor Fusion Algorithms and Applications, 2008.
[28] B. Prosser, W.-S. Zheng, S. Gong, and T. Xiang, "Person Re-Identification by Support Vector Ranking," Proc. British Machine Vision Conf., 2010.
[29] M. Schultz and T. Joachims, "Learning a Distance Metric from Relative Comparisons," Proc. Advances in Neural Information Processing Systems, 2004.
[30] W. Schwartz and L. Davis, "Learning Discriminative Appearance-Based Models Using Partial Least Squares," Proc. Brazilian Symp. Computer Graphics and Image Processing, 2009.
[31] UK, "Home Office i-LIDS Multiple Camera Tracking Scenario Definition," 2008.
[32] X. Wang, G. Doretto, T. Sebastian, J. Rittscher, and P. Tu, "Shape and Appearance Context Modeling," Proc. IEEE Int'l Conf. Computer Vision, 2007.
[33] K. Weinberger, J. Blitzer, and L. Saul, "Distance Metric Learning for Large Margin Nearest Neighbor Classification," Proc. Advances in Neural Information Processing Systems, 2006.
[34] S. Xiang, F. Nie, and C. Zhang, "Learning a Mahalanobis Distance Metric for Data Clustering and Classification," Pattern Recognition, vol. 41, no. 12, pp. 3600-3612, 2008.
[35] E. Xing, A. Ng, M. Jordan, and S. Russell, "Distance Metric Learning with Application to Clustering with Side-Information," Proc. Advances in Neural Information Processing Systems, 2002.
[36] L. Yang, R. Jin, R. Sukthankar, and Y. Liu, "An Efficient Algorithm for Local Distance Metric Learning," Proc. 21st Nat'l Conf. Artificial Intelligence, pp. 543-548, 2006.
[37] W.-S. Zheng, S. Gong, and T. Xiang, "Associating Groups of People," Proc. British Machine Vision Conf., 2009.
[38] W.-S. Zheng, S. Gong, and T. Xiang, "Person Re-Identification by Probabilistic Relative Distance Comparison," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2011.
[39] W.-S. Zheng, S. Gong, and T. Xiang, "Quantifying and Transferring Contextual Information in Object Detection," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 34, no. 4, pp. 762-777, Apr. 2012.
7 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool