The Community for Technology Leaders
RSS Icon
Issue No.07 - July (2011 vol.33)
pp: 1457-1469
Matthew J. Leotta , Kitware, Inc., Clifton Park
Joseph L. Mundy , Brown University, Providence
In automated surveillance, one is often interested in tracking road vehicles, measuring their shape in 3D world space, and determining vehicle classification. To address these tasks simultaneously, an effective approach is the constrained alignment of a prior model of 3D vehicle shape to images. Previous 3D vehicle models are either generic but overly simple or rigid and overly complex. Rigid models represent exactly one vehicle design, so a large collection is needed. A single generic model can deform to a wide variety of shapes, but those shapes have been far too primitive. This paper uses a generic 3D vehicle model that deforms to match a wide variety of passenger vehicles. It is adjustable in complexity between the two extremes. The model is aligned to images by predicting and matching image intensity edges. Novel algorithms are presented for fitting models to multiple still images and simultaneous tracking while estimating shape in video. Experiments compare the proposed model to simple generic models in accuracy and reliability of 3D shape recovery from images and tracking in video. Standard techniques for classification are also used to compare the models. The proposed model outperforms the existing simple models at each task.
Machine vision, road vehicle location monitoring, image shape analysis, image recognition, video signal processing.
Matthew J. Leotta, Joseph L. Mundy, "Vehicle Surveillance with a Generic, Adaptive, 3D Vehicle Model", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.33, no. 7, pp. 1457-1469, July 2011, doi:10.1109/TPAMI.2010.217
[1] D. Koller, "Moving Object Recognition and Classification Based on Recursive Shape Parameter Estimation," Proc. 12th Israeli Conf. Artificial Intelligence, Computer Vision, and Neural Networks, pp. 359-368, Dec. 1993.
[2] J.M. Ferryman, A.D. Worrall, G.D. Sullivan, and K.D. Baker, "A Generic Deformable Model for Vehicle Recognition," Proc. British Conf. Machine Vision, vol. 1, pp. 127-136, 1995.
[3] V. Blanz and T. Vetter, "A Morphable Model for the Synthesis of 3D Faces," Proc. SIGGRAPH, pp. 187-194, 1999.
[4] D. Anguelov, P. Srinivasan, D. Koller, S. Thrun, J. Rodgers, and J. Davis, "Scape: Shape Completion and Animation of People," ACM Trans. Graphics, vol. 24, no. 3, pp. 408-416, 2005.
[5] Y. Guo, C. Rao, S. Samarasekera, J. Kim, R. Kumar, and H. Sawhney, "Matching Vehicles under Large Pose Transformations Using Approximate 3D Models and Piecewise MRF Model," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1-8, June 2008.
[6] X. Song and R. Nevatia, "A Model-Based Vehicle Segmentation Method for Tracking," Proc. IEEE Int'l Conf. Computer Vision, vol. 2, pp. 1124-1131, Oct. 2005.
[7] M.J. Leotta and J.L. Mundy, "Predicting High Resolution Image Edges with a Generic, Adaptive, 3-D Vehicle Model," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1311-1318, 2009.
[8] M.J. Leotta, "Generic, Deformable Models for 3-D Vehicle Surveillance," PhD dissertation, Brown Univ., May 2010.
[9] D. Beymer, P. McLauchlan, B. Coifman, and J. Malik, "A Real-Time Computer Vision System for Measuring Traffic Parameters," Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, pp. 495-501, June 1997.
[10] C. Harris and M. Stephens, "A Combined Corner and Edge Detector," Proc. Alvey Vision Conf., pp. 147-151, 1988.
[11] N.K. Kanhere and S.T. Birchfield, "Real-Time Incremental Segmentation and Tracking of Vehicles at Low Camera Angles Using Stable Features," IEEE Trans. Intelligent Transportation Systems, vol. 9, no. 1, pp. 148-160, 2008.
[12] V. Jain, B.B. Kimia, and J.L. Mundy, "Segregation of Moving Objects Using Elastic Matching," Computer Vision and Image Understanding, vol. 108, pp. 230-242, 2007.
[13] M. Leotta and J. Mundy, "Epipolar Curve Tracking in 3-D," Proc. IEEE Int'l Conf. Image Processing, vol. 6, pp. 325-328, Sept. 2007.
[14] J. Canny, "A Computational Approach to Edge Detection," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 8, no. 6, pp. 679-698, Nov. 1986.
[15] C. Stauffer and W. Grimson, "Adaptive Background Mixture Models for Real-Time Tracking," Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 2, pp. 246-252, 1999.
[16] S. Gupte, O. Masoud, R. Martin, and N. Papanikolopoulos, "Detection and Classification of Vehicles," IEEE Trans. Intelligent Transportation Systems, vol. 3, no. 1, pp. 37-47, Mar. 2002.
[17] S. Atev, H. Arumugam, O. Masoud, R. Janardan, and N. Papanikolopoulos, "A Vision-Based Approach to Collision Prediction at Traffic Intersections," IEEE Trans. Intelligent Transportation Systems, vol. 6, no. 4, pp. 416-423, Dec. 2005.
[18] J.-Y. Choi, K.-S. Sung, and Y.-K. Yang, "Multiple Vehicles Detection and Tracking Based on Scale-Invariant Feature Transform," Proc. IEEE Intelligent Transportation Systems Conf., pp. 528-533, 2007.
[19] D.M. Ha, J.M. Lee, and Y.D. Kim, "Neural-Edge-Based Vehicle Detection and Traffic Parameter Extraction," Image and Vision Computing, vol. 22, no. 11, pp. 899-907, 2004.
[20] D. Koller, J. Weber, and J. Malik, "Robust Multiple Car Tracking with Occlusion Reasoning," Proc. European Conf. Computer Vision, pp. 189-196, 1994.
[21] P.L.M. Bouttefroy, A. Bouzerdoum, S.L. Phung, and A. Beghdadi, "Vehicle Tracking by Non-Drifting Mean-Shift Using Projective Kalman Filter," Proc. IEEE Conf. Intelligent Transportation Systems, pp. 61-66, Oct. 2008.
[22] D.R. Magee, "Tracking Multiple Vehicles Using Foreground, Background and Motion Models," Image and Vision Computing, vol. 22, no. 2, pp. 143-155, 2004.
[23] B. Leibe, A. Leonardis, and B. Schiele, "Robust Object Detection with Interleaved Categorization and Segmentation," Int'l J. Computer Vision, vol. 77, nos. 1-3, pp. 259-289, May 2008.
[24] J. Liebelt, C. Schmid, and K. Schertler, "Viewpoint-Independent Object Class Detection Using 3D Feature Maps," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1-8, June 2008.
[25] J.L. Mundy and C.-F. Chang, "Fusion of Intensity, Texture, and Color in Video Tracking Based on Mutual Information," Proc. Applied Image Pattern Recognition Workshop, pp. 10-15, 2004.
[26] J. van Leuven, M. van Leeuwen, and F. Groen, "Real-Time Vehicle Tracking in Image Sequences," Proc. IEEE Instrumentation and Measurement Technology Conf., vol. 3, pp. 2049-2054, 2001.
[27] M.-P. Dubuisson Jolly, S. Lakshmanan, and A. Jain, "Vehicle Segmentation and Classification Using Deformable Templates," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 18, no. 3, pp. 293-308, Mar. 1996.
[28] H. Dahlkamp, H. Nagel, A. Ottlik, and P. Reuter, "A Framework for Model-Based Tracking Experiments in Image Sequences," Int'l J. Computer Vision, vol. 73, no. 2, pp. 139-157, 2007.
[29] T. Cootes, G. Edwards, and C. Taylor, "Active Appearance Models," Proc. European Conf. Computer Vision, vol. 2, pp. 484-498, 1998.
[30] T. Cootes et al., "Active Shape Models—Their Training and Application," Computer Vision and Image Understanding, vol. 61, no. 1, pp. 38-59, 1995.
[31] E. Catmull and J. Clark, "Recursively Generated B-Spline Surfaces on Arbitrary Topological Surfaces," Computer-Aided Design, vol. 10, no. 6, pp. 350-355, 1978.
[32] T. Drummond and R. Cipolla, "Real-Time Visual Tracking of Complex Structures," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 7, pp. 932-946, July 2002.
[33] D. Lowe, "Fitting Parameterized Three-Dimensional Models to Images," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 13, no. 5, pp. 441-450, May 1991.
[34] A.N. Tikhonov and V.Y. Arsenin, Solutions of Ill Posed Problems. Winston, 1977.
[35] C.V. Stewart, "Robust Parameter Estimation in Computer Vision," SIAM Rev., vol. 41, no. 3, pp. 513-537, 1999.
[36] A.E. Beaton and J.W. Tukey, "The Fitting of Power Series, Meaning Polynomials, Illustrated on Band-Spectroscopic Data," Technometrics, vol. 16, no. 2, pp. 147-185, May 1974.
[37] D.W. Marquardt, "An Algorithm for Least-Squares Estimation of Nonlinear Parameters," J. SIAM, vol. 11, no. 2, pp. 431-441, June 1963.
[38] J. Shi and C. Tomasi, "Good Features to Track," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 593-600, 1994.
[39] A.A. Ambardekar, "Efficient Vehicle Tracking and Classification for an Automated Traffic Surveillance System," master's thesis, Univ. of Nevada, Reno, Dec. 2007.
[40] A. Ottlik and H. Nagel, "Initialization of Model-Based Vehicle Tracking in Video Sequences of Inner-City Intersections," Int'l J. Computer Vision, vol. 80, no. 2, pp. 211-225, 2008.
[41] R. Duda, P. Hart, and D. Stork, Pattern Classification. Wiley 2001.
[42] Supplemental Material and Source Code. http://www.lems. defvehicle3d.php, 2010.
21 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool