This Article 
 Bibliographic References 
 Add to: 
Sequential Monte Carlo for Bayesian Matching of Objects with Occlusions
June 2006 (vol. 28 no. 6)
pp. 930-941
We consider the problem of locating instances of a known object in a novel scene by matching the fiducial features of the object. The appearance of the features and the shape of the object are modeled separately and combined in a Bayesian framework. In this paper, we present a novel matching scheme based on Sequential Monte Carlo, in which the features are matched sequentially, utilizing the information about the locations of previously matched features to constrain the task. The particle representation of hypotheses about the object position allow matching in multimodal and cluttered environments, where batch algorithms may have convergence difficulties. The proposed method requires no initialization or predetermined matching order, as the sequence can be started from any feature. We also utilize a Bayesian model to deal with features that are not detected due to occlusions or abnormal appearance. In our experiments, the proposed matching system shows promising results, with performance equal to batch approaches when the target distribution is unimodal, while surpassing traditional methods under multimodal conditions. Using the occlusion model, the object can be localized from only a few visible features, with the nonvisible parts predicted from the conditional prior model.

[1] T.F. Cootes, C.J. Taylor, D.H. Cooper, and J. Graham, “Active Shape Models— Their Training and Application,” Computer Vision and Image Understanding, vol. 61, no. 1, pp. 38-59, 1995.
[2] T.F. Cootes, G.J. Edwards, and C.J. Taylor, “Active Appearance Models,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 6, pp. 681-685, June 2001.
[3] L. Wiskott, J.-M. Fellous, N. Krüger, and C. von der Malsburg, “Face Recognition by Elastic Bunch Graph Matching,” Intelligent Biometric Techniques in Fingerprint and Face Recognition, L. Jain, U. Halici, I. Hayashi, and S. Lee, eds., CRC Press, 1999.
[4] W.J. Rucklidge, “Efficiently Locating Objects Using the Haussdorf distance,” Int'l J. Computer Vision, vol. 24, no. 3, pp. 251-270, 1997.
[5] C. Steger, “Occlusion, Clutter, and Illumination Invariant Object Recognition,” Int'l Archives of Photogrammetry and Remote Sensing, vol. XXXIV, part 3A, 2002.
[6] J. Sullivan, A. Blake, M. Isard, and J. MacCormick, “Bayesian Object Localisation in Images,” Int'l J. Computer Vision, vol. 44, no. 2, pp. 111-135, 2001.
[7] Y. Zhong, A.K. Jain, and M.-P. Dubuisson-Jolly, “Object Tracking Using Deformable Templates,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 5, pp. 544-549, May 2000.
[8] P.F. Felzenszwalb, “Representation and Detection of Deformable Shapes,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2003.
[9] M. Isard, “PAMPAS: Real-Valued Graphical Models for Computer Vision,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2003.
[10] E.B. Sudderth, A.T. Ihler, W.T. Freeman, and A.S. Willsky, “Nonparametric Belief Propagation,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2003.
[11] L. Sigal, M. Isard, B.H. Sigelman, and M.J. Black, “Attractive People: Assembling Loose-Limbed Models Using Non-Parametric Belief Propagation,” Proc. Neural Information Processing Systems Conf., 2003.
[12] J. Coughlan and H. Shen, “Shape Matching with Belief Propagation: Using Dynamic Quantization to Accommodata Occlusion and Clutter,” Proc. Workshop Generative Model-Based Vision, 2004.
[13] P. Pérez, A. Blake, and M. Gangnet, “Jetstream: Probabilistic Contour Extraction with Particles,” Proc. IEEE Int'l Conf. Computer Vision, 2001.
[14] J. Zhang, R. Collins, and Y. Liu, “Representation and Matching of Articulated Shapes,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2004.
[15] Z. Tu and S.-C. Zhu, “Image Segmentation by Data-Driven Markov Chain Monte Carlo,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 5, pp. 657-673, May 2002.
[16] J.G. Daugman, “Complete Discrete 2-D Gabor Transforms by Neural Networks for Image Analysis and Compression,” IEEE Trans. Acoustics, Speech, and Signal Processing, vol. 36, no. 7, pp. 1169-1179, 1988
[17] M.B. Stegmann, “Analysis and Segmentation of Face Images Using Point Annotations and Linear Subspace Techniques,” technical report, Informatics and Mathematical Modelling, Technical Univ. of Denmark, 2002, http://www
[18] Y. Zhou, L. Gu, and H.-J. Zhang, “Bayesian Tangent Shape Model: Estimating Shape and Pose Parameters via Bayesian Inference,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2003.
[19] A. Gelman, J.B. Carlin, H.S. Stern, and D.R. Rubin, Bayesian Data Analysis, second ed. Chapman & Hall, 2004.
[20] F.-F. Li, R. Fergus, and P. Perona, “A Bayesian Approach to Unsupervised One-Shot Learning of Object Categories,” Proc. Int'l Conf. Computer Vision, 2003.
[21] T. Tamminen and J. Lampinen, “A Bayesian Occlusion Model for Sequential Object Matching,” Proc. British Machine Vision Conf., 2004.
[22] D. Mumford, “Pattern Theory: A Unifying Perspective,” Perception as Bayesian Inference, D.C. Knill and W. Richards, eds. Cambridge Univ. Press, 1996.
[23] M.A. Fischler and R.C. Bolles, “Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography,” Comm. ACM, vol. 24, no. 6, pp. 381-395, 1981.
[24] Markov Chain Monte Carlo in Practice, W.R. Gilks, S. Richardson, and D.J. Spiegelhalter, eds. Chapman & Hall, 1996.
[25] T. Tamminen and J. Lampinen, “Bayesian Object Matching with Hierarchical Priors and Markov Chain Monte Carlo,” Bayesian Statistics 7, J. Bernardo, M. Bayarri, J. Berger, A. Dawid, D. Heckerman, A. Smith, and M. West, eds. Oxford Univ. Press, 2003.
[26] P. Matthews, “A Slowly Mixing Markov Chain with Implications for Gibbs Sampling,” Statistics & Probability Letters, vol. 17, pp. 231-236, 1993.
[27] F. Liang, “Use of Sequential Structure in Simulation from High-Dimensional Systems,” Physical Rev. E, vol. 67, no. 056101, 2003.
[28] Sequential Monte Carlo Methods in Practice, A. Doucet, N. de Freitas, and N. Gordon, eds. Springer, 2001.
[29] N. Chopin, “A Sequential Particle Filter Method for Static Models,” Biometrika, vol. 89, no. 3, pp. 539-552, 2002.
[30] C.P. Robert and G. Casella, Monte Carlo Statistical Methods. Springer, 2004.
[31] D. Fox, S. Thrun, W. Burgard, and F. Dellaert, “Particle Filters for Mobile Robot Localization,” Sequential Monte Carlo Methods in Practice, A. Doucet, N. de Freitas, and N. Gordon, eds. Springer, 2001.
[32] G. Kitagawa, “Monte Carlo Filter and Smoother for Non-Gaussian Nonlinear State Space Models,” J. Computational & Graphical Statistics, vol. 5, no. 1, pp. 1-25, 1996.
[33] A. Kong, J.S. Liu, and W.H. Wong, “Sequential Imputations and Bayesian Missing Data Problems,” J. Am. Statistical Assoc., vol. 89, no. 425, pp. 278-288, 1994.
[34] R. Karlsson and F. Gustafsson, “Monte Carlo Data Association for Multiple Target Tracking,” Proc. IEE Int'l Seminar Target Tracking: Algorithms and Applications, 2001.
[35] O. Jesorsky, K.J. Kirchberg, and R.W. Frischholz, “Robust Face Detection Using the Haussdorf Distance,” Proc. Int'l Conf. Audio- and Video-Based Biometric Person Authentication, 2001.
[36] D. Cristinacce, T. Cootes, and I. Scott, “A Multi-Stage Approach to Facial Feature Detection,” Proc. British Machine Vision Conf., 2004.

Index Terms:
Object recognition, statistical models in pattern recognition, Monte Carlo simulation.
Toni Tamminen, Jouko Lampinen, "Sequential Monte Carlo for Bayesian Matching of Objects with Occlusions," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 28, no. 6, pp. 930-941, June 2006, doi:10.1109/TPAMI.2006.128
Usage of this product signifies your acceptance of the Terms of Use.