This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
A Framework for Weighted Fusion of Multiple Statistical Models of Shape and Appearance
November 2006 (vol. 28 no. 11)
pp. 1847-1857
This paper presents a framework for weighted fusion of several Active Shape and Active Appearance Models. The approach is based on the eigenspace fusion method proposed by Hall et al. [1], which has been extended to fuse more than two weighted eigenspaces using unbiased mean and covariance matrix estimates. To evaluate the performance of fusion, a comparative assessment on segmentation precision as well as facial verification tests are performed using the AR, EQUINOX, and XM2VTS databases. Based on the results, it is concluded that the fusion is useful when the model needs to be updated online or when the original observations are absent.

[1] P. Hall, D. Marshall, and R. Martin, “Merging and Splitting Eigenspace Models,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 9, pp. 1042-1049, Sept. 2000.
[2] T. Cootes, D. Cooper, C. Taylor, and J. Graham, “Active Shape Models—Their Training and Application,“ Computer Vision and Image Understanding, vol. 61, no. 1, pp. 38-59, 1995.
[3] T. Cootes and C. Taylor, “Active Shape Models—Smart Snakes,” Proc. British Machine Vision Conf., pp. 266-275, 1992.
[4] T. Cootes, G. Edwards, and C. Taylor, “Active Appearance Models,” Proc. European Conf. Computer Vision, H. Burkhardt and B. Neumann, eds., vol. 2, pp. 484-498, 1998.
[5] T. Cootes, G. Edwards, and C. Taylor, “Active Appearance Models,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 6, pp. 681-685, June 2001.
[6] S. Mitchell, B. Lelieveldt, R. van der Geest, H. Bosch, J. Reiber, and M. Sonka, “Multistage Hybrid Active Appearance Model Matching: Segmentation of Left and Right Ventricles in Cardiac MR Images,” IEEE Trans. Medical Imaging, vol. 20, no. 5, pp. 415-423, 2001.
[7] S. Mitchell, J. Bosch, B. Lelieveldt, R. van der Geest, J. Reiber, and M. Sonka, “3-D Active Appearance Models: Segmentation of Cardiac MR and Ultrasound Images,” IEEE Trans. Medical Imaging, vol. 21, no. 9, pp. 1167-1178, 2002.
[8] B. van Ginneken, A. Frangi, J. Staal, B. ter Haar Romeny, and M. Viergever, “Active Shape Model Segmentation with Optimal Features,“ IEEE Trans. Medical Imaging, vol. 21, no. 8, pp. 924-933, 2002.
[9] A.U. Batur and M.H. Hayes, “Adaptive Active Appearance Models,” IEEE Trans. Image Processing, vol. 14, no. 11, pp. 1707-1721, 2005.
[10] R. Beichel, H. Bischof, F. Leberl, and M. Sonka, “Robust Active Appearance Models and Their Application to Medical Image Analysis,“ IEEE Trans. Medical Imaging, vol. 24, no. 9, pp. 1151-1169, 2005.
[11] F. Sukno, J. Guerrero, and A. Frangi, “Homographic Active Shape Models for View-Independent Facial Analysis,” SPIE, Biometric Technology for Human Identification II, A. Jain and N. Ratha, eds., vol. 5779, pp. 152-163, 2005.
[12] H. van Assen, M. Danilouchkine, A. Frangi, S. Ordas, J. Westenberg, J. Reiber, and B. Lelieveldt, “SPASM: A 3D-ASM for Segmentation of Sparse and Arbitrarily Oriented Cardiac MRI Data,” Medical Image Analysis, vol. 10, no. 2, pp. 286-303, 2006.
[13] J. Lim, D. Ross, R.-S. Lin, and M.-H. Yan, “Incremental Learning for Visual Tracking,” Advances in Neural Information Processing Systems, L. Saul, Y. Weiss, and L. Bottou, eds., vol. 17, 2005.
[14] A. Levy and M. Lindenbaum, “Sequential Karhunen-Loeve Basis Extraction and Its Application to Images,” IEEE Trans. Image Processing, vol. 9, no. 8, pp. 1371-1374, 2000.
[15] J. Bunch, C. Nielsen, and D. Sorenson, “Rank-One Modification of the Symmetric Eigenproblem,” Numerische Mathematik, vol. 31, pp.31-48, 1978.
[16] S. Chandrasekaran, B. Manjunath, Y. Wang, J. Winkler, and H. Zhang, “An Eigenspace Update Algorithm for Image Analysis,” Graphical Models and Image Processing, vol. 59, no. 5, pp. 321-332, 1997.
[17] R. DeGroat and R. Roberts, “Efficient, Numerically Stablized Rank-One Eigenstructure Updating,” IEEE Trans. Acoustics, Speech, and Signal Processing, vol. 38, no. 2, pp. 301-316, 1990.
[18] H. Murakami and B. Kumar, “Efficient Calculation of Primary Images from a Set of Images,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 4, no. 5, pp. 511-515, 1982.
[19] A. Franco, A. Lumini, and D. Maio, “Eigenspace Merging for Model Updating,” Proc. 16th Int'l Conf. Pattern Recognition, vol. 2, pp. 156-159, 2002.
[20] X.S. Zhou, D. Comaniciu, and A. Gupta, “An Information Fusion Framework for Robust Shape Tracking,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 1, pp. 115-129, Jan. 2005.
[21] M.B. Stegmann, B.K. Ersboll, and R. Larsen, “FAME—A Flexible Appearance Modeling Environment,” IEEE Trans. Medical Imaging, vol. 22, no. 10, pp. 1319-1331, 2003.
[22] A. Martinez and R. Benavente, “The AR Face Database,” technical report, Computer Vision Center, Barcelona, 1998, http://rvl1.ecn.purdue.edu/_aleixaleix face DB.html.
[23] R. Davies, “Learning Shape: Optimal Models for Analysing Shape Variability,” PhD dissertation, Division of Imaging Science and Biomedical Eng., Univ. of Manchester, 2002.
[24] Equinox Face Database, http://www.equinoxsensors.com/productsHID.html , 2006.
[25] K. Messer, J. Matas, J. Kittler, J. Luettin, and G. Maitre, “XM2VTSDB: The Extended M2VTS Database,” Proc. Second Int'l Conf. Audio and Video-Based Biometric Person Authentication, pp. 72-77, 1999, http://xm2vtsdb.ee.surrey.ac.uk.
[26] V. Perlibakas, “Distance Measures for PCA-Based Face Recognition,” Pattern Recognition Letters, vol. 25, no. 6, pp. 711-724, 2004.
[27] R.A. Johnson and D.W. Wichern, Applied Multivariate Statistical Analysis, fifth ed. Prentice Hall, 2002.
[28] K.M. Hoffman and R. Kunze, Linear Algebra, second ed. Prentice Hall, 1971.
[29] C.D. Meyer, “Matrix Analysis and Applied Linear Algebra,” SIAM: Soc. for Industrial and Applied Math., 2001.

Index Terms:
AAM, ASM, model fusion, statistical model, segmentation.
Citation:
Constantine Butakoff, Alejandro F. Frangi, "A Framework for Weighted Fusion of Multiple Statistical Models of Shape and Appearance," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 28, no. 11, pp. 1847-1857, Nov. 2006, doi:10.1109/TPAMI.2006.215
Usage of this product signifies your acceptance of the Terms of Use.