This Article 
 Bibliographic References 
 Add to: 
Strings: Variational Deformable Models of Multivariate Continuous Boundary Features
November 2003 (vol. 25 no. 11)
pp. 1399-1410

Abstract—We propose a new image segmentation technique called strings. A string is a variational deformable model that is learned from a collection of example objects rather than built from a priori analytical or geometrical knowledge. As opposed to existing approaches, an object boundary is represented by a one-dimensional multivariate curve in functional space, a feature function, rather than by a point in vector space. In the learning phase, feature functions are defined by extraction of multiple shape and image features along continuous object boundaries in a given learning set. The feature functions are aligned, then subjected to functional principal components analysis and functional principal regression to summarize the feature space and to model its content, respectively. Also, a Mahalanobis distance model is constructed for evaluation of boundaries in terms of their feature functions, taking into account the natural variations seen in the learning set. In the segmentation phase, an object boundary in a new image is searched for with help of a curve. The curve gives rise to a feature function, a string, that is weighted by the regression model and evaluated by the Mahalanobis model. The curve is deformed in an iterative procedure to produce feature functions with minimal Mahalanobis distance. Strings have been compared with active shape models on 145 vertebra images, showing that strings produce better results when initialized close to the target boundary, and comparable results otherwise.

[1] A. Baumberg and D. Hogg, “Learning Flexible Models from Image Sequences,” Computer Vision-ECCV '94, J.-O. Eklundh, ed., Springer-Verlag, vol. 1, pp. 299-308, 1994.
[2] M. Brejl and M. Sonka, Object Localization and Border Detection Criteria Design in Edge-Based Image Segmentation: Automated Learning from Examples IEEE Trans. Medical Imaging, vol. 19, pp. 973-985, 2000.
[3] S. Chatterjee, A.S. Hadi, and B. Price, Regression Analysis by Example. New York: John Wiley and Sons, 2000.
[4] T. Cootes, G. Edwards, and C. Taylor, Active Appearance Models IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 6, pp. 681-685, June 2001.
[5] T.F. Cootes and C.J. Taylor, Combining Point Distribution Models with Shape Models Based on Finite Element Analysis Image Vision and Computing, vol. 13, pp. 403-409, 1995.
[6] T.F. Cootes, C.J. Taylor, D.H. Cooper, and J. Graham, "Active Shape Models—Their Training and Application," Computer Vision and Image Understanding, vol. 61, no. 1, pp. 38-59, Jan. 1995.
[7] T.F. Cootes, C.J. Taylor, A. Lanitis, D.H. Cooper, and J. Graham, "Building and Using Flexible Models Incorporating Grey-Level Information," Proc. Fourth Int'l Conf. Computer Vision, pp. 242-246.Los Alamitos, Calif.: IEEE CS Press, 1993.
[8] R.H. Davies, T.F. Cootes, C. Twining, and C.J. Taylor, An Information Theoretic Approach to Statistical Shape Modelling Proc. British Machine Vision Conf., pp. 3-11, 2001.
[9] I.L. Dryden and K.V. Mardia, Statistical Shape Analysis. New York: John Wiley and Sons, 1998.
[10] J. Duckworth, What Is Chemometrics Proc. Int'l Conf. Near Infrared Spectroscopy, 1995.
[11] N. Duta, A.K. Jain, and M.-P. Dubuisson-Jolly, Automatic Construction of 2D Shape Models IEEE Trans. Pattern Analysis and Machince Intelligence, vol. 23, pp. 433-446, 2001.
[12] G.J. Edwards, A. Lanitis, C.J. Taylor, and T.F. Cootes, Statistical Models of Face Images: Improving Specificity Image and Vision Computing, vol. 16, no. 3, pp. 203-211, 1998.
[13] S.D. Fenster and J.R. Kender, Sectored Snakes: Evaluating Learned-Energy Segmentations IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 9, pp. 1028-1034, Sept. 2001.
[14] Plan and Operation of the Second National Health and Nutrition Examination Survey 1976-80 Programs and Collection Procedures, no. 15, DHHS publication no. (PHS) 81-1317, Nat'l Center for Health Statistics, July 1981.
[15] C. Goodall, Procrustes Methods in the Statistical Analysis of Shape Royal Statistical Soc. Series B. Methodological, vol. 53, no. 2, pp. 285-33, 1991.
[16] G. Hamarneh, Active Shape Model: Modeling Shape Variations and Gray Level Information and an Application to Image Search and Classification Technical Report R005/1998, Dept. of Signals and Systems, Chalmers Univ. of Technology, Sweden, 1998.
[17] J. Haslam, C.J. Taylor, and T.F. Cootes, A Probabalistic Fitness Measure for Deformable Template Models Proc. British Machine Vision Conf., pp. 33-42, 1994.
[18] S. Kirkpatrick, C. Gelatt, and M. Vecchi, Optimization by Simulated Annealing IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 5, no. 3, pp. 267-286, 1983.
[19] J.J. Koenderink, The Structure of Images Biological Cybernetics, vol. 50, pp. 363-370, 1984.
[20] A.C.W. Kotcheff and C.J. Taylor, Automatic Construction of Eigenshape Models Medical Image Analysis, vol. 2, pp. 303-314, 1998.
[21] R. Kramer, Chemometric Techniques for Quantitative Analysis. Marcel-Dekker, 1998.
[22] M. Leventon, E. Grimson, and O. Faugeras, Statistical Shape Influence in Geodesic Active Contours Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 316-322, June 2000.
[23] L. Piegl and W. Tiller, The NURBS Book.New York: Springer-Verlag, 1995.
[24] J. Ramsay and B.W. Silverman, Functional Data Analysis. Berlin: Springer-Verlag, 1997.
[25] S. Rowe and A. Blake, Statistical Feature Modelling for Active Contours Proc. European Conf. Computer Vision, vol. B, pp. 560-569, 1996.
[26] L.H. Staib and J.S. Duncan, “Boundary Finding with Parametrically Deformable Models,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 14, no. 11, pp. 1,061-1,075, Nov. 1992.
[27] B. van Ginneken, A.F. Frangi, J.J. Staal, B. ter Haar Romeny, and M. Viergever, Active Shape Model Segmentation with Optimal Features IEEE Trans. Medical Imaging, vol. 21, no. 8, pp. 924-933, 2002.
[28] Y. Wang and L.H. Staib, Boundary Finding with Prior Shape and Smoothness Models IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 7, pp. 738-743, July 2000.

Index Terms:
Machine learning, deformable models, energy minimization, multivariate statistics, shape analysis, functional data analysis, chemometrics, active shape models.
Sennay Ghebreab, Arnold W.M. Smeulders, "Strings: Variational Deformable Models of Multivariate Continuous Boundary Features," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 25, no. 11, pp. 1399-1410, Nov. 2003, doi:10.1109/TPAMI.2003.1240114
Usage of this product signifies your acceptance of the Terms of Use.