The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.03 - March (2013 vol.35)
pp: 611-623
Hongzhi Wang , Dept. of Radiol., Univ. of Pennsylvania, Philadelphia, PA, USA
J. W. Suh , HeartFlow, Inc., Redwood City, CA, USA
S. R. Das , Dept. of Radiol., Univ. of Pennsylvania, Philadelphia, PA, USA
J. B. Pluta , Dept. of Radiol., Univ. of Pennsylvania, Philadelphia, PA, USA
C. Craige , Sch. of Med., Temple Univ., Temple, TX, USA
P. A. Yushkevich , Dept. of Radiol., Univ. of Pennsylvania, Philadelphia, PA, USA
ABSTRACT
Multi-atlas segmentation is an effective approach for automatically labeling objects of interest in biomedical images. In this approach, multiple expert-segmented example images, called atlases, are registered to a target image, and deformed atlas segmentations are combined using label fusion. Among the proposed label fusion strategies, weighted voting with spatially varying weight distributions derived from atlas-target intensity similarity have been particularly successful. However, one limitation of these strategies is that the weights are computed independently for each atlas, without taking into account the fact that different atlases may produce similar label errors. To address this limitation, we propose a new solution for the label fusion problem in which weighted voting is formulated in terms of minimizing the total expectation of labeling error and in which pairwise dependency between atlases is explicitly modeled as the joint probability of two atlases making a segmentation error at a voxel. This probability is approximated using intensity similarity between a pair of atlases and the target image in the neighborhood of each voxel. We validate our method in two medical image segmentation problems: hippocampus segmentation and hippocampus subfield segmentation in magnetic resonance (MR) images. For both problems, we show consistent and significant improvement over label fusion strategies that assign atlas weights independently.
INDEX TERMS
Image segmentation, Educational institutions, Biomedical imaging, Joints, Indexes, Accuracy, Radiology, hippocampal segmentation, Multi-atlas label fusion segmentation, dependence
CITATION
Hongzhi Wang, J. W. Suh, S. R. Das, J. B. Pluta, C. Craige, P. A. Yushkevich, "Multi-Atlas Segmentation with Joint Label Fusion", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.35, no. 3, pp. 611-623, March 2013, doi:10.1109/TPAMI.2012.143
REFERENCES
[1] P. Aljabar, R. Heckemann, A. Hammers, J. Hajnal, and D. Rueckert, "Multi-Atlas Based Segmentation of Brain Images: Atlas Selection and Its Effect on Accuracy," NeuroImage, vol. 46, pp. 726-739, 2009.
[2] S. Allassonniere, Y. Amit, and A. Trouve, "Towards a Coherent Statistical Framework for Dense Deformable Template Estimation," J. Royal Statistical Soc. Series B, vol. 69, no. 1, pp. 3-29, 2007.
[3] X. Artaechevarria, A. Munoz-Barrutia, and C. Ortiz de Solorzano, "Combination Strategies in Multi-Atlas Image Segmentation: Application to Brain MR Data," IEEE Trans. Medical Imaging, vol. 28, no. 8, pp. 1266-1277, Aug. 2009.
[4] B. Avants, C. Epstein, M. Grossman, and J. Gee, "Symmetric Diffeomorphic Image Registration with Cross-Correlation: Evaluating Automated Labeling of Elderly and Neurodegenerative Brain," Medical Image Analysis, vol. 12, no. 1, pp. 26-41, 2008.
[5] D. Blezek and J. Miller, "Atlas Stratification," Medical Image Analysis, vol. 11, no. 5, pp. 443-457, 2007.
[6] O. Carmichael, H. Aizenstein, S. Davis, J. Becker, P. Thompson, C. Meltzer, and Y. Liu, "Atlas-Based Hippocampus Segmentation in Alzheimers Disease and Mild Cognitive Impairment," NeuroImage, vol. 27, no. 4, pp. 979-990, 2005.
[7] D. Collins and J. Pruessner, "Towards Accurate, Automatic Segmentation of the Hippocampus and Amygdala from MRI by Augmenting ANIMAL with a Template Library and Label Fusion," NeuroImage, vol. 52, no. 4, pp. 1355-1366, 2010.
[8] P. Coupe, J.V. Manjon, V. Fonov, J. Pruessner, N. Robles, and D.L. Collins, "Nonlocal Patch-Based Label Fusion for Hippocampus Segmentation," Proc. Int'l Conf. Computing and Computer Assisted Interventions, 2010.
[9] M. de Leon, S. DeSanti, R. Zinkowski, P. Mehta, D. Pratico, S. Segal, H. Rusinek, J. Li, W. Tsui, L. Louis, C. Clark, C. Tarshish, Y. Li, L. Lair, E. Javier, K. Rich, P. Lesbre, L. Mosconi, B. Reisberg, M. Sadowski, J. DeBernadis, D. Kerkman, H. Hampel, L.-O. Wahlund, and P. Davies, "Longitudinal CSF and MRI Biomarkers Improve the Diagnosis of Mild Cognitive Impairment," Neurobiology Aging, vol. 27, no. 3, pp. 394-401, 2006.
[10] L. Dice, "Measure of the Amount of Ecological Association between Species," Ecology, vol. 26, pp. 297-302, 1945.
[11] B. Fischl, D. Salat, E. Busa, M. Albert, M. Dieterich, C. Haselgrove, A. van der Kouwe, A. Killiany, A. Kennedy, S. Klaveness, A. Montillo, N. Makris, B. Rosen, and A. Dale, "Whole Brain Segmentation: Automated Labeling of Neuroanatomical Structures in the Human Brain," Neuron, vol. 33, pp. 341-355, 2002.
[12] A. Guimond, J. Meunier, and J.P. Thirion, "Average Brain Models: A Convergence Study," Computer Vision and Image Understanding, vol. 77, no. 2, pp. 192-210, 2000.
[13] L.K. Hansen and P. Salamon, "Neural Network Ensembles," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 12, no. 10, pp. 993-1001, Oct. 1990.
[14] J. Hartung, G. Knapp, and B.K. Sinha, Statistical Meta-Analysis with Application. Wiley, 2008.
[15] D. Hasboun, M. Chantome, A. Zouaoui, M. Sahel, M. Deladoeuille, N. Sourour, M. Duymes, M. Baulac, C. Marsault, and D. Dormont, "MR Determination of Hippocampal Volume: Comparison of Three Methods," Am. J. Neuroradiology, vol. 17, pp. 1091-1098, 1996.
[16] R. Heckemann, J. Hajnal, P. Aljabar, D. Rueckert, and A. Hammers, "Automatic Anatomical Brain MRI Segmentation Combining Label Propagation and Decision Fusion," NeuroImage, vol. 33, pp. 115-126, 2006.
[17] I. Isgum, M. Staring, A. Rutten, M. Prokop, M. Viergever, and B. van Ginneken, "Multi-Atlas-Based Segmentation with Local Decision Fusionapplication to Cardiac and Aortic Segmentation in CT Scans," IEEE Trans. Machine Intelligence, vol. 28, no. 7, pp. 1000-1010, July 2009.
[18] S. Joshi, B. Davis, M. Jomier, and G. Gerig, "Unbiased Diffeomorphism Atlas Construction for Computational Anatomy," NeuroImage, vol. 23, pp. 151-160, 2004.
[19] J. Kittler, "Combining Classifiers: A Theoretical Framework," Pattern Analysis and Application, vol. 1, pp. 18-27, 1998.
[20] K. Leung, J. Barnes, G. Ridgway, J. Bartlett, M. Clarkson, K. Macdonald, N. Schuff, N. Fox, and S. Ourselin, "Automated Cross-Sectional and Longitudinal Hippocampal Volume Measurement in Mild Cognitive Impairment and Alzheimers Disease," NeuroImage, vol. 51, pp. 1345-1359, 2010.
[21] C. Liu, J. Yuen, and A. Torralba, "Nonparametric Scene Parsing: Label Transfer via Dense Scene Alignment," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2009.
[22] J.M. Lotjonen, R. Wolz, J.R. Koikkalainen, L. Thurfjell, G. Waldemar, H. Soininen, and D. Rueckert, "Fast and Robust Multi-Atlas Segmentation of Brain Magnetic Resonance Images," NeuroImage, vol. 49, no. 3, pp. 2352-2365, 2010.
[23] N. Malykhin, R. Lebel, N. Coupland, A. Wilman, and R. Carter, "In Vivo Quantification of Hippocampal Subfields Using 4.7 T Fast Spin Echo Imaging," NeoroImage, vol. 49, no. 2, pp. 1224-1230, 2009.
[24] J. Morra, Z. Tu, L. Apostolova, A. Green, A. Toga, and P. Thompson, "Automatic Subcortical Segmentation Using a Contextual Model," Proc. 11th Int'l Conf. Computing and Computer Assisted Interventions, pp. 194-201, 2008.
[25] S. Mueller, L. Stables, A. Du, N. Schuff, D. Truran, N. Cashdollar, and M. Weiner, "Measurements of Hippocampal Subfields and Age Related Changes with High Resolution MRI at 4T," Neurobiology of Aging, vol. 28, no. 5, pp. 719-726, 2007.
[26] S. Mueller and M. Weiner, "Selective Effect of Age, Apo e4, and Alzheimers Disease on hippocampal Subfields," Hippocampus, vol. 19, no. 6, pp. 558-564, 2009.
[27] K.G. Murty, Linear Complementarity, Linear and Nonlinear Programming. Helderman-Verlag, 1988.
[28] L. Penrose, "The Elementary Statistics of Majority Voting," J. Royal Statistical Soc., vol. 109, no. 1, pp. 53-57, 1946.
[29] J. Pluta, B. Avants, S. Glynn, S. Awate, J. Gee, and J. Detre, "Appearance and Incomplete Label Matching for Diffeomorphic Template Based Hippocampus Segmentation," Hippocampus, vol. 19, pp. 565-571, 2009.
[30] T. Rohlfing, R. Brandt, R. Menzel, and C. Maurer, "Evaluation of Atlas Selection Strategies for Atlas-Based Image Segmentation with Application to Confocal Microscopy Images of Bee Brains," NeuroImage, vol. 21, no. 4, pp. 1428-1442, 2004.
[31] T. Rohlfing, D. Russakoff, and C. Maurer, "Performance-Based Classifier Combination in Atlas-Based Image Segmentation Using Expectation-Maximization Parameter Estimation," IEEE Trans. Medical Imaging, vol. 23, no. 8, pp. 983-994, Aug. 2004.
[32] M. Sabuncu, S. Balci, M. Shenton, and P. Golland, "Image Driven Population Analysis through Mixture-Modeling," IEEE Trans. Machine Intelligence, vol. 28, no. 9, pp. 1473-1487, Sept. 2009.
[33] M. Sabuncu, B.T.T. Yeo, K. Van Leemput, B. Fischl, and P. Golland, "A Generative Model for Image Segmentation Based on Label Fusion," IEEE Trans. Machine Intelligence, vol. 29, no. 10, pp. 1714-1720, Oct. 2010.
[34] R. Scahill, J. Schott, J. Stevens, M. Rossor, and N. Fox, "Mapping the Evolution of Regional Atrophy in Alzheimers Disease: Unbiased Analysis of Fluidregistered Serial MRI," Proc. Nat'l Academy of Sciences USA, vol. 99, no. 7, pp. 4703-4707, 2002.
[35] S.M. Smith, M. Jenkinson, M.W. Woolrich, C.F. Beckmann, T.E.J. Behrens, H. JohansenBerg, P.R. Bannister, M.D. Luca, I. Drobnjak, D.E. Flitney, R.K. Niazy, J. Saunders, J. Vickers, Y. Zhang, N.D. Stefano, J.M. Brady, and P.M. Matthews, "Advances in Functional and Structural MR Image Analysis and Implementation as FSL," Neuroimage, vol. 23, Supplement 1, pp. S208-S219, 2004.
[36] L. Squire, "Memory and the Hippocampus: A Synthesis from Findings with Rats, Monkeys, and Humans," Psychological Rev., vol. 99, pp. 195-231, 1992.
[37] T. Toyoda and O. Hasegawa, "Random Field Model for Integration of Local Information and Global Information," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 30, no. 8, pp. 1483-1489, Aug. 2008.
[38] H. Wang, J. Suh, J. Pluta, M. Altinay, and P. Yushkevich, "Optimal Weights for Multi-Atlas Label Fusion," Proc. 22nd Int'l Conf. Information Processing in Medical Imaging, G. Székely and H.K. Hahn, eds., pp. 73-84, 2011.
[39] H. Wang, J.W. Suh, S. Das, J. Pluta, M. Altinay, and P. Yushkevich, "Regression-Based Label Fusion for Multi-Atlas Segmentation," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2011.
[40] S. Warfield, K. Zou, and W. Wells, "Simultaneous Truth and Performance Level Estimation (STAPLE): An Algorithm for the Validation of Image Segmentation," IEEE Trans. Machine Intelligence, vol. 23, no. 7, pp. 903-921, July 2004.
[41] R. Wolz, P. Aljabar, J.V. Hajnal, A. Hammers, and D. Rueckert, "Leap: Learning Embeddings for Atlas Propagation," NeuroImage, vol. 49, no. 2, pp. 1316-1325, 2010.
[42] P. Yushkevich, J. Piven, H. Hazlett, R. Smith, S. Ho, J. Gee, and G. Gerig, "User-Guided 3D Active Contour Segmentation of Anatomical Structures: Significantly Improved Efficiency and Reliability," NeuroImage, vol. 31, no. 3, pp. 1116-1128, 2006.
[43] P. Yushkevich, H. Wang, J. Pluta, S. Das, C. Craige, B. Avants, M. Weiner, and S. Mueller, "Nearly Automatic Segmentation of Hippocampal Subfields in Vivo Focal T2-Weighted MRI," NeuroImage, vol. 53, no. 4, pp. 1208-1224, 2010.
[44] M. Zeineh, S. Engel, P. Thompson, and S. Bookheimer, "Dynamics of the Hippocampus during Encoding and Retrieval of Face-Name Pairs," Science, vol. 299, no. 5606, pp. 577-580, 2003.
10 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool