| | This Article | |
| |
| |
| | Share | |
| |
| |
| | Bibliographic References | |
| |
| |
| | Add to: | |
| |
 Digg
 Furl
 Spurl
 Blink
 Simpy
 Google
 Del.icio.us
 Y!MyWeb
| |
| | Search | |
| |
| |
| | |
Image Modeling with Position-Encoding Dynamic Trees
July 2003 (vol. 25 no. 7)
pp. 859-871
Abstract—This paper describes the Position-Encoding Dynamic Tree (PEDT). The PEDT is a probabilistic model for images that improves on the dynamic tree by allowing the positions of objects to play a part in the model. This increases the flexibility of the model over the dynamic tree and allows the positions of objects to be located and manipulated. This paper motivates and defines this form of probabilistic model using the belief network formalism. A structured variational approach for inference and learning in the PEDT is developed, and the resulting variational updates are obtained, along with additional implementation considerations that ensure the computational cost scales linearly in the number of nodes of the belief network. The PEDT model is demonstrated and compared with the dynamic tree and fixed tree. The structured variational learning method is compared with mean field approaches.
[1] 859 N.J. Adams, Dynamic Trees: A Hierarchical Probabilistic Approach to Image Modelling PhD thesis, Division of Informatics, Univ. of Edinburgh, 5 Forrest Hill, Edinburgh, EH1 2QL, UK, 2001.[2] N.J. Adams, A.J. Storkey, Z. Ghahramani, and C.K.I. Williams, MFDTs: Mean Field Dynamic Trees Proc. 15th Int'l Conf. Pattern Recognition, 2000.[3] M. Basseville, A. Benveniste, K.C. Chou, S.A. Golden, R. Nikoukhah, and A.S. Willsky, “Modeling and Estimation of Multiresolution Stochastic Processes,” IEEE Trans. Information Theory, vol. 38, no. 2, pp. 766-784, 1992.[4] J. Besag, On the Statistical Analysis of Dirty Pictures J. Royal Statistics, Soc. B, vol. 48, no. 3, pp. 259-302, 1974.[5] C.A. Bouman and M. Shapiro, “A Multiscale Random Field Model for Bayesian Image Segmentation,” IEEE Trans. Image Processing, vol. 3, pp. 162-176, 1994.[6] E. Charniak, Statistical Language Learning. MIT Press, 1993.[7] M.S. Crouse, R.D. Novak, and R.G. Baraniuk, “Wavelet-Based Statistical Signal Processing Using Hidden Markov Models,” IEEE Trans. Signal Processing, vol. 46, pp. 886-902, Apr. 1998.[8] P. Dayan, G.E. Hinton, R.M. Neal, and R.S. Zemel, The Helmholtz Machine Neural Computation, vol. 7, no. 5, pp. 889-904, 1995.[9] J.S. De Bonet and P. Viola, “A Non-Parametric Multi-Scale Statistical Model for Natural Images,” Advances in Neural Information Processing, vol. 10, 1997.[10] X. Feng, C.K.I. Williams, and S.N. Felderhof, Combining Belief Networks and Neural Networks for Scene Segmentation IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 4, pp. 467-483, Apr. 2002.[11] S. Chakravarty and M. Liu, "Algorithms for Current Monitor Based Diagnosis of Bridging and Leakage Faults," Proc. 1992 Design Automation Conf., pp. 353-356, June 1992.[12] S. Geman and D. Geman, Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 6, no. 6, pp. 721-741, 1984.[13] Z. Ghahramani and M.J. Beal, Propagation Algorithms for Variational Bayesian Learning Proc. Advances in Neural Information Processing Systems, vol. 13, 2000.[14] W.R. Gilks, S. Richardson, and D.J. Spiegelhalter, Markov Chain Monte Carlo in Practice, London: Chapman and Hall, 1996.[15] G.E. Hinton, Z. Ghahramani, and Y.W. Teh, Learning to Parse Images Proc. Advances in Neural Information Processing Systems, S.A. Solla, T.K. Leen, and K.-R. Muller, eds., vol. 12, pp. 463-469, 2000.[16] J. Kittler, Statistical Pattern Recognition in Image Analysis Statistics and Images 2, K.V. Mardia, ed., pp. 61-75, 1994.[17] S.L. Lauritzen, Graphical Models. Oxford Univ. Press 1996.[18] H. Lucke, Bayesian Belief Networks as a Tool for Stochastic Parsing Speech Comm., vol. 16, pp. 89-118, 1995.[19] M.R. Luettgen, W. Karl, and A.S. Willsky, Efficient Multiscale Regularization with Applications to the Computation of Optical Flow IEEE Trans. Image Processing, vol. 3, pp. 41-64, 1994.[20] M.R. Luettgen, A.S. Willsky, Likelihood Calculation for a Class of Multiscale Stochastic Models, with Application to Texture Discrimination IEEE Trans. Image Processing, vol. 4, no. 2, pp. 194-207, 1995.[21] A. Montanvert, P. Meer, and A. Rosenfeld, Hierarchical Image Analysis Using Irregular Tesselations IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 13, no. 4, pp. 307-316, Apr. 1991.[22] J. Pearl, Probabilistic Reasoning in Intelligent Systems. San Mateo, Calif.: Morgan Kaufman, 1988.[23] P. Pérez, A. Chardin, and J-M. Laferté, Noniterative Manipulation of Discrete Energy-Based Models for Image Analysis Pattern Recognition, vol. 33, no. 4, pp. 573-586, Apr. 2000.[24] O. Ronen, J.R. Rohlicek, and M. Ostendorf, Parameter Estimation of Dependence Tree Models Using the EM Algorithm IEEE Signal Processing Letters, vol. 2, no. 8, pp. 157-159, 1995.[25] L.K. Saul and M.I. Jordan, Exploiting Tractable Substructures in Intractable Networks Proc Advances in Neural Information Processing Systems, D.S. Touretzky, M.C. Mozer, and M.E. Hasselmo, eds., vol. 8, 1996.[26] A.J. Storkey, Dynamic Trees: A Structured Variational Method Giving Efficient Propagation Rules Uncertainty in Artificial Intelligence, C. Boutilier and M. Goldszmidt, eds., pp. 566-573, Morgan Kauffmann, 2000.[27] C. von der Malsburg, The Correlation Theory of Brain Function Internal Report 81-2,Max-Planck-Institut für Biophysikalische Chemie, 1981. Reprinted Models of Neural Networks, K. Schulten and H.-J. van Hemmen, eds., second ed., Springer, 1994.[28] C. von der Malsburg, Dynamic Link Architecture Handbook of Brain Theory and Neural Networks. M.A. Arbib, ed., pp. 329-331, MIT Press, 1995.[29] C.K.I. Williams and N.J. Adams, DTs: Dynamic Trees Proc. Advances in Neural Information Processing Systems, M.J. Kearns, S.A. Solla, and D.A. Cohn, eds., vol. 11, 1999.[30] C.K.I. Williams and X. Feng, Combining Neural Networks and Belief Networks for Image Segmentation Proc. Neural Networks for Signal Processing VIII, T. Constantinides, S.-Y. Kung, M. Niranjan, and E. Wilson, eds., 1998.
Index Terms:
Dynamic trees, variational inference, belief networks, Bayesian networks, image segmentation, structured image models, tree structured networks.
Citation:
Amos J. Storkey, Christopher K.I. Williams, "Image Modeling with Position-Encoding Dynamic Trees," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 25, no. 7, pp. 859-871, July 2003, doi:10.1109/TPAMI.2003.1206515
