This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Expandable Bayesian Networks for 3D Object Description from Multiple Views and Multiple Mode Inputs
June 2003 (vol. 25 no. 6)
pp. 769-774
ZuWhan Kim, IEEE Computer Society

Abstract—Computing 3D object descriptions from images is an important goal of computer vision. A key problem here is the evaluation of a hypothesis based on evidence that is uncertain. There have been few efforts on applying formal reasoning methods to this problem. In multiview and multimode object description problems, reasoning is required on evidence features extracted from multiple images and nonintensity data. One challenge here is that the number of the evidence features varies at runtime because the number of images being used is not fixed and some modalities may not always be available. We introduce an augmented Bayesian network, the expandable Bayesian network (EBN), which instantiates its structure at runtime according to the structure of input. We introduce the use of hidden variables to handle correlation of evidence features across images. We show an application of an EBN to a multiview building description system. Experimental results show that the proposed method gives significant and consistent performance improvement to others.

[1] E. Bauer and R. Kohavi, An Empirical Comparison of Voting Classification Algorithms: Bagging, Boosting and Variants Machine Learning, vol. 36, pp. 105-142, 1998.
[2] J. Binder, D. Koller, S. Russell, and K. Kanazawa, Adaptive Probabilistic Networks with Hidden Variables Machine Learning, vol. 29, pp. 213-244, 1997.
[3] M. Brand, N. Oliver, and A. Pentland, “Coupled Hidden Markov Models for Complex Action Recognition,” IEEE Proc. Computer Vision and Pattern Recognition, 1997.
[4] Rule-Based Expert Systems: The MYCIN Experiments of the Stanford Heuristic Programming Project. B. Buchanan and E. Shortliffe eds., Addison Wesley, 1984.
[5] D.M. Chickering and D. Heckerman, Efficient Approximations for the Marginal Likelihood of Bayesian Networks with Hidden Variables Proc. 12th Conf. Uncertainty in Artificial Intelligence, pp. 158-168, 1996.
[6] G.F. Cooper, The Computational Complexity of Probabilistic Inference Using Bayesian Belief Networks Artificial Intelligence, vol. 42, pp. 393-405, 1990.
[7] T. Dean and K. Kanazawa, A Model for Reasoning about Persistence and Causation Artificial Intelligence, vol. 93, pp. 1-27, 1989.
[8] A. Dempster, N. Laird, and D. Rubin, Maximum Likelihood from Incomplete Data via the EM Algorithm J. Royal Statistical Soc. B, vol. 39, pp. 1-38, 1977.
[9] P. Domingos and M. Pazzani, On the Optimality of the Simple Bayesian Classifier Under Zero-One Loss Machine Learning, vol. 29, pp. 103-130, 1997.
[10] J. Dougherty, R. Kohavi, and M. Sahami, Supervised and Unsupervised Discretization of Continuous Features Proc. 12th Int'l Conf. Machine Learning, 1995.
[11] R.O. Duda and P.E. Hart, Pattern Classification and Scene Analysis. John Wiley and Sons, 1973.
[12] N. Friedman and M. Goldszmidt, Discretizing Continuous Attributes while Learning Bayesian Networks Proc. 13th Int'l Conf. Machine Learning, pp. 157-165, 1996.
[13] Computer Vision and Image Understanding: Special Issue on Automatic Building Extraction from Aerial Images. A. Gruen and R. Nevatia, eds., vol. 72, no. 2, 1998.
[14] A. Huertas, Z. Kim, and R. Nevatia, Use of Cues from Range Data for Building Modeling Proc. DARPA Image Understanding Workshop, pp. 577-582, 1998.
[15] A. Huertas, R. Nevatia, and D. Landgrebe, Use of Hyperspectral Data with Intensity Images for Automatic Building Modeling Proc. Second Int'l Conf. Information Fusion, pp. 680-687, 1999.
[16] F.V. Jensen, S.L. Lauritzen, and K.G. Olesen, Bayesian Updating in Recursive Graphical Models by Local Computations Technical Report R 89-15, Institute for Electronic Systems, Dept. of Math. and Computer Science, Univ. of Aalborg, Denmark, 1989.
[17] Z. Kim, Multi-View 3D Object Description with Uncertain Reasoning and Machine Learning, PhD Thesis, Computer Science Dept., Univ. of Southern California, 2001.
[18] Z. Kim and R. Nevatia, Uncertain Reasoning and Learning for Feature Grouping Computer Vision and Image Understanding, vol. 76, pp. 278-288, 1999.
[19] R. Kohavi, A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection Proc. 14th Int'l Joint Conf. Artificial Intelligence, pp. 1137-1143, 1995.
[20] M.A. Maloof, P. Langley, T.O. Binford, and R. Nevatia, Generalizing over Aspect and Location for Rooftop Detection Proc. 14th IEEE Workshop Applications of Computer Vision, pp. 194-199, 1998.
[21] S. Noronha and R. Nevatia, Detection and Modeling of Buildings from Multiple Aerial Images IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 5, pp. 501-518, May 2001.
[22] J. Pearl, Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. San Francisco: Morgan Kaufmann, 1988.
[23] R.D. Rimey and C.M. Brown, Control of Selective Perception Using Bayes Nets and Decision Theory Int'l J. Computer Vision, vol. 12, no. 2, pp. 173-207, 1994.
[24] S. Russell and P. Norvig, Artificial Intelligence: A Modern Approach. Prentice-Hall, 1995.
[25] S. Sarkar and K.L. Boyer, Using Perceptual Inference Networks to Manage Vision Process Computer Vision and Image Understanding, vol. 62, pp. 27-46, 1995.
[26] V. Tresp, M. Haft, and R. Hofmann, Mixture Approximations to Bayesian Networks Proc. 15th Conf. Uncertainty in Artificial Intelligence, 1999.
[27] T. Van Allen and R. Greiner, Model Selection Criteria for Learning Belief Nets: an Empirical Comparison Proc. 17th Int'l Conf. Machine Learning, pp. 1047-1054, 2000.

Index Terms:
Multiview object description, learning, uncertain reasoning, building description, bayesian network.
Citation:
ZuWhan Kim, Ramakant Nevatia, "Expandable Bayesian Networks for 3D Object Description from Multiple Views and Multiple Mode Inputs," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 25, no. 6, pp. 769-774, June 2003, doi:10.1109/TPAMI.2003.1201825
Usage of this product signifies your acceptance of the Terms of Use.