This Article 
 Bibliographic References 
 Add to: 
Integrated Analysis of Thermal and Visual Images for Scene Interpretation
July 1988 (vol. 10 no. 4)
pp. 469-481

An approach for computer perception of outdoor scenes is presented. The approach is based on integrating information extracted from thermal images and visual images, which provides information not available by processing either type of image alone. The thermal image is analyzed to provide estimates of surface temperature. The visual image provides surface absorptivity and relative orientation. These parameters are used together to provide estimates of heat fluxes at the surfaces of viewed objects. The thermal behavior of scene objects is described in terms of surface heat fluxes. Features based on estimated values of surface heat fluxes are shown to be more meaningful and specific in distinguishing scene components.

[1] J. H. Kim, D. W. Payton, and K. E. Olin, "An expert system for object recognition in natural scenes," inProc. 1st Conf. AI Appl., Denver, CO, Dec. 1984, pp. 170-175.
[2] M. Burton and C. Benning, "Comparison of imaging infrared detection algorithms,"Proc. SPIE, vol. 302, pp. 26-32, 1981.
[3] L. Sevigny, "Evaluation of a class of segmenters for IR imagery, Rep. DREV R-4172/80, Defense Res. Establishment, Valcartier, Canada, 1981.
[4] L. Sevigny, G. Hvedstrup-Jensen, M. Bohner, E. Ostevold, and S. Grinaker, "Discrimination and classification of vehicles in natural scenes from thermal imagery,"Comput. Vision, Graphics, Image Processing, vol. 24, pp. 229-243, 1983.
[5] J. Hinderer, "Model for generating synthetic 3-D images of small vehicles,"Proc. SPIE, vol. 302, pp. 8-13, 1981.
[6] D. Casasent, J. Pauly, and D. Felterly, "Infrared ship classification using a new moment pattern recognition concept,"Proc. SPIE, vol. 302, pp. 126-133, 1981.
[7] J. Keng, "Automatic ship recognition using a passive radiometric sensor,"Proc. SPIE, vol. 302, pp. 122-125, 1981.
[8] Y. J. Lin, "Feature analysis for forward looking infrared (FLIR) target identification,"Proc. SPIE, vol. 302, pp. 117-121, 1981.
[9] C. F. Hester and D. Casasent, "Interclass discrimination using synthetic discriminant functions (SFDs),"Proc. SPIE, vol. 302, pp. 108- 116, 1981.
[10] R. A. Aguilera, "Advanced IR image seeker program,"Proc. SPIE, vol. 253, pp. 58-64, 1980.
[11] N. Nandhakumar and J. K. Aggarwal, "The artificial intelligence approach to pattern recognition--A perspective and an overview,"Pattern Recognition, vol. 18, no. 6, pp. 383-389, 1985.
[12] F. P. Incropera and D. P. De Witt,Fundamentals of Heat Transfer. New York: Wiley, 1981.
[13] J. R. Howell, R. B. Bannerot, and G. C. Vliet,Solar Thermal Energy Systems: Analysis and Design. New York: McGraw-Hill, 1982.
[14] R. Siegel and J. R. Howell,Thermal Radiation Heat Transfer, 2nd ed. New York: McGraw-Hill, 1981.
[15] Z. M. Ryu and J. A. Pearce, private communications, June 1985.
[16] C. Ohman, "Practical methods for improving thermal measurements,"Proc. SPIE, vol. 313, pp. 204-212, 1981.
[17] J. R. Schott and J. D. Biegel, "Comparison of modelled and empirical atmospheric propagation data,"Proc. SPIE, vol. 430, pp. 45- 52, 1983.
[18] J. M. Jarem, J. H. Pierluissi, and W. W. Ng, "A transmittance model for atmospheric methane,"Proc. SPIE, vol. 510, pp. 94-99, 1984.
[19] T. Thepchatri, C. P. Johnson, and H. Matlock, "Prediction of temperature and stresses in highway bridges by a numerical procedure using daily weather reports," Cen. for Highway Res., Tech. Rep. 23-1, Univ. Texas, Austin, 1977.
[20] C. Strock and R. L. Koral,Handbook of Air Conditioning, Heating and Ventilating, 2nd ed. New York: Industrial Press, 1965.
[21] M. E. Bukowski, R. L. Tucker, and D. W. Fowler, "Detection of voids underneath concrete pavements using infrared thermography," Cen. Transportation Res., Res. Rep. 246-2, Univ. Texas, Austin, Apr. 1983.
[22] E. Stamper and L. Koral, Eds.,Handbook of Air Conditioning, Heating and Ventilating, 3rd ed. New York: Industrial Press, 1979.
[23] M. Kumar, "Use of reflectivity ratios to measure light interception by crops,"Proc. SPIE, vol. 234, pp. 77-81, 1980.
[24] W. M. Roshenaw and J. R. Hartnett,Handbook of Heat Transfer. New York: McGraw-Hill, 1973.
[25] G. E. Clifford,Heating, Ventilating and Air Conditioning. Reston, VA: Reston Publishing, 1984.
[26] B. K. P. Horn and R. W. Sjoberg, "Calculating the reflectance map,"Appl. Opt., vol. 18, no. 1, pp. 1770-1779, 1979.
[27] B. K. P. Horn, "Hill shading and the reflectance map,"Proc. IEEE, vol. 19, no. 1, pp. 14-47.
[28] R. J. Woodham, "Analysing images of curved surfaces,"Artificial Intell., vol. 17, pp. 117-140, 1981.
[29] K. Ikeuchi and B. K. P. Horn, "Numerical shape from shading and occluding boundaries,"Artificial Intell., vol. 17, pp. 141-184, 1981.
[30] F. E. Nicodemus, J. C. Richmond, J. J. Hsia, I. W. Ginsberg, and T. Limperis, "Geometrical considerations and nomenclature for reflectance," U.S. Nat. Bur. Standards, NBS Monograph 160, 1977.
[31] P. Besl and R. Jain, "Range image understanding," inProc. IEEE Conf. Comput. Vision Pattern Recognition, San Fransisco, CA, June 1985, pp. 430-449.
[32] Y. C. Kim and J. K. Aggarwal, "Finding range from stereo images," inProc. IEEE Conf. Comput. Vision Pattern Recognition, San Fransisco, CA, June 1985, pp. 289-294.
[33] J. A. Pearce and Z. M. Ryu, "Nonlinear processing of quantitative thermographic images,"Proc. SPIE, vol. 446, pp. 218-225, 1983.
[34] M. Lloyd,Thermal Imaging Systems. New York: Plenum, 1975.
[35] W. D. H. Van Groningen, G. F. Vermeij, D. Bosman, and C. R. Traas, "Geometric reconstruction of buried heat source from a surface thermogram,"IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-7, pp. 610-616, Sept. 1985.

Index Terms:
IR imaging; computerised picture processing; computerised pattern recognition; visual images; scene interpretation; thermal images; surface temperature; surface absorptivity; relative orientation; heat fluxes; computerised pattern recognition; computerised picture processing; infrared imaging
N. Nandhakumar, J.K. Aggarwal, "Integrated Analysis of Thermal and Visual Images for Scene Interpretation," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 10, no. 4, pp. 469-481, July 1988, doi:10.1109/34.3911
Usage of this product signifies your acceptance of the Terms of Use.