This Article 
 Bibliographic References 
 Add to: 
Information-Theoretic Bounds on Target Recognition Performance Based on Degraded Image Data
September 2002 (vol. 24 no. 9)
pp. 1153-1166

Abstract—This paper derives bounds on the performance of statistical object recognition systems, wherein an image of a target is observed by a remote sensor. Detection and recognition problems are modeled as composite hypothesis testing problems involving nuisance parameters. We develop information-theoretic performance bounds on target recognition based on statistical models for sensors and data, and examine conditions under which these bounds are tight. In particular, we examine the validity of asymptotic approximations to probability of error in such imaging problems. Problems involving Gaussian, Poisson, and multiplicative noise, and random pixel deletions are considered, as well as least-favorable Gaussian clutter. A sixth application involving compressed sensor image data is considered in some detail. This study provides a systematic and computationally attractive framework for analytically characterizing target recognition performance under complicated, non-Gaussian models and optimizing system parameters.

[1] J.A. Ratches, C.P. Walters, R.G. Buser, and B.D. Guenther, “Aided and Automatic Target Recognition Based upon Sensory Inputs from Image Forming Systems,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 9, pp. 1004-1019, Sept. 1997.
[2] IEEE Trans. Image Processing, special issue on automatic target recognition, vol. 6, no. 1, Jan. 1997.
[3] H.V. Poor, An Introduction to Signal Detection and Estimation. New York: Springer-Verlag, 1994.
[4] K. Fukunaga, Introduction to Statistical Pattern Recognition, second edition. Academic Press, 1990.
[5] M.I. Miller, U. Grenander, J. O'Sullivan, and D. Snyder, “Automatic Target Recognition via Jump-Diffusion Algorithms,” IEEE Trans. Image Processing, vol. 6, no. 1, pp. 157-174, Jan. 1997.
[6] U. Grenander, M.I. Miller, and A. Srivastava, “Hilbert-Schmidt Lower Bounds for Estimators on Matrix Lie Groups for ATR,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 20, no. 8, pp. 790-802, Aug. 1998.
[7] A.D. Lanterman, J.A. O'Sullivan, and M.I. Miller, “Kullback-Leibler Distances for Quantifying Clutter and Models,” Optical Eng., vol. 38, no. 2, pp. 2134-2146, Dec. 1999.
[8] M. Lindenbaum, “Bounds on Shape Recognition Performance,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 17, no. 7, pp. 666-680, July 1995.
[9] S.R.F. Sims, “Data Compression Issues in Automatic Target Recognition and the Measuring of Distortion,” Optical Eng., vol. 36, no. 10, pp. 2671-2674, Oct. 1997.
[10] S. Jana and P. Moulin, “Optimal Design of Transform Coders for Image Classification,” Proc. Conf. Information Systems and Science, Mar. 1999.
[11] T.M. Cover and J.A. Thomas, Elements of Information Theory. John Wiley&Sons, 1991.
[12] R. Duda, P. Hart, and D. Stork, Pattern Classification. New York: John Wiley&Sons, 2001.
[13] S.M. Ali and S.D. Silvey, “A General Class of Coefficients of Divergence of One Distribution from Another,” J. Royal Statistics Soc., vol. 28, pp. 132-142, 1966.
[14] A. Gersho and R.M. Gray, Vector Quantization and Signal Compression. Boston: Kluwer Academic, 1992.
[15] S.A. Kassam, “Optimal Quantization for Signal Detection,” IEEE Trans. Comm., vol. 25, pp. 479-484, May 1977.
[16] H.V. Poor and J.B. Thomas, “Applications of Ali-Silvey Distance Measures in the Design of Generalized Quantizers for Binary Decision Systems,” IEEE Trans. Comm., vol. 25, pp. 893-900, Sept. 1977.
[17] A. Jain, “Image Reconginition from Compressed Data: Performance Analysis,” Masters thesis, Dept. of Electrical and Computer Eng., Univ. of Illinois at Urbana-Champaign, Aug. 1999.
[18] S.G. Mallat, A Wavelet Tour of Signal Processing. San Diego, Calif.: Academic Press, 1998.
[19] H.L. Van Trees, Detection, Estimation, and Modulation Theory. New York: Wiley, 1968.
[20] W. Feller, An Introduction to Probability Theory and Its Applications, second ed., vol. II. New York: Wiley, 1971.
[21] J.A. Bucklew, Large Deviation Techniques in Decision, Simulation, and Estimation. New York: Wiley, 1990.
[22] R.T. Rockefellar, Convex Analysis. Princeton, N.J.: Princeton Univ. Press, 1972.
[23] E.L. Lehmann, Testing Statistical Hypotheses, second ed. New York: Springer-Verlag, 1986.
[24] J.O. Berger, Bayesian Decision Theory. Springer-Verlag, 1984.
[25] B.S. Clarke and A.R. Barron, “Information-Theoretic Asymptotics of Bayes Methods,” IEEE Trans. Information Theory, vol. 36, no. 3, pp. 453-471, May 1990.
[26] S. LoPresto, K. Ramchandran, and M.T. Orchard, Proc. IEEE Data Compression Conf., 1997.
[27] M.K. Mihçak, I. Kozintsev, K. Ramchandran, and P. Moulin, “Low-Complexity Image Denoising Based on Statistical Modeling of Wavelet Coefficients,” IEEE Signal Processing Letters, vol. 6, no. 12, pp. 300-303, 1999.
[28] J.G. Proakis, Digital Communications, New York: McGraw-Hill, 1995.

Index Terms:
Object recognition, automatic target recognition, imaging sensors, multisensor data fusion, data compression, performance metrics.
Avinash Jain, Pierre Moulin, Michael I. Miller, Kannan Ramchandran, "Information-Theoretic Bounds on Target Recognition Performance Based on Degraded Image Data," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 24, no. 9, pp. 1153-1166, Sept. 2002, doi:10.1109/TPAMI.2002.1033209
Usage of this product signifies your acceptance of the Terms of Use.