This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Estimates of Error Probability for Complex Gaussian Channels with Generalized Likelihood Ratio Detection
October 2005 (vol. 27 no. 10)
pp. 1580-1591
We derive approximate expressions for the probability of error in a two-class hypothesis testing problem in which the two hypotheses are characterized by zero-mean complex Gaussian distributions. These error expressions are given in terms of the moments of the test statistic employed and we derive these moments for both the likelihood ratio test, appropriate when class densities are known, and the generalized likelihood ratio test, appropriate when class densities must be estimated from training data. These moments are functions of class distribution parameters which are generally unknown so we develop unbiased moment estimators in terms of the training data. With these, accurate estimates of probability of error can be calculated quickly for both the optimal and plug-in rules from available training data. We present a detailed example of the behavior of these estimators and demonstrate their application to common pattern recognition problems, which include quantifying the incremental value of larger training data collections, evaluating relative geometry in data fusion from multiple sensors, and selecting a good subset of available features.

[1] H.L. Van Trees, Detection, Estimation, and Modulation Theory, vol. I, John Wiley & Sons, 1968.
[2] L. Devroye, L. Györfi, and G. Lugosi, A Probabilistic Theory of Pattern Recognition. Springer-Verlag, 1996.
[3] D.L. Fried, “Statistics of the Laser Radar Cross Section of a Randomly Rough Target,” J. Optical Soc. Am., vol. 66, no. 11, pp. 1150-1160, Nov. 1976.
[4] J.W. Goodman, “Some Fundamental Properties of Speckle,” J. Optical Soc. Am., vol. 66, no. 11, pp. 1145-1150, Nov. 1976.
[5] H.L. Van Trees, Detection, Estimation, and Modulation Theory. Radar-Sonar Signal Processing and Gaussian Signals in Noise, vol. III, John Wiley & Sons, 1971.
[6] M.D. DeVore and J.A. O'Sullivan, “Quantitative Statistical Assessment of Conditional Models for Synthetic Aperture Radar,” IEEE Trans. Image Processing, vol. 13, no. 2, pp. 113-125, Feb. 2003.
[7] J.A. O'Sullivan, M.D. DeVore, V. Kedia, and M.I. Miller, “Automatic Target Recognition Performance for SAR Imagery Using a Conditionally Gaussian Model,” IEEE Trans. Aerospace and Electronic Systems, vol. 37, no. 1, pp. 91-108, Jan. 2001.
[8] M.D. DeVore and J.A. O'Sullivan, “A Performance-Complexity Study of Several Approaches to Automatic Target Recognition from SAR Images,” IEEE Trans. Aerospace and Electronic Systems, vol. 38, no. 2, pp. 632-648, Apr. 2000.
[9] M.D. DeVore and J.A. O'Sullivan, “Target-Centered Models and Information-Theoretic Segmentation for Automatic Target Recognition,” Multidimensional Systems and Signal Processing, vol. 14, pp. 139-159, Jan. 2003.
[10] S.P. Jacobs and J.A. O'Sullivan, “Automatic Target Recognition Using Sequences of High Resolution Radar Range-Profiles,” IEEE Trans. Aerospace and Electronic Systems, vol. 36, no. 2, pp. 364-382, Apr. 2000.
[11] S.J. Raudys and A.K. Jain, “Small Sample Size Effects in Statistical Pattern Recognition: Recommendations for Practitioners,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 13, no. 3, pp. 252-264, Mar. 1991.
[12] N. Glick, “Sample-Based Classification Procedures Derived from Density Estimators,” J. Am. Statistical Assoc., vol. 67, no. 337, pp. 116-122, Mar. 1972.
[13] S.J. Raudys and V. Pikelis, “On Dimensionality, Sample Size, Classification Error, and Complexity of Classification Algorithm in Pattern Recognition,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 2, no. 3, pp. 242-252, May 1980.
[14] N.L. Johnson, S. Kotz, and N. Balakrishnan, Continuous Univariate Distributions, vol. 1, John Wiley & Sons, 1994.
[15] N.L. Johnson, “Systems of Frequency Curves Generated by Methods of Translation,” Biometrika, vol. 36, no. 1/2, pp. 149-176, June 1949.
[16] M.D. DeVore, “Analytical Performance Evaluation of SAR ATR with Inaccurate or Estimated Models,” Proc. SPIE Algorithms for Synthetic Aperture Radar Imagery XI, E.G. Zelnio and F.D. Garber, eds., vol. 5427, pp. 407-417, 2004.
[17] N.A. Schmid and J.A. O'Sullivan, “Thresholding Method for Reduction of Dimensionality,” IEEE Trans. Information Theory, vol. 47, no. 7, pp. 2903-2920, Nov. 2001.
[18] V.K. Rohatgi and G.J. Székely, “Sharp Inequalities between Skewness and Kurtosis,” Statistics and Probability Letters, vol. 8, pp. 297-299, Sept. 1989.
[19] I.D. Hill, R. Hill, and R.L. Holder, “Algorithm AS 99: Fitting Johnson Curves by Moments,” Applied Statistics, vol. 25, no. 2, pp. 180-189, 1976.
[20] I.D. Hill, “Algorithm AS 100: Normal-Johnson and Johnson-Normal Transformations,” Applied Statistics, vol. 25, no. 2, pp. 190-192, 1976.
[21] A.M. Mathai and S.B. Provost, Quadratic Forms in Random Variables: Theory and Applications. Marcel Dekker, 1992.
[22] O. Barndorff-Nielsen and D.R. Cox, “Edgeworth and Saddle-Point Approximations with Statistical Applications,” J. Royal Statistical Soc., Series B, vol. 41, no. 3, pp. 279-312, 1979.
[23] S.M. Kay, A.H. Nuttall, and P.M. Baggenstoss, “Multidimensional Probability Density Function Approximations for Detection, Classification, and Model Order Selection,” IEEE Trans. Signal Processing, vol. 49, no. 10, pp. 2240-2252, Oct. 2001.
[24] “University Research Initiative Synthetic Dataset (HRR),” Johns Hopkins Univ., Center for Imaging Science, http://cis.jhu.edu/data.setsurisd, 2005.
[25] T.M. Cover and J.M. Van Campenhout, “On the Possible Orderings in the Measurement Selection Problem,” IEEE Trans. Systems, Man, and Cybernetics, vol. 7, no. 9, pp. 657-661, Sept. 1977.
[26] A. Jain and D. Zongker, “Feature Selection: Evaluation, Application, and Small Sample Performance,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 2, pp. 153-158, Feb. 1997.

Index Terms:
Index Terms- Complex Gaussian channels, probability of error, model inaccuracy, moment estimators, Johnson's systems of distributions.
Citation:
Michael D. DeVore, "Estimates of Error Probability for Complex Gaussian Channels with Generalized Likelihood Ratio Detection," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 27, no. 10, pp. 1580-1591, Oct. 2005, doi:10.1109/TPAMI.2005.198
Usage of this product signifies your acceptance of the Terms of Use.