| | This Article | |
| |
| |
| | Share | |
| |
| |
| | Bibliographic References | |
| |
| |
| | Add to: | |
| |
 Digg
 Furl
 Spurl
 Blink
 Simpy
 Google
 Del.icio.us
 Y!MyWeb
| |
| | Search | |
| |
| |
| | |
Rate-Distortion Analysis of Discrete-HMM Pose Estimation via Multiaspect Scattering Data
July 2003 (vol. 25 no. 7)
pp. 872-883
Abstract—We consider the problem of estimating the pose of a target based on a sequence of scattered waveforms measured at multiple target-sensor orientations. Using a hidden Markov model (HMM) representation of the scattered-waveform sequence, pose estimation reduces to estimating the underlying HMM states from a sequence of observations. It is assumed that each scattered waveform must be quantized via an encoding procedure. A distortion D is defined as the error in estimating the underlying HMM states, and the rate R represents the size of the discrete-HMM codebook. Rate-distortion theory is applied to define the minimum rate required to achieve a desired distortion, denoted as R(D). After deriving the rate-distortion function R(D), we demonstrate that discrete-HMM performance based on Lloyd encoding is far from this bound. Performance is improved via block coding, based on Bayes VQ. Results are presented for a canonical HMM problem, and then for multiaspect acoustic scattering from underwater elastic targets. Although the examples presented here are for multiaspect scattering and pose estimation, the results are of general applicability to discrete-HMM state estimation.
[1] 872 J. Principe, D. Xu, and J. Fisher III, Pose Estimation in SAR Using an Information-Theoretic Criterion Proc. SPIE, vol. 3370, pp. 218-229, 1998.[2] J.A. Ratches, C.P. Walters, R.G. Buser, and B.D. Guenther, “Aided and Automatic Target Recognition Based upon Sensory Inputs from Image Forming Systems,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 9, pp. 1004-1019, Sept. 1997.[3] S.R. Sims, Data Compression Issues in Automatic Target Recognition and the Measuring of Distortion Optical Eng., vol. 36, pp. 2671-2674, Oct. 1997.[4] T. Berger, Rate-Distortion Theory. Prentice-Hall, 1971.[5] T.M. Cover and J.A. Thomas, Elements of Information Theory. John Wiley&Sons, 1991.[6] S.D. Morgera and M.R. Soleymanl, A Structural Look at Pattern Recognition from the Point of View of Rate-Distortion Theory Pattern Recognition and Artificial Intelligence, E.S. Gelsema and L.N. Kanal, eds., pp. 257-275, 1988.[7] P.A. Chou, Application of Information Theory to Pattern Recognition and the Design of Decision Trees and Trellises PhD dissertation, Stanford Univ., 1988.[8] L.R. Rabiner, “Tutorial on Hidden Markov Model and Selected Applications in Speech Recognition,” Proc. IEEE, vol. 77, no. 2, pp. 257-285, 1989.[9] P. Runkle, L. Carin, L. Couchman, T.J. Yoder, and J.A. Bucaro, Multi-Aspect Target Identification with Wave-Based Matched Pursuits and Continuous Hidden Markov Models IEEE Trans. Pattern Analysis Machine Intelligence, vol. 21, no. 12, pp. 1371-1378, Dec. 1999.[10] P.R. Runkle, P.K. Bharadwaj, L. Couchman, and L. Carin, “Hidden Markov Models for Multiaspect Target Classification,” IEEE Trans. Signal Processing, vol. 47, pp. 2035-2040, July 1999.[11] R.E. Blahut, Computation of Channel Capacity and Rate-Distortion Functions IEEE Trans. Information Theory, vol. 18, pp. 460-473, July 1972.[12] C.E. Shannon, A Mathematical Theory of Communication Bell System Technical J., vol. 27, (Parts I and II), pp. 379-423, 623-656, 1948.[13] Y. Dong, P. Runkle, and L. Carin, Markov Modeling of Transient Scattering and its Application in Multi-Aspect Target Classification Proc. Int'l Conf. Acoustics, Speech, and Signal Processing, pp. 2841-2844, 2001.[14] Y. Linde, A. Buzo, R.M. Gray, An Algorithm for Vector Quantizer Design IEEE Trans. Comm., vol. 28, no. 1, pp. 84-95, 1980.[15] G. Yu, W. Russell, R. Schwartz, and J. Makhoul, Discriminant Analysis and Supervised Vector Quantization for Continuous Speech Recognition Proc. Int'l Conf. Acoustics, Speech, and Signal Processing, pp. 685-688, Apr. 1990.[16] E. Trentin and M. Gori, A Survey of Hybrid ANN/HMM Models for Automatic Speech Recognition Neurocomputing, vol. 37, pp. 91-126, 2001.[17] G. Rigoll, Maximum Mutual Information Neural Networks for Hybrid Connectionist-HMM Speech Recognition Systems IEEE Trans. Speech and Audio Processing, vol. 2, part II, pp. 175-184, Jan. 1994.[18] C. Neukirchen, J. Rottland, D. Willett, and G. Rigoll, A Continuous Density Interpretation of Discrete HMM Systems and MMI-Neural Networks IEEE Trans. Speech and Audio Processing, vol. 9, pp. 367-377, May 2001.[19] D. Kimber, M. Bush, and G. Tajchman, Speaker-Independent Vowel Classification Using Hidden Markov Model and LVQ2 Proc. Int'l Conf. Acoustics, Speech, and Signal Processing, pp. 497-500, Apr. 1990.[20] K.L. Oehler and R.M. Gray, Combining Image Compression and Classification Using Vector Quantization IEEE Trans. Pattern Analysis Machine Intelligence, vol. 17, no. 5, pp. 461-473, May 1995.[21] K.O. Perlmutter, S.M. Perlmutter, R.M. Gray, R.A. Olshen, and K.L. Oehler, Bayes Risk Weighted Vector Quantization with Posterior Estimation for Image Compression and Classification IEEE Trans. Image Processing, vol. 5, pp. 347-360, Feb. 1996.[22] O.E. Agazzi and S. Kuo, Pseudo Two-Dimensional Hidden Markov Models for Document Recognition AT&T Technical J., vol. 72, pp. 60-72, Sept./Oct. 1993.[23] N. Dasgupta, P. Runkle, L. Couchman, and L. Carin, “Dual Hidden Markov Model for Characterizing the Wavelet Coefficients from Multi-Aspect Scattering Data,” Signal Processing, vol. 81, pp. 1303-1316, June 2001.[24] J. Li and P. Stoica, Efficient Mixed-Spectrum Estimation with Applications to Target Feature Extraction IEEE Trans. Signal Processing, vol. 44, no. 2, pp. 281-295, Feb. 1996.[25] M.R. McClure and L. Carin, Matching Pursuits with a Wave-Based Dictionary IEEE Trans. Signal Processing, vol. 45, no. 12, pp. 2912-2927, Dec. 1997.[26] B.A. Hanson and T.H. Applebaum, Robust Speaker-Independent Word Recognition, Using Static, Dynamic and Acceleration Features Proc. Int'l Conf. Acoustics, Speech, and Signal Processing, pp. 857-860, Apr. 1990.[27] K. Lee, Context-Dependent Phonetic Hidden Markov Models for Speaker-Independent Continuous Speech Recognition IEEE Trans. Acoustics, Speech, and Signal Processing, vol. 38, pp. 599-609, Apr. 1990.[28] H.W. Sorenson, Parameter Estimation: Principles and Problems. M. Dekker, 1980.
Index Terms:
Rate distortion, vector quantization, HMM, pose estimation, underwater sensing.
Citation:
Yanting Dong, Lawrence Carin, "Rate-Distortion Analysis of Discrete-HMM Pose Estimation via Multiaspect Scattering Data," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 25, no. 7, pp. 872-883, July 2003, doi:10.1109/TPAMI.2003.1206516
