This Article 
 Bibliographic References 
 Add to: 
Image Representation Using Block Pattern Models and Its Image Processing Applications
April 1993 (vol. 15 no. 4)
pp. 321-336

An image representation scheme using a set of block pattern models (BPMs) consisting of three categories (constant, oriented, and irregular) is introduced. Algorithms for model classification, model parameter estimation, and image reconstruction from model parameters are presented, and these provide the necessary vehicles for applying the proposed representation scheme to various image processing tasks. The applications of the proposed models in image coding, image zooming, and image smoothing are described. Satisfactory coded images have been obtained at bit rates between 0.5 approximately 0.6 b.p.p. (bits per pixel) with a high-rate realization and between 0.3 approximately 0.5 b.p.p. with a low-rate realization. The high-rate realization has a simple structure suitable for real-time implementation. The methods for image zooming and smoothing are similar, where both adapt the processing for each pixel according to the model of its neighborhood. By using directional filters in oriented regions, edges and lines are rendered sharper in a smoother manner than with conventional linear filtering approaches, which leads to significant improvement in perceived image quality.

[1] D. H. Hubel and T. Weisel, "Brain mechanisms of vision,"Sci. Amer., pp. 130-146, Sept. 1979.
[2] L. A. Olzak and J. P. Thomas, "Seeing spatial patterns," inHandbook of Perception and Human Performance(K. R. Roffet al., Eds.). New York: Wiley Interscience, 1986.
[3] A. Rosenfield, Ed.,Image Modeling. New York: Academic, 1981.
[4] A. K. Jain, "Advances in mathematical models for image processing,"Proc. IEEE, vol. 69, pp. 502-528, May. 1981.
[5] G. R. Cross and A. K. Jain, "Markov random field texture models,"IEEE Trans. Patt. Anal. Machine Intell., vol. PAMI-5, pp. 25-39, Jan. 1983.
[6] R. Chellappa, "Two-dimensional discrete Gaussian Markov random field models for image processing," inProgress in Pattern Recognition(L. N. Kanal and A. Rozenfield, Eds.). New York: Elsevier, 1985.
[7] W. F. Schreiber, C. F. Knapp, and N. D. Kay, "Synthetic highs: An experimental TV bandwidth reduction system,"J. SMPTE, vol. 68, pp. 525-537, Aug. 1959.
[8] B. Ramamurthi and A. Gersho, "Classified vector quantization of images,"IEEE Trans. Commun., vol. COM-34, pp. 1105-1115, Nov. 1986.
[9] M. Kocher and M. Kunt, "A contour-texture approach to picture coding," inProc. IEEE Int. Conf. Acoust. Speech Signal Processing(Paris), May 1982, pp. 436-440.
[10] M. Kunt, A. Ikonomopoulos, and M. Kocher, "Second-generation image-coding techniques,"Proc. IEEE, vol. 73, pp. 549-574, Apr. 1985.
[11] M. Kunt, M. Benard, and R. Leonardi, "Recent results in high-compression image coding,"IEEE Trans. Circuits Syst., vol. CAS-34, pp. 1306-1336, Nov. 1987.
[12] J. Vaisey, "Variable blocksize image coding using quadtree segmentation," Ph.D. thesis, Univ. of California, Santa Barbara, 1989.
[13] Y. -S. Ho, "Variable-rate image coding with hierarchical multistage vector quantization," Ph.D. thesis, Univ. of California, Santa Barbara, 1990.
[14] Y. Wang and S. K. Mitra, "Edge-preserving image coding based on local modeline of images," inProc. IEEE Int. Conf. Acoust. Speech Signal Processing(New York), Apr. 1988, pp. 1320-1323.
[15] Y. Wang and S. K. Mitra, "Edge preserved image zooming," inProc. Euro. Signal Processing Conf.(Grenoble, France), Sept. 1988, pp. 1445-1448.
[16] Y. Wang and S. K. Mitra, "Image smoothing based on local image models," inProc. IEEE Int. Conf. Syst. Eng.(Dayton), Aug. 1989, pp. 81-83.
[17] Y. Wang and S. K. Mitra, "Edge detection based on orientation distribution of gradient images," inProc. IEEE Int. Conf. Acoust. Speech Signal Processing(Toronto), May 1991, pp. 2569-2572.
[18] Y. Wang and S. K. Mitra, "Motion/pattern adaptive interpolation of interlaced video sequences," inProc. IEEE Int. Conf. Acoust. Speech Signal Processing(Toronto), May 1991, pp. 2829-2832.
[19] D. Chen and A. Bovik, "Visual pattern image coding,"IEEE Trans. Commun., vol. 38, Dec. 1990.
[20] A. N. Netravali and J. O. Limb, "Picture coding: A review,"Proc. IEEE, vol. 68, pp. 366-406, Mar. 1980.
[21] H. Tamura, S. Mori, and T. Yamawaki, "Textural features corresponding to visual perception,"IEEE Trans. Syst. Man Cybern., vol. SMC-8, pp. 460-473, 1978.
[22] T. N. Cornsweet,Visual Perception. New York: Academic, 1970.
[23] Y. Wang, "Image representation using block pattern models and its image processing applications," Ph.D. thesis, Univ. of California, Santa Barbara, 1990.
[24] A. Jain,Fundamentals of Digital Image Processing. Englewood Cliffs, NJ: Prentice-Hall, 1989.
[25] A. K. Jain, "Image data compression: A review,"Proc. IEEE, vol. 69, pp. 349-388, Mar. 1981.
[26] H. Musmannet al., "Advances in picture coding,"Proc. IEEE, vol. 73, pp. 523-548, Apr. 1985.
[27] C. T. Chen and T. R. Hsing, "Review: Digital coding techniques for visual communications,"J. Visual Commun. Image Represent., vol. 2, pp. 1-16, Mar. 1991.
[28] S. Carlsson, "Sketch based coding of grey level images,"Signal Processing, vol. 15, pp. 57-83, July 1988.
[29] R. Forchheimer and T. Kronander, "Image Coding--From Waveforms to Animation,"IEEE Trans. Acoustics, Speech and Image Processing, Vol. 37, No. 12, Dec. 1989, pp. 2008-2023.
[30] H. G. Musmann, M. Hotter, and J. Ostermann, "Object oriented analysis-synthesis coding of moving images,"Signal Processing: Image Commun., vol. 1, pp. 119-138, Oct. 1989.
[31] R. M. Gray, "Vector quantization,"IEEE ASSP Mag., vol. 1, pp. 4-29, Apr. 1984.
[32] N. M. Nasrabadi and R. A. King, "Image coding using vector quantization: A review,"IEEE Trans. Commun., vol. COM-36, pp. 957-971, Aug. 1988.
[33] E.J. Delp and O.R. Mitchell, "Image Compression Using Block Truncation Coding,"IEEE Trans. on Comm., Vol. COM-27, No. 9, Sept. 1979, pp. 1,335-1,342.
[34] D. R. Halverson, N. C. Griswold, and G. L. Wise, "A generalized block truncation coding algorithm for image compression,"IEEE Trans. Acoust. Speech Signal Processing, vol. ASSP-32, pp. 664-668, June 1984.
[35] N. C. Griswold, D. R. Halverson, and G. L. Wise, "A note on adaptive block truncation coding for image processing,"IEEE Trans. Acoust. Speech Signal Processing, vol. ASSP-35, pp. 1201-1203, Aug. 1987.
[36] S.P. Lloyd, "Least squares quantization in PCM,"IEEE Trans. Inform. Theory, vol. IT-28, pp. 129-136, Mar. 1982; previously an unpublished Bell Laboratories Tech. Note, 1957.
[37] D. Chen and A. C. Bovik, "Fast image coding using simple image patterns," inProc. SPIE: Visual Commun. Image Processing(Philadelphia), Nov. 1989, pp. 1461-1471.
[38] R. G. Keys, "Cubic convolution interpolation for digital image processing,"IEEE Trans. Acoust., Speech, Signal Processing, vol. ASSP-29, pp. 1153-1160, 1981.
[39] H. S. Hou and H. C. Andrews, "Cubic splines for image interpolation and digital filtering,"IEEE Trans. Acoust., Speech, Signal Processing, vol. ASSP-26, pp. 508-517, 1978.
[40] D. M. Martinez and J. S. Lim, "Spatial interpolation of interlaced television pictures," inProc. IEEE Int. Conf. Acoust. Speech Signal Processing(Glasgow, Scotland), May 1989, pp. 1886-1889.
[41] K. Jensen and D. Anastassiou, "Spatial resolution enhancement of images using nonlinear interpolation," inProc. IEEE Int. Conf. Acoust. Speech Signal Processing(Albuquerque), Apr. 1990, pp. 2045-2048.
[42] M. H. Hueckel, "An operator which localizes edges in digitized pictures," inJ. Assoc. Comput. Machine, vol. 18, pp. 113-125, 1971.
[43] R. T. Chin and C. L. Yeh, "Quantitative evaluation of some edge-preserving noise-smoothing techniques,"Comput. Vision Graphics Image Processing, vol. 23, pp. 67-91, 1983.
[44] L. S. Davis and A. Rosenfield, "Noise cleaning by iterated local averaging,"IEEE Trans. Syst. Man Cybern., vol. SMC-8, pp. 705-710, Sept. 1978.
[45] P. A. Heinonen, A. Nieminen, and Y. Neuvo, "A new class of detail-preserving filters for image processing,"IEEE Trans. Patt. Anal. Machine Intell., vol. PAMI-9, pp. 74-90, Jan. 1987.

Index Terms:
block pattern models; image processing; model classification; model parameter estimation; image reconstruction; image coding; image zooming; image smoothing; directional filters; oriented regions; edges; lines; image reconstruction; parameter estimation
Y. Wang, S.K. Mitra, "Image Representation Using Block Pattern Models and Its Image Processing Applications," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 15, no. 4, pp. 321-336, April 1993, doi:10.1109/34.206953
Usage of this product signifies your acceptance of the Terms of Use.