The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.12 - December (2010 vol.32)
pp: 2191-2204
Tal Kenig , Technion - Insitute of Technology, Haifa
Zvi Kam , Weizmann Institute of Science, Rehovot
Arie Feuer , Technion - Insitute of Technology, Haifa
ABSTRACT
In this work, we propose a novel method for the regularization of blind deconvolution algorithms. The proposed method employs example-based machine learning techniques for modeling the space of point spread functions. During an iterative blind deconvolution process, a prior term attracts the point spread function estimates to the learned point spread function space. We demonstrate the usage of this regularizer within a Bayesian blind deconvolution framework and also integrate into the latter a method for noise reduction, thus creating a complete blind deconvolution method. The application of the proposed algorithm is demonstrated on synthetic and real-world three-dimensional images acquired by a wide-field fluorescence microscope, where the need for blind deconvolution algorithms is indispensable, yielding excellent results.
INDEX TERMS
Blind deconvolution, deblurring, machine learning, PCA, kernel PCA, microscopy.
CITATION
Tal Kenig, Zvi Kam, Arie Feuer, "Blind Image Deconvolution Using Machine Learning for Three-Dimensional Microscopy", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.32, no. 12, pp. 2191-2204, December 2010, doi:10.1109/TPAMI.2010.45
REFERENCES
[1] G.R. Ayers and J.C. Dainty, "Iterative Blind Deconvolution Method and Its Applications," Optics Letters, vol. 13, no. 7, pp. 547-549, 1988.
[2] M.J. Booth, M.A.A. Neil, and T. Wilson, "Aberration Correction for Confocal Imaging in Refractive-Index-Mismatched Media," J. Microscopy, vol. 192, no. 2, pp. 90-98, 1998.
[3] M. Born and E. Wolf, Principles of Optics, seventh ed. Cambridge Univ. Press, 1999.
[4] B.E. Boser, I.M. Guyon, and V.N. Vapnik, "A Training Algorithm for Optimal Margin Classifiers," Proc. Fifth Ann. Workshop Computational Learning Theory, pp. 144-152, 1992.
[5] R.W. Boyd, Radiometry and the Detection of Optical Radiation. Wiley, 1983.
[6] P. Campisi and K. Egiazarian, Blind Image Deconvolution: Theory and Applications. CRC Press, 2007.
[7] M. Cannon, "Blind Deconvolution of Spatially Invariant Image Blurs with Phase," IEEE Trans. Acoustics, Speech, and Signal Processing, vol. 24, no. 1, pp. 58-63, Feb. 1976.
[8] A.S. Carasso, "Linear and Nonlinear Image Deblurring: A Documented Study," SIAM J. Numerical Analysis, vol. 36, no. 6, pp. 1659-1689, 1999.
[9] R.R. Coifman, S. Lafon, A.B. Lee, M. Maggioni, B. Nadler, F. Warner, and S.W. Zucker, "Geometric Diffusions as a Tool for Harmonic Analysis and Structure Definition of Data: Diffusion Maps," Proc. Nat'l Academy of Sciences USA, vol. 102, no. 21, pp. 7426-7431, May 2005.
[10] I. Csiszár and G. Tusnády, "Information Geometry and Alternating Minimization Procedures," Statistics and Decisions, Supplement Issue, vol. 1, pp. 205-237, 1984.
[11] S. Dai and Y. Wu, "Motion from Blur," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1-8, June 2008.
[12] S. Dambreville, Y. Rathi, and A. Tannenbaum, "A Shape-Based Approach to Robust Image Segmentation," Proc. Int'l Conf. Image Analysis and Recognition, vol. 1, pp. 73-183, 2006.
[13] S. Dambreville, Y. Rathi, and A. Tannenbaum, "Shape-Based Approach to Robust Image Segmentation Using Kernel PCA," Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 977-984, 2006.
[14] S. Dambreville, Y. Rathi, and A. Tannenbaum, "A Framework for Image Segmentation Using Shape Models and Kernel Space Shape Priors," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 30, no. 8, pp. 1385-1399, Aug. 2008.
[15] D. Datsenko and M. Elad, "Example-Based Single Document Image Super-Resolution: A Global Map Approach with Outlier Rejection," Multidimensional Systems and Signal Processing, vol. 18, pp. 103-121, 2007.
[16] J.B. de Monvel, E. Scarfone, S. Le Calvez, and M. Ulfendahl, "Image-Adaptive Deconvolution for Three-Dimensional Deep Biological Imaging," Biophysical J., vol. 85, no. 6, pp. 3991-4001, 2003.
[17] A.R. De Pierro, "A Modified Expectation Maximization Algorithm for Penalized Likelihood Estimation in Emission Tomography," IEEE Trans. Medical Imaging, vol. 14, no. 1, pp. 132-137, Mar. 1995.
[18] N. Dey, L. Blanc-Feraud, C. Zimmer, Z. Kam, J.-C. Olivo-Marin, and J. Zerubia, "A Deconvolution Method for Confocal Microscopy with Total Variation Regularization," Proc. IEEE Int'l Symp. Biomedical Imaging: Nano to Macro, vol. 2, pp. 1223-1226, 2004.
[19] P. Etyngier, F. Segonne, and R. Keriven, "Active-Contour-Based Image Segmentation Using Machine Learning Techniques," Proc. Medical Image Computing and Computer-Assisted Intervention, N. Ayache, S. Ourselin, and A. Maeder, eds., pp. 891-899, 2007.
[20] P. Etyngier, F. Segonne, and R. Keriven, "Shape Priors Using Manifold Learning Techniques," Proc. IEEE 11th Int'l Conf. Computer Vision, pp. 1-8, 2007.
[21] R. Fergus, B. Singh, A. Hertzmann, S.T. Roweis, and W.T. Freeman, "Removing Camera Shake from a Single Photograph," ACM Trans. Graphics, vol. 25, no. 3, pp. 787-794, 2006.
[22] D.A. Fish, A.M. Brinicombe, E.R. Pike, and J.G. Walker, "Blind Deconvolution by Means of the Richardson-Lucy Algorithm," J. Optical Soc. Am. A, vol. 12, no. 1, pp. 58-65, 1995.
[23] W.T. Freeman, T.R. Jones, and E.C. Pasztor, "Example-Based Super-Resolution," IEEE Computer Graphics and Applications, vol. 22, no. 2, pp. 56-65, Mar./Apr. 2002.
[24] S.F. Gibson and F. Lanni, "Experimental Test of an Analytical Model of Aberration in an Oil-Immersion Objective Lens Used in Three-Dimensional Light Microscopy," J. Optical Soc. Am. A, vol. 9, no. 1, pp. 154-166, Jan. 1992.
[25] J.W. Goodman, Introduction to Fourier Optics, second ed. McGraw-Hill Companies, Inc., 1996.
[26] P.J. Green, "Bayesian Reconstructions from Emission Tomography Data Using a Modified EM Algorithm," IEEE Trans. Medical Imaging, vol. 9, no. 1, pp. 84-93, Mar. 1990.
[27] M.G.L. Gustafsson, D.A. Agard, and J.W. Sedat, "Sevenfold Improvement of Axial Resolution in 3D Widefield Microscopy Using Two Objective Lenses," Proc. SPIE, pp. 147-156, 1995.
[28] R.M. Haralick and L.G. Shapiro, Computer and Robot Vision. Addison-Wesley Longman Publishing Co., Inc., 1992.
[29] T.J. Holmes, "Blind Deconvolution of Quantum-Limited Incoherent Imagery: Maximum-Likelihood Approach," J. Optical Soc. Am. A, vol. 9, no. 7, pp. 1052-1061, 1992.
[30] E.F.Y. Hom, F. Marchis, T.K. Lee, S. Haase, D.A. Agard, and J.W. Sedat, "AIDA: An Adaptive Image Deconvolution Algorithm with Application to Multi-Frame and Three-Dimensional Data," J. Optical Soc. Am. A, vol. 24, no. 6, pp. 1580-1600, 2007.
[31] J. Jia, "Single Image Motion Deblurring Using Transparency," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1-8, June 2007.
[32] N. Joshi, R. Szeliski, and D.J. Kriegman, "PSF Estimation Using Sharp Edge Prediction," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1-8, June 2008.
[33] V. Krishnamurthi, Y.-H. Liu, S. Bhattacharyya, J.N. Turner, and T.J. Holmes, "Blind Deconvolution of Fluorescence Micrographs by Maximum-Likelihood Estimation," Applied Optics, vol. 34, no. 29, pp. 6633-6647, 1995.
[34] D. Kundur and D. Hatzinakos, "Blind Image Deconvolution," IEEE Signal Processing Magazine, vol. 13, no. 3, pp. 43-64, May 1996.
[35] J.-Y. Kwok and I.-H. Tsang, "The Pre-Image Problem in Kernel Methods," IEEE Trans. Neural Networks, vol. 15, no. 6, pp. 1517-1525, Nov. 2004.
[36] R.L. Lagendijk, J. Biemond, and D.E. Boekee, "Regularized Iterative Image Restoration with Ringing Reduction," IEEE Trans. Acoustics, Speech, and Signal Processing, vol. 36, no. 12, pp. 1874-1888, Dec. 1988.
[37] R.G. Lane and R.H.T. Bates, "Automatic Multidimensional Deconvolution," J. Optical Soc. Am. A, vol. 4, no. 1, p. 180, 1987.
[38] M.E. Leventon, W.E.L. Grimson, and O. Faugeras, "Statistical Shape Influence in Geodesic Active Contours," Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 316-323, 2000.
[39] D. Li, R.M. Mersereau, and S. Simske, "Blind Image Deconvolution through Support Vector Regression," IEEE Trans. Neural Networks, vol. 18, no. 3, pp. 931-935, May 2007.
[40] D. Li, R.M. Mersereau, and S. Simske, "Blur Identification Based on Kurtosis Minimization," Proc. IEEE Int'l Conf. Image Processing, vol. 1, pp. I-905-8, Sept. 2005.
[41] L. Lucy, "An Iterative Technique for the Rectification of Observed Distributions," The Astronomical J., vol. 79, pp. 745-754, 1974.
[42] F. Macias-Garza, A.C. Bovik, K.R. Diller, S.J. Aggarwal, and J.K. Aggarwal, "Digital Reconstruction of Three-Dimensional Serially Sectioned Optical Images," IEEE Trans. Acoustics, Speech, and Signal Processing, vol. 36, no. 7, pp. 1067-1075, July 1988.
[43] J. Markham and J.-A. Conchello, "Parametric Blind Deconvolution of Microscopic Images: Further Results," Proc. SPIE Three-Dimensional and Multidimensional Microscopy: Image Acquisition and Processing V, C.J. Cogswell, J.-A. Conchello, T. Wilson, T.T. Lu, and J.M. Lerner, eds., pp. 38-49, Jun. 1998.
[44] S. Mika, B. Schölkopf, A.J. Smola, K.-R. Müller, M. Scholz, and G. Rätsch, "Kernel PCA and De-Noising in Feature Spaces," Advances in Neural Information Processing Systems 11, M.S. Kearns, S.A. Solla, and D.A. Cohn, eds., MIT Press, 1999.
[45] R. Nakagaki and A.K. Katsaggelos, "A VQ-Based Blind Image Restoration Algorithm," IEEE Trans. Image Processing, vol. 12, no. 9, pp. 1044-1053, Sept. 2003.
[46] A.V. Oppenheim and J.S. Lim, "The Importance of Phase in Signals," Proc. IEEE, vol. 69, no. 5, pp. 529-541, May 1981.
[47] K. Panchapakesan, D.G. Sheppard, M.W. Marcellin, and B.R. Hunt, "Blur Identification from Vector Quantizer Encoder Distortion," IEEE Trans. Image Processing, vol. 10, no. 3, pp. 465-470, Mar. 2001.
[48] P. Pankajakshan, B. Zhang, L. Blanc-Feraud, Z. Kam, J.-C. Olivo-Marin, and J. Zerubia, "Blind Deconvolution for Diffraction-Limited Fluorescence Microscopy," Proc. Fifth IEEE Int'l Symp. Biomedical Imaging: From Nano to Macro, pp. 740-743, 2008.
[49] K. Pearson, "On Lines and Planes of Closest Fit to Systems of Points in Space," Philosophical Magazine, vol. 2, no. 6, pp. 559-572, 1901.
[50] R. Raskar, A. Agrawal, and J. Tumblin, "Coded Exposure Photography: Motion Deblurring Using Fluttered Shutter," ACM Trans. Graphics, vol. 25, no. 3, pp. 795-804, 2006.
[51] Y. Rathi, S. Dambreville, and A. Tannenbaum, "Statistical Shape Analysis Using Kernel PCA," Proc. SPIE, Electronic Imaging, 2006.
[52] S.J. Reeves and R.M. Mersereau, "Blur Identification by the Method of Generalized Cross-Validation," IEEE Trans. Image Processing, vol. 1, no. 3, pp. 301-311, July 1992.
[53] W.H. Richardson, "Bayesian-Based Iterative Method of Image Restoration," J. Optical Soc. Am. A, vol. 62, no. 1, pp. 55-59, 1972.
[54] M. Rousson and N. Paragios, "Shape Priors for Level Set Representations," Proc. Seventh European Conf. Computer Vision-Part II, pp. 78-92, 2002.
[55] L.I. Rudin, S. Osher, and E. Fatemi, "Nonlinear Total Variation Based Noise Removal Algorithms," Physica D, vol. 60, nos. 1-4, pp. 259-268, 1992.
[56] B.A. Scalettar, J.R. Swedlow, J.W. Sedat, and D.A. Agard, "Dispersion, Aberration and Deconvolution in Multi-Wavelength Fluorescence Images," J. Microscopy, vol. 182, no. 1, pp. 50-60, Apr. 1996.
[57] B. Schölkopf, A. Smola, and K.-R. Müller, "Nonlinear Component Analysis as a Kernel Eigenvalue Problem," Neural Computation, vol. 10, no. 5, pp. 1299-1319, 1998.
[58] Q. Shan, J. Jia, and A. Agarwala, "High-Quality Motion Deblurring from a Single Image," ACM Trans. Graphics, vol. 27, no. 3, pp. 1-10, 2008.
[59] L.A. Shepp and Y. Vardi, "Maximum Likelihood Reconstruction for Emission Tomography," IEEE Trans. Medical Imaging, vol. 1, no. 2, pp. 113-122, Oct. 1982.
[60] J.-L. Starck, E. Pantin, and F. Murtagh, "Deconvolution in Astronomy: A Review," Publications of the Astronomical Soc. of the Pacific, vol. 114, pp. 1051-1069, 2002.
[61] J. Stockham, T.G., T.M. Cannon, and R.B. Ingebretsen, "Blind Deconvolution through Digital Signal Processing," Proc. IEEE, vol. 63, no. 4, pp. 678-692, Apr. 1975.
[62] P.A. Stokseth, "Properties of a Defocused Optical System," J. Optical Soc. Am. A, vol. 59, no. 10, pp. 1314-1321, 1969.
[63] N. Streibl, "Three-Dimensional Imaging by a Microscope," J. Optical Soc. Am. A, vol. 2, no. 2, pp. 121-127, 1985.
[64] A. Tsai, J. Yezzi, A.W. Wells, C. Tempany, D. Tucker, A. Fan, W. Grimson, and A. Willsky, "A Shape-Based Approach to the Segmentation of Medical Imagery Using Level Sets," IEEE Trans. Medical Imaging, vol. 22, no. 2, pp. 137-154, Feb. 2003.
[65] F. Tsumuraya, N. Miura, and N. Baba, "Iterative Blind Deconvolution Method Using Lucy's Algorithm," Astronomy and Astrophysics, vol. 282, pp. 699-708, Feb. 1994.
[66] Y. Yang, N.P. Galatsanos, and H. Stark, "Projection-Based Blind Deconvolution," J. Optical Soc. Am. A, vol. 11, no. 9, pp. 2401-2409, 1994.
[67] Y.-L. You and M. Kaveh, "Blind Image Restoration by Anisotropic Regularization," IEEE Trans. Image Processing, vol. 8, no. 3, pp. 396-407, Mar. 1999.
[68] L. Yuan, J. Sun, L. Quan, and H.-Y. Shum, "Image Deblurring with Blurred/Noisy Image Pairs," ACM Trans. Graphics, vol. 26, no. 3, pp. 1-10, 2007.
[69] B. Zhang, J. Zerubia, and J.-C. Olivo-Marin, "Gaussian Approximations of Fluorescence Microscope Point-Spread Function Models," Applied Optics, vol. 46, no. 10, pp. 1819-1829, 2007.
33 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool