The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.10 - October (2011 vol.17)
pp: 1487-1498
Jason Lawrence , University of Virginia, Charlottesville
Sean Arietta , University of Virginia, Charlottesville
Michael Kazhdan , Johns Hopkins University, Baltimore
Daniel Lepage , University of Virginia, Charlottesville
Colleen O'Hagan , University of Virginia, Charlottesville
ABSTRACT
We present a new technique for fusing together an arbitrary number of aligned images into a single color or intensity image. We approach this fusion problem from the context of Multidimensional Scaling (MDS) and describe an algorithm that preserves the relative distances between pairs of pixel values in the input (vectors of measurements) as perceived differences in a color image. The two main advantages of our approach over existing techniques are that it can incorporate user constraints into the mapping process and allows adaptively compressing or exaggerating features in the input in order to make better use of the output's limited dynamic range. We demonstrate these benefits by showing applications in various scientific domains and comparing our algorithm to previously proposed techniques.
INDEX TERMS
Multidimensional images, visualization techniques, dimensionality reduction, multidimensional scaling, physical sciences and engineering, life and medical sciences.
CITATION
Jason Lawrence, Sean Arietta, Michael Kazhdan, Daniel Lepage, Colleen O'Hagan, "A User-Assisted Approach to Visualizing Multidimensional Images", IEEE Transactions on Visualization & Computer Graphics, vol.17, no. 10, pp. 1487-1498, October 2011, doi:10.1109/TVCG.2010.229
REFERENCES
[1] Landsat, http:/landsat.gsfc.nasa.gov, 2008.
[2] P.J. Burt and R.J. Kolczynski, “Enhanced Image Capture through Fusion,” Proc. Int'l Conf. Computer Vision, pp. 173-182, 1993.
[3] C. Pohl and J.L.V. Genderen, “Multisensor Image Fusion in Remote Sensing: Concepts, Methods and Applications,” Int'l J. Remote Sensing, vol. 19, no. 5, pp. 823-854, 1998.
[4] Multi-Sensor Image Fusion and Its Applications, R.S. Blum and Z. Liu, eds. Taylor & Francis, 2006.
[5] J.S. Tyo, A. Konsolakis, D.I. Diersen, and R.C. Olsen, “Principal-Components-Based Display Strategy for Spectral Imagery,” IEEE Trans. Geoscience and Remote Sensing, vol. 41, no. 3, pp. 708-718, Mar. 2003.
[6] N.P. Jacobson and M.R. Gupta, “Design Goals and Solutions for Display of Hyperspectral Images,” IEEE Trans. Geoscience and Remote Sensing, vol. 43, no. 11, pp. 2684-2692, Nov. 2005.
[7] P.J. Ready and P.A. Wintz, “Information Extraction, SNR Improvement, and Data Compression in Multispectral Imagery,” IEEE Trans. Comm., vol. COM-21, no. 10, pp. 1123-1131, Oct. 1973.
[8] A. Toet, “Hierarchical Image Fusion,” Machine Vision and Applications, vol. 3, no. 1, pp. 1-11, 1990.
[9] H. Li, B.S. Manjunath, and S.K. Mitra, “Multisensor Image Fusion Using the Wavelet Transform,” Graphical Models and Image Processing, vol. 57, no. 3, pp. 235-245, 1995.
[10] D.A. Socolinsky and L.B. Wolff, “Multispectral Image Visualization through First-Order Fusion,” IEEE Trans. Image Processing, vol. 11, no. 8, pp. 923-931, Aug. 2002.
[11] T.F. Cox and M.A.A. Cox, Multidimensional Scaling, second ed. Chapman & Hall/CRC, 2001.
[12] D. Harel and Y. Koren, “Graph Drawing by High-Dimensional Embedding,” J. Graph Algorithms and Applications, vol. 8, no. 2, pp. 195-214, 2004.
[13] Y. Koren, “Graph Drawing by Subspace Optimization,” Proc. Joint EUROGRAPHICS-IEEE TCVG Symp. Visualization, pp. 65-74, 2004.
[14] V. de Silva and J.B. Tenenbaum, “Global versus Local Methods in Nonlinear Dimensionality Reduction,” Proc. Advances in Neural Information Processing Systems (NIPS), pp. 705-712, 2003.
[15] U. Brandes and C. Pich, “Eigensolver Methods for Progressive Multidimensional Scaling of Large Data,” Proc. Int'l Conf. Graph Drawing, pp. 42-53, 2006.
[16] A. Ifarraguerri and C.-I. Chang, “Hyperspectral Image Segmentation with Convex Cones,” IEEE Trans. Geoscience and Remote Sensing, vol. 37, no. 2, pp. 756-770, Mar. 1999.
[17] J. Silverman, C.E. Caefer, J.M. Mooney, M.M. Weeks, and P. Yip, “Automated Clustering/Segmentation of Hyperspectral Images Based on Histogram Thresholding,” Proc. SPIE, vol. 4480, no. 65, pp. 65-75, 2002.
[18] J.H. Friedman and J.W. Tukey, “A Projection Pursuit Algorithm for Exploratory Data Analysis,” IEEE Trans. Computers, vol. C-23, no. 9, pp. 881-890, Sept. 1974.
[19] G. Harikumar and Y. Bresler, “Feature Extraction Techniques for Exploratory Visualization of Vector-Valued Imagery,” IEEE Trans. Image Processing, vol. 5, no. 9, pp. 1324-1334, Sept. 1996.
[20] X. Jia and J.A. Richards, “Segmented Principal Components Transformation for Efficient Hyperspectral Remote-Sensing Image Display and Classification,” IEEE Trans. Geoscience and Remote Sensing, vol. 37, no. 1, pp. 538-542, Jan. 1999.
[21] Q. Du, S. Cai, and R.J. Moorhead, “Color Display for Hyperspectral Imagery,” IEEE Trans. Geoscience and Remote Sensing, vol. 46, no. 6, pp. 1858-1866, June 2008.
[22] M. Cui, A. Razdan, J. Hu, and P. Wonka, “Interactive Hyperspectral Image Visualization Using Convex Optimization,” IEEE Trans. Geoscience and Remote Sensing, vol. 47, no. 6, pp. 1673-1684, June 2009.
[23] T. Kohonen, Self-Organizing Maps. Springer-Verlag, 1995.
[24] A. Manduca, “Multispectral Image Visualization with Nonlinear Projections,” IEEE Trans. Image Processing, vol. 5, no. 10, pp. 1486-1490, Oct. 1996.
[25] Z. Zhang, S. Sun, and F. Zheng, “Image Fusion Based on Median Filters and SOFM Neural Networks: A Three-Step Scheme,” Signal Processing, vol. 81, no. 6, pp. 1325-1330, 2001.
[26] D.H. Kim and L.H. Finkel, “Hyperspectral Image Processing Using Locally Linear Embedding,” Proc. First Int'l IEEE Conf. Neural Eng., pp. 316-319, 2003.
[27] S.T. Roweis and L.K. Saul, “Nonlinear Dimensionality Reduction by Locally Linear Embedding,” Science, vol. 290, no. 5500, pp. 2323-2326, 2000.
[28] A.A. Gooch, S.C. Olsen, J. Tumblin, and B. Gooch, “Color2Gray: Salience-Preserving Color Removal,” ACM Trans. Graphics, vol. 24, no. 3, pp. 634-639, 2005.
[29] K. Rasche, R. Geist, and J. Westall, “Re-Coloring Images for Gamuts of Lower Dimension,” Computer Graphics Forum, vol. 24, no. 3, pp. 423-432, 2005.
[30] K. Smith, J.T. Pierre-Edouard Landes, and K. Myszkowski, “Apparent Greyscale: A Simple and Fast Conversion to Perceptually Accurate Images and Video,” Computer Graphics Forum, vol. 27, no. 2, pp. 193-200, 2008.
[31] P.J. Burt and E.H. Adelson, “The Laplacian Pyramid as a Compact Image Code,” IEEE Trans. Comm., vol. COM-31, no. 4, pp. 532-540, Apr. 1983.
[32] P. Scheunders, “Multiscale Edge Representation Applied to Image Fusion,” Proc. SPIE, vol. 4119, no. 2, pp. 894-901, 2000.
[33] S. Mallat and S. Zhong, “Characterization of Signals from Multiscale Edges,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 14, no. 7, pp. 710-732, July 1992.
[34] S.D. Zenzo, “A Note on the Gradient of a Multi-Image,” Computer Vision, Graphics, and Image Processing, vol. 33, no. 1, pp. 116-125, 1986.
[35] D.A. Socolinsky and L.B. Wolff, “A New Visualization Paradigm for Multispectral Imagery and Data Fusion,” Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), pp. 319-324, 1999.
[36] J. Tumblin, “Three Methods of Detail-Preserving Contrast Reduction for Displayed Images,” PhD dissertation, Georgia Inst. of Tech nology, 1999.
[37] F. Durand and J. Dorsey, “Fast Bilateral Filtering for the Display of High-Dynamic-Range Images,” Proc. ACM SIGGRAPH, pp. 257-266, 2002.
[38] R. Fattal, D. Lischinski, and M. Werman, “Gradient Domain High Dynamic Range Compression,” Proc. ACM SIGGRAPH, pp. 249-256, 2002.
[39] E. Reinhard, M. Stark, P. Shirley, and J. Ferwerda, “Photographic Tone Reproduction for Digital Images,” Proc. ACM SIGGRAPH, pp. 267-276, 2002.
[40] R. Fattal, M. Agrawala, and S. Rusinkiewicz, “Multiscale Shape and Detail Enhancement from Multi-Light Image Collections,” ACM Trans. Graphics, vol. 26, no. 3, 2007.
[41] Z. Farbman, R. Fattal, D. Lischinski, and R. Szeliski, “Edge-Preserving Decompositions for Multi-Scale Tone and Detail Manipulation,” ACM Trans. Graphics, vol. 27, no. 3, 2008.
[42] I. Borg and P. Groenen, Modern Multidimensional Scaling: Theory and Applications. Springer-Verlag, 1997.
[43] J.B. Kruskal, “Multidimensional Scaling by Optimizing Goodness of Fit to a Nonmetric Hypothesis,” Psychometrika, vol. 29, no. 1, pp. 1-27, 1964.
[44] J. de Leeuw, “Applications of Convex Analysis to Multidimensional Scaling,” Recent Developments in Statistics, J. Barra, F. Brodeau, G. Romier, and B.V. Cutsem, eds., pp. 133-146, North Holland Publishing Company, 1977.
[45] E.R. Gansner, Y. Koren, and S. North, “Graph Drawing by Stress Majorization,” Proc. Int'l Symp. Graph Drawing, pp. 239-250, 2004.
[46] S. Ingram, T. Munzner, and M. Olano, “Glimmer: Multilevel MDS on the GPU,” IEEE Trans. Visualization and Computer Graphics, vol. 15, no. 2, pp. 249-261, Mar./Apr. 2009.
[47] M.D. Fairchild, Color Appearance Models, first ed. Addison-Wesley, 1997.
[48] E.R. Tufte, Visual Explanations: Images and Quantities, Evidence and Narrative, first ed. Graphics Press, 1997.
[49] J. Keuchel, S. Naumann, M. Heiler, and A. Siegmund, “Automatic Land Cover Analysis for Tenerife by Supervised Classification Using Remotely Sensed Data,” Remote Sensing of Environment, vol. 86, no. 4, pp. 530-541, 2003.
[50] J.J. Lewis, R.J. O'Callaghan, S.G. Nikolov, D.R. Bull, and N. Canagarajah, “Pixel- and Region-Based Image Fusion Using Complex Wavelets,” Image Fusion, vol. 8, no. 2, pp. 119-130, 2007.
7 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool