This Article 
 Bibliographic References 
 Add to: 
An Approach to the Perceptual Optimization of Complex Visualizations
July/August 2006 (vol. 12 no. 4)
pp. 509-521
Donald H. House, IEEE Computer Society

Abstract—This paper proposes a new experimental framework within which evidence regarding the perceptual characteristics of a visualization method can be collected, and describes how this evidence can be explored to discover principles and insights to guide the design of perceptually near-optimal visualizations. We make the case that each of the current approaches for evaluating visualizations is limited in what it can tell us about optimal tuning and visual design. We go on to argue that our new approach is better suited to optimizing the kinds of complex visual displays that are commonly created in visualization. Our method uses human-in-the-loop experiments to selectively search through the parameter space of a visualization method, generating large databases of rated visualization solutions. Data mining is then used to extract results from the database, ranging from highly specific exemplar visualizations for a particular data set, to more broadly applicable guidelines for visualization design. We illustrate our approach using a recent study of optimal texturing for layered surfaces viewed in stereo and in motion. We show that a genetic algorithm is a valuable way of guiding the human-in-the-loop search through visualization parameter space. We also demonstrate several useful data mining methods including clustering, principal component analysis, neural networks, and statistical comparisons of functions of parameters.

[1] J. Albers, Interaction of Color. Yale Univ. Press, 1963.
[2] A. Bair, D. House, and C. Ware, “Perceptually Optimizing Textures for Layered Surfaces,” Proc. Symp. Applied Perception in Graphics and Visualization, pp. 67-74, 2005.
[3] M.J. Black and R. Rosenholtz, “Robust Estimation of Multiple Surface Shapes from Occluded Textures,” Proc. Int'l Symp. Computer Vision, pp. 485-490, 1995.
[4] C. Chen and M.P. Czerwinski, “Empirical Evaluation of Information Visualizations: An Introduction,” Int'l J. Human-Computer Studies, vol. 53, pp. 631-635, 2000.
[5] B.G. Cumming, E.B. Johnston, and A.J. Parker, “Effects of Different Texture Cues on Curved Surfaces Viewed Stereoscopically,” Vision Research, vol. 33, no. 56, pp. 827-838, 1993.
[6] R. Dawkins, The Blind Watchmaker. Harlow Logman, 1986.
[7] D.B. Fogel, Evolutionary Computation: Toward a New Philosophy of Machine Intelligence, second ed. Piscataway, N.J.: IEEE Press, 1999.
[8] G. Greenfield, “Color Dependent Computational Aesthetics for Evolving Expressions,” Bridges: Math. Connections in Art, Music, and Science; Conf. Proc., pp. 9-16, 2002.
[9] T. He, L. Hong, A. Kaufman, and H. Pfister, “Generation of Transfer Functions with Stochastic Search Techniques,” Proc. IEEE Conf. Visualization '96, pp. 227-234, 1996.
[10] S. Hayk, Neural Networks, A Comprehensive Foundation, second ed. Upper Saddle River, N.J.: Prentice-Hall, 1999.
[11] D. House, A. Bair, and C. Ware, “On the Optimization of Visualizations of Complex Phenomena,” Proc. IEEE Conf. Visualization '05, pp. 87-94, 2005.
[12] D. House and C. Ware, “A Method for the Perceptual Optimization of Complex Visualizations,” Proc. Conf. Advanced Visual Interfaces, pp. 148-155, 2002.
[13] V. Interrante, H. Fuchs, and S.M. Pizer, “Conveying Shape of Smoothly Curving Transparent Surfaces via Texture,” IEEE Trans. Visualization and Computer Graphics, vol. 3, no. 2, pp. 98-117, 1997.
[14] S.C. Johnson, “Hierarchical Clustering Schemes,” Psychometrika, vol. 2, pp. 241-254, 1967.
[15] S. Kim, H. Hagh-Shenas, and V. Interrante, “Conveying Shape with Texture: Experimental Investigations of the Texture's Effects on Shape Categorization Judgments,” IEEE Trans. Visualization and Computer Graphics, vol. 10, no. 4, pp. 471-483, 2004.
[16] D.F. Keefe, D.B. Karelitz, E.L. Vote, and D.H. Laidlaw, “Artistic Collaboration in Designing VR Visualizations,” IEEE Computer Graphics and Applications, pending publication.
[17] D.H. Laidlaw, M. Kirby, C. Jackson, J.S. Davidson, T. Miller, M. DaSilva, W. Warren, and M. Tarr, “Comparing 2D Vector Field Visualization Methods: A User Study,” IEEE Trans. Visualization and Computer Graphics, vol. 11, no. 1, pp. 59-70, Jan./Feb. 2005.
[18] J. Marks, B. Andalman, P.A. Beardsley, W. Freeman, S. Gibson, J. Hodgins, and T. Kang, “Design Galleries: A General Approach to Setting Parameters for Computer Graphics and Animation,” Computer Graphics (Proc. SIGGRAPH '97), pp. 389-400, 1997.
[19] The MathWorks Inc., Matlab Release 13, 2003.
[20] E. Morse, M. Lewis, and K.A. Olsen, “Evaluating Visualizations: Using a Taxonomic Guide,” Int'l J. Human-Computer Studies, vol. 53, no. 5, pp. 637-662, 2000.
[21] J.F. Norman, J.T. Todd, and F. Phillips, “The Perception of Surface Orientation from Multiple Sources of Optical Information,” Perception and Psychophysics, vol. 57, no. 5, pp. 629-636, 1995.
[22] C. Plaisant, “The Challenge of Information Visualization Evaluation,” Proc. Conf. Advanced Visual Interfaces, pp. 109-116, 2004.
[23] V. Ramachandran, “Perceived Shape from Shading,” Scientific Am., pp. 76-780, Aug. 1988.
[24] B. Rogers and R. Cagnello, “Disparity Curvature and the Perception of Three-Dimensional Surfaces,” Nature, vol. 339, pp. 137-139, May 1989.
[25] C. Ryan, “Niche and Species Formation in Genetic Algorithms,” Practical Handbook of Genetic Algorithms, Lance Chambers, ed., vol. 1, Boca Raton, Fla.: CRC Press, Inc., pp. 58-73, 1995.
[26] K. Sims, “Artificial Evolution for Computer Graphics,” Computer Graphics (Proc. SIGGRAPH '91), vol. 25, pp. 319-328, 1991.
[27] D.A. Smith, “Case Study and Analysis of the Tacoma Narrows Bridge Failure,” 99.497 Eng. Project, Dept. of Mechanical Eng., Carleton Univ., Ottawa, Canada, Mar. 1974.
[28] J. Stasko, R. Catrambone, M. Guzdial, and K. McDonald, “An Evaluation of Space-Filling Information Visualizations for Depicting Hierarchical Structures,” Int'l J. Human-Computer Studies, vol. 53, no. 5, pp. 663-694, 2000.
[29] J.T. Todd and R. Akerstrom, “Perception of Three-Dimensional Form from Patterns of Optical Texture,” J. Experimental Psychology: Human Perception and Performance, vol. 13, no. 2, pp. 242-255, 1987.
[30] C. Ware and G. Frank, “Evaluating Stereo and Motion Cues for Visualizing Information Nets in Three Dimensions,” ACM Trans. Graphics, vol. 15, no. 2, pp. 121-140, 1996.
[31] C. Ware and P. Mitchell, “Reevaluating Stereo and Motion Cues for Visualizing Graphs in Three Dimensions,” Proc. Symp. Applied Perception in Graphics and Visualization, 2005.
[32] T. Watanabe and P. Cavanagh, “Texture Laciness,” Perception, vol. 25, pp. 293-303, 1996.

Index Terms:
Data mining, evaluation/methodology, theory and methods, visualization techniques, methodologies.
Donald H. House, Alethea S. Bair, Colin Ware, "An Approach to the Perceptual Optimization of Complex Visualizations," IEEE Transactions on Visualization and Computer Graphics, vol. 12, no. 4, pp. 509-521, July-Aug. 2006, doi:10.1109/TVCG.2006.58
Usage of this product signifies your acceptance of the Terms of Use.