This Article 
 Bibliographic References 
 Add to: 
Human Factors in Visualization Research
January-February 2004 (vol. 10 no. 1)
pp. 72-84

Abstract—Visualization can provide valuable assistance for data analysis and decision making tasks. However, how people perceive and interact with a visualization tool can strongly influence their understanding of the data as well as the system's usefulness. Human factors therefore contribute significantly to the visualization process and should play an important role in the design and evaluation of visualization tools. Several research initiatives have begun to explore human factors in visualization, particularly in perception-based design. Nonetheless, visualization work involving human factors is in its infancy, and many potentially promising areas have yet to be explored. Therefore, this paper aims to 1) review known methodology for doing human factors research, with specific emphasis on visualization, 2) review current human factors research in visualization to provide a basis for future investigation, and 3) identify promising areas for future research.

[1] C.L. Bajaj, V. Pascucci, and D.R. Schikore, "The Contour Spectrum," Proc. Visualization 97, ACM Press, New York, 1997, pp. 167-173, 539.
[2] M.Q.W. Baldonado, A. Woodruff, and A. Kuchinsky, Guidelines for Using Multiple Views in Information Visualization Proc. Working Conf. Advanced Visual Interfaces, pp. 110-119, 2000.
[3] L.D. Bergman, B.E. Rogowitz, and L.A. Treinish, “A Rule-Based Tool for Assisting Colormap Selection,” Proc. Visualization 1995, pp. 118-125, Oct. 1995.
[4] S. Björk and J. Redström, Redefining the Focus and Context of Focus + Context Visualization Proc. IEEE Symp. Information Visualization, pp. 85-89, 2000.
[5] A.F. Blackwell et al., Cognitive Dimensions of Notations: Design Tools for Cognitive Technology Proc. Cognitive Technology, pp. 325-341, 2001.
[6] M.R. Bolin and G.W. Meyer, A Perceptually Based Adaptive Sampling Algorithm Proc. SIGGRAPH, pp. 299-309, 1998.
[7] V. Bruce, P.R. Green, and M.A. Georgeson, Visual Perception: Physiology, Psychology, and Ecology, third ed. Exeter, U.K.: Psychology Press, 1996.
[8] S.K. Card, J.D. Mackinlay, and B. Shneiderman, Readings in Information Visualization: Using Vision to Think. San Francisco: Morgan Kaufmann Publishers, 1999.
[9] M.S.T. Carpendale et al., The tardis: A Visual Exploration Environment for Landscape Dynamics Proc. Visual Data Exploration and Analysis VI, 1999.
[10] M.S.T. Carpendale, D.J. Cowperthwaite, and F.D. Fracchia, 3-Dimensional Pliable Surfaces: For the Effective Presentation of Visual Information Proc. ACM Symp. User Interface Software and Technology, pp. 217-226, 1995.
[11] M.F. Cohen et al., Volume Seedlings Proc. Symp. Interactive 3D Graphics, pp. 139-145, 1992.
[12] D.J. Cowperthwaite, Occlusion Resolution Operators for Three-Dimensional Detail-in-Context doctoral dissertation, Computing Science Dept., Simon Fraser Univ., Burnaby, B.C., 2000.
[13] B. Csébfalvi et al., Fast Visualization of Object Contours by Non-Photorealistic Volume Rendering Proc. Eurographics, vol. 20, no. 3, 2001.
[14] S. Daly, The Visible Differences Predictor: An Algorithm for the Assessment of Image Fidelity Digital Images and Human Vision, A.B. Watson, ed., pp. 179-206, Cambridge, Mass.: MIT Press, 1993.
[15] D.S. Ebert et al., Procedural Shape Generation for Multi-Dimensional Data Visualization Computers&Graphics, vol. 24, no. 3, pp. 375-384, June 2000.
[16] S. Fang, T. Biddlecome, and M. Tuceryan, Image-Based Transfer Function Design for Data Exploration in Volume Visualization Proc. IEEE Visualization, pp. 319-326, 1998.
[17] J.A. Ferwerda et al., A Model of Visual Adaptation for Realistic Image Synthesis Proc. SIGGRAPH, pp. 249-258, 1996.
[18] J.A. Ferwerda et al., A Model of Visual Masking for Computer Graphics Proc. SIGGRAPH, pp. 143-152, 1997.
[19] B. Fröhlich et al., "Cubic-Mouse-Based Interaction in Virtual Environments," IEEE Computer Graphics and Applications, Vol. 20, No. 4, July/Aug. 2000, pp. 12-15.
[20] I. Fujishiro, T. Azuma, and Y. Takeshima, “Automating Transfer Function Design for Comprehensible Volume Rendering Based on 3D Field Topology Analysis,” Proc. IEEE Visualization '99, pp. 467-470, Oct. 1999.
[21] G.W. Furnas, Generalized Fisheye Views Proc. Conf. Human Factors in Computing Systems, pp. 16-23, 1986.
[22] D.P. Greenberg et al., A Framework for Realistic Image Synthesis Proc. SIGGRAPH, pp. 477-494, 1997.
[23] J.T. Hackos and J.C. Redish, User and Task Analysis for Interface Design, pp. 7-8. Toronto: John Wiley&Sons, 1998.
[24] T. He et al., Generation of Transfer Functions with Stochastic Search Techniques Proc. IEEE Visualization, pp. 227-234, 489, 1996.
[25] C.G. Healey, Choosing Effective Colours for Data Visualization Proc. IEEE Visualization, pp. 263-270, 493, 1996.
[26] C.G. Healey, On the Use of Perceptual Cues and Data Mining for Effective Visualization of Scientific Datasets Proc. Graphics Interface, pp. 177-184, 1998.
[27] C.G. Healey, K.S. Booth, and J.T. Enns, High-Speed Visual Estimation Using Preattentive Processing ACM Trans. Computer-Human Interaction, vol. 3, no. 2, pp. 107-135, 1996.
[28] C.G. Healey and J.T. Enns, Perception and Painting: A Search for Effective, Engaging Visualizations IEEE Computer Graphics and Applications, pp. 10-15, Mar./Apr. 2002.
[29] K. Hinckley et al., A Survey of Design Issues in Spatial Input Proc. ACM Symp. User Interface Software and Technology, pp. 213-222, 1994.
[30] K. Hinckley et al., Passive Real-World Interface Props for Neurosurgical Visualization Proc. Conf. Human Factors in Computing Systems, pp. 452-458, 1994.
[31] V. Interrante, H. Fuchs, and S. Pizer, Conveying the 3D Shape of Smoothly Curving Transparent Surfaces via Texture IEEE Computer Graphics and Applications, vol. 3, no. 2, pp. 98-117, Mar./Apr. 1997.
[32] V. Interrante, "Harnessing Natural Textures for Multivariate Visualization," IEEE Computer Graphics and Applications, vol. 20, no. 6, Nov./Dec. 2000, pp. 6-10.
[33] P. Irani, M. Tingley, and C. Ware, Using Perceptual Syntax to Enhance Semantic Content in Diagrams IEEE Computer Graphics and Applications, vol. 21, no. 5, pp. 76-84, Sept./Oct. 2001.
[34] T.J. Jankun-Kelly and K-.L. Ma, "Visualization Exploration and Encapsulation via a Spreadsheet-like Interface," IEEE Tran. Visualization and Computer Graphics, vol. 7, no. 3, July-Sept. 2001, pp. 275-287.
[35] D. Kasik et al., "Evaluating Graphics Displays for Complex 3D Models," IEEE Computer Graphics and Applications, vol. 22, no. 3, May/June 2002, pp. 56-64.
[36] T.A. Keahey, The Generalized Detail In-Context Problem Proc. IEEE Symp. Information Visualization, pp. 44-51, 152, 1998.
[37] T.A. Keahey, Visualization of High-Dimensional Clusters Using Nonlinear Magnification Technical Report LA-UR-98-2776, Los Alamos Nat'l Laboratory, 1998.
[38] G. Kindlmann and J.W. Durkin, Semi-Automatic Generation of Transfer Functions for Direct Volume Rendering Proc. IEEE Symp. Volume Visualization, pp. 79-86, 1998.
[39] R. Kirby, H. Marmanis, and D. Laidlaw, Visualizing Multivalued Data from 2D Incompressible Flows Using Concepts from Painting Proc. Visualization '99, pp. 333-340, 1999.
[40] J. Kniss, G. Kindlmann, and C. Hansen, “Interactive Volume Rendering Using Multi-Dimensional Transfer Functions and Direct Manipulation Widgets,” Proc. IEEE Visualization 2001, pp. 255-262, 2001.
[41] A. König, H. Doleisch, and E. Gröller, Multiple Views and Magic Mirrors fMRI Visualization of the Human Brain Technical Report TR-186-2-99-08, Inst. of Computer Graphics and Algorithms, Vienna Univ. of Tech nology, Feb. 1999.
[42] R. Kosara, S. Miksch, and H. Hauser, "Semantic Depth of Field," Proc. IEEE Symp. Information Visualization (InfoVis 2001), IEEE CS Press, Los Alamitos, Calif., 2001, pp. 97-104.
[43] Y. Kurzion and R. Yagel, Interactive Space Deformation with Hardware-Assisted Rendering IEEE Computer Graphics and Applications, vol. 17, no. 5, pp. 66-77, Sept./Oct. 1997.
[44] D.H. Laidlaw, E.T. Ahrens, D. Kremers, M.J. Avalos, C. Readhead, and R.E. Jacobs, Visualizing Diffusion Tensor Images of the Mouse Spinal Cord Proc. Visualization '98, 1998.
[45] E. LaMar, B. Hamann,, and K.I. Joy,"A Magnification Lens for Interactive Volume Visualization," Proc. 9th Pacific Conf. Computer Graphics and Applications (PG '01), IEEE CS Press, 2001, pp. 223-233.
[46] G.T. Herman and H. Levkowitz, “Color Scales for Image Data,” Computer Graphics and Applications, pp. 72-80, 1992.
[47] J. Lubin, A Visual Discrimination Model for Imaging System Design and Evaluation Vision Models for Target Detection and Recognition, E. Peli, ed., pp. 245-283, World Scientific, 1995.
[48] E.B. Lum and K.-L. Ma, Hardware-Accelerated Parallel Non-Photorealistic Volume Rendering Proc. Non-Photorealistic Animation and Rendering, pp. 67-74, 158, 2002.
[49] E.B. Lum, A. Stompel, and K.-L. Ma, Kinetic Visualization: A Technique for Illustrating 3D Shape and Structure Proc. IEEE Visualization 2002, pp. 435-442, 2002.
[50] R.L. Mack and J. Nielsen, Usability Inspection Methods: Executive Summary Readings in Human-Computer Interaction: Toward the Year 2000, second ed., R.M. Baecker et al., eds., pp. 170-181, San Francisco: Morgan Kaufmann, 1995.
[51] J.D. Mackinlay, G.G. Robertson, and S.K. Card, The Perspective Wall: Detail and Context Smoothly Integrated Proc. Conf. Human Factors in Computing Systems, pp. 173-179, 1991.
[52] J. Marks et al., Design Galleries: A General Approach to Setting Parameters for Computer Graphics and Animation Proc. SIGGRAPH, pp. 389-400, 1997.
[53] G.C. Murphy and D. Notkin, “Reengineering with Reflexion Models: A Case Study,” Computer, vol. 30, no. 8, pp. 29–36, Aug. 1997.
[54] L. Nigay and F. Vernier, Design Method of Interaction Techniques for Large Information Spaces Proc. Advanced Visualization Interfaces, pp. 37-46, 1998.
[55] S.N. Pattanaik et al., A Multiscale Model of Adaptation and Spatial Vision for Realistic Image Display Proc. SIGGRAPH, pp. 287-298, 1998.
[56] J.M. Patten and K.-L. Ma, A Graph Based Interface for Representing Volume Visualization Results Proc. Graphics Interface, pp. 117-124, 1998.
[57] F. Pellacini, J.A. Ferwerda, and D.P. Greenberg, Toward a Psychophysically-Based Light Reflection Model for Image Synthesis Proc. SIGGRAPH, pp. 55-64, 2000.
[58] G. Peters, Theories of Three-Dimensional Object Perception: A Survey Recent Research Developments in Pattern Recognition, Transworld Research Network, 2000.
[59] A. Raab and M. Rüger, 3D-Zoom: Interactive Visualisation of Structures and Relations in Complex Graphics 3D Image Analysis and Synthesis, B. Girod, H. Niemann, and H.P. Seidel, eds., pp. 125-132, 1996.
[60] M. Reddy, Perceptually Optimized 3D Graphics IEEE Computer Graphics and Applications, vol. 21, no. 5, pp. 68-75, Sept./Oct. 2001.
[61] K. Rehm et al., A Symbolic Environment for Visualizing Activated Foci in Functional Neuroimaging Datasets Medical Image Analysis, vol. 2, no. 3, pp. 215-226, 1998.
[62] P. Rheingans, Are We There Yet? Exploring with Dynamic Visualization IEEE Computer Graphics and Applications, vol. 22, no. 1, pp. 6-10, Jan./Feb. 2002.
[63] P. Rheingans, Opacity-Modulating Triangular Textures for Irregular Surfaces Proc. IEEE Visualization, pp. 219-225, 1996.
[64] P. Rheingans, Task-Based Color Scale Design Proc. Applied Image and Pattern Recognition, pp. 35-43, 1999.
[65] P. Rheingans and D. Ebert, Volume Illustration: Nonphotorealistic Rendering of Volume Models IEEE Trans. Visualization and Computer Graphics, vol. 7, no. 3, pp. 253-264, July-Sept. 2001.
[66] F. Ritter et al., Virtual 3D Puzzles: A New Method for Exploring Geometric Models in VR IEEE Computer Graphics and Applications, vol. 21, no. 5, pp. 11-13, Sept./Oct. 2001.
[67] M.P. Salisbury et al., Orientable Textures for Image-Based Pen-and-Ink Illustration Proc. SIGGRAPH, pp. 401-406, 1997.
[68] M. Sarkar et al., Stretching the Rubber Sheet: A Metaphor for Viewing Large Layouts on Small Screens Proc. ACM Symp. User Interface Software and Technology, pp. 81-91, 1993.
[69] W. Schroeder, K. Martin, and B. Lorensen, The Visualization Toolkit: An Object-Oriented Approach to 3D Graphics, second ed. Upper Saddle River, N.J.: Prentice Hall, 1998.
[70] C.D. Shaw et al., Interactive Lens Visualization Techniques Proc. IEEE Visualization, pp. 155-160, 1999.
[71] B. Shneiderman, Designing the User Interface, third ed. Reading, Mass.: Addison-Wesley 1997.
[72] R.R. Springmeyer, M.M. Blattner, and N.L. Max, A Characterization of the Scientific Data Analysis Process Proc. IEEE Visualization, pp. 235-242, 1992.
[73] T. Strothotte and S. Schlechtweg, Non-Photorealistic Computer Graphics: Modeling, Rendering, and Animation, pp. 10-11. San Francisco: Morgan Kaufmann, 2002.
[74] M. Tory and T. Möller, A Model-Based Visualization Taxonomy Technical Report CMPT-TR2002-06, Computing Science Dept., Simon Fraser Univ., 2002.
[75] S.M.F. Treavett and M. Chen, “Pen-and-Ink Rendering in Volume Visualisation,” Proc. IEEE Visualization 2000, pp. 203-209, Oct. 2000.
[76] S.M.F. Treavett et al., Volumes of Expression: Artistic Modelling and Rendering of Volume Datasets Proc. Computer Graphics Int'l, 2001.
[77] A. Treisman and S. Gormican, Search, Similarity and Integration of Features between and within Dimensions J. Experimental Psychology: Human Perception and Performance, vol. 17, pp. 652-676, 1991.
[78] J.E. Van der Heyden et al., Visual Presentation of Magnetic Resonance Images Proc. IEEE Visualization, pp. 423-426, 1998.
[79] Y. Waern, On the Dynamics of Mental Models Mental Models and Human-Computer Interaction 1, D. Ackermann and M.J. Tauber, eds., pp. 73-93, New York: Elsevier Science, 1990.
[80] A. Walenstein, Cognitive Support in Software Engineering Tools: A Distributed Cognition Framework doctoral dissertation, Computing Science Dept., Simon Fraser Univ., Burnaby, B.C., Canada, 2002.
[81] C. Ware, Information Visualization: Perception for Design. San Francisco: Morgan Kaufmann (Academic Press), 2000.
[82] D.D. Woods, Visual Momentum: A Concept to Improve the Cognitive Coupling of Person and Computer Int'l J. Man-Machine Studies, vol. 21, pp. 229-244, 1984.

Index Terms:
Human factors, visualization, perception, cognitive support, methodology.
Melanie Tory, Torsten M?ller, "Human Factors in Visualization Research," IEEE Transactions on Visualization and Computer Graphics, vol. 10, no. 1, pp. 72-84, Jan.-Feb. 2004, doi:10.1109/TVCG.2004.1260759
Usage of this product signifies your acceptance of the Terms of Use.