Issue No. 03 - May/June (2006 vol. 26)
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/MCG.2006.70
Chris North , Virginia Polytechnic Institute and State University
The purpose of visualization is insight. The purpose of visualization evaluation is to determine whether visualizations are achieving their purpose. If these statements are true, then evaluating visualizations should seek to determine how well visualizations generate insight. But what, exactly, is insight? How can it be measured and evaluated? Do current approaches for evaluating visualizations provide measures of insight? This viewpoint identifies critical characteristics of insight, argues the fundamental reasons why traditional controlled experiments with benchmark tasks on visualizations do not effectively measure insight, and offers a new approach to controlled experiments that can better capture the notion of insight. The ultimate goal is a much richer view of how visualizations can achieve their purpose.
visualization evaluation, controlled experiments, benchmark tasks, insight
C. North, "Toward Measuring Visualization Insight," in IEEE Computer Graphics and Applications, vol. 26, no. , pp. 6-9, 2006.