This Article 
 Bibliographic References 
 Add to: 
To Score or Not to Score? Tripling Insights for Participatory Design
May/June 2009 (vol. 29 no. 3)
pp. 29-38
Michael Smuc, Danube University Krems
Eva Mayr, Danube University Krems
Tim Lammarsch, Danube University Krems
Wolfgang Aigner, Danube University Krems
Silvia Miksch, Danube University Krems
For evaluating visual-analytics tools, many studies confine to scoring user insights into data. For participatory design of those tools, we propose a three-level methodology to make more out of users' insights. The Relational Insight Organizer (RIO) helps to understand how insights emerge and build on one each other.

1. J.J. Thomas and K.A. Cook, Illuminating the Path: The Research and Development Agenda for Visual Analytics, US Nat'l Visualization and Analytics Center, 2005; .
2. C. North, "Toward Measuring Visualization Insight," IEEE Computer Graphics and Applications, vol. 26, no. 3, 2006, pp. 6–9.
3. C. Plaisant, J. Fekete, and G. Grinstein, "Promoting Insight-Based Evaluation of Visualizations: From Contest to Benchmark Repository," IEEE Trans. Visualization and Computer Graphics, vol. 14, no. 1, 2008, pp. 120–134.
4. P.B. Saraiya, C. North, and K. Duca, "An Insight-Based Methodology for Evaluating Bioinformatics Visualizations," IEEE Trans. Visualization and Computer Graphics, vol. 11, no. 4, 2005, pp. 443–456.
5. G.W. Hartmann, "The Concept and Criteria of Insight," Psychological Rev., vol. 38, 1931, pp. 242–252.
6. G. Jones, "Testing Two Cognitive Theories of Insight," J. Experimental Psychology: Learning, Memory, and Cognition, vol. 29, 2003, pp. 1017–1027.
7. M. Smuc et. al., "Visualizations at First Sight: Do Insights Require Training?" Learners, Technology, and the Brain, LNCS 5298, Springer, 2008, pp. 261–280.
8. D. Suthers et al., "An Abstract Transcript Notation for Analyzing Interactional Construction of Meaning in Online Learning," Proc. 40th Ann. Hawaii Int'l Conf. System Sciences (HICSS 07), IEEE CS Press, 2007, p. 4c.

Index Terms:
insight, usability engineering, formative evaluation, participatory design
Michael Smuc, Eva Mayr, Tim Lammarsch, Wolfgang Aigner, Silvia Miksch, Johannes Gärtner, "To Score or Not to Score? Tripling Insights for Participatory Design," IEEE Computer Graphics and Applications, vol. 29, no. 3, pp. 29-38, May-June 2009, doi:10.1109/MCG.2009.53
Usage of this product signifies your acceptance of the Terms of Use.