The Community for Technology Leaders
RSS Icon
Issue No.12 - Dec. (2012 vol.18)
pp: 2631-2638
Nicholas Kong , University of California, Berkeley
Maneesh Agrawala , University of California, Berkeley
Reading a visualization can involve a number of tasks such as extracting, comparing or aggregating numerical values. Yet, most of the charts that are published in newspapers, reports, books, and on the Web only support a subset of these tasks. In this paper we introduce graphical overlays—visual elements that are layered onto charts to facilitate a larger set of chart reading tasks. These overlays directly support the lower-level perceptual and cognitive processes that viewers must perform to read a chart. We identify five main types of overlays that support these processes; the overlays can provide (1) reference structures such as gridlines, (2) highlights such as outlines around important marks, (3) redundant encodings such as numerical data labels, (4) summary statistics such as the mean or max and (5) annotations such as descriptive text for context. We then present an automated system that applies user-chosen graphical overlays to existing chart bitmaps. Our approach is based on the insight that generating most of these graphical overlays only requires knowing the properties of the visual marks and axes that encode the data, but does not require access to the underlying data values. Thus, our system analyzes the chart bitmap to extract only the properties necessary to generate the desired overlay. We also discuss techniques for generating interactive overlays that provide additional controls to viewers. We demonstrate several examples of each overlay type for bar, pie and line charts.
Visualization, Encoding, Image color analysis, Data mining, Data visualization, Bars, Market research, graph comprehension, Visualization, overlays, graphical perception
Nicholas Kong, Maneesh Agrawala, "Graphical Overlays: Using Layered Elements to Aid Chart Reading", IEEE Transactions on Visualization & Computer Graphics, vol.18, no. 12, pp. 2631-2638, Dec. 2012, doi:10.1109/TVCG.2012.229
[1] Arizona Software. GraphClick. http://www.arizona-software.chgraphclick. Retrieved Jun11, 2012.
[2] D. Bargeron and T. Moscovich, Reflowing digital ink annotations. In CHI ‘03: Proceedings of the SIGCHI conference on Human factors in computing systems, pages 385-393, 2003.
[3] L. Bartram, B. Cheung, and M. Stone, The effect of colour and trans-parency on the perception of overlaid grids IEEE Transactions on Visualization and Computer Graphics, 17(12):1942-1948, Dec. 2011.
[4] P. Baudisch and R. Rosenholtz, Halo: a technique for visualizing off-screen objects. In CHI ‘03: Proceedings of the SIGCHI conference on Humanfactors in computing systems, pages 481-488, 2003.
[5] J. Bertin, Sémiologie Graphique. Gauthier-Villars, 1967
[6] I. Bormann, DigitizeIt. http:/ Retrieved Jun11, 2012.
[7] British Broadcasting Corporation. EU budget plans for 2011. Retrieved Mar31, 2012.
[8] P. A. Carpenter and P. Shah, A model of the perceptual and conceptual processes in graph comprehension Journal of Experimental Psychology: Applied 4(2):75-100, 1998.
[9] W. S. Cleveland and R. McGill, Graphical perception: Theory, experimentation, and application to the development of graphical methods Journal of the American Statistical Association, 79(387):531-554, 1984.
[10] C. Collins, G. Penn, and S. Carpendale, Bubble sets: Revealing set relations with isocontours over existing visualizations IEEE Transactions on Visualization and Computer Graphics, 15(6):1009-1016, Nov.-Dec. 2009.
[11] J.-D. Fekete, D. Wang, N. Dang, A. Aris, and C. Plaisant, Interactive poster: Overlaying graph links on treemaps IEEE Symposium on Information Visualization, 2003.
[12] GoogleFinance. Retrieved Mar30, 2012.
[13] S. Gustafson, P. Baudisch, C. Gutwin, and P. Irani, Wedge: clutter-free visualization of off-screen locations. In CHI ‘08: Proceedings of the 26th annual SIGCHI conference on Humanfactors in computing systems, pages 787-796, 2008.
[14] J. Heer and M. Bostock, Crowdsourcing graphical perception: Using me-chanical turk to assess visualization design. In CHI’ 10: Proceedings of the 28th international conference on Human factors in computing systems, pages 203-212, 2010.
[15] J. Heer, F. B. Viégas, and M. Wattenberg, Voyagers and voyeurs: supporting asynchronous collaborative information visualization. In CHI ‘07: Proceedings of the SIGCHI conference on Human factors in computing systems, pages 1029-1038, 2007.
[16] W. C. Hill and J. D. Hollan, Deixis and the future of visualization excellence. In Proc. of IEEE Visualization, pages 314-320, 1991.
[17] N. Kong and M. Agrawala, Perceptual interpretation of ink annotations on line charts. In UIST ‘09: Proceedings of the 22nd annual ACM symposium on User interface software and technology, pages 233-236, 2009.
[18] S. M, Kosslyn. Understanding charts and graphs Applied Cognitive Psychology, 3(3): 185-225, 1989.
[19] S. Kriz and M. Hegarty, Top-down and bottom-up influences on learning from animations International Journal of Human-Computer Studies, 65(11):911-930, 2007.
[20] G. L. Lohse, A cognitive model for understanding graphical perception Human-Computer Interaction, 8(4):353-388, 1993.
[21] M. Migurski, T. Carden, and E. Rodenback, Oakland Crimespotting. Retrieved Mar30, 2012.
[22] S. Pinker, A theory of graph comprehension, pages 73-126. Lawrence Erlbaum Associates, 1990.
[23] W. Playfair, Playfair's Commercial and Political Atlas and Statistical Breviary. Cambridge University Press, 2005.
[24] R. M. Ratwani, J. G. Trafton, and D. A. Boehm-Davis, Thinking graph-ically: Connecting vision and cognition during graph comprehension Journal of Experimental Psychology: Applied, 14(1):36-49, 2008.
[25] M. Savva, N. Kong, A. Chhajta, L. Fei-Fei, M. Agrawala, and J. Heer, Revision: automated classification, analysis and redesign of chart images. In UIST ‘11: Proceedings of the 24th annual ACM symposium on User interface software and technology, pages 393-402, 2011.
[26] D. Simkin and R. Hastie, An information-processing analysis of graph perception. Journal of the American Statistical Association, 82(398):454-465, 1987.
[27] M. Steinberger, M. Waldner, M. Streit, A. Lex, and D. Schmalstieg, Context-preserving visual links IEEE Transactions on Visualization and Computer Graphics, 17(12):2249-2258, dec. 2011.
[28] M. Stone and L. Bartram, Alpha, contrast and the perception of visual metadata Color Imaging Conference, 2009.
[29] A. Sun, J. Valentino-DeVries, and Z. Seward, A Week on Foursquare. Retrieved Mar30, 2012.
[30] S. Trickett and J. Trafton, Toward a comprehensive model of graph com-prehension: Making the case for spatial cognition. In Diagrammatic Rep-resentation and Inference, volume 4045 of Lecture Notes in Computer Science, pages 286-300. Springer Berlin, 2006.
[31] E. R. Tufte, The Visual Display of Quantitative Information. Graphics Press, 1983.
[32] E. R, Tufte Envisioning Information. Graphics Press, 1990.
[33] B. Tummers, DataThief III. http:/ Retrieved Mar31, 2012.
[34] UK Department of Energy and Climate Change. National Heat Map. http://ceo.decc. Retrieved Mar30, 2012.
[35] I. Vollick, D. Vogel, M. Agrawala, and A. Hertzmann, Specifying label layout style by example. In UIST'07: Proceedings of the 20th annual ACM symposium on User interface software and technology, pages 221230, 2007.
[36] M. Wertheimer, Laws of organization in perceptual forms A source book of Gestalt psychology, pages 71-88, 1938.
[37] L. Yang, W. Huang, and C. Tan, Semi-automatic ground truth generation for chart image recognition. In H. Bunke and A. Spitz, editors, Document Analysis Systems VII, volume 3872 of Lecture Notes in Computer Science, pages 324-335. 2006.
[38] J. Zacks and B. Tversky, Bars and lines: A study of graphic communication Memmory & Cognition, 27(6):1073-1079, 1999.
18 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool