This Article 
 Bibliographic References 
 Add to: 
Visual and Textual Consistency Checking Tools for Graphical User Interfaces
November 1997 (vol. 23 no. 11)
pp. 722-735

Abstract—Designing user interfaces with consistent visual and textual properties is difficult. To demonstrate the harmful effects of inconsistency, we conducted an experiment with 60 subjects. Inconsistent interface terminology slowed user performance by 10 to 25 percent. Unfortunately, contemporary software tools provide only modest support for consistency control. Therefore, we developed SHERLOCK, a family of consistency analysis tools, evaluates visual and textual properties of user interfaces. It provides graphical analysis tools such as a dialog box summary table that presents a compact overview of visual properties of all dialog boxes. SHERLOCK provides terminology analysis tools including an Interface Concordance, an Interface Spellchecker, and Terminology Baskets to check for inconsistent use of familiar groups of terms. Button analysis tools include a Button Concordance and a Button Layout Table to detect variant capitalization, distinct typefaces, distinct colors, variant button sizes, and inconsistent button placements. This paper describes the design, software architecture, and the use of SHERLOCK. We tested SHERLOCK with four commercial prototypes. The outputs, analysis, and feedback from designers of the applications are presented.

[1] Apple Computer, Macintosh Human Interface Guidelines.Reading, Mass.: Addison-Wesley, 1992.
[2] S. Bajwa, "Effects of Inconsistencies on Users Performance and Subjective Satisfaction," unpublished report, Dept. of Computer Science, Univ. of Maryland, 1995.
[3] P. Barnard, J. Hammond, J. Morton, J. Long, and I. Clark, "Consistency and Compatibility in Human-Computer Dialogue," Int'l J. Man-Machine Studies, vol. 15, pp. 87-134, 1981.
[4] F. Bodart, A.-M. Hennebert, J.-M. Leheureux, and J. Vanderdonckt, "Towards a Dynamic Strategy for Computer-Aided Visual Placement," T. Catarci, M. Costabile, S. Levialdi, and G. Santucci, eds., Proc. Advanced Visual Interfaces Conf., pp. 78-87,New York: ACM Press, 1994.
[5] R. Chimera and B. Shneiderman, "User Interface Consistency: An Evaluation of Original and Revised Interfaces for a Videodisk Library," B. Shneiderman, ed., Sparks of Innovation in Human-Computer Interaction, pp. 259-273,Norwood, N.J.: Ablex Publishers, 1993.
[6] J.P. Chin, V.A. Diehl, and K.L. Norman, "Development of an Instrument Measuring User Satisfaction of the Human-Computer Interface," Proc. CHI '88: Human Factors in Computing Systems, ACM, New York, 1988, pp. 213-218.
[7] R. Coll and A. Wingertsman, "The Effect of Screen Complexity on User Preference and Performance," Int'l J. Human-Computer Interaction, vol. 2, no. 3, pp. 255-265, 1990.
[8] T. Comber and J. Maltby, "Investigating Layout Complexity," J. Vanderdonckt, ed., Computer-Aided Design of User Interfaces, Press Universitaires de Namur, Namur, Belgium, pp. 209-227, 1996.
[9] N. Frederiksen, J. Grudin, and B. Laursen, "Inseparability of Design and Use: An Experimental Study of Design Consistency: Proc. Computers in Context'95, Aarhus, Aarhus Univ., pp. 83-89, 1995.
[10] J. Grudin, "The Case against User Interface Consistency," Comm. ACM, vol. 32, no. 10, pp. 1,164-1,173,New York: ACM Press, 1989.
[11] J. Grudin and D. Norman, "Language Evolution and Human-Computer Interaction," Proc. 13th Ann. Conf. Cognitive Science Soc.,Hillsdale, N.J., pp. 611-616, 1991.
[12] M.D. Harrison and H.W. Thimbleby, "Formalizing Guidelines for the Design of Interactive Systems," Proc. BCS HCI Specialist Group Conf. HCI85, pp. 161-171, 1985.
[13] R. Jeffries, J.R. Miller, C. Wharton, and K.M. Uyeda, "User Interface Evaluation in the Real World: A Comparison of Four Techniques," Proc. Conf. Human Factors in Computing Systems, CHI'91, pp. 119-124, ACM Press, 1991.
[14] C.-M. Karat, "Cost-Justifying Human Factors Support in Development Projects," Human Factors Soc. Bull., vol. 35, no. 8, 1992.
[15] W. Kellogg, "Conceptual Consistency in the User Interface: Effects on User Performance," Proc. Interact '87 Conf. Human-Computer Interaction,Stuttgart, Germany, 1987.
[16] P. Lynch, "Visual Design for the User Interface, Part 1 Design Fundamentals," J. Biocommunications, vol. 21, no. 1, pp. 22-30, 1994.
[17] F. MacIntyre, K.W. Estep, and J.M. Sieburth, "Cost of User-Friendly Programming," J. Fourth Application and Research, vol. 6, no. 2, pp. 103-115, 1990.
[18] R. Mahajan and B. Shneiderman, "A Family of User Interface Consistency Checking Tools: Design Analysis of SHERLOCK, Proc. NASA 20th Ann. Software Eng. Workshop, pp. 169-188, 1995.
[19] Microsoft, Inc., The Windows Interface: An Application Design Guide.Redmond, Wash.: Microsoft Press, 1992.
[20] K. Mullet, "Organizing Information Spatially," Interactions, pp. 15-20, July 1995.
[21] H. Nielsen, "Coordinating User Interfaces for Consistency Checking," J. Nielsen, ed., London: Academic Press, 1989.
[22] P. Polson, E. Muncher, and G. Engelbeck, "A test of a common elements theory of transfer, Proc. CHI '86, pp. 78-83,New York: ACM, 1986.
[23] P. Reisner, "What is Consistency?" Proc. IFIP Third Int'l Conf. Human-Computer Interaction, Interact '90, pp. 175-181, Elsevier Science, B.V., North-Holland, 1990.
[24] D. Rosenberg, "Cost Benefit Analysis for Corporate User Interface Standards: What Price to Pay for Consistent Look and Feel?" Coordinating User Interfaces for Consistency Checking, J. Nielsen, ed., pp. 21-34,London: Academic Press, 1989.
[25] A. Sears, "Layout Appropriateness: A Metric for Evaluating User Interface Widget Layout," IEEE Trans. Software Eng., vol. 17, no. 7, pp. 707-719, July 1993.
[26] A. Sears, "AIDE: A Step Toward Metric-Based Interface Development Tools," Proc. 8th ACM Symp. User Interface Software and Technology, ACM Press, New York, 1995, pp. 101-110.
[27] B. Shneiderman, Designing the User Interface, 2nd edition, Addison-Wesley, Reading, Mass., 1992.
[28] B. Shneiderman, R. Chimera, N. Jog, R. Stimart, and D. White, "Evaluating Spatial and Textual Style of Displays," L.W. MacDonald and A.C. Lowe, eds., Display Systems: Design and Applications.Chichester, U.K.: John Wiley&Sons, pp. 83-96, 1997.
[29] D.C. Smith, C. Irby, R. Kimball, B. Verplank, E. Harslem, "Designing the Star User Interface," Byte 7, no. 4, pp. 242-282, 1982.
[30] D. Streveler and A. Wasserman, "Quantitative Measures of the Spatial Properties of Screen Designs," Proc. INTERACT '87,Amsterdam: Elsevier Science, pp. 125-133, 1987.
[31] T.S. Tullis, "The Formatting of Alphanumeric Displays: A Review and Analysis," Human Factors, vol. 25, pp. 657-682, 1983.
[32] T.S. Tullis, "A System for Evaluating Screen Formats: Research and Application," Hartson, H. Rex and Hix, Hartson, ed., Advances in Human-Computer Interaction: vol. 2. Norwood N.J.: Ablex Publishing Corp., pp. 214-286, 1988.
[33] T.S. Tullis, "Screen Design," M. Helander, T. Landauer, and P. Prabhu, eds., Handbook of Human-Computer Interaction: Second Edition.Amsterdam, The Netherlands: Elsevier Science, pp. 503-531, 1997.
[34] J. Vanderdonckt and X. Gillo, "Visual Techniques for Traditional and Multimedia Layouts," T. Catarci, M. Costabile, S. Levialdi, and G. Santucci, eds., Proc. Advanced Visual Interfaces Conf. '94,New York: ACM Press, pp. 95-104, 1994.
[35] C. Wiecha, W. Bennett, S. Boies, and J. Gould, "Generating Highly Interactive User Interface," Proc. CHI '89, pp. 277-282,New York: ACM, 1989.
[36] R. Wolf, "Consistency as Process," Coordinating User Interfaces for Consistency Checking, J. Nielsen, ed., pp. 89-92,London: Academic Press, 1989.

Index Terms:
Graphical User Interfaces, evaluation tools, consistency, textual and visual style, assessment tools, metrics.
Rohit Mahajan, Ben Shneiderman, "Visual and Textual Consistency Checking Tools for Graphical User Interfaces," IEEE Transactions on Software Engineering, vol. 23, no. 11, pp. 722-735, Nov. 1997, doi:10.1109/32.637386
Usage of this product signifies your acceptance of the Terms of Use.