The Community for Technology Leaders
RSS Icon
Issue No.06 - Nov.-Dec. (2013 vol.28)
pp: 66-72
Randolph G. Bias , University of Texas at Austin
Robert Hoffman , Florida Institute for Human and Machine Cognition
If usability is to be a valuable, empirical methodology ... then where's the science in usability analysis?
Usability, Psychology, Performance analysis, Time measurement,intelligent systems, usability analysis, user-centered design, UCD
Randolph G. Bias, Robert Hoffman, "Where's the Rigor in the Field of Usability Analysis?", IEEE Intelligent Systems, vol.28, no. 6, pp. 66-72, Nov.-Dec. 2013, doi:10.1109/MIS.2013.150
1. J. Spool,“Magic and Mental Models: Using Illusion to Simplify Designs,” presentation, SXSW Interactive Conf., 2008.
2. J. Nielsen,“Usability for the Masses,” J. Usability Studies, vol. 1, no. 1, 2005, pp. 2-3.
3. J.M. Bradshaw et al., “The Seven Deadly Myths of ‘Autonomous Systems’,” IEEE Intelligent Systems, vol. 28, no. 3, 2013, pp. 54-61.
4. K. Neville et al., “The Procurement Woes Revisited,” IEEE Intelligent Systems, vol. 23, no. 1, 2008, pp. 72-75.
5. ISO 9241-11, Ergonomic Requirements for Office Work with Visual Display Terminals (VDTs)—Part 11: Guidance on Usability, 1998.
6. R.R. Hoffman,M. Marx,, and P.A. Hancock,“Metrics, Metrics, Metrics: Negative Hedonicity,” IEEE Intelligent Systems, Mar.-Apr. 2008, pp. 69-73.
7. R.G. Bias, and S.C. Huang,“Remote, Remote, Remote, Remote Usability Testing,” Proc. Society for Technical Comm. Summit, 2010.
8. D. Liu et al., “Crowdsourcing for Usability Testing,” Ann. Meeting of the Am. Soc. Information Science and Technology, 2012, Baltimore, October.
9. J. Nielsen,Why You Only Need to Test with 5 Users, Nielsen Norman Group, 2000;
10. R.G. Bias et al., “Clothing the Naked Emperor: The Unfulfilled Promise of the Science of Usability,” interactions, vol. xx.6, Nov./Dec. 2013, p. 72.
11. R. Molich,CUE—Comparative Usability Evaluation, user study; www.dialogdesign.dkCUE.html.
12. R. Jeffries et al., User Interface Evaluation in the Real World: A Comparison of Four Techniques, Proc. Conf. Human Factors in Computing Systems, 1991, pp. 119-124.
13. W.D. Gray and M.C. Salzman,“Damaged Merchandise? A Review of Experiments That Compare Usability Evaluation Methods,” Human- Computer Interaction, vol. 13, no. 3, 1998, pp. 203-261.
14. K. Hornbaek,“Current Practice in Measuring Usability: Challenges to Usability Studies and Research,” Int’l J. Human-Computer Studies, vol. 64, no. 2, 2006, pp. 79-102.
15. R.R. Hoffman and L.G. Militello,Perspectives on Cognitive Task Analysis: Historical Origins and Modern Communities of Practice, CRC Press/Taylor and Francis, 2008.
16. H. Beyer and K. Holtzblatt,Contextual Design: Defining Customer-Centered Systems, Morgan Kaufmann, 2007.
17. J.L. Fath and R.G. Bias,“Taking the ‘Task’ out of Task Analysis,” Proc. 36th Ann. Meeting of the Human Factors Society, 1992, pp. 379-383.
18. J. Rubin and D. Chisnell,Handbook of Usability Testing: How to Plan, Design, and Conduct Effective Tests, John Wiley, 2008.
19. J. Nielsen,“How to Conduct a Heuristic Evaluation,” 1995; .
20. B. Crandall,G. Klein,, and R.R. Hoffman,Working Minds: A Practitioner's Guide to Cognitive Task Analysis, MIT Press, 2006.
21. M.R. Endsley,“Measurement of Situation Awareness in Dynamic Systems,” Human Factors, vol. 37, 1995, pp. 65-84.
22. R.R. Hoffman et al., Accelerated Expertise: Training for High Proficiency in a Complex World. Boca Raton, FL: Taylor and Francis/CRC Press, 2014.
23. R.R. Hoffman et al., “Measurement for Evaluating the Learnability and Resilience of Methods of Cognitive Work,” Theoretical Issues in Ergonomic Science, vol. 11, no. 6, 2010, pp. 561-575.
24. K.M. Dresel,“Testing Usability Goals with Small Samples: A Binomial Analysis Methodology,” Proc. Human Factors and Ergonomics Soc. 57th Ann. Meeting, 2013, pp. 1303-1307.
25. C.J. Chao and G. Salvendy,“Percentage of Procedural Knowledge Acquired as a Function of the Number of Experts from Whom Knowledge Is Acquired for Diagnosis, Debugging, and Interpretation Tasks,” Int’l J. Human-Computer Interaction, vol. 6, 1994, pp. 221-233.
26. R.A. Virzi,“Refining the Test Phase of Usability Evaluation: How Many Subjects Is Enough?” Human Factors, vol. 34, no. 4, 1992, 457-471.
27. J. Sauro and J.R. Lewis,Quantifying the User Experience: Practical Statistics for User Research, Morgan Kaufmann, 2012.
28. R.R. Hoffman and M.J. McCloskey,“Envisioning Desirements,” IEEE Intelligent Systems, vol. 28, no. 4, 2013, pp. 82-89.
29. D.A. Norman,The Design of Everyday Things, Basic Books, 1998.
70 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool