The Community for Technology Leaders
RSS Icon
Issue No.11 - Nov. (2013 vol.39)
pp: 1494-1520
Norhayati Mohd Ali , Universiti Putra Malaysia, Selangor
John Hosking , Australian National University, Canberra
John Grundy , Swinburne University, Melbourne
Critics have emerged in recent times as a specific tool feature to support users in computer-mediated tasks. These computer-supported critics provide proactive guidelines or suggestions for improvement to designs, code, and other digital artifacts. The concept of a critic has been adopted in various domains, including medical, programming, software engineering, design sketching, and others. Critics have been shown to be an effective mechanism for providing feedback to users. We propose a new critic taxonomy based on extensive review of the critic literature. The groups and elements of our critic taxonomy are presented and explained collectively with examples, including the mapping of 13 existing critic tools, predominantly for software engineering and programming education tasks to the taxonomy. We believe this critic taxonomy will assist others in identifying, categorizing, developing, and deploying computer-supported critics in a range of domains.
Taxonomy, Software, Recommender systems, Programming, Software engineering, Unified modeling language, Java,survey, Design critics, critiquing systems, critic taxonomy, software tool support
Norhayati Mohd Ali, John Hosking, John Grundy, "A Taxonomy and Mapping of Computer-Based Critiquing Tools", IEEE Transactions on Software Engineering, vol.39, no. 11, pp. 1494-1520, Nov. 2013, doi:10.1109/TSE.2013.32
[1] "ArchStudio," /, 2013.
[2] "ArgoUML" http:/, 2013.
[3] "MetaCase" http:/, 2013.
[4] "Rational Rose Enterprise" us/enenterprise/, 2013.
[5] "RSSE" tools, 2013.
[6] N.M. Ali, J. Hosking, and J. Grundy, "A Taxonomy of Computer-Supported Critics," Proc. Int'l Symp. Information Technology, pp. 1152-1157, June 2010.
[7] N.M. Ali et al., "End-User Oriented Critic Specification for Domain-Specific Visual Language Tools," Proc. IEEE/ACM Int'l Conf. Automated Software Eng., pp. 297-300, 2010.
[8] N.M. Ali et al., "Template-Based Critic Authoring for Domain-Specific Visual Language Tools," Proc. IEEE Symp. Visual Languages and Human-Centric Computing, pp. 111-118, Sept. 2009.
[9] F. Bergenti and A. Poggi, "Improving UML Designs Using Automatic Design Pattern Detection," Proc. Int'l Conf. Software Eng. and Knowledge Eng., pp. 336-343, 2000.
[10] J. Bezivin and F. Jouault, "Using ATL for Checking Models," Electronic Notes in Theoretical Computer Science, vol. 152, pp. 69-81. 2006.
[11] A.F. Blackwell and T.R.G. Green, "Investment of Attention as an Analytic Approach to Cognitive Dimensions," Proc. Collected Papers of the 11th Ann. Workshop the Psychology of Programming Interest Group, pp. 24-35, 1999.
[12] G.A. Bolcer, "User Interface Design Assistance for Large-Scale Software Development," Automated Software Eng., vol. 2, no. 3, pp. 203-217, 1995.
[13] B. Bosansky and L. Lhotska, "Agent-Based Process-Critiquing Decision Support System," Proc. Second Int'l Symp. Applied Sciences in Biomedical and Comm. Technologies, pp. 1-6, 2009.
[14] R. Burke, "Hybrid Recommender Systems: Survey and Experiments," User Modelling and User-Adapted Interaction, vol. 12, no. 4, pp. 331-370, Nov. 2002.
[15] L. Chen and P. Pu, "Interaction Design Guidelines on Critiquing-Based Recommender Systems," User Modellling and User-Adapted Interaction, vol. 19, no. 3, pp. 167-206, 2009.
[16] L. Chen and P. Pu, "Critiquing-Based Recommenders: Survey and Emerging Trends," User Modelling and User-Adapted Interaction. vol. 22, nos. 1/2, pp. 125-150, 2012.
[17] C.I. Chesnevar, A.G. Maguitman, and G.R. Simari, "Argument-Based Critics and Recommenders: A Qualitative Perspective on User Support Systems," Data and Knowledge Eng., vol. 59, no. 2, pp. 293-319, Nov. 2006.
[18] W.K. Cheung, private communication, 2012.
[19] W. Coelho and G. Murphy, "ClassCompass: A Software Design Mentoring System," ACM J. Educational Resource in Computing, vol. 7, no. 1, pp. 1-18, 2007.
[20] S. Cook et al., "Defining the Context of OCL Expressions," Proc. Second Int'l Conf. Unified Modeling Language: Beyond the Standard, pp. 372-383, 1999.
[21] E.M. Dashofy, A.V.D. Hoek, and R.N.A Taylor, "Comprehensive Approach for the Development of Modular Software Architecture Description Languages," ACM Trans. Software Eng. and Methodology, vol. 14, no. 2, pp. 199-245, 2005.
[22] C.R.B. de Souza et al., "A Group Critic System for Object-Oriented Analysis and Design," Proc. 15th IEEE Int'l Conf. Automated Software Eng., pp. 313-316, 2000.
[23] C.R.B. de Souza et al., "Using Critiquing Systems for Inconsistency Detection in Software Engineering Models," Proc. Int'l Conf. Software Eng. and Knowledge Eng., pp. 196-203, 2003.
[24] G. Fischer, "A Critic for LISP," Proc. 10th Int'l Joint Conf. Artificial Intelligence, pp. 177-184, 1987.
[25] G. Fischer, "Human-Computer Interaction Software: Lessons Learned, Challenges Ahead," IEEE Software, vol. 6, no. 1, pp. 44-52, Jan. 1989.
[26] G. Fischer and A. Girgensohn, "End-User Modifiability in Design Environments," Proc. SIGCHI Conf. Human Factors in Computing Systems: Empowering People, pp. 183-192, 1990.
[27] G. Fischer, A.C. Lemke, and T. Mastaglio, "Critics: An Emerging Approach to Knowledge-Based Human Computer Interaction," Int'l J. Man-Machine Studies, vol. 35, pp. 695-721, 1991.
[28] G. Fischer et al., "The Role of Critiquing in Cooperative Problem Solving," ACM Trans. Information Systems, vol. 9, no. 3, pp. 123-151, 1991.
[29] G. Fischer and T. Mastaglio, "A Conceptual Framework for Knowledge-Based Critic Systems," Decision Support Systems, vol. 7, pp. 355-378, 1990.
[30] G. Fischer, "Context-Aware Systems—The 'Right' Information, at the 'Right' Time, in the 'Right' Place, in the 'Right' Way, to the 'Right' Person," Proc. Int'l Working Conf. Advanced Visual Interfaces, May 2012.
[31] G. Florijn, RevJava-Design Critiques and Architectural Conformance Checking for Java Software: Software Eng. Research Centre, javawhitepaper_ revjava.pdf. 2002.
[32] M.C. Fu, C.C. Hayes, and E.W. East, "SEDAR: Expert Critiquing Systems for Flat and Low-Slope Roof Design and Review," J. Computing in Civil Eng., vol. 11, no. 1, pp. 60-68, 1997.
[33] A.S. Gertner and B.L. Webber, "TraumaTIQ: Online Decision Support for Trauma Management," IEEE Intelligent Systems and Their Applications, vol. 13, no. 1, pp. 32-39, Jan./Feb. 1998.
[34] T.R.G. Green and A.F. Blackwell, "Cognitive Dimensions of Information Artefacts: A Tutorial,"∼afb21/CognitiveDimensions CDtutorial.pdf, 1998.
[35] J. Grundy et al., "Marama: An Eclipse MetaToolset for Generating Multi-View Environments," Proc. Int'l Conf. Software Eng., pp. 819-822, 2008.
[36] H. Irandoust, "Critiquing Systems for Decision Support," Technical Report no. DRDC Valcartier TR 2003-321, Defence Research and Development Canada, 2006.
[37] S. Kelly, K. Lyytinen, and M. Rossi, "MetaEdit+: A Fully Configurable Multi-User and Multi-Tool CASE and CAME Environment," Proc. Eighth Int'l Conf. Advances in Information System Eng., pp. 1-21, 1996.
[38] A. Kleppe and J. Warmer, "The Semantics of the OCL Action Clause. Object Modelling with the OCL," Object Modeling with the OCL, The Rationale behind the Object Constraint Language, pp. 213-227, Springer-Verlag, 2002.
[39] E. Knauss, D. Luebke, and S. Meyer, "Feedback-Driven Requirements Engineering: The Heuristic Requirements Assistant," Proc. 31st IEEE Int'l Conf. Software Eng., pp. 587-590, 2009.
[40] E. Knauss, private communication, 2010.
[41] C. Lee et al., "Web-Based Essay Critiquing System and EFL Students' Writing: A Quantitative and Qualitative Investigation," Computer Assisted Language Learning, vol. 22, no. 1, pp. 57-72, 2009.
[42] A.C. Lemke and G. Fischer, "A Cooperative Problem Solving System for User Interface Design," Proc. Eighth Nat'l Conf. Artificial Intelligence, pp. 479-484, 1990.
[43] K. McCarthy et al., "Experiments in Dynamic Critiquing," Proc. Int'l Conf. Intelligent User Interfaces, pp. 175-182, 2005.
[44] K. McCarthy et al., "Group Recommender Systems: A Critiquing Based Approach," Proc. Int'l Conf. Intelligent User Interfaces, pp. 267-269, 2006.
[45] P. Miller, Expert Critiquing Systems: Practice-Based Medical Consultation by Computer. Springer-Verlag, 1986.
[46] K. Nakakoji, "Case-Deliverer: Retrieving Cases Relevant to the Task at Hand," Proc. Selected Papers from the First European Workshop Topics in Case-Based Reasoning, pp. 446-457, 1993.
[47] K. Nakakoji, B.N. Reeves, A. Aoki, H. Suzuki, and K. Mizushima, "eMMaC: Knowledge-Based Colour Critiquing Support for Novice Multimedia Authors," Proc. Third ACM Int'l Conf. Multimedia, p. 467, 1995.
[48] Y. Oh, E.Y.-L. Do, and M.D. Gross, "Intelligent Critiquing of Design Sketches," Making Pen-Based Interaction Intelligent and Natural, R. Davis, J. Landay, T. Stahovich, R. Miller, and E. Saund, eds., AAAI Press, 2004.
[49] Y. Oh, M.D. Gross, and E.Y.-L. Do, "Computer-Aided Critiquing System," Proc. Computer Aided Architectural Design and Research in Asia, pp. 161-167, 2008.
[50] Y. Oh et al., "Constraint-Based Design Critic for Flat-Pack Furniture Design," Proc. 17th Int'l Conf. Computers in Education, pp. 19-26, 2009.
[51] Y. Pisan et al., "Submit! A Web-Based System for Automatic Program Critiquing," Proc. Fifth Australasian Computing Education Conf., pp. 59-68, 2003.
[52] Y. Pisan, private communication, 2012.
[53] L. Qiu and C.K. Riesbeck, "An Incremental Model for Developing Educational Critiquing Systems: Experiences with the Java Critiquer," J. Interactive Learning Research, vol. 19, no. 1, pp. 119-145, 2008.
[54] L. Qiu and C.K. Riesbeck, "Facilitating Critiquing in Education: the Design and Implementation of the Java Critiquer," Proc. Int'l Conf. Computers in Education 2003.
[55] J. Reilly et al., "Incremental Critiquing," Knowledge-Based Systems, vol. 18, pp. 146-151, 2005.
[56] C.K. Riesbeck and W. Dobson, "Authorable Critiquing for Intelligent Educational Systems," Proc. Third Int'l Conf. Intelligent User Interfaces, pp. 145-152, 1998.
[57] J.E. Robbins, "Design Critiquing Systems," technical report, Dept. of Information and Computer Science, Univ. of California, 1998.
[58] J.E. Robbins and D.F. Redmiles, "Software Architecture Critics in the Argo Design Environment," Knowledge-Based Systems, vol. 11, no. 1, pp. 47-60, 1998.
[59] J.E. Robbins and D.F. Redmiles, "Cognitive Support, UML Adherence, and XMI Interchange in ArgoUML," J. Information and Software Technology, vol. 42, no. 2, pp. 79-89, 2000.
[60] B.G. Silverman, "Expert Critics: Operationalizing the Judgement/Decision Making Literature as a Theory of "Bugs" and Repair Strategies," Knowledge Acquisition, vol. 3, no. 2, pp. 175-214, 1991.
[61] B.G. Silverman, "Survey of Expert Critiquing Systems: Practical and Theoretical Frontiers," Comm. ACM, vol. 35, no. 4, pp. 106-127, 1992.
[62] B.G. Silverman and T.M. Mehzer, "Expert Critics in Engineering Design: Lessons Learned and Research Needs," AI Magazine, vol. 13, pp. 45-62, 1992.
[63] T. Sumner, N. Bonnardel, and B.H. Kallak, "The Cognitive Ergonomics of Knowledge-Based Design Support Systems," Proc. SIGCHI Conf. Human factors in Computing Systems, pp. 83-90, 1997.
[64] M. Stolze, "Visual Critiquing in Domain Oriented Design Environments: Showing the Right Thing at the Right Place," Proc. Third Int'l Conf. Artificial Intelligence and Design, pp. 1-16, 1994.
[65] H. Tianfield and R. Wang, "Critic System—Towards Human-Computer Collaborative Problem Solving," Artificial Intelligence Rev., vol. 22, pp. 271-295, 2004.
[66] W.M.K. Trochim, "Outcome Pattern Matching and Program Theory," J. Evaluation and Program Planning, vol. 12, no. 4, pp. 355-366, 1989.
[67] E. Tyugu, Algorithms and Architectures of Artificial Intelligence. IOS Press. 2007.
[68] N. Zhu et al., "Pounamu: A MetaTool for Exploratory Domain-Specific Visual Language Tool Development," J. Systems and Software, vol. 80, no. 8, pp. 1390-1407, 2007.
50 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool