The Community for Technology Leaders
RSS Icon
Issue No.01 - January/February (2010 vol.36)
pp: 96-118
Filippo Ricca , University of Genova, Italy
Massimiliano Di Penta , University of Sannio, Benevento
Marco Torchiano , Politecnico di Torino, Torino
Paolo Tonella , Fondazione Bruno Kessler, Trento
Mariano Ceccato , Fondazione Bruno Kessler, Trento
In recent years, several design notations have been proposed to model domain-specific applications or reference architectures. In particular, Conallen has proposed the UML Web Application Extension (WAE): a UML extension to model Web applications. The aim of our empirical investigation is to test whether the usage of the Conallen notation supports comprehension and maintenance activities with significant benefits, and whether such benefits depend on developers ability and experience. This paper reports and discusses the results of a series of four experiments performed in different locations and with subjects possessing different experience—namely, undergraduate students, graduate students, and research associates—and different ability levels. The experiments aim at comparing performances of subjects in comprehension tasks where they have the source code complemented either by standard UML diagrams or by diagrams stereotyped using the Conallen notation. Results indicate that, although, in general, it is not possible to observe any significant benefit associated with the usage of stereotyped diagrams, the availability of stereotypes reduces the gap between subjects with low skill or experience and highly skilled or experienced subjects. Results suggest that organizations employing developers with low experience can achieve a significant performance improvement by adopting stereotyped UML diagrams for Web applications.
Documentation, maintenance, and enhancement, software engineering, software/software engineering.
Filippo Ricca, Massimiliano Di Penta, Marco Torchiano, Paolo Tonella, Mariano Ceccato, "How Developers' Experience and Ability Influence Web Application Comprehension Tasks Supported by UML Stereotypes: A Series of Four Experiments", IEEE Transactions on Software Engineering, vol.36, no. 1, pp. 96-118, January/February 2010, doi:10.1109/TSE.2009.69
[1] J. Rumbaugh, I. Jacobson, and G. Booch, Unified Modeling Language Reference Manual. Addison-Wesley, 2004.
[2] J. Conallen, Building Web Applications with UML, second ed. Addison-Wesley Publishing Company, 2002.
[3] M. Staron, L. Kuzniarz, and C. Wohlin, "Empirical Assessment of Using Stereotypes to Improve Comprehension of UML Models: A Set of Experiments," J. Systems and Software, vol. 79, no. 5, pp. 727-742, 2006.
[4] L. Kuzniarz, M. Staron, and C. Wohlin, "An Empirical Study on Using Stereotypes to Improve Understanding of UML Models," Proc. Int'l Workshop Program Comprehension, pp. 14-23, 2004.
[5] J. Conallen, "Modeling Web Application Architectures with UML," Comm. ACM, vol. 42, no. 10, pp. 63-70, 1999.
[6] S. Ceri, P. Fraternali, A. Bongio, M. Brambilla, S. Comai, and M. Matera, Designing Data Intensive Web Applications. Morgan Kaufmann, 2002.
[7] O.M.F. De Troyer and C.J. Leune, "WSDM: A User Centered Design Method for Web Sites," Proc. Seventh Int'l Conf. World Wide Web, pp. 85-94, 1998.
[8] R. Hennicker and N. Koch, "A UML-Based Methodology for Hypermedia Design," Proc. UML 2000—The Unified Modeling Language: Advancing the Standard, Third Int'l Conf., pp. 410-424, 2000.
[9] C. Wohlin, P. Runeson, M. Höst, M. Ohlsson, B. Regnell, and A. Wesslén, Experimentation in Software Engineering—An Introduction. Kluwer Academic Publishers, 2000.
[10] N. Juristo and A. Moreno, Basics of Software Engineering Experimentation. Kluwer Academic Publishers, 2001.
[11] D. Brugali and M. Torchiano, Software Development: Case Studies in Java. Addison Wesley, 2005.
[12] F. Ricca, M. Di Penta, M. Torchiano, P. Tonella, and M. Ceccato, "How Developers' Experience and Ability Influence Web Application Comprehension Tasks Supported by UML Stereotypes: A Series of Four Experiments," technical report, Univ. of Sannio, pdf , 2009.
[13] L.C. Briand, Y. Labiche, M. Di Penta, and H.D. Yan-Bondoc, "An Experimental Investigation of Formality in UML-Based Development," IEEE Trans. Software Eng., vol. 31, no. 10, pp. 833-849, Oct. 2005.
[14] L. Kuzniarz, M. Staron, and C. Wohlin, "An Empirical Study on Using Stereotypes to Improve Understanding of UML Models," Proc. Int'l Workshop Program Comprehension, pp. 14-23, 2004.
[15] W.B. Frakes and R. Baeza-Yates, Information Retrieval: Data Structures and Algorithms. Prentice-Hall, 1992.
[16] A.N. Oppenheim, Questionnaire Design, Interviewing and Attitude Measurement. Pinter, 1992.
[17] E. Arisholm, L.C. Briand, S.E. Hove, and Y. Labiche, "The Impact of UML Documentation on Software Maintenance: An Experimental Evaluation," IEEE Trans. Software Eng., vol. 32, no. 6, pp. 365-381, June 2006.
[18] A. Agresti, An Introduction to Categorical Data Analysis. John Wiley & Sons, 2007.
[19] D. Sheskin, Handbook of Parametric and Nonparametric Statistical Procedures, fourth ed. Chapman & Hall, 2007.
[20] F. Ricca, M. Di Penta, M. Torchiano, P. Tonella, and M. Ceccato, "The Role of Experience and Ability in Comprehension Tasks Supported by UML Stereotypes," Proc. Int'l Conf. Software Eng., pp. 375-384, 2007.
[21] L. Bratthall and C. Wohlin, "Is It Possible to Decorate Graphical Software Design and Architecture Models with Qualitative Information?—An Experiment," IEEE Trans. Software Eng., vol. 28, no. 12, pp. 1181-1193, Jan. 2002.
[22] S.M.D. Hendrix, J.H. Cross,, and S. Maghsoodloo, "The Effectiveness of Control Structure Diagrams in Source Code Comprehension Activities," IEEE Trans. Software Eng., vol. 28, no. 5, pp. 463-477, May 2002.
[23] J.H. Cross, L.A. Barowski, T.D. Hendrix, and J.C. Teate, "Control Structure Diagrams for Ada 95," Proc. Conf. TRI-Ada '96, pp. 143-147, 1996.
[24] J. Lawrance, S. Clarke, M.M. Burnett, and G. Rothermel, "How Well Do Professional Developers Test with Code Coverage Visualizations? An Empirical Study," Proc. 2005 IEEE Symp. Visual Languages and Human-Centric Computing, pp. 53-60, 2005.
[25] J. Carver, L. Jaccheri, S. Morasca, and F. Shull, "Issues in Using Students in Empirical Studies in Software Engineering Education," Proc. Ninth Int'l Software Metrics Symp., pp. 239-249, 2003.
[26] P. Runeson, "Using Students as Experiment Subjects—An Analysis on Graduate and Freshmen Student Data," Proc. Int'l Conf. Empirical Assessment and Evaluation in Software Eng., pp. 95-102, 2003.
[27] M. Torchiano, "Empirical Assessment of UML Static Object Diagrams," Proc. Int'l Workshop Program Comprehension, pp. 226-229, 2004.
[28] S. Tilley and S. Huang, "A Qualitative Assessment of the Efficacy of UML Diagrams as a Form of Graphical Documentation in Aiding Program Understanding," Proc. SIGDOC '03, pp. 184-191, 2003.
[29] J.A. Cruz-Lemus, M. Genero, M.E. Manso, and M. Piattini, "Evaluating the Effect of Composite States on the Understandability of UML Statechart Diagrams," Proc. Int'l Conf. Model Driven Eng. Languages and Systems, 2005.
[30] H.C. Purchase, L. Colpoys, M. McGill, D. Carrington, and C. Britton, "UML Class Diagram Syntax: An Empirical Study of Comprehension," Proc. 2001 Asia-Pacific Symp. Information Visualisation, pp. 113-120, 2001.
[31] M.C. Otero and J.J. Dolado, "An Initial Experimental Assessment of the Dynamic Modelling in UML," Empirical Software Eng., vol. 7, no. 1, pp. 27-47, 2002.
[32] D. Firesmith, B. Henderson-Sellers, and I. Graham, OPEN Modeling Language (OML) Reference Manual. Cambridge Univ. Press, 1998.
[33] G. Canfora, A. Cimitile, F. Garcia, M. Piattini, and C.A. Visaggio, "Confirming the Influence of Educational Background in Pair-Design Knowledge through Experiments," Proc. 2005 ACM Symp. Applied Computing, pp. 1478-1484, 2005.
[34] G.A. Di Lucca, A.R. Fasolino, and P. Tramontana, "Reverse Engineering Web Applications: The WARE Approach," J. Software Maintenance, vol. 16, nos. 1/2, pp. 71-101, 2004.
13 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool