This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
A Controlled Experiment for Evaluating Quality Guidelines on the Maintainability of Object-Oriented Designs
June 2001 (vol. 27 no. 6)
pp. 513-530

Abstract—This paper presents a controlled experiment focusing on the impact of applying quality design principles such as the ones provided by Coad and Yourdon on the maintainability of object-oriented designs. Results, which repeat the findings of a previous study, strongly suggest that such design principles have a beneficial effect on the maintainability of object-oriented designs. It is argued that object-oriented designs are sensitive to poor design practices because the cognitive complexity introduced becomes increasingly unmanageable. However, as our ability to generalize these results is limited, they should be considered as preliminary, i.e., it is very likely that they can only be generalized to programmers with little object-oriented training and programming experience. Such programmers can, however, be commonly found on maintenance projects. As well as additional research, external replications of this study are required to confirm the results and achieve confidence in these findings.

[1] R. Arnold, “Impact Analysis—Towards a Framework for Comparison,” Proc. IEEE Conf. Software Maintenance, pp. 234-243, 1993.
[2] V. Basili, L. Briand, and W. Melo, "Measuring the Impact of Reuse on Quality and Productivity in Object-Oriented Systems," Comm. ACM, vol. 39, no. 10, 1996.
[3] V.R. Basili, L.C. Briand, and W. Melo, "A Validation of Object-Oriented Design Metrics as Quality Indicators," IEEE Trans. Software Eng., Oct. 1996, pp. 751-761.
[4] L. Briand, C. Bunse, and J. Daly, “An Experimental Evaluation of Quality Guidelines on the Maintainability of Object-Oriented Design Guidelines,” Proc. Empirical Studies of Programmers, Oct. 1997.
[5] L. Briand, C. Bunse, J. Daly, and C. Differding, “An Experimental Comparison of the Maintainability of Object-Oriented and Structured Design Documents,” Empirical Software Eng., An Int'l J., vol. 2, no. 3, 1997.
[6] L. Briand, J. Daly, and J. Wüst, "A Unified Framework for Cohesion Measurement in Object-Oriented Systems," Empirical Software Eng.: An Int'l J., vol. 3, no. 1, pp. 65-117, 1998.
[7] A. Brooks, J. Daly, J. Miller, M. Roper, and M. Wood, “Replication of Experimental Results in Software Engineering,” Technical Report ISERN-96-10, Dept. of Computer Science, Univ. of Strathclyde, Glasgow, 1996.
[8] R. Brooks, “Studying Programmer Behavior Experimentally: The Problems of Proper Methodology,” Comm. ACM, vol. 23, no. 4, pp. 207–213, Apr. 1980.
[9] L. Briand, C. Bunse, and J. Daly, Replication Package for Design Experiment SE I WS 96-97, Fraunhofer Inst. (IESE), Kaiserslautern, Germany, 1997.
[10] S.R. Chidamber and C.F. Kemerer, "A Metrics Suite for Object Oriented Design," IEEE Trans. Software Eng., vol. 20, no. 6, pp. 476-493, 1994.
[11] P. Coad and E. Yourdon, Object-Oriented Analysis, second ed., Yourdon Press, Englewood Cliffs, N.J., 1991.
[12] P. Coad and E. Yourdon, Object-Oriented Design, first edition. Prentice Hall, 1991.
[13] B. Curtis, “Measurement and Experimentation in Software Engineering,” Proc. IEEE, vol. 68, no. 9, pp. 1144-1157, Sept. 1980.
[14] J. Daly, A. Brooks, J. Miller, M. Roper, and M. Wood, “Evaluating Inheritance Depth on the Maintainability of Object-Oriented Software,” Empirical Software Eng., An Int'l J., vol. 1, no. 2, pp. 109-132, 1996.
[15] J. Daly, K. El Emam, and J. Miller, “An Empirical Research Methodology for Software Process Improvement,” Technical Report ISERN-97-04, Fraunhofer Inst. (IESE), Kaiserslautern, Germany, 1997.
[16] H. Deubler and M. Koestler, “Introducing Object-Orientation in Large and Complex Systems,” IEEE Trans. Software Eng., vol. 20, no. 11, pp. 840-848, Nov. 1994.
[17] B. Everitt, Cluster Analysis, third ed., Edward Ar nold, 1993.
[18] C. Jones, “Gaps in the Object-Oriented Paradigm,” Computer, vol. 27, no. 6, pp. 90-91, June 1994.
[19] B. Kaplan and D. Duchon, “Combining Qualitative and Quantitative Methods in Information Systems Research: A Case Study,” MIS Quarterly, pp. 571-586, Dec. 1988.
[20] H. Kraemer and S. Thiemann, How Many Subjects? first ed. Sage Publications, 1987.
[21] J. Miller, J. Daly, M. Wood, A. Brooks, and M. Roper, “Statistical Power and Its Subcomponents—Missing and Misunderstood Concepts in Empirical Software Engineering Research,” Information and Software Technology, vol. 39, pp. 285-295, 1997.
[22] C.L. Chang, R.A. Stachowitz, and J.B. Combs, “Validation of Nonmonotonic Knowledge-Based Systems,” Proc. IEEE Int'l Conf. Tools for Artificial Intelligence, Nov. 1990.
[23] P. Spector, Research Designs. Quantitative Applications in the Social Sciences. Sage Publications, 1981.
[24] J. van Hillegersberg, K. Kumar, and R. Welke, “An Empirical Analysis of the Performance and Strategies of Programmers New to Object-Oriented Techniques, Proc. Seventh Workshop Psychology of Programming Interest Group, Jan. 1995.
[25] J. Welkowitz, R. Ewen, and J. Cohen, Introductory Statistics for the Behavioral Sciences. second ed. Academic Press, 1976.
[26] M. Wood, J. Daly, J. Miller, and M. Roper, “Multi-Method Research: An Empirical Investigation of Object-Oriented Technology,” J. Systems and Software, 1999.
[27] L. Briand, J. Wuest, J. Daly, and V. Porter, “Exploring the Relationships between Design Measures and Software Quality in Object-Oriented Systems,” J. Systems and Software, vol. 51, 2000.
[28] L. Briand, J. Daly, and J. Wuest, A Unified Framework for Coupling Measurement in Object-Oriented Systems IEEE Trans. Software Eng., vol. 25, no. 1, pp. 91-121, 1999.
[29] L.C. Briand, J. Wuest, and H. Lounis, “Replicated Case Studies for Investigating Quality Factors in Object-Oriented Designs,” Empirical Software Eng.: An Int'l J., vol. 6, no. 6, 2001.

Index Terms:
Design documents, experiment, maintainability, object-oriented, replication.
Citation:
Lionel C. Briand, Christian Bunse, John W. Daly, "A Controlled Experiment for Evaluating Quality Guidelines on the Maintainability of Object-Oriented Designs," IEEE Transactions on Software Engineering, vol. 27, no. 6, pp. 513-530, June 2001, doi:10.1109/32.926174
Usage of this product signifies your acceptance of the Terms of Use.