Issue No. 04 - July/August (2010 vol. 36)
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/TSE.2009.92
Niklas Pettersson , Växjö University, Växjö
Welf Löwe , Växjö University, Växjö
Joakim Nivre , Växjö University, Växjö
Detection of design pattern occurrences is part of several solutions to software engineering problems, and high accuracy of detection is important to help solve the actual problems. The improvement in accuracy of design pattern occurrence detection requires some way of evaluating various approaches. Currently, there are several different methods used in the community to evaluate accuracy. We show that these differences may greatly influence the accuracy results, which makes it nearly impossible to compare the quality of different techniques. We propose a benchmark suite to improve the situation and a community effort to contribute to, and evolve, the benchmark suite. Also, we propose fine-grained metrics assessing the accuracy of various approaches in the benchmark suite. This allows comparing the detection techniques and helps improve the accuracy of detecting design pattern occurrences.
Patterns, object-oriented design methods, measurement techniques, evaluation, reverse engineering, reengineering, restructuring.
J. Nivre, N. Pettersson and W. Löwe, "Evaluation of Accuracy in Design Pattern Occurrence Detection," in IEEE Transactions on Software Engineering, vol. 36, no. , pp. 575-590, 2009.