Issue No. 04 - July/August (2010 vol. 36)
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/TSE.2009.92
Joakim Nivre , Växjö University, Växjö
Niklas Pettersson , Växjö University, Växjö
Welf Löwe , Växjö University, Växjö
Detection of design pattern occurrences is part of several solutions to software engineering problems, and high accuracy of detection is important to help solve the actual problems. The improvement in accuracy of design pattern occurrence detection requires some way of evaluating various approaches. Currently, there are several different methods used in the community to evaluate accuracy. We show that these differences may greatly influence the accuracy results, which makes it nearly impossible to compare the quality of different techniques. We propose a benchmark suite to improve the situation and a community effort to contribute to, and evolve, the benchmark suite. Also, we propose fine-grained metrics assessing the accuracy of various approaches in the benchmark suite. This allows comparing the detection techniques and helps improve the accuracy of detecting design pattern occurrences.
Patterns, object-oriented design methods, measurement techniques, evaluation, reverse engineering, reengineering, restructuring.
Joakim Nivre, Niklas Pettersson, Welf Löwe, "Evaluation of Accuracy in Design Pattern Occurrence Detection", IEEE Transactions on Software Engineering, vol. 36, no. , pp. 575-590, July/August 2010, doi:10.1109/TSE.2009.92