Second Working Conference on Reverse Engineering (WCRE '95)
Toward experimental evaluation of subsystem classification recovery techniques
Toronto, Ontario, Canada
July 14-July 16
ISBN: 0-8186-7111-4
Several reverse engineering techniques classify software system components into subsystems. These techniques are designed to discover such classifications when the classifications are unknown. The techniques are rested and evaluated, however, by matching the classifications they recover against expected classifications. Several such techniques may be compared by experimentally evaluating their performance on the same set of software systems. Two things are needed to ensure experiment repeatability: a set of "real-world" software systems whose expected subsystem classifications are known; and an objective criterion to quantitatively determine the similarity of subsystem classifications. This paper contributes to both needs by identifying a set of widely used and easily accessible software systems whose modular decomposition either is documented or can be easily inferred from their design philosophy, and by presenting a measure to quantitatively determine the congruence between hierarchical subsystem classifications.
Index Terms:
reverse engineering; software performance evaluation; system documentation; subsystem classification recovery; reverse engineering; performance evaluation; experiment repeatability; subsystem classifications; modular decomposition; design philosophy; hierarchical subsystem classifications
Citation:
A. Lakhotia, J.M. Gravley, "Toward experimental evaluation of subsystem classification recovery techniques," wcre, pp.262, Second Working Conference on Reverse Engineering (WCRE '95), 1995