The Community for Technology Leaders
2011 26th IEEE/ACM International Conference on Automated Software Engineering (ASE 2011) (2011)
Lawrence, KS, USA
Nov. 6, 2011 to Nov. 10, 2011
ISBN: 978-1-4577-1638-6
pp: 412-415
LiGuo Huang , Department of Computer Science and Engineering, Southern Methodist University, Dallas, TX, USA
Vincent Ng , Human Language Technology Research Institute, University of Texas at Dallas, USA
Isaac Persing , Human Language Technology Research Institute, University of Texas at Dallas, USA
Ruili Geng , Department of Computer Science and Engineering, Southern Methodist University, Dallas, TX, USA
Xu Bai , Department of Computer Science and Engineering, Southern Methodist University, Dallas, TX, USA
Jeff Tian , Department of Computer Science and Engineering, Southern Methodist University, Dallas, TX, USA
ABSTRACT
Orthogonal Defect Classification (ODC), the most influential framework for software defect classification and analysis, provides valuable in-process feedback to system development and maintenance. Conducting ODC classification on existing organizational defect reports is human intensive and requires experts' knowledge of both ODC and system domains. This paper presents AutoODC, an approach and tool for automating ODC classification by casting it as a supervised text classification problem. Rather than merely apply the standard machine learning framework to this task, we seek to acquire a better ODC classification system by integrating experts' ODC experience and domain knowledge into the learning process via proposing a novel Relevance Annotation Framework. We evaluated AutoODC on an industrial defect report from the social network domain. AutoODC is a promising approach: not only does it leverage minimal human effort beyond the human annotations typically required by standard machine learning approaches, but it achieves an overall accuracy of 80.2% when using manual classifications as a basis of comparison.
INDEX TERMS
CITATION

I. Persing, Ruili Geng, LiGuo Huang, Jeff Tian, V. Ng and Xu Bai, "AutoODC: Automated generation of Orthogonal Defect Classifications," 2011 26th IEEE/ACM International Conference on Automated Software Engineering (ASE 2011)(ASE), Lawrence, KS, USA, 2011, pp. 412-415.
doi:10.1109/ASE.2011.6100086
182 ms
(Ver 3.3 (11022016))