This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Automated Behavioral Testing of Refactoring Engines
Feb. 2013 (vol. 39 no. 2)
pp. 147-162
Gustavo Soares, Federal University of Campina Grande, Campina Grande
Rohit Gheyi, Federal University of Campina Grande, Campina Grande
Tiago Massoni, Federal University of Campina Grande, Campina Grande
Refactoring is a transformation that preserves the external behavior of a program and improves its internal quality. Usually, compilation errors and behavioral changes are avoided by preconditions determined for each refactoring transformation. However, to formally define these preconditions and transfer them to program checks is a rather complex task. In practice, refactoring engine developers commonly implement refactorings in an ad hoc manner since no guidelines are available for evaluating the correctness of refactoring implementations. As a result, even mainstream refactoring engines contain critical bugs. We present a technique to test Java refactoring engines. It automates test input generation by using a Java program generator that exhaustively generates programs for a given scope of Java declarations. The refactoring under test is applied to each generated program. The technique uses SafeRefactor, a tool for detecting behavioral changes, as an oracle to evaluate the correctness of these transformations. Finally, the technique classifies the failing transformations by the kind of behavioral change or compilation error introduced by them. We have evaluated this technique by testing 29 refactorings in Eclipse JDT, NetBeans, and the JastAdd Refactoring Tools. We analyzed 153,444 transformations, and identified 57 bugs related to compilation errors, and 63 bugs related to behavioral changes.
Index Terms:
Java,Metals,Engines,Computer bugs,Testing,Automatic programming,Unified modeling language,program generation,Refactoring,automated testing
Citation:
Gustavo Soares, Rohit Gheyi, Tiago Massoni, "Automated Behavioral Testing of Refactoring Engines," IEEE Transactions on Software Engineering, vol. 39, no. 2, pp. 147-162, Feb. 2013, doi:10.1109/TSE.2012.19
Usage of this product signifies your acceptance of the Terms of Use.