2017 32nd IEEE/ACM International Conference on Automated Software Engineering (ASE) (2017)
Urbana, IL, USA
Oct. 30, 2017 to Nov. 3, 2017
Jeanderson Candido , Federal University of Pernambuco, Pernambuco, Brazil
Luis Melo , Federal University of Pernambuco, Pernambuco, Brazil
Marcelo d'Amorim , Federal University of Pernambuco, Pernambuco, Brazil
Dealing with high testing costs remains an important problem in Software Engineering. Test suite parallelization is an important approach to address this problem. This paper reports our findings on the usage and impact of test suite parallelization in open-source projects. It provides recommendations to practitioners and tool developers to speed up test execution. Considering a set of 468 popular Java projects we analyzed, we found that 24% of the projects contain costly test suites but parallelization features still seem underutilized in practice — only 19.1% of costly projects use parallelization. The main reported reason for adoption resistance was the concern to deal with concurrency issues. Results suggest that, on average, developers prefer high predictability than high performance in running tests.
Testing, Parallel processing, Java, Open source software, Resistance, Electrical resistance measurement, Instruction sets
J. Candido, L. Melo and M. d'Amorim, "Test suite parallelization in open-source projects: A study on its usage and impact," 2017 32nd IEEE/ACM International Conference on Automated Software Engineering (ASE), Urbana, IL, USA, 2017, pp. 838-848.