2015 30th IEEE/ACM International Conference on Automated Software Engineering (ASE) (2015)
Lincoln, NE, USA
Nov. 9, 2015 to Nov. 13, 2015
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/ASE.2015.45
A key challenge of the development and maintenanceof configurable systems is to predict the performance ofindividual system variants based on the features selected. It isusually infeasible to measure the performance of all possible variants, due to feature combinatorics. Previous approaches predictperformance based on small samples of measured variants, butit is still open how to dynamically determine an ideal samplethat balances prediction accuracy and measurement effort. Inthis paper, we adapt two widely-used sampling strategies forperformance prediction to the domain of configurable systemsand evaluate them in terms of sampling cost, which considersprediction accuracy and measurement effort simultaneously. Togenerate an initial sample, we introduce a new heuristic based onfeature frequencies and compare it to a traditional method basedon t-way feature coverage. We conduct experiments on six realworldsystems and provide guidelines for stakeholders to predictperformance by sampling.
Predictive models, Training, Testing, Measurement, Buildings, Mathematical model, Electronic mail
Atri Sarkar, Jianmei Guo, Norbert Siegmund, Sven Apel, Krzysztof Czarnecki, "Cost-Efficient Sampling for Performance Prediction of Configurable Systems (T)", 2015 30th IEEE/ACM International Conference on Automated Software Engineering (ASE), vol. 00, no. , pp. 342-352, 2015, doi:10.1109/ASE.2015.45