The Community for Technology Leaders
2018 IEEE 25th International Conference on Software Analysis, Evolution and Reengineering (SANER) (2018)
Campobasso, Italy
March 20, 2018 to March 23, 2018
ISBN: 978-1-5386-4970-1
pp: 72-83
Giovanni Grano , University of Zurich, Department of Informatics, Switzerland
Adelina Ciurumelea , University of Zurich, Department of Informatics, Switzerland
Sebastiano Panichella , University of Zurich, Department of Informatics, Switzerland
Fabio Palomba , University of Zurich, Department of Informatics, Switzerland
Harald C. Gall , University of Zurich, Department of Informatics, Switzerland
ABSTRACT
The intense competition characterizing mobile application's marketplaces forces developers to create and maintain high-quality mobile apps in order to ensure their commercial success and acquire new users. This motivated the research community to propose solutions that automate the testing process of mobile apps. However, the main problem of current testing tools is that they generate redundant and random inputs that are insufficient to properly simulate the human behavior, thus leaving feature and crash bugs undetected until they are encountered by users. To cope with this problem, we conjecture that information available in user reviews—that previous work showed as effective for maintenance and evolution problems—can be successfully exploited to identify the main issues users experience while using mobile applications, e.g., GUI problems and crashes. In this paper we provide initial insights into this direction, investigating (i) what type of user feedback can be actually exploited for testing purposes, (ii) how complementary user feedback and automated testing tools are, when detecting crash bugs or errors and (iii) whether an automated system able to monitor crash-related information reported in user feedback is sufficiently accurate. Results of our study, involving 11,296 reviews of 8 mobile applications, show that user feedback can be exploited to provide contextual details about errors or exceptions detected by automated testing tools. Moreover, they also help detecting bugs that would remain uncovered when rely on testing tools only. Finally, the accuracy of the proposed automated monitoring system demonstrates the feasibility of our vision, i.e., integrate user feedback into testing process.
INDEX TERMS
Testing, Tools, Computer bugs, Androids, Humanoid robots, Mobile applications
CITATION

G. Grano, A. Ciurumelea, S. Panichella, F. Palomba and H. C. Gall, "Exploring the integration of user feedback in automated testing of Android applications," 2018 IEEE 25th International Conference on Software Analysis, Evolution and Reengineering (SANER), Campobasso, Italy, 2018, pp. 72-83.
doi:10.1109/SANER.2018.8330198
317 ms
(Ver 3.3 (11022016))