2013 IEEE 24th International Symposium on Software Reliability Engineering (ISSRE) (2013)
Pasadena, CA, USA USA
Nov. 4, 2013 to Nov. 7, 2013
Stefano Di Alesio , Certus Centre for Software Verification & Validation, Simula Research Laboratory, Norway
Shiva Nejati , Interdisciplinary Centre for Reliability, Security and Trust (SnT), University of Luxembourg, Luxembourg
Lionel Briand , Interdisciplinary Centre for Reliability, Security and Trust (SnT), University of Luxembourg, Luxembourg
Arnaud Gotlieb , Certus Centre for Software Verification & Validation, Simula Research Laboratory, Norway
Safety-critical Real Time Embedded Systems (RT-ESs) are usually subject to strict timing and performance requirements that must be satisfied for the system to be deemed safe. In this paper, we use effective search strategies whose goal is finding worst case scenarios with respect to deadline misses. Such scenarios can in turn be used to test the target RTES and ensure that it satisfies its timing requirements even under worst case conditions. Specifically, we develop an approach based on Constraint Programming (CP) to automate the generation of test cases that reveal, or are likely to, task deadline misses. We evaluate it through a comparison with a state-of-the-art approach based on Genetic Algorithms (GA). In particular, we compare CP and GA in five case studies for efficiency, effectiveness, and scalability. Our experimental results show that, on the largest and more complex case studies, CP performs significantly better than GA. Furthermore, CP offers some advantages over GA, such as it guarantees a complete search when there is sufficient time, and, being deterministic, it doesn't rely on parameters that potentially have a significant effect on the search and therefore need to be tuned. Hence, we conclude that our results are encouraging and suggest this is an advantageous approach for stress testing of RTESs with respect to timing constraints.
Constraint Programming, Real-Time Systems, Stress Testing
S. Di Alesio, S. Nejati, L. Briand and A. Gotlieb, "Stress testing of task deadlines: A constraint programming approach," 2013 IEEE 24th International Symposium on Software Reliability Engineering (ISSRE), Pasadena, CA, USA USA, 2013, pp. 158-167.