Search For:

Displaying 1-41 out of 41 total
Search-Based Propagation of Regression Faults in Automated Regression Testing
Found in: 2013 IEEE 6th International Conference On Software Testing, Verification and Validation Workshops (ICSTW)
By Sina Shamshiri,Gordon Fraser,Phil Mcminn,Alessandro Orso
Issue Date:March 2013
pp. 396-399
Over the lifetime of software programs, developers make changes by adding, removing, enhancing functionality or by refactoring code. These changes can sometimes result in undesired side effects in the original functionality of the software, better known as...
 
EvoSuite at the SBST 2013 Tool Competition
Found in: 2013 IEEE 6th International Conference On Software Testing, Verification and Validation Workshops (ICSTW)
By Gordon Fraser,Andrea Arcuri
Issue Date:March 2013
pp. 406-409
EvoSuite is a mature research prototype that automatically generates unit tests for Java code. This paper summarizes the results and experiences in participating at the unit testing competition held at SBST 2013, where EvoSuite ranked first with a score of...
 
CrowdOracles: Can the Crowd Solve the Oracle Problem?
Found in: 2013 IEEE Sixth International Conference on Software Testing, Verification and Validation (ICST)
By Fabrizio Pastore,Leonardo Mariani,Gordon Fraser
Issue Date:March 2013
pp. 342-351
Despite the recent advances in test generation, fully automatic software testing remains a dream: Ultimately, any generated test input depends on a test oracle that determines correctness, and, except for generic properties such as "the program shall ...
 
Generating Unit Tests for Concurrent Classes
Found in: 2013 IEEE Sixth International Conference on Software Testing, Verification and Validation (ICST)
By Sebastian Steenbuck,Gordon Fraser
Issue Date:March 2013
pp. 144-153
As computers become more and more powerful, programs are increasingly split up into multiple threads to leverage the power of multi-core CPUs. However, writing correct multi-threaded code is a hard problem, as the programmer has to ensure that all access t...
 
EvoSuite: On the Challenges of Test Case Generation in the Real World
Found in: 2013 IEEE Sixth International Conference on Software Testing, Verification and Validation (ICST)
By Gordon Fraser,Andrea Arcuri
Issue Date:March 2013
pp. 362-369
Test case generation is an important but tedious task, such that researchers have devised many different prototypes that aim to automate it. As these are research prototypes, they are usually only evaluated on a few hand-selected case studies, such that de...
 
Reconstructing Core Dumps
Found in: 2013 IEEE Sixth International Conference on Software Testing, Verification and Validation (ICST)
By Jeremias Rossler,Andreas Zeller,Gordon Fraser,Cristian Zamfir,George Candea
Issue Date:March 2013
pp. 114-123
When a software failure occurs in the field, it is often difficult to reproduce. Guided by a memory dump at the moment of failure (a "core dump"), our RECORE test case generator searches for a series of events that precisely reconstruct the failu...
 
Whole Test Suite Generation
Found in: IEEE Transactions on Software Engineering
By Gordon Fraser,Andrea Arcuri
Issue Date:February 2013
pp. 276-291
Not all bugs lead to program crashes, and not always is there a formal specification to check the correctness of a software test's outcome. A common scenario in software testing is therefore that test data are generated, and a tester manually adds test ora...
 
Augmented dynamic symbolic execution
Found in: 2012 27th IEEE/ACM International Conference on Automated Software Engineering (ASE)
By Konrad Jamrozik,Gordon Fraser,Nikolai Tillmann,Jonathan De Halleux
Issue Date:September 2012
pp. 254-257
Dynamic symbolic execution (DSE) can efficiently explore all simple paths through a program, reliably determining whether there are any program crashes or violations of assertions or code contracts. However, if such automated oracles do not exist, the trad...
 
The Seed is Strong: Seeding Strategies in Search-Based Software Testing
Found in: Software Testing, Verification, and Validation, 2008 International Conference on
By Gordon Fraser,Andrea Arcuri
Issue Date:April 2012
pp. 121-130
Search-based techniques have been shown useful for the task of generating tests, for example in the case of object-oriented software. But, as for any meta-heuristic search, the efficiency is heavily dependent on many different factors, seeding is one such ...
 
Semi-automatic Search-Based Test Generation
Found in: Software Testing, Verification, and Validation, 2008 International Conference on
By Yury Pavlov,Gordon Fraser
Issue Date:April 2012
pp. 777-784
Search-based testing techniques can efficiently generate test data to achieve high code coverage. However, when the fitness function does not provide sufficient guidance, the search will only generate optimal results by chance. Yet, where the search algori...
 
Behaviourally Adequate Software Testing
Found in: Software Testing, Verification, and Validation, 2008 International Conference on
By Gordon Fraser,Neil Walkinshaw
Issue Date:April 2012
pp. 300-309
Identifying a finite test set that adequately captures the essential behaviour of a program such that all faults are identified is a well-established problem. Traditional adequacy metrics can be impractical, and may be misleading even if they are satisfied...
 
Combining search-based and constraint-based testing
Found in: Automated Software Engineering, International Conference on
By Jan Malburg,Gordon Fraser
Issue Date:November 2011
pp. 436-439
Many modern automated test generators are based on either meta-heuristic search techniques or use constraint solvers. Both approaches have their advantages, but they also have specific drawbacks: Search-based methods get stuck in local optima and degrade w...
 
Automatically Generating Test Cases for Specification Mining
Found in: IEEE Transactions on Software Engineering
By Valentin Dallmeier,Nikolai Knopp,Christoph Mallon,Gordon Fraser,Sebastian Hack,Andreas Zeller
Issue Date:March 2012
pp. 243-257
Dynamic specification mining observes program executions to infer models of normal program behavior. What makes us believe that we have seen sufficiently many executions? The TAUTOKO (“Tautoko” is the Mãori word for “enhance, enrich.”) typestate miner gene...
 
Mutation-Driven Generation of Unit Tests and Oracles
Found in: IEEE Transactions on Software Engineering
By Gordon Fraser,Andreas Zeller
Issue Date:March 2012
pp. 278-292
To assess the quality of test suites, mutation analysis seeds artificial defects (mutations) into programs; a nondetected mutation indicates a weakness in the test suite. We present an automated approach to generate unit tests that detect these mutations f...
 
Evolutionary Generation of Whole Test Suites
Found in: Quality Software, International Conference on
By Gordon Fraser, Andrea Arcuri
Issue Date:July 2011
pp. 31-40
Recent advances in software testing allow automatic derivation of tests that reach almost any desired point in the source code. There is, however, a fundamental problem with the general idea of targeting one distinct test coverage goal at a time: Coverage ...
 
Exploiting Common Object Usage in Test Case Generation
Found in: Software Testing, Verification, and Validation, 2008 International Conference on
By Gordon Fraser, Andreas Zeller
Issue Date:March 2011
pp. 80-89
Generated test cases are good at systematically exploring paths and conditions in software. However, generated test cases often do not make sense. We adapt test case generation to follow patterns of common object usage, as mined from code examples. Our exp...
 
It is Not the Length That Matters, It is How You Control It
Found in: Software Testing, Verification, and Validation, 2008 International Conference on
By Gordon Fraser, Andrea Arcuri
Issue Date:March 2011
pp. 150-159
The length of test cases is a little investigated topic in search-based test generation for object oriented software, where test cases are sequences of method calls. While intuitively longer tests can achieve higher overall code coverage, there is always t...
 
Generating Minimal Fault Detecting Test Suites for Boolean Expressions
Found in: Software Testing Verification and Validation Workshop, IEEE International Conference on
By Gordon Fraser, Angelo Gargantini
Issue Date:April 2010
pp. 37-45
New coverage criteria for Boolean expressions are regularly introduced with two goals: to detect specific classes of realistic faults and to produce as small as possible test suites. In this paper we investigate whether an approach targeting specific fault...
 
Using Spectrum-Based Fault Localization for Test Case Grouping
Found in: Automated Software Engineering, International Conference on
By Martin Weiglhofer, Gordon Fraser, Franz Wotawa
Issue Date:November 2009
pp. 630-634
Model-based test case generation allows one to derive almost arbitrary numbers of test cases from models. If resulting test suites are executed against real implementations, there are often huge numbers of failed test cases. Thus, the analysis of the test ...
 
An Evaluation of Specification Based Test Generation Techniques Using Model Checkers
Found in: Practice And Research Techniques, Testing: Academic & Industrial Conference on
By Gordon Fraser, Angelo Gargantini
Issue Date:September 2009
pp. 72-81
Test case generation can be represented as a model checking problem, such that model checking tools automatically generate test cases. This has previously been applied to testing techniques such as coverage criteria, combinatorial testing, mutation testing...
 
Increasing Diversity in Coverage Test Suites Using Model Checking
Found in: Quality Software, International Conference on
By Gordon Fraser, Franz Wotawa
Issue Date:August 2009
pp. 211-218
Automated test case generation often results in test suites containing significant redundancy such as test cases that are duplicates, prefixes of other test cases, or cover the same test requirements. In this paper we consider the fact that items described...
 
An Evaluation of Model Checkers for Specification Based Test Case Generation
Found in: Software Testing, Verification, and Validation, 2008 International Conference on
By Gordon Fraser, Angelo Gargantini
Issue Date:April 2009
pp. 41-50
Under certain constraints the test case generation problem can be represented as a model checking problem, thus enabling the use of powerful model checking tools to perform the test case generation automatically. There are, however, several different model...
 
Reachability and Propagation for LTL Requirements Testing
Found in: Quality Software, International Conference on
By Gordon Fraser, Paul Ammann
Issue Date:August 2008
pp. 189-198
It is important to test software with respect to user requirements, especially when adhering to safety standards, which require traceability from requirements to test cases. While research has resulted in many different model based testing techniques, only...
 
Coverage Based Testing with Test Purposes
Found in: Quality Software, International Conference on
By Gordon Fraser, Martin Weiglhofer, Franz Wotawa
Issue Date:August 2008
pp. 199-208
Test purposes have been presented as a solution to avoid the state space explosion when selecting test cases from formal models. Although such techniques work very well with regard to the speed of the test derivation, they leave the tester with one importa...
 
Mutant Minimization for Model-Checker Based Test-Case Generation
Found in: Testing: Academic and Industrial Conference Practice and Research Techniques - MUTATION
By Gordon Fraser, Franz Wotawa
Issue Date:September 2007
pp. 161-168
Mutation of model-checker specifications is used to generate test-cases automatically. In general, model-checker based techniques are efficient when using small, abstract models, but are limited in their applicability by the performance of the model-checke...
 
Nondeterministic Testing with Linear Model-Checker Counterexamples
Found in: Quality Software, International Conference on
By Gordon Fraser, Franz Wotawa
Issue Date:October 2007
pp. 107-116
In model-based testing, software test-cases are derived from a formal specification. A popular technique is to use traces created by a model-checker as test-cases. This ap- proach is fully automated and flexible with regard to the structure and type of tes...
 
Improving Model-Checkers for Software Testing
Found in: Quality Software, International Conference on
By Gordon Fraser, Franz Wotawa
Issue Date:October 2007
pp. 25-31
In recent years, automated test-case generation with model-checkers has seen increasing attention in the re- search community. The use of model-checkers for testing offers full automation, a choice of different methods to de- rive test-suites, and is effic...
 
Test-Case Generation and Coverage Analysis for Nondeterministic Systems Using Model-Checkers
Found in: Software Engineering Advances, International Conference on
By Gordon Fraser, Franz Wotawa
Issue Date:August 2007
pp. 45
Nondeterminism is used as a means of underspecification or implementation choice in specifications, and it is often necessary if part of a system or the environment is unpredictable. The use of model-checker counterexamples as test-cases is a popular techn...
 
Using Model-Checkers for Mutation-Based Test-Case Generation, Coverage Analysis and Specification Analysis
Found in: Software Engineering Advances, International Conference on
By Gordon Fraser, Franz Wotawa
Issue Date:November 2006
pp. 16
Automated software testing is an important measure to improve software quality and the efficiency of the software development process. We present a model-checker based approach to automated test-case generation applying mutation to behavioral models and re...
 
Ordering Coverage Goals in Model Checker Based Testing
Found in: Software Testing Verification and Validation Workshop, IEEE International Conference on
By Gordon Fraser, Franz Wotawa
Issue Date:April 2008
pp. 31-40
Model-based testing techniques select test cases according to test goals, which might be coverage criteria or mutation adequacy. Complex criteria and large models lead to large test suites, and a test case created for one coverage item might cover several ...
 
Automatic Testing of Natural User Interfaces
Found in: 2014 IEEE Seventh International Conference on Software Testing, Verification and Validation (ICST)
By Chris J. Hunt,Guy Brown,Gordon Fraser
Issue Date:March 2014
pp. 123-132
Automated test generation can effectively explore programs through their programmer interfaces and traditional graphical user interfaces, but the recent advent of natural user interfaces (NUI) based on motion and gesture detection, for example the Microsof...
 
Improving search-based test suite generation with dynamic symbolic execution
Found in: 2013 IEEE 24th International Symposium on Software Reliability Engineering (ISSRE)
By Juan Pablo Galeotti,Gordon Fraser,Andrea Arcuri
Issue Date:November 2013
pp. 360-369
Search-based testing can automatically generate unit test suites for object oriented code, but may struggle to generate specific values necessary to cover difficult parts of the code. Dynamic symbolic execution (DSE) efficiently generates such specific val...
   
Search-based data-flow test generation
Found in: 2013 IEEE 24th International Symposium on Software Reliability Engineering (ISSRE)
By Mattia Vivanti,Andre Mis,Alessandra Gorla,Gordon Fraser
Issue Date:November 2013
pp. 370-379
Coverage criteria based on data-flow have long been discussed in the literature, yet to date they are still of surprising little practical relevance. This is in part because 1) manually writing a unit test for a data-flow aspect is more challenging than wr...
   
Does automated white-box test generation really help software testers?
Found in: Proceedings of the 2013 International Symposium on Software Testing and Analysis (ISSTA 2013)
By Andrea Arcuri, Frank Padberg, Gordon Fraser, Matt Staats, Phil McMinn
Issue Date:July 2013
pp. 291-301
Automated test generation techniques can efficiently produce test data that systematically cover structural aspects of a program. In the absence of a specification, a common assumption is that these tests relieve a developer of most of the work, as the act...
     
Test suite generation with memetic algorithms
Found in: Proceeding of the fifteenth annual conference on Genetic and evolutionary computation conference (GECCO '13)
By Andrea Arcuri, Gordon Fraser, Phil McMinn
Issue Date:July 2013
pp. 1437-1444
Genetic Algorithms have been successfully applied to the generation of unit tests for classes, and are well suited to create complex objects through sequences of method calls. However, because the neighborhood in the search space for method sequences is hu...
     
Augmented dynamic symbolic execution
Found in: Proceedings of the 27th IEEE/ACM International Conference on Automated Software Engineering (ASE 2012)
By Gordon Fraser, Jonathan De Halleux, Konrad Jamrozik, Nikolai Tillmann
Issue Date:September 2012
pp. 254-257
Dynamic symbolic execution (DSE) can efficiently explore all simple paths through a program, reliably determining whether there are any program crashes or violations of assertions or code contracts. However, if such automated oracles do not exist, the trad...
     
Isolating failure causes through test case generation
Found in: Proceedings of the 2012 International Symposium on Software Testing and Analysis (ISSTA 2012)
By Alessandro Orso, Andreas Zeller, Gordon Fraser, Jeremias Röβler
Issue Date:July 2012
pp. 309-319
Manual debugging is driven by experiments—test runs that narrow down failure causes by systematically confirming or excluding individual factors. The BUGEX approach leverages test case generation to systematically isolate such causes from a single fa...
     
Search-based system testing: high coverage, no false alarms
Found in: Proceedings of the 2012 International Symposium on Software Testing and Analysis (ISSTA 2012)
By Andreas Zeller, Florian Gross, Gordon Fraser
Issue Date:July 2012
pp. 67-77
Modern test case generation techniques can automatically achieve high code coverage. If they operate on the unit level, they run the risk of generating inputs infeasible in reality, which, when causing failures, are painful to identify and eliminate. Runni...
     
Generating parameterized unit tests
Found in: Proceedings of the 2011 International Symposium on Software Testing and Analysis (ISSTA '11)
By Andreas Zeller, Gordon Fraser
Issue Date:July 2011
pp. 364-374
State-of-the art techniques for automated test generation focus on generating executions that cover program behavior. As they do not generate oracles, it is up to the developer to figure out what a test does and how to check the correctness of the observed...
     
Mutation-driven generation of unit tests and oracles
Found in: Proceedings of the 19th international symposium on Software testing and analysis (ISSTA '10)
By Andreas Zeller, Gordon Fraser
Issue Date:July 2010
pp. 147-158
To assess the quality of test suites, mutation analysis seeds artificial defects (mutations) into programs; a non-detected mutation indicates a weakness in the test suite. We present an automated approach to generate unit tests that detect these mutations ...
     
Qr-model based testing
Found in: Proceedings of the 3rd international workshop on Automation of software test (AST '08)
By Franz Wotawa, Gordon Fraser, Harald Brandl
Issue Date:May 2008
pp. 1-1
As reactive and embedded systems continuously interact with their environment, it is important to test as many as possible interactions. The use of qualitative models of the environment and hardware has the potential to provide test cases that might not be...
     
 1