Search For:

Displaying 1-50 out of 50 total
Detection or Isolation of Defects? An Experimental Comparison of Unit Testing and Code Inspection
Found in: Software Reliability Engineering, International Symposium on
By Per Runeson, Anneliese Andrews
Issue Date:November 2003
pp. 3
Code inspections and white-box testing have both been used for unit testing. One is a static analysis technique, the other a dynamic one, since it is based on executing test cases. Naturally, the question arises whether one is superior to the other, or, wh...
 
A Second Replicated Quantitative Analysis of Fault Distributions in Complex Software Systems
Found in: IEEE Transactions on Software Engineering
By Tihana Galinac Grbac,Per Runeson,Darko Huljenić
Issue Date:April 2013
pp. 462-476
Background: Software engineering is searching for general principles that apply across contexts, for example, to help guide software quality assurance. Fenton and Ohlsson presented such observations on fault distributions, which have been replicated once. ...
 
A Replicated Experiment of Usage-Based and Checklist-Based Reading
Found in: Software Metrics, IEEE International Symposium on
By Thomas Thelin, Carina Andersson, Per Runeson, Nina Dzamashvili-Fogelström
Issue Date:September 2004
pp. 246-256
Software inspection is an effective method to detect faults in software artefacts. Several empirical studies have been performed on reading techniques, which are used in the individual preparation phase of software inspections. Besides new experiments, rep...
 
A Case Study Using Sampling to Improve Software Inspection Effectiveness
Found in: Empirical Software Engineering, International Symposium on
By Per Runeson,Thomas Thelin
Issue Date:October 2003
pp. 252
Software inspections have shown to contribute to improved software quality. However, as they are time consuming, sometimes the resources available are not sufficient to inspect all documents. Instead of selecting documents ad hoc, Sample-Driven Inspections...
 
Prioritized Use Cases as a Vehicle for Software Inspections
Found in: IEEE Software
By Thomas Thelin, Per Runeson, Claes Wohlin
Issue Date:July 2003
pp. 30-33
<p>Principles from software inspection, use cases, and operational profile testing are combined into the usage-based reading technique. The goal is to provide an efficient reading technique for software inspections, which takes the user viewpoint on ...
 
Trends in the Quality of Human-Centric Software Engineering Experiments--A Quasi-Experiment
Found in: IEEE Transactions on Software Engineering
By Barbara Kitchenham,Dag I.K. Sjoberg,Tore Dyba,O. Pearl Brereton,David Budgen,Martin Host,Per Runeson
Issue Date:July 2013
pp. 1002-1017
Context: Several text books and papers published between 2000 and 2002 have attempted to introduce experimental design and statistical methods to software engineers undertaking empirical studies. Objective: This paper investigates whether there has been an...
 
Requirements Trade-offs During UML Design
Found in: Engineering of Computer-Based Systems, IEEE International Conference on the
By Anneliese Andrews, Per Runeson, Robert France
Issue Date:May 2004
pp. 282
Designs almost always require trade-offs between competing design choices to meet pervasive system dependability requirements (e.g., security, performance and fault tolerance system goals). In some cases, dependability requirements are realized by function...
 
Efficient Evaluation of Multifactor Dependent System Performance Using Fractional Factorial Design
Found in: IEEE Transactions on Software Engineering
By Tomas Berling, Per Runeson
Issue Date:September 2003
pp. 769-781
<p><b>Abstract</b>—Performance of computer-based systems may depend on many different factors, internal and external. In order to design a system to have the desired performance or to validate that the system has the required performance,...
 
How much Information is Needed for Usage-Based Reading? — A Series of Experiments
Found in: Empirical Software Engineering, International Symposium on
By Thomas Thelin, Per Runeson, Claes Wohlin, Thomas Olsson, Carina Andersson
Issue Date:October 2002
pp. 127
Software inspections are regarded as an important technique to detect faults throughout the software development process. The individual preparation phase of software inspections has enlarged its focus from only comprehension to also include fault searchin...
 
Roundtable: What's Next in Software Analytics
Found in: IEEE Software
By Ahmed E. Hassan,Abram Hindle,Per Runeson,Martin Shepperd,Prem Devanbu,Sunghun Kim
Issue Date:July 2013
pp. 53-56
For this special issue, the guest editors asked a panel of six established experts in software analytics to highlight what they thought were the most important, or overlooked, aspect of this field. They all pleaded for a much broader view of analytics than...
 
It Takes Two to Tango -- An Experience Report on Industry -- Academia Collaboration
Found in: Software Testing, Verification, and Validation, 2008 International Conference on
By Per Runeson
Issue Date:April 2012
pp. 872-877
Industry -- academia collaboration is critical for empirical research to exist. However, there are many obstacles in the collaboration process. This paper reports on the experiences gained by the author, in a 2-year collaboration project on software testin...
 
A Comparative Analysis of Three Replicated Experiments Comparing Inspection and Unit Testing
Found in: Replication in Empirical Software Engineering Research, International Workshop on
By Per Runeson,Andreas Stefik,Anneliese Andrews,Sam Grönblom,Ivan Porres,Susanna Siebert
Issue Date:September 2011
pp. 35-42
Code inspections and structural unit testing are two common defect detection methods in software development. This paper analyzes three replications of an experiment aimed at comparing which method finds more defects. The first two experiments use the same...
 
Investigating Test Teams? Defect Detection in Function test
Found in: Empirical Software Engineering and Measurement, International Symposium on
By Carina Andersson, Per Runeson
Issue Date:September 2007
pp. 458-460
In a case study, the defect detection for functional test teams is investigated. In the study it is shown that the test teams not only discover defects in the features under test that they are responsible for, but also defects in interacting components, be...
 
A Survey of Unit Testing Practices
Found in: IEEE Software
By Per Runeson
Issue Date:July 2006
pp. 22-29
Most companies and testing books use the term unit testing, but its semantics varies widely in different organizations. Lund University researchers launched a survey in a company network to explore this variation. The survey, which involved companies in fo...
 
An Experimental Comparison of Usage-Based and Checklist-Based Reading
Found in: IEEE Transactions on Software Engineering
By Thomas Thelin, Per Runeson, Claes Wohlin
Issue Date:August 2003
pp. 687-704
<p><b>Abstract</b>—Software quality can be defined as the customers' perception of how a system works. Inspection is a method to monitor and control the quality throughout the development cycle. Reading techniques applied to inspections h...
 
Experiences from Teaching PSP for Freshmen
Found in: Software Engineering Education and Training, Conference on
By Per Runeson
Issue Date:February 2001
pp. 98
The Personal Software Process (PSP) is launched as a means for improving software development capabilities for the individual engineer. It is proposed that it should be used in software engineering curricula; some authors propose it to be used already duri...
 
Application of Factorial Design to Validation of System Performance
Found in: Engineering of Computer-Based Systems, IEEE International Conference on the
By Tomas Berling, Per Runeson
Issue Date:April 2000
pp. 318
System verification and validation are performed to secure that a system fulfils the different quality aspects, such as reliability, functionality, maintainability, performance and user friendliness. Since the verification and validation activities take a ...
 
IR in Software Traceability: From a Bird's Eye View
Found in: 2013 ACM/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM)
By Markus Borg,Per Runeson
Issue Date:October 2013
pp. 243-246
Background. Several researchers have proposed creating after-the-fact structure among software artifacts using trace recovery based on Information Retrieval (IR). Due to significant variation points in previous studies, results are not easily aggregated. A...
 
Analyzing Networks of Issue Reports
Found in: 2013 17th European Conference on Software Maintenance and Reengineering (CSMR)
By Markus Borg,Dietmar Pfahl,Per Runeson
Issue Date:March 2013
pp. 79-88
Completely analyzed and closed issue reports in software development projects, particularly in the development of safety-critical systems, often carry important information about issue-related change locations. These locations may be in the source code, as...
 
Software Product Line Testing -- A 3D Regression Testing Problem
Found in: Software Testing, Verification, and Validation, 2008 International Conference on
By Per Runeson,Emelie Engström
Issue Date:April 2012
pp. 742-746
In software product line engineering, testing for regression concerns not only versions, as in one-off product development, but also regression across variants. We propose a 3D process model, with the dimensions of level, version and variant, to help analy...
 
Case Studies Synthesis: Brief Experience and Challenges for the Future
Found in: Empirical Software Engineering and Measurement, International Symposium on
By Daniela S. Cruzes,Tore Dybâ,Per Runeson,Martin Höst
Issue Date:September 2011
pp. 343-346
Synthesis of case studies is different from synthesis of purely quantitative studies, for example, in that sampling and analysis in primary studies have been carried out differently, and that primary results are of a different nature. The objective of this...
 
Testing Software Product Lines
Found in: IEEE Software
By Paulo Anselmo da Mota Silveira Neto,Per Runeson,Ivan do Carmo Machado,Eduardo Santana de Almeida,Silvio Romero de Lemos Meira,Emelie Engström
Issue Date:September 2011
pp. 16-20
Two studies of testing practices for software product lines identify gaps between required techniques and existing approaches in the available literature. This Web extra offers extra details for the main article (specifically, the bibliography for the two ...
 
Decision Support for Test Management and Scope Selection in a Software Product Line Context
Found in: Software Testing Verification and Validation Workshop, IEEE International Conference on
By Emelie Engström, Per Runeson
Issue Date:March 2011
pp. 262-265
In large software organizations with a product line development approach, system test planning and scope selection is a complex tasks for which tool support is needed. Due to repeated testing: across different testing levels, over time (test for regression...
 
Improving Regression Testing Transparency and Efficiency with History-Based Prioritization -- An Industrial Case Study
Found in: Software Testing, Verification, and Validation, 2008 International Conference on
By Emelie Engström, Per Runeson, Andreas Ljung
Issue Date:March 2011
pp. 367-376
Background: History based regression testing was proposed as a basis for automating regression test selection, for the purpose of improving transparency and test efficiency, at the function test level in a large scale software development organization. Aim...
 
An Empirical Evaluation of Regression Testing Based on Fix-Cache Recommendations
Found in: Software Testing, Verification, and Validation, 2008 International Conference on
By Emelie Engström, Per Runeson, Greger Wikstrand
Issue Date:April 2010
pp. 75-78
Background: The fix-cache approach to regression test selection was proposed to identify the most fault-prone files and corresponding test cases through analysis of fixed defect reports. Aim: The study aims at evaluating the efficiency of this approach, co...
 
Checklists for Software Engineering Case Study Research
Found in: Empirical Software Engineering and Measurement, International Symposium on
By Martin Host, Per Runeson
Issue Date:September 2007
pp. 479-481
Case study is an important research methodology for software engineering. We have identified the need for checklists supporting researchers and reviewers in conducting and reviewing case studies. We derived checklists for researchers and reviewers respecti...
 
A Replicated Quantitative Analysis of Fault Distributions in Complex Software Systems
Found in: IEEE Transactions on Software Engineering
By Carina Andersson, Per Runeson
Issue Date:May 2007
pp. 273-286
To contribute to the body of empirical research on fault distributions during development of complex software systems, a replication of a study of Fenton and Ohlsson is conducted. The hypotheses from the original study are investigated using data taken fro...
 
Detection of Duplicate Defect Reports Using Natural Language Processing
Found in: Software Engineering, International Conference on
By Per Runeson, Magnus Alexandersson, Oskar Nyholm
Issue Date:May 2007
pp. 499-510
Defect reports are generated from various testing and development activities in software engineering. Sometimes two reports are submitted that describe the same problem, leading to duplicate reports. These reports are mostly written in structured natural l...
 
Combining Agile Methods with Stage-Gate Project Management
Found in: IEEE Software
By Daniel Karlström, Per Runeson
Issue Date:May 2005
pp. 43-49
Agile methods have received positive attention in the software engineering community. Their focus on simplicity, programmers, and products empowers the technical staff and gives a sense of focus on product development basics. Researchers have investigated ...
 
Are Found Defects an Indicator of Software Correctness? An Investigation in a Controlled Case Study
Found in: Software Reliability Engineering, International Symposium on
By Per Runeson, Måns Holmstedt Jönsson, Fredrik Scheja
Issue Date:November 2004
pp. 91-100
In quality assurance programs, we want indicators of software quality, especially software correctness. The number of found defects during inspection and testing are often used as the basis for indicators of software correctness. However, there is a parado...
 
A Case Study on Regression Test Suite Maintenance in System Evolution
Found in: Software Maintenance, IEEE International Conference on
By Mats Skoglund, Per Runeson
Issue Date:September 2004
pp. 438-442
When a system is maintained, its automated test suites must also be maintained to keep the tests up to date. Even though practice indicates that test suite-maintenance can be very costly we have seen few studies considering the actual efforts for maintenan...
 
An Experimental Evaluation of Inspection and Testing for Detection of Design Faults
Found in: Empirical Software Engineering, International Symposium on
By Carina Andersson,Thomas Thelin,Per Runeson,Nina Dzamashvili
Issue Date:October 2003
pp. 174
The two most common strategies for verification and validation, inspection and testing, are in a controlled experiment evaluated in terms of their fault detection capabilities. These two techniques are in the previous work compared applied to code. In orde...
 
Verification and Validation in Industry — A Qualitative Survey on the State of Practice
Found in: Empirical Software Engineering, International Symposium on
By Carina Andersson, Per Runeson
Issue Date:October 2002
pp. 37
Verification and validation activities take a substantial share of project budgets and need improvements. This is an accepted truth, but the current practices are seldom assessed and analyzed. In this paper, we present a qualitative survey of the verificat...
 
Experience from Replicating Empirical Studies on Prediction Models
Found in: Software Metrics, IEEE International Symposium on
By Magnus C. Ohlsson, Per Runeson
Issue Date:June 2002
pp. 217
When conducting empirical studies, replications are important contributors to investigate the generality of the studies. By replicating a study in another context, it is investigated which impact the specific environment has, related to the effect of the s...
 
Defect Content Estimation for Two Reviewers
Found in: Software Reliability Engineering, International Symposium on
By Hakan Petersson, Claes Wohlin, Per Runeson, M. Höst
Issue Date:November 2001
pp. 340
Estimation of the defect content is important to enable quality control throughout the software development process. Capture-recapture methods and curve fitting methods have been suggested as tools to estimate the defect content after a review. The methods...
 
An Experiment on Lead-Time Impact in Testing of Distributed Real-Time Systems
Found in: Software Metrics, IEEE International Symposium on
By Thomas Olsson, Per Runeson, Niclas Bauer, Lars Bratthall
Issue Date:April 2001
pp. 159
In the search for efficient test methods for distributed real-time systems, an experiment is conducted that investigates the impact on the lead-time required to identify a defect, depending on what information is available. One group of experiment particip...
 
Assessing the Sensitivity to Usage Profile Changes in Test Planning
Found in: Software Reliability Engineering, International Symposium on
By Anders Wesslén, Per Runeson, Björn Regnell
Issue Date:October 2000
pp. 317
Software reliability is an important characteristic for most systems, but due to its dynamic properties, it is hard to assess until very late in the development. Nevertheless, the testing must be planned to meet the reliability requirements. In test planni...
 
A New Software Engineering Program ? Structure and Initial Experiences
Found in: Software Engineering Education and Training, Conference on
By Per Runeson
Issue Date:March 2000
pp. 223
Software plays an increasingly important role in new products of different kinds. Therefore, the need of engineers developing software is continuously increasing. However, computer science education programs are not enough to fulfill the industrial needs. ...
 
Derivation of an Integrated Operational Profile and Use Case Model
Found in: Software Reliability Engineering, International Symposium on
By Per Runeson, Björn Regnell
Issue Date:November 1998
pp. 70
Requirements engineering and software reliability engineering both involve model building related to the usage of the intended system; requirements models and test case models respectively are built. Use case modelling for requirements engineering and oper...
 
Software Quality Assurance — Concepts and Misconceptions
Found in: EUROMICRO Conference
By Per Runeson, Peter Isacsson
Issue Date:August 1998
pp. 20853
Software quality engineering is concerned with building software products with required quality and assessing the level of quality. Software processes are important assets in achieving and assessing the software quality. Furthermore the adherence to define...
 
Defect Content Estimations from Review Data
Found in: Software Engineering, International Conference on
By Claes Wohlin, Per Runeson
Issue Date:April 1998
pp. 400
No summary available.
 
Test Benchmarks -- what is the question?
Found in: Software Testing Verification and Validation Workshop, IEEE International Conference on
By Per Runeson, Mats Skoglund, Emelie Engström
Issue Date:April 2008
pp. 369-371
Kids do not grow very old until they begin benchmarking. They benchmark to impress on their mates and to give themselves a position in the group. But what does the benchmark mean when the child wants to reach the cookies on the top shelf of the larder? Alt...
 
Supporting Regression Test Scoping with Visual Analytics
Found in: 2014 IEEE Seventh International Conference on Software Testing, Verification and Validation (ICST)
By Emelie Engstrom,Mika Mantyla,Per Runeson,Markus Borg
Issue Date:March 2014
pp. 283-292
Background: Test managers have to repeatedly select test cases for test activities during evolution of large software systems. Researchers have widely studied automated test scoping, but have not fully investigated decision support with human interaction. ...
 
V-GQM: A Feed-Back Approach to Validation of a GQM Study
Found in: Software Metrics, IEEE International Symposium on
By Thomas Olsson, Per Runeson
Issue Date:April 2001
pp. 236
The Goal/Question/Metric paradigm is used for empirical studies on software projects. Support is given on how to define and execute a study. However, the support for running several subsequent studies is poor. V-GQM introduces a life-cycle perspective, cre...
 
System Level Mutation Analysis Applied to a State-Based Language
Found in: Engineering of Computer-Based Systems, IEEE International Conference on the
By Thomas Olsson, Per Runeson
Issue Date:April 2001
pp. 0222
Abstract: One of the great challenges within software testing is to know if a test suite covers a program sufficiently. Mutation analysis is presented as an approach to address that challenge. Faulty versions, or mutants, are created and it is investigated...
 
A model-based framework for flexible safety-critical software development: a design study
Found in: Proceedings of the 28th Annual ACM Symposium on Applied Computing (SAC '13)
By Jesper Pedersen Notander, Martin Höst, Per Runeson
Issue Date:March 2013
pp. 1137-1144
This paper presents the findings from a design study of a model-based framework for safety-critical software development, called SimPal. The objective of the study was to better understand the necessary properties of such a framework and to learn more abou...
     
Can we evaluate the quality of software engineering experiments?
Found in: Proceedings of the 2010 ACM-IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM '10)
By Barbara Kitchenham, Dag I. K. Sjoberg, David Budgen, Dietmar Pfahl, Martin Host, O. Pearl Brereton, Per Runeson, Tore Dyba
Issue Date:September 2010
pp. 1-8
Context: The authors wanted to assess whether the quality of published human-centric software engineering experiments was improving. This required a reliable means of assessing the quality of such experiments. Aims: The aims of the study were to confirm th...
     
Empirical evaluations of regression test selection techniques: a systematic review
Found in: Proceedings of the Second ACM-IEEE international symposium on Empirical software engineering and measurement (ESEM '08)
By Emelie Engstrom, Mats Skoglund, Per Runeson
Issue Date:October 2008
pp. 1-87
Regression testing is the verification that previously functioning software remains after a change. In this paper we report on a systematic review of empirical evaluations of regression test selection techniques, published in major software engineering jou...
     
Sensitivity of software system reliability to usage profile changes
Found in: Proceedings of the 2007 ACM symposium on Applied computing (SAC '07)
By Kim Weyns, Per Runeson
Issue Date:March 2007
pp. 1440-1444
Usage profiles are an important factor in software system reliability estimation. To assess the sensitivity of a system's reliability to changes in the usage profile, a Markov based system model is used. With the help of this model, the statistical sensiti...
     
Decision support for extreme programming introduction and practice selection
Found in: Proceedings of the 14th international conference on Software engineering and knowledge engineering (SEKE '02)
By Daniel Karlstrom, Per Runeson
Issue Date:July 2002
pp. 835-841
This paper presents an investigation concerning the introduction of Extreme Programming (XP) in software development organisations. More specifically the concept of using a decision support method known as the Analytical Hierarchy Process (AHP) is evaluate...
     
 1