The Community for Technology Leaders
2013 ACM / IEEE International Symposium on Empirical Software Engineering and Measurement (2013)
Baltimore, MD USA
Oct. 10, 2013 to Oct. 11, 2013
ISSN: 1938-6451
ISBN: 978-0-7695-5056-5
TABLE OF CONTENTS

Cover Art (PDF)

pp. C4

Title Page i (PDF)

pp. i

Title Page iii (PDF)

pp. iii

Copyright Page (PDF)

pp. iv

Table of Contents (PDF)

pp. v-viii

High impact research: Blending basic and applied methods (Abstract)

Ben Shneiderman , Univ. of Maryland, College Park, MD, USA
pp. 3

Towards understanding replication of software engineering experiments (Abstract)

Natalia Juristo , Univ. Politec. de Madrid, Madrid, Spain
pp. 4

An Empirical Study of API Usability (Abstract)

Marco Piccioni , Dept. of Software Eng., ETH Zurich, Zurich, Switzerland
Carlo A. Furia , Dept. of Software Eng., ETH Zurich, Zurich, Switzerland
Bertrand Meyer , Dept. of Software Eng., ETH Zurich, Zurich, Switzerland
pp. 5-14

Real Challenges in Mobile App Development (Abstract)

Mona Erfani Joorabchi , Univ. of British Columbia, Vancouver, BC, Canada
Ali Mesbah , Univ. of British Columbia, Vancouver, BC, Canada
Philippe Kruchten , Univ. of British Columbia, Vancouver, BC, Canada
pp. 15-24

Tracing Requirements and Source Code during Software Development: An Empirical Study (Abstract)

Alexander Delater , Inst. of Comput. Sci., Univ. of Heidelberg, Heidelberg, Germany
Barbara Paech , Inst. of Comput. Sci., Univ. of Heidelberg, Heidelberg, Germany
pp. 25-34

Automatic Checking of Conformance to Requirement Boilerplates via Text Chunking: An Industrial Case Study (Abstract)

Chetan Arora , SnT Centre for Security, Univ. of Luxembourg, Luxembourg, Luxembourg
Mehrdad Sabetzadeh , SnT Centre for Security, Univ. of Luxembourg, Luxembourg, Luxembourg
Lionel Briand , SnT Centre for Security, Univ. of Luxembourg, Luxembourg, Luxembourg
Frank Zimmer , SES TechCom, Luxembourg, Luxembourg
Raul Gnaga , SES TechCom, Luxembourg, Luxembourg
pp. 35-44

Learning from Open-Source Projects: An Empirical Study on Defect Prediction (Abstract)

Zhimin He , Lab. for Internet Software Technol., Inst. of Software, Beijing, China
Fayola Peters , Lane Dept. of CS & EE, West Virginia Univ. Morgantown, Morgantown, WV, USA
Tim Menzies , Lane Dept. of CS & EE, West Virginia Univ. Morgantown, Morgantown, WV, USA
Ye Yang , Lab. for Internet Software Technol., Inst. of Software, Beijing, China
pp. 45-54

An Empirical Study of Client-Side JavaScript Bugs (Abstract)

Frolin Ocariza , Univ. of British Columbia, Vancouver, BC, Canada
Kartik Bajaj , Univ. of British Columbia, Vancouver, BC, Canada
Karthik Pattabiraman , Univ. of British Columbia, Vancouver, BC, Canada
Ali Mesbah , Univ. of British Columbia, Vancouver, BC, Canada
pp. 55-64

When a Patch Goes Bad: Exploring the Properties of Vulnerability-Contributing Commits (Abstract)

Andrew Meneely , Dept. of Software Eng., Rochester Inst. of Technol., Rochester, NY, USA
Harshavardhan Srinivasan , Dept. of Software Eng., Rochester Inst. of Technol., Rochester, NY, USA
Ayemi Musa , Dept. of Software Eng., Rochester Inst. of Technol., Rochester, NY, USA
Alberto Rodriguez Tejeda , Dept. of Software Eng., Rochester Inst. of Technol., Rochester, NY, USA
Matthew Mokary , Dept. of Software Eng., Rochester Inst. of Technol., Rochester, NY, USA
Brian Spates , Dept. of Software Eng., Rochester Inst. of Technol., Rochester, NY, USA
pp. 65-74

Have Agile Techniques been the Silver Bullet for Software Development at Microsoft? (Abstract)

Brendan Murphy , Microsoft Res., Cambridge, UK
Christian Bird , Microsoft Res., Redmond, WA, USA
Thomas Zimmermann , Microsoft Res., Redmond, WA, USA
Laurie Williams , NCSU, Raleigh, NC, USA
Nachiappan Nagappan , Microsoft Res., Redmond, WA, USA
Andrew Begel , Microsoft Res., Redmond, WA, USA
pp. 75-84

ScrumBut, But Does it Matter? A Mixed-Method Study of the Planning Process of a Multi-team Scrum Organization (Abstract)

Ville T. Heikkila , Dept. of Comput. Sci. & Eng., Aalto Univ., Helsinki, Finland
Maria Paasivaara , Dept. of Comput. Sci. & Eng., Aalto Univ., Helsinki, Finland
Casper Lassenius , Dept. of Comput. Sci. & Eng., Aalto Univ., Helsinki, Finland
pp. 85-94

Obstacles to Efficient Daily Meetings in Agile Development Projects: A Case Study (Abstract)

Viktoria Gulliksen Stray , Dept. of Inf., Univ. of Oslo, Oslo, Norway
Yngve Lindsjorn , Dept. of Inf., Univ. of Oslo, Oslo, Norway
Dag I. K. Sjoberg , Dept. of Inf., Univ. of Oslo, Oslo, Norway
pp. 95-102

A Replicated Experiment on the Effectiveness of Test-First Development (Abstract)

Davide Fucci , Dept. of Inf. Process. Sci., Univ. of Oulu, Oulu, Finland
Burak Turhan , Dept. of Inf. Process. Sci., Univ. of Oulu, Oulu, Finland
pp. 103-112

How Significant is the Effect of Fault Interactions on Coverage-Based Fault Localizations? (Abstract)

Xiaozhen Xue , Dept. of Comput. Sci., Texas Tech Univ., Lubbock, TX, USA
Akbar Siami Namin , Dept. of Comput. Sci., Texas Tech Univ., Lubbock, TX, USA
pp. 113-122

Impact of Peer Code Review on Peer Impression Formation: A Survey (Abstract)

Amiangshu Bosu , Dept. of Comput. Sci., Univ. of Alabama, Tuscaloosa, AL, USA
Jeffrey C. Carver , Dept. of Comput. Sci., Univ. of Alabama, Tuscaloosa, AL, USA
pp. 133-142

Lessons from Conducting a Distributed Quasi-experiment (Abstract)

David Budgen , Sch. of Eng. & Comput. Sci., Durham Univ., Durham, UK
Barbara Kitchenham , Sch. of Comput. & Math., Keele Univ., Keele, UK
Stuart Charters , Dept. of Appl. Comput., Lincoln Univ., Lincoln, New Zealand
Shirley Gibbs , Sch. of Eng. & Comput. Sci., Durham Univ., Durham, UK
Amnart Pohthong , Prince of Songkla Univ., Songkhla, Thailand
Jacky Keung , Hong Kong City Univ., Hong Kong, China
Pearl Brereton , Sch. of Comput. & Math., Keele Univ., Keele, UK
pp. 143-152

Using Meta-ethnography to Synthesize Research: A Worked Example of the Relations between Personality and Software Team Processes (Abstract)

Fabio Q. B. Da Silva , Centre for Inf., Fed. Univ. of Pernambuco, Recife, Brazil
Shirley S. J. O. Cruz , Centre for Inf., Fed. Univ. of Pernambuco, Recife, Brazil
Tatiana B. Gouveia , Centre for Inf., Fed. Univ. of Pernambuco, Recife, Brazil
Luiz Fernando Capretz , Dept. of Electr. & Comput. Eng., Univ. of Western Ontario, London, ON, Canada
pp. 153-162

An Experimental Comparison of Two Risk-Based Security Methods (Abstract)

Katsiaryna Labunets , DISI, Univ. of Trento Trento, Trento, Italy
Fabio Massacci , DISI, Univ. of Trento Trento, Trento, Italy
Federica Paci , DISI, Univ. of Trento Trento, Trento, Italy
Le Minh Sang Tran , DISI, Univ. of Trento Trento, Trento, Italy
pp. 163-172

Using Ensembles for Web Effort Estimation (Abstract)

Damir Azhar , Dept. of Comput. Sci., Univ. of Auckland, Auckland, New Zealand
Patricia Riddle , Dept. of Comput. Sci., Univ. of Auckland, Auckland, New Zealand
Emilia Mendes , Sch. of Comput., Blekinge Inst. of Technol., Karlskrona, Sweden
Nikolaos Mittas , Dept. of Inf., Aristotle Univ. of Thessaloniki, Thessaloniki, Greece
Lefteris Angelis , Dept. of Inf., Aristotle Univ. of Thessaloniki, Thessaloniki, Greece
pp. 173-182

Benchmarking Usability and Performance of Multicore Languages (Abstract)

Sebastian Nanz , ETH Zurich, Zurich, Switzerland
Scott West , ETH Zurich, Zurich, Switzerland
Kaue Soares Da Silveira , Google Inc., Zurich, Switzerland
Bertrand Meyer , ETH Zurich, Zurich, Switzerland
pp. 183-192

DevNet: Exploring Developer Collaboration in Heterogeneous Networks of Bug Repositories (Abstract)

Song Wang , Lab. for Internet Software Technol., Inst. of Software, Beijing, China
Wen Zhang , Lab. for Internet Software Technol., Inst. of Software, Beijing, China
Ye Yang , Lab. for Internet Software Technol., Inst. of Software, Beijing, China
Qing Wang , Lab. for Internet Software Technol., Inst. of Software, Beijing, China
pp. 193-202

Identifying Barriers to the Systematic Literature Review Process (Abstract)

Jeffrey C. Carver , Dept. of Comput. Sci., Univ. of Alabama, Tuscaloosa, AL, USA
Edgar Hassler , Dept. of Inf. Syst., Stat., & Manage. Sci., Univ. of Alabama, Tuscaloosa, AL, USA
Elis Hernandes , LaPES - Software Eng. Res. Lab., Fed. Univ. of Sao Carlos, Sao Carlos, Brazil
Nicholas A. Kraft , Dept. of Comput. Sci., Univ. of Alabama, Tuscaloosa, AL, USA
pp. 203-212

Identifying Experimental Incidents in Software Engineering Replications (Abstract)

Martin Solari , Univ. ORT Uruguay, Montevideo, Uruguay
pp. 213-222

Experimental Comparison of Two Safety Analysis Methods and Its Replication (Abstract)

Jessica Jung , Fraunhofer IESE, Kaiserslautern, Germany
Kai Hoefig , Univ. of Kaiserslautern, Kaiserslautern, Germany
Dominik Domis , Ind. Software Syst. Program, ABB Corp. Res. Germany, Ladenburg, Germany
Andreas Jedlitschka , Fraunhofer IESE, Kaiserslautern, Germany
Martin Hiller , Cassidian, Ulm, Germany
pp. 223-232

Replication Data Management: Needs and Solutions -- An Initial Evaluation of Conceptual Approaches for Integrating Heterogeneous Replication Study Data (Abstract)

Stefan Biffl , Inst. of Software Technol. & Interactive Syst. CDL-Flex, Vienna Univ. of Technol., Vienna, Austria
Estefania Serral , Inst. of Software Technol. & Interactive Syst. CDL-Flex, Vienna Univ. of Technol., Vienna, Austria
Dietmar Winkler , Inst. of Software Technol. & Interactive Syst. CDL-Flex, Vienna Univ. of Technol., Vienna, Austria
Oscar Dieste , Fac. de Inf., Univ. Politec. de Madrid, Boadilla del Monte, Spain
Natalia Juristo , Fac. de Inf., Univ. Politec. de Madrid, Boadilla del Monte, Spain
Nelly Condori-Fernández , ProS Res. Center, Univ. Politec. de Valencia, Valencia, Spain
pp. 233-242

IR in Software Traceability: From a Bird's Eye View (Abstract)

Markus Borg , Dept. of Comput. Sci., Lund Univ., Lund, Sweden
Per Runeson , Dept. of Comput. Sci., Lund Univ., Lund, Sweden
pp. 243-246

Impact of Triage: A Study of Mozilla and Gnome (Abstract)

Jialiang Xie , Sch. of Electron. Eng. & Comput. Sci., Peking Univ., Beijing, China
Minghui Zhou , Sch. of Electron. Eng. & Comput. Sci., Peking Univ., Beijing, China
Audris Mockus , Avaya Labs. Res., Basking Ridge, NY, USA
pp. 247-250

On the Use of Input/Output Queries for Code Search (Abstract)

Kathryn T. Stolee , Dept. of Comput. Sci., Iowa State Univ., Ames, IA, USA
Sebastian Elbaum , Dept. of Comput. Sci. & Eng., Univ. of Nebraska-Lincoln, Lincoln, NE, USA
pp. 251-254

An Embedded Multiple-Case Study on OSS Design Quality Assessment across Domains (Abstract)

Apostolos Ampatzoglou , Dept. of Math. & Comput. Sci., Univ. of Groningen, Groningen, Netherlands
Antonios Gkortzis , Dept. of Math. & Comput. Sci., Univ. of Groningen, Groningen, Netherlands
Sofia Charalampidou , Dept. of Math. & Comput. Sci., Univ. of Groningen, Groningen, Netherlands
Paris Avgeriou , Dept. of Math. & Comput. Sci., Univ. of Groningen, Groningen, Netherlands
pp. 255-258

Evaluating Software Product Metrics with Synthetic Defect Data (Abstract)

Jeffrey Stuckman , Dept. of Comput. Sci., Univ. of Maryland, College Park, MD, USA
Kent Wills , Dept. of Comput. Sci., Univ. of Maryland, College Park, MD, USA
James Purtilo , Dept. of Comput. Sci., Univ. of Maryland, College Park, MD, USA
pp. 259-262

The Case for Knowledge Translation (Abstract)

David Budgen , Sch. of Eng. & Comput. Sci., Durham Univ., Durham, UK
Barbara Kitchenham , Sch. of Comput. & Math., Keele Univ., Keele, UK
Pearl Brereton , Sch. of Comput. & Math., Keele Univ., Keele, UK
pp. 263-266

Understanding the Impact of Artefact-Based RE -- Design of a Replication Study (Abstract)

Birgit Penzenstadler , Inst. for Software Res., Univ. of California, Irvine, Irvine, CA, USA
Daniel Mendez Fernandez , Inst. fur Inf., Tech. Univ. Munchen, Munich, Germany
Jonas Eckhardt , Inst. fur Inf., Tech. Univ. Munchen, Munich, Germany
pp. 267-270

An Empirical Validation of Coupling Metrics Using Automated Refactoring (Abstract)

Varsha Veerappa , Oxford Brookes Univ., Oxford, UK
Rachel Harrison , Oxford Brookes Univ., Oxford, UK
pp. 271-274

Using Amazon's Mechanical Turk for User Studies: Eight Things You Need to Know (Abstract)

Lucas Layman , Fraunhofer Center for Exp. Software Eng., College Park, MD, USA
Gunnar Sigurdsson , Sch. of Comput. Sci., Reykjavik Univ., Reykjavik, Iceland
pp. 275-278

Would Sociable Software Engineers Observe Better? (Abstract)

Rafael M. de Mello , ESE Group/ COPPE, Univ. Fed. do Rio de Janeiro, Rio de Janeiro, Brazil
Guilherme H. Travassos , ESE Group/ COPPE, Univ. Fed. do Rio de Janeiro, Rio de Janeiro, Brazil
pp. 279-282

Incremental Estimation of Project Failure Risk with Naive Bayes Classifier (Abstract)

Toshiki Mori , Corp. Software Eng. Center, Toshiba Corp., Kawasaki, Japan
Shurei Tamura , Corp. Software Eng. Center, Toshiba Corp., Kawasaki, Japan
Shingo Kakui , Corp. Software Eng. Center, Toshiba Corp., Kawasaki, Japan
pp. 283-286

Classification of Language Interactions (Abstract)

Federico Tomassetti , Dept. of Control & Comput. Eng., Politec. di Torino, Turin, Italy
Marco Torchiano , Dept. of Control & Comput. Eng., Politec. di Torino, Turin, Italy
Antonio Vetro , Dept. of Control & Comput. Eng., Politec. di Torino, Turin, Italy
pp. 287-290

CCM: A Tool for Measuring Combinatorial Coverage of System State Space (Abstract)

Itzel Dominguez Mendoza , Centro Nac. de Metrol., Santiago de Queretaro, Mexico
D. Richard Kuhn , Nat. Inst. of Stand. & Technol., Gaithersburg, MD, USA
Raghu N. Kacker , Nat. Inst. of Stand. & Technol., Gaithersburg, MD, USA
Yu Lei , Comput. Sci. & Eng., Univ. of Texas, Arlington, TX, USA
pp. 291

Motivation to Perform Systematic Reviews and their Impact on Software Engineering Practice (Abstract)

Ronnie E. S. Santos , Centre for Inf. (CIn), Fed. Univ. of Pernambuco (UFPE), Recife, Brazil
Fabio Q. B. Da Silva , Centre for Inf. (CIn), Fed. Univ. of Pernambuco (UFPE), Recife, Brazil
pp. 292-295

Tools to Support Systematic Literature Reviews in Software Engineering: A Mapping Study (Abstract)

Christopher Marshall , Sch. of Comput. & Math., Keele Univ., Keele, UK
Pearl Brereton , Sch. of Comput. & Math., Keele Univ., Keele, UK
pp. 296-299

Can Automated Text Classification Improve Content Analysis of Software Project Data? (Abstract)

John Noll , Irish Software Eng. Res. Centre, Univ. of Limerick, Limerick, Ireland
Dominik Seichter , Irish Software Eng. Res. Centre, Univ. of Limerick, Limerick, Ireland
Sarah Beecham , Irish Software Eng. Res. Centre, Univ. of Limerick, Limerick, Ireland
pp. 300-303

Combinatorial Testing Tool Learnability in an Industrial Environment (Abstract)

Peter M. Kruse , Berner & Mattner Systemtechnik GmbH, Berlin, Germany
Nelly Condori-Fernandez , Berner & Mattner Systemtechnik GmbH, Berlin, Germany
Tanja E. J. Vos , ProS Res. Center, Univ. Politec. de Valencia, Valencia, Spain
Alessandra Bagnato , R&D Dept., SOFTEAM, Guyancourt, France
Etienne Brosse , Inf. Syst. Group2, Univ. of Twente Enschede, Enschede, Netherlands
pp. 304-312

Recommendations to the Adoption of New Software Practices: A Case Study of Team Intention and Behavior in Three Software Companies (Abstract)

Carol Passos , SOLUTIS Tecnol. Dev. Center, Salvador, Brazil
Daniela S. Cruzes , Dept. of Comput. & Inf. Sci., NTNU, Trondheim, Norway
Arthur Hayne , AVN Tecnol. Dev. Center, Salvador, Brazil
Manoel Mendonca , Fraunhofer Project Center at UFBA, Salvador, Brazil
pp. 313-322

Application of Statistical Process Control to Software Defect Metrics: An Industry Experience Report (Abstract)

Carla Fernandez-Corrales , Univ. of Illinois at Urbana-Champaign, Urbana, IL, USA
Marcelo Jenkins , Univ. of Costa Rica, San Jose, Costa Rica
Jorge Villegas , Central Bank of Costa Rica, San Jose, Costa Rica
pp. 323-331

Evaluating the FITTEST Automated Testing Tools: An Industrial Case Study (Abstract)

Cu D. Nguyen , Fondazione Bruno Kessler, Trento, Italy
Bilha Mendelson , IBM Res. Lab., Haifa, Israel
Daniel Citron , IBM Res. Lab., Haifa, Israel
Onn Shehory , IBM Res. Lab., Haifa, Israel
Tanja E. J. Vos , Univ. Politec. de Valencia, Valencia, Spain
Nelly Condori-Fernandez , Univ. Politec. de Valencia, Valencia, Spain
pp. 332-339

Cost Effectiveness of Unit Testing: A Case Study in a Financial Institution (Abstract)

Diego Delgado , Financial Instn., San Jose, Costa Rica
Alexandra Martinez , Esc. de Cienc. de la Comput. e Inf., Univ. de Costa Rica San Jose, San Jose, Costa Rica
pp. 340-347

The Impact of Agile Principles and Practices on Large-Scale Software Development Projects: A Multiple-Case Study of Two Projects at Ericsson (Abstract)

Lina Lagerberg , Dept. of Comput. & Inf. Sci., Linkoping Univ., Linkoping, Sweden
Tor Skude , Dept. of Comput. & Inf. Sci., Linkoping Univ., Linkoping, Sweden
Par Emanuelsson , Dept. of Comput. & Inf. Sci., Linkoping Univ., Linkoping, Sweden
Kristian Sandahl , Dept. of Comput. & Inf. Sci., Linkoping Univ., Linkoping, Sweden
Daniel Stahl , Ericsson AB, Linkoping, Sweden
pp. 348-356

Constructing Defect Predictors and Communicating the Outcomes to Practitioners (Abstract)

Taneli Taipale , EB (Elektrobit Wireless Commun. Ltd.), Finland
Mika Qvist , Dept. of Inf. Process. Sci., Univ. of Oulu, Oulu, Finland
Burak Turhan , EB (Elektrobit Wireless Commun. Ltd.), Finland
pp. 357-362

Towards a Metric Suite Proposal to Quantify Confirmation Biases of Developers (Abstract)

Gul Calikli , Data Sci. Lab., Ryerson Univ., Toronto, ON, Canada
Ayse Bener , Data Sci. Lab., Ryerson Univ., Toronto, ON, Canada
Turgay Aytac , Prescience Inc., West New York, NJ, USA
Ovunc Bozcan , Turkcell, Istanbul, Turkey
pp. 363-372

The Value of Certifying Software Release Readiness: An Exploratory Study of Certification for a Critical System at JPL (Abstract)

Daniel Port , Dept. of Inf. Technol. Manage., Univ. of Hawaii, Honolulu, HI, USA
Joel Wilf , JPL Software Product & Process Assurance, California Inst. of Technol., Pasadena, CA, USA
pp. 373-382

Debugging Revisited: Toward Understanding the Debugging Needs of Contemporary Software Developers (Abstract)

Lucas Layman , Fraunhofer Center for Exp. Software Eng., College Park, MD, USA
Madeline Diep , Fraunhofer Center for Exp. Software Eng., College Park, MD, USA
Meiyappan Nagappan , Software Anal. & Intell. Lab. (SAIL), Queen's Univ., Kingston, ON, Canada
Janice Singer , Nat. Res. Council, Ottawa, ON, Canada
Robert Deline , Microsoft Res., Redmond, WA, USA
Gina Venolia , Microsoft Res., Redmond, WA, USA
pp. 383-392

Author Index (PDF)

pp. 397-398
188 ms
(Ver 3.1 (10032016))