Empirical Software Engineering, International Symposium on (2005)
Noosa Heads, Qld.
Nov. 18, 2005 to Nov. 18, 2005
pp: 10 pp.
F. Shull , Fraunhofer Center, MD, USA
The development of high-performance computing (HPC) programs is crucial to progress in many fields of scientific endeavor. We have run initial studies of the productivity of HPC developers and of techniques for improving that productivity, which have not previously been the subject of significant study. Because of key differences between development for HPC and for more conventional software engineering applications, this work has required the tailoring of experimental designs and protocols. A major contribution of our work is to begin to quantify the code development process in a specialized area that has previously not been extensively studied. Specifically, we present an analysis of the domain of high-performance computing for the aspects that would impact experimental design; show how those aspects are reflected in experimental design for this specific area; and demonstrate how we are using such experimental designs to build up a body of knowledge specific to the domain. Results to date build confidence in our approach by showing that there are no significant differences across studies comparing subjects with similar experience tackling similar problems, while there are significant differences in performance and effort among the different parallel models applied.
experimental designs, high-performance computing, HPC developer productivity, software engineering, code development process, parallel models
F. Shull, L. Hochstein, V. Basili, J. Carver, "Empirical study design in the area of high-performance computing (HPC)", Empirical Software Engineering, International Symposium on, vol. 00, no. , pp. 10 pp., 2005, doi:10.1109/ISESE.2005.1541839