Using Resampling Techniques to Compute Confidence Intervals for the Harmonic Mean of Rate-Based Performance Metrics
Issue No. 01 - January-June (2010 vol. 9)
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/L-CA.2010.1
David J. Lilja , University of Minnesota, Minneapolis
Shruti Patil , University of Minnesota Twin Cities, Minneapolis
Rate-based metrics such as floating point operations per second, instructions per cycle and so forth are commonly used to measure computer performance. In addition to the average or mean performance of the metric, indicating the precision of the mean using confidence intervals helps to make informed decisions and comparisons with the data. In this paper, we discuss the determination of confidence intervals for the harmonic mean of rate-based metrics using two statistical resampling techniques - Jackknife and Bootstrap. We show using Monte Carlo simulations that resampling indeed works as expected, and can be used for generating confidence intervals for harmonic mean.
Performance of Systems, Nonparametric statistics
David J. Lilja, Shruti Patil, "Using Resampling Techniques to Compute Confidence Intervals for the Harmonic Mean of Rate-Based Performance Metrics", IEEE Computer Architecture Letters, vol. 9, no. , pp. 1-4, January-June 2010, doi:10.1109/L-CA.2010.1