Issue No.06 - June (2006 vol.55)
Ajay Joshi , IEEE
Aashish Phansalkar , IEEE
Lizy Kurian John , IEEE
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/TC.2006.85
This paper proposes a methodology for measuring the similarity between programs based on their inherent microarchitecture-independent characteristics, and demonstrates two applications for it: 1) finding a representative subset of programs from benchmark suites and 2) studying the evolution of four generations of SPEC CPU benchmark suites. Using the proposed methodology, we find a representative subset of programs from three popular benchmark suites—SPEC CPU2000, MediaBench, and MiBench. We show that this subset of representative programs can be effectively used to estimate the average benchmark suite IPC, L1 data cache miss-rates, and speedup on 11 machines with different ISAs and microarchitectures—this enables one to save simulation time with little loss in accuracy. From our study of the similarity between the four generations of SPEC CPU benchmark suites, we find that, other than a dramatic increase in the dynamic instruction count and increasingly poor temporal data locality, the inherent program characteristics have more or less remained unchanged.
Measurement techniques, modeling techniques, performance of systems, performance attributes.
Ajay Joshi, Aashish Phansalkar, Lieven Eeckhout, Lizy Kurian John, "Measuring Benchmark Similarity Using Inherent Program Characteristics", IEEE Transactions on Computers, vol.55, no. 6, pp. 769-782, June 2006, doi:10.1109/TC.2006.85