Issue No. 06 - June (2006 vol. 55)
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/TC.2006.85
Lizy Kurian John , IEEE
Ajay Joshi , IEEE
Aashish Phansalkar , IEEE
This paper proposes a methodology for measuring the similarity between programs based on their inherent microarchitecture-independent characteristics, and demonstrates two applications for it: 1) finding a representative subset of programs from benchmark suites and 2) studying the evolution of four generations of SPEC CPU benchmark suites. Using the proposed methodology, we find a representative subset of programs from three popular benchmark suites—SPEC CPU2000, MediaBench, and MiBench. We show that this subset of representative programs can be effectively used to estimate the average benchmark suite IPC, L1 data cache miss-rates, and speedup on 11 machines with different ISAs and microarchitectures—this enables one to save simulation time with little loss in accuracy. From our study of the similarity between the four generations of SPEC CPU benchmark suites, we find that, other than a dramatic increase in the dynamic instruction count and increasingly poor temporal data locality, the inherent program characteristics have more or less remained unchanged.
Measurement techniques, modeling techniques, performance of systems, performance attributes.
Lieven Eeckhout, Lizy Kurian John, Ajay Joshi, Aashish Phansalkar, "Measuring Benchmark Similarity Using Inherent Program Characteristics", IEEE Transactions on Computers, vol. 55, no. , pp. 769-782, June 2006, doi:10.1109/TC.2006.85