The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.06 - November/December (2010 vol.30)
pp: 57-65
Luk Van Ertvelde , Ghent University, Ghent
Lieven Eeckhout , Ghent University, Gent
ABSTRACT
<p>Benchmarking is a fundamental aspect of computer system design. Recently proposed workload reduction and generation techniques include input reduction, sampling, code mutation, and benchmark synthesis. The authors discuss and compare these techniques along several criteria: whether they yield representative and short-running benchmarks, whether they can be used for both architecture and compiler explorations, and whether they hide proprietary information.</p>
INDEX TERMS
workload characterization, workload generation, workload reduction, benchmarking
CITATION
Luk Van Ertvelde, Lieven Eeckhout, "Workload Reduction and Generation Techniques", IEEE Micro, vol.30, no. 6, pp. 57-65, November/December 2010, doi:10.1109/MM.2010.97
REFERENCES
1. A.J. KleinOsowski and D.J. Lilja, "MinneSPEC: A New SPEC Benchmark Workload for Simulation-based Computer Architecture Research," Computer Architecture Letters, vol. 1, no. 2, June 2002, pp. 10-13.
2. L. Eeckhout, H. Vandierendonck, and K. De Bosschere, "Designing Workloads for Computer Architecture Research," Computer, vol. 36, no. 2, Feb. 2003, pp. 65-71.
3. T.M. Conte, M.A. Hirsch, and K.N. Menezes, "Reducing State Loss for Effective Trace Sampling of Superscalar Processors," Proc. Int'l Conf. Computer Design (ICCD 96), IEEE CS Press, 1996, pp. 468-477.
4. R.E. Wunderlich et al., "Smarts: Accelerating Microarchitecture Simulation via Rigorous Statistical Sampling," Proc. Ann. Int'l Symp. Computer Architecture (ISCA 03), ACM Press, 2003, pp. 84-95.
5. T. Sherwood et al., "Automatically Characterizing Large Scale Program Behavior," Proc. Int'l Conf. Architectural Support for Programming Languages and Operating Systems (ASPLOS 02), ACM Press, 2002, pp. 45-57.
6. M. Van Biesbrouck, B. Calder, and L. Eeckhout, "Efficient Sampling Startup for SimPoint," IEEE Micro, vol. 26, no. 4, July 2006, pp. 32-42.
7. T.F. Wenisch et al., "Simulation Sampling with Live-points," Proc. Ann. Int'l Symp. Performance Analysis of Systems and Software (ISPASS 06), IEEE Press, 2006, pp. 2-12.
8. J. Ringenberg et al., "Intrinsic Checkpointing: A Methodology for Decreasing Simulation Time through Binary Modification," Proc. IEEE Int'l Symp. Performance Analysis of Systems and Software (ISPASS 05), IEEE Press, 2005, pp. 78-88.
9. E. Perelman et al., "Cross Binary Simulation Points," Proc. Ann. Int'l Symp. Performance Analysis of Systems and Software (ISPASS 07), IEEE Press, 2007, pp. 179-189.
10. L. Van Ertvelde and L. Eeckhout, "Dispersing Proprietary Applications as Benchmarks through Code Mutation," Proc. Int'l Conf. Architectural Support for Programming Languages and Operating Systems (ASPLOS 08), ACM Press, 2008, pp. 201-210.
11. T. Karkhanis and J.E. Smith, "A First-order Superscalar Processor Model," Proc. Ann. Int'l Symp. Computer Architecture (ISCA 04), ACM Press, 2004, pp. 338-349.
12. C.-K. Luk et al., "Pin: Building Customized Program Analysis Tools with Dynamic Instrumentation," Proc. ACM SIGPLAN Conf. Programming Languages Design and Implementation (PLDI 05), ACM Press, 2005, pp. 190-200.
13. M. Weiser, "Program Slicing," IEEE Trans. Software Eng., vol. 10, no. 4, July 1984, pp. 352-357.
14. L. Van Ertvelde and L. Eeckhout, "Benchmark Synthesis for Architecture and Compiler Exploration," Proc. IEEE Int'l Symp. Workload Characterization (IISWC 10), IEEE Press, 2010, to appear.
15. K.D. Cooper, P.J. Schielke, and D. Subramanian, "Optimizing for Reduced Code Space Using Genetic Algorithms," Proc. SIGPLAN/SIGBED Conf. Languages, Compilers, and Tools for Embedded Systems (LCTES 99), ACM Press, 1999, pp. 1-9.
16. P. Kulkarni et al., "Fast Searches for Effective Optimization Phase Sequences," Proc. ACM SIGPLAN Conf. Programming Language Design and Implementation (PLDI 04), ACM Press, 2004, pp. 171-182.
17. T.F. Wenisch et al., "SimFlex: Statistical Sampling of Computer System Simulation," IEEE Micro, vol. 26, no. 4, July 2006, pp. 18-31.
6 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool