The Community for Technology Leaders
RSS Icon
Issue No.05 - September/October (2009 vol.29)
pp: 18-29
Jason A. Poovey , Georgia Institute of Technology
Thomas M. Conte , Georgia Institute of Technology
Markus Levy , EDN Embedded Microprocessor Benchmark Consortium
Shay Gal-On , EDN Embedded Microprocessor Benchmark Consortium
<p>Benchmark consumers expect benchmark suites to be complete, accurate, and consistent, and benchmark scores serve as relative measures of performance. However, it is important to understand how benchmarks stress the processors that they aim to test. This study explores the stress points of the EEMBC embedded benchmark suite using the benchmark characterization technique.</p>
benchmarking, benchmark characterization, embedded systems, workload characterization, EEMBC
Jason A. Poovey, Thomas M. Conte, Markus Levy, Shay Gal-On, "A Benchmark Characterization of the EEMBC Benchmark Suite", IEEE Micro, vol.29, no. 5, pp. 18-29, September/October 2009, doi:10.1109/MM.2009.74
1. T.M. Conte and W.W. Hwu, "Benchmark Characterization," Computer, vol. 24, no. 1, Jan. 1991, pp. 48-56.
2. A. Joshi et al., "Distilling the Essence of Proprietary Workloads into Miniature Benchmarks," ACM Trans. Architecture and Code Optimization (TACO), vol. 5, no. 1, 2008, article 10.
3. T.S. Karkhanis and J.E. Smith, "Automated Design of Application Specific Superscalar Processors: An Analytical Approach," Proc. 34th Ann. Int'l Symp. Computer Architecture (ISCA 07), ACM Press, 2007, pp. 402-411.
4. K. Hoste and L. Eeckhout, "Microarchitecture-Independent Workload Characterization," IEEE Micro, vol. 27, no. 3, May 2007, pp. 63-72.
5. A. Joshi et al., "Measuring Benchmark Similarity Using Inherent Program Characteristics," IEEE Trans. Computers, vol. 55, no. 6, June 2006, pp.769-782.
6. K. Hoste et al., "Performance Prediction Based on Inherent Program Similarity," Proc. 15th Int'l Conf. Parallel Architectures and Compilation Techniques (PACT 06), ACM Press, 2006, pp. 114-122.
7. T.M. Conte, M.A. Hirsch, and W.-M.W Hwu, "Combining Trace Sampling with Single Pass Methods for Efficient Cache Simulation," IEEE Trans. Computers, vol. 47, no. 6, June 1998, pp. 714-720.
8. P. Viana et al., "A Table-Based Method for Single-Pass Cache Optimization," Proc. 18th ACM Great Lakes Symp. VLSI, ACM Press, 2008, pp. 71-76.
9. A. Silva et al., "Cache-Analyzer: Design Space Evaluation of Configurable-Caches in a Single-Pass," Proc. 18th IEEE/IFIP Int'l Workshop Rapid System Prototyping (RSP 07), IEEE CS Press, 2007, pp. 3-9.
10. T.M. Conte, "Architectural Resource Requirements of Contemporary Benchmarks: A Wish List," Proc. 26th Hawaii Int'l Conf. System Sciences (HICSS 93), IEEE CS Press, 1993, pp. 517-529.
11. K.W. Kolence and P.J. Kiviat, "Software Unit Profiles &Kiviat Figures," ACM SIGMETRICS Performance Evaluation Rev., vol. 2, no. 3, 1973, pp. 2-12.
12. R. Bell Jr. and L. John, "Improved Automatic Test Case Synthesis for Performance Model Validation," Proc. Int'l Conf. Supercomputing (ICS 05), ACM Press, 2005, pp. 111-120.
13. Z. Kurmas et al., "Synthesizing Representative I/O Workloads Using Iterative Distillation," Proc. Int'l Symp. Modeling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS 03), IEEE CS Press, 2003, pp. 6-15.
14. A.M. Joshi, "Automated Microprocessor Stressmark Generation," Proc. IEEE 14th Int'l Symp. High Performance Computer Architecture (HPCA 08), IEEE CS Press, 2008, pp. 229-239.
8 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool