The Community for Technology Leaders
RSS Icon
Subscribe
Rio Rico, Arizona
Mar. 28, 1999 to Mar. 30, 1999
ISBN: 0-7695-0237-7
pp: 102
Margo Seltzer , Harvard University
David Krinsky , Harvard University
Keith Smith , Harvard University
Xiaolan Zhang , Harvard University
ABSTRACT
Most performance analysis today uses either microbenchmarks or standard macrobenchmarks (e.g., SPEC, LADDIS, the Andrew benchmark). However, the results of such benchmarks provide little information to indicate how well a particular system will handle a particular application. Such results are, at best, useless and, at worst, misleading. In this paper, we argue for an application-directed approach to benchmarking, using performance metrics that reflect the expected behavior of a particular application across a range of hardware or software platforms. We present three different approaches to application-specific measurement, one using vectors that characterize both the underlying system and an application, one using trace-driven techniques, and a hybrid approach. We argue that such techniques should become the new standard.
INDEX TERMS
benchmark, performance, application-specific, measurement
CITATION
Margo Seltzer, David Krinsky, Keith Smith, Xiaolan Zhang, "The Case for Application-Specific Benchmarking", HOTOS, 1999, Hot Topics in Operating Systems, Workshop on, Hot Topics in Operating Systems, Workshop on 1999, pp. 102, doi:10.1109/HOTOS.1999.798385
14 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool