research-article

Free access

A benchmark study

Author:

J. C. StraussAuthors Info & Claims

AFIPS '72 (Fall, part II): Proceedings of the December 5-7, 1972, fall joint computer conference, part II

Pages 1225 - 1233

https://doi.org/10.1145/1480083.1480162

Published: 05 December 1972 Publication History

PDF eReader

Abstract

Several recent articles speak to the problems involved in computer system performance evaluation in general and performance prediction for system selection in particular. The interest in this general area is growing in an almost exponential manner as demonstrated by the number of references per year for the period 1965 to 1969 listed in a recent bibliography on Computer Performance Analysis by Miller:³ 6, 9, 28, 32, 42. However, while there is considerable general discussion in this referenced literature on the relative merits of benchmarking as a technique for system evaluation and selection, there are virtually no documented case studies of benchmarking for third generation, multiprogramming oriented system selection.

References

[1]

H C Lucas Jr Performance evaluation and monitoring Computing Surveys Vol 3 No 3 1971

Digital Library

Google Scholar

[2]

M E Drummond Jr A perspective on system performance evaluation IMB Systems Journal Vol 9 No 4 1969

Google Scholar

[3]

E F Miller Jr Bibliography on techniques of computer performance analysis General Research Corporation Report P O Box 3587 Santa Barbara California 93105

Google Scholar

[4]

M D Draper R C Milton Univac 1108 evaluation plan Technical Report No 13 University of Wisconsin Computing Center Madison Wisconsin March 1970

Google Scholar

Cited By

View all

Bogott RFranklin M(2006)Evaluation of markov program models in virtual memory systemsSoftware: Practice and Experience10.1002/spe.43800504045:4(337-346)Online publication date: 27-Oct-2006
https://doi.org/10.1002/spe.4380050404
Clark JGolladay R(1980)Empirical investigation of the effectiveness of several computer performance evaluation toolsACM SIGMETRICS Performance Evaluation Review10.1145/1041883.10418849:3(31-36)Online publication date: 1-Sep-1980
https://dl.acm.org/doi/10.1145/1041883.1041884
Mamrak SAbrams M(1979)Special FeatureComputer10.1109/MC.1979.165857712:12(60-65)Online publication date: 1-Dec-1979
https://dl.acm.org/doi/10.1109/MC.1979.1658577
Show More Cited By

Recommendations

How to Build a Benchmark
ICPE '15: Proceedings of the 6th ACM/SPEC International Conference on Performance Engineering

Standardized benchmarks have become widely accepted tools for the comparison of products and evaluation of methodologies. These benchmarks are created by consortia like SPEC and TPC under confidentiality agreements which provide little opportunity for ...
Subsetting the SPEC CPU2006 benchmark suite

On August 24, 2006, the Standard Performance Evaluation Corporation (SPEC) announced CPU2006 -- the next generation of industry-standardized CPU-intensive benchmark suite. The SPEC CPU benchmark suite has become the most frequently used suite for ...
A Comprehensive Java Benchmark Study on Memory and Garbage Collection Behavior of DaCapo, DaCapo Scala, and SPECjvm2008
ICPE '17: Proceedings of the 8th ACM/SPEC on International Conference on Performance Engineering

Benchmark suites are an indispensable part of scientific research to compare different approaches against each another. The diversity of benchmarks is an important asset to evaluate novel approaches for effectiveness and weaknesses. In this paper, we ...

Comments

Information & Contributors

Information

Published In

AFIPS '72 (Fall, part II): Proceedings of the December 5-7, 1972, fall joint computer conference, part II

December 1972

692 pages

ISBN:9781450379137

DOI:10.1145/1480083

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 December 1972

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
148
Total Downloads

Downloads (Last 12 months)52
Downloads (Last 6 weeks)9

Reflects downloads up to 28 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Bogott RFranklin M(2006)Evaluation of markov program models in virtual memory systemsSoftware: Practice and Experience10.1002/spe.43800504045:4(337-346)Online publication date: 27-Oct-2006
https://doi.org/10.1002/spe.4380050404
Clark JGolladay R(1980)Empirical investigation of the effectiveness of several computer performance evaluation toolsACM SIGMETRICS Performance Evaluation Review10.1145/1041883.10418849:3(31-36)Online publication date: 1-Sep-1980
https://dl.acm.org/doi/10.1145/1041883.1041884
Mamrak SAbrams M(1979)Special FeatureComputer10.1109/MC.1979.165857712:12(60-65)Online publication date: 1-Dec-1979
https://dl.acm.org/doi/10.1109/MC.1979.1658577
Oliver PBaird GCook MJohnson AHoyt P(1974)An experiment in the use of synthetic programs for system benchmarkingProceedings of the May 6-10, 1974, national computer conference and exposition10.1145/1500175.1500265(431-438)Online publication date: 6-May-1974
https://dl.acm.org/doi/10.1145/1500175.1500265

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Recommendations

How to Build a Benchmark

Subsetting the SPEC CPU2006 benchmark suite

A Comprehensive Java Benchmark Study on Memory and Garbage Collection Behavior of DaCapo, DaCapo Scala, and SPECjvm2008

Comments

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Qualifiers

Other Metrics

Article Metrics

Other Metrics

Cited By

PDF

eReader

Login options

Full Access

Abstract

References

Cited By

Recommendations

How to Build a Benchmark

Subsetting the SPEC CPU2006 benchmark suite

A Comprehensive Java Benchmark Study on Memory and Garbage Collection Behavior of DaCapo, DaCapo Scala, and SPECjvm2008

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

PDF

eReader

Login options

Full Access

Share

Share this Publication link

Share on social media

Affiliations