Selection procedures based on proportion parameters
Abstract
The data analysis component of a simulation study comparing a set of alternatives should include a confidence statement regarding the accuracy of the selection results. The usefulness of statistical ranking and selection procedures in providing such confidence statements in simulation experiments has become increasingly clear. Five general selection goals are described. Procedures are given when the alternatives are compared on the basis of proportion parameters. Statistical derivations and tables underlying these procedures are not included, but instead are appropriately referenced.
References
[1]
Amer, P. D. & Mamrak, S. A. (1978), "Statistical Methods in Computer Performance Evaluation: A Binomial Approach to the Comparison Problem", Proc. Computer Science and Statistics: Eleventh Annual Symposium on the Interface, March, 314-319.
[2]
Amer, P. D. (1979), Experimental Design for Computer Comparison and Selection, Ph.D. dissertation, The Ohio State Univ., Columbus, March.
[3]
Amer, P. D. (1980), Application of Measurement Criteria in the Selection of Interactive Computer Services, NBS Special Publication 500-58, National Bureau of Standards,Wash., D.C., April.
[4]
Amer, P. D. & Dudewicz, E. J. (1980), "Two New Goals for Selection Based on Proportions", Comm. in Statistics, A9, 14, 1461-1472.
[5]
Bechhofer, R. E. (1954), "A Single-Sample Multiple-Decision Procedure for Ranking Means of Normal Populations with Known Variances", Annals of Mathematical Statistics 25, 1, 16-39.
[6]
Carbonell, J. R., Elkind, J., & Nickerson, R. (1968), "On the Psychological Importance of Time in a Time Sharing System", Human Factors 10, 2, 135-142.
[7]
Dudewicz, E. J. & Koo, J. O. (1978), "A Categorized Bibliography on Ranking and Selection Procedures", Tech. Report 163, Dept. of Statistics, Ohio State Univ., June.
[8]
Gibbons, J. D., Olkin, I. & Sobel, M. (1977), Selecting and Ordering Populations: A New Statistical Methodology, John Wiley & Sons, New York.
[9]
Gupta, S. S., Huyett, M. J. & Sobel, M. (1957), "Selection and Ranking Problems with Binomial Populations", Transactions American Society for quality Control, Baltimore, 635-643.
[10]
Gupta, S. S. & Sobel, M. (1958), "On Selecting a Subset Containing the Best of Several Binomial Populations", Annals of Mathematical Statistics 29, 235-244.
[11]
Gupta, S. S. & Sobel, M. (1960), "Selecting a Subset Containing the Best of Several Binomial Populations", Contributions to Probability and Statistics: Essays in Honor of Harold Hotelling, (ed. Olkin et.al.), 224-248.
[12]
Highland, H. J., Sargent, R. G. & Schmidt, J. W. (eds.) (1977), Proc. 1977 Winter Simulation Conference, National Bureau of Standards, Gaithersburg, MD, December.
[13]
Kleijnen, J. P. C. (1975), Statistical Techniques in Simulation: Part II, Marcel Dekker, New York.
[14]
Mamrak, S. A. & Amer, P. D. (1979), A Methodology for the Selection of Interactive Computer Services, NBS Special Publication 500-44, National Bureau of Standards, Wash., D.C., January.
[15]
Sobel, M. & Huyett, M. J. (1957), "Selecting the Best One of Several Binomial Populations", Bell Systems Tech. Journal 36, March, 537-576.
Index Terms
- Selection procedures based on proportion parameters
Recommendations
Step-up and step-down procedures controlling the number and proportion of false positives
In multiple hypotheses testing, it is important to control the probability of rejecting ''true'' null hypotheses. A standard procedure has been to control the family-wise error rate (FWER), the probability of rejecting at least one true null hypothesis. ...
Indifference zone selection procedures: inferences from indifference-zone selection procedures
WSC '03: Proceedings of the 35th conference on Winter simulation: driving innovationTwo-stage indifference-zone selection procedures have been widely studied and applied. It is known that most indifference-zone selection procedures also guarantee multiple comparisons with the best confidence intervals with half-width corresponding to ...
New procedures for selection among (simulated) alternatives
WSC '77: Proceedings of the 9th conference on Winter simulation - Volume 1“Ranking and selection” procedures were developed for use in situations where the experimenter's goal is to “select the best” (selection) or to “rank competing alternatives” (ranking). These are typical goals when a simulation study is performed, often ...
Comments
Information & Contributors
Information
Published In
Sponsors
- DOE: Department of Energy
- AIIE: AIIE
- ORSA: Operations Research Society of America
- SCS: Society for Computer Simulation
- TIMS
- SIGSIM: ACM Special Interest Group on Simulation and Modeling
- IEEE: Institute of Electrical and Electronics Engineers
Publisher
IEEE Press
Publication History
Published: 01 January 1980
Check for updates
Qualifiers
- Article
Acceptance Rates
Overall Acceptance Rate 3,413 of 5,075 submissions, 67%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 112Total Downloads
- Downloads (Last 12 months)31
- Downloads (Last 6 weeks)7
Reflects downloads up to 16 Jan 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in