The controversy regarding reverse or negatively-worded survey stems has been around for several d... more The controversy regarding reverse or negatively-worded survey stems has been around for several decades. The practice has been used to guard against acquiescent or response set behaviors. A 20-item, 5-point Likert item survey was designed and the stems and response sets were varied in a 2 by 3 design. One independent variable was type of item stem: one level had all direct-worded stems and the other had, randomly determined, half direct and half reverse-worded stems. The other independent variable was response set type. One level had all response sets going "strongly disagree" (SD) to "strongly agree" (SA), one had all response sets going SA to SD, and the third had, randomly determined, half going SD to SA and half going SA to SD. The surveys were administered to 687 subjects. The form each subject received was determined randomly. Responses were scored so that all were in agreement with the direct or positive form of the item stem. Item means were lower for the...
This study compared effect sizes applied to raw, scaled, and normal curve equivalent (NCE) data. ... more This study compared effect sizes applied to raw, scaled, and normal curve equivalent (NCE) data. Recommendations for the interpretation of effect sizes vary. For example, some authors suggest that an effect size below 0.50 is small, between 0.50 and 1.00 is moderate, and above 1.00 is large. These are products of the criterion formally used by the U.S. Department of Education's Joint Dissemination Review Panel and the Program Effectiveness Panel. it is clear from the context of these articles that it is assumed that they were dealing with raw scores or scaled scores, not NCEs. NCE scores for individual students and, particularly, mean NCE scores for schools would not be expected to change from year to year without some type of intervention. This study computed effect sizes for the raw, scaled scores, and NCEs by school for grades 4, 6, and 8 on a national norm-referenced test for 749, 574, and 464 schools respectively representing 120,149 students. The results show that, as expe...
Tukey's Honestly Significant Difference (HSD) procedure (J. Tukey, 1953) is probably the most... more Tukey's Honestly Significant Difference (HSD) procedure (J. Tukey, 1953) is probably the most recommended and used procedure for controlling Type I error rate when making multiple pairwise comparisons as follow-ups to a significant omnibus F test. This study compared observed Type I errors with nominal alphas of 0.01, 0.05, and 0.10 compared for various sample sizes and numbers of groups. Monte Carlo methods were used to generate replications expected to provide 0.95 confidence intervals of +/-0.001 around the nominal alphas of 0.10, 0.05, and 0.01 for 42 combinations of n (5, 10, 15, 20, 30, 60, and 100) and numbers of groups (3, 4, 5, 6, 8, and 10) . Means and standard deviations of observed Type I error rates and percentages of observed Type I errors falling below, within, and above the 0.95 confidence intervals were determined for total number of Type I errors. The results indicate that HSD is conservative relative to experimentwise Type I error control across all alpha leve...
This research investigated the effects of types and prevalence of response patterns that might be... more This research investigated the effects of types and prevalence of response patterns that might be provided by nonattending respondents on Cronbach’s alpha. Three simulated data sets, one for each value of Cronbach’s alpha .700, .800, and .900, were constructed for 100 respondents on 50 one-to-seven Likert items. Participants were replaced randomly in each population by one of eight response patterns at 5%, 10%, 15%, and 20% replacement levels. Effects were greater as a function of increased prevalence in the respondent group; however, as few as 5% of certain types of nonattending patterns had strong, inflating effects on alpha.
... Click on any of the links below to perform a new search. Title: Measuring Attitudes TowardRea... more ... Click on any of the links below to perform a new search. Title: Measuring Attitudes TowardReading in Large Scale Assessment. ... Identifiers: Attitudes Toward Reading Scale. ... Help ERIC expand online access to documents currently available only on microfiche. ...
The controversy regarding reverse or negatively-worded survey stems has been around for several d... more The controversy regarding reverse or negatively-worded survey stems has been around for several decades. The practice has been used to guard against acquiescent or response set behaviors. A 20-item, 5-point Likert item survey was designed and the stems and response sets were varied in a 2 by 3 design. One independent variable was type of item stem: one level had all direct-worded stems and the other had, randomly determined, half direct and half reverse-worded stems. The other independent variable was response set type. One level had all response sets going "strongly disagree" (SD) to "strongly agree" (SA), one had all response sets going SA to SD, and the third had, randomly determined, half going SD to SA and half going SA to SD. The surveys were administered to 687 subjects. The form each subject received was determined randomly. Responses were scored so that all were in agreement with the direct or positive form of the item stem. Item means were lower for the...
This study compared effect sizes applied to raw, scaled, and normal curve equivalent (NCE) data. ... more This study compared effect sizes applied to raw, scaled, and normal curve equivalent (NCE) data. Recommendations for the interpretation of effect sizes vary. For example, some authors suggest that an effect size below 0.50 is small, between 0.50 and 1.00 is moderate, and above 1.00 is large. These are products of the criterion formally used by the U.S. Department of Education's Joint Dissemination Review Panel and the Program Effectiveness Panel. it is clear from the context of these articles that it is assumed that they were dealing with raw scores or scaled scores, not NCEs. NCE scores for individual students and, particularly, mean NCE scores for schools would not be expected to change from year to year without some type of intervention. This study computed effect sizes for the raw, scaled scores, and NCEs by school for grades 4, 6, and 8 on a national norm-referenced test for 749, 574, and 464 schools respectively representing 120,149 students. The results show that, as expe...
Tukey's Honestly Significant Difference (HSD) procedure (J. Tukey, 1953) is probably the most... more Tukey's Honestly Significant Difference (HSD) procedure (J. Tukey, 1953) is probably the most recommended and used procedure for controlling Type I error rate when making multiple pairwise comparisons as follow-ups to a significant omnibus F test. This study compared observed Type I errors with nominal alphas of 0.01, 0.05, and 0.10 compared for various sample sizes and numbers of groups. Monte Carlo methods were used to generate replications expected to provide 0.95 confidence intervals of +/-0.001 around the nominal alphas of 0.10, 0.05, and 0.01 for 42 combinations of n (5, 10, 15, 20, 30, 60, and 100) and numbers of groups (3, 4, 5, 6, 8, and 10) . Means and standard deviations of observed Type I error rates and percentages of observed Type I errors falling below, within, and above the 0.95 confidence intervals were determined for total number of Type I errors. The results indicate that HSD is conservative relative to experimentwise Type I error control across all alpha leve...
This research investigated the effects of types and prevalence of response patterns that might be... more This research investigated the effects of types and prevalence of response patterns that might be provided by nonattending respondents on Cronbach’s alpha. Three simulated data sets, one for each value of Cronbach’s alpha .700, .800, and .900, were constructed for 100 respondents on 50 one-to-seven Likert items. Participants were replaced randomly in each population by one of eight response patterns at 5%, 10%, 15%, and 20% replacement levels. Effects were greater as a function of increased prevalence in the respondent group; however, as few as 5% of certain types of nonattending patterns had strong, inflating effects on alpha.
... Click on any of the links below to perform a new search. Title: Measuring Attitudes TowardRea... more ... Click on any of the links below to perform a new search. Title: Measuring Attitudes TowardReading in Large Scale Assessment. ... Identifiers: Attitudes Toward Reading Scale. ... Help ERIC expand online access to documents currently available only on microfiche. ...
Uploads
Papers