Estimating Standard Errors of Cut Scores for Item Rating and Mapmark Procedures: A Generalizability Theory Approach  

Oleh:

Yin, Ping ; Sconing, James

Jenis: Article from Journal - ilmiah internasional
Dalam koleksi: Educational and Psychological Measurement vol. 68 no. 01 (Feb. 2008), page 25-41.
Topik: standard setting; item rating method; mapmark method; generalizability theory
Fulltext: 25.pdf (148.88KB)

Isi artikel

Standard-setting methods are widely used to determine cut scores on a test that examinees must meet for a certain performance standard. Because standard setting is a measurement procedure, it is important to evaluate variability of cut scores resulting from the standard-setting process. Generalizability theory is used in this study to estimate standard errors of cut scores resulting from two standard-setting methods: item rating (Angoff-based) and mapmark (bookmark-based) methods. In this study, two different generalizability (G) study designs and four different decision (D) study designs were examined, and the impact of varying different aspects of the study design and universes of generalization was examined. Results suggest that cut scores were generally consistent for both methods. The first round standard setting contributed the most to the overall variability for the mapmark method. Also, it is clear that there is no one standard error associated with a certain cut score.

Opini Anda

Klik untuk menuliskan opini Anda tentang koleksi ini!

Kembali