How Many Raters Should Be Used for Establishing Cut Off Scores With The Angoff Method ? A Generalizability Theory Study  

Oleh:

Hertz, Norman R. ; Hurtz, Gregory M.

Jenis: Article from Journal - ilmiah internasional
Dalam koleksi: Educational and Psychological Measurement vol. 59 no. 6 (1999), page 885-897.
Topik: METHODS; tests; psychology; occupations; licensing
Fulltext: 885.pdf (102.06KB)

Ketersediaan

Perpustakaan Pusat (Semanggi) Nomor Panggil: EE30.4 Non-tandon: 1 (dapat dipinjam: 0) Tandon: tidak ada

Lihat Detail Induk

Isi artikel

Although the angoff method is perhaps the most highly regarded and widely used judgemental method for setting criterion - referenced cutoff scores, little research as been conducted to determine the optimal number of raters to employ for obtaining stable cutoff scores. In the present study, angoff ratings obtained from eight different occupational licensing examinations were evaluated via geenralizability theory to estimate the optimal number of raters. Results indicated that approximately 10 to 15 raters is an optimal target range, although fewer raters may sometimes be sufficient. It is recommended that 10 to 15 raters be sampled as a general rule, followed by analyses to determine the optimal number of raters for examinations in a particular profession using a particular procedural variant of the angoff method.

Opini Anda

Klik untuk menuliskan opini Anda tentang koleksi ini!

Kembali