Published Studies of Interrater Reliability Often Over Estimate Reliability : Computing The Correct Coefficient  

Oleh:

Chen, Michael ; Xitao, Fan

Jenis: Article from Journal - ilmiah internasional
Dalam koleksi: Educational and Psychological Measurement vol. 60 no. 4 (2000), page 532-542.
Topik: reliability; research; psychological tests; tests; reliability; ratings & rankings
Fulltext: 532.pdf (86.35KB)

Ketersediaan

Perpustakaan Pusat (Semanggi) Nomor Panggil: EE30.5 Non-tandon: 1 (dapat dipinjam: 0) Tandon: tidak ada

Lihat Detail Induk

Isi artikel

It is erroneous to generalize the interrater reliability coefficient estimated from two or more raters rating only a (small) portion of the sample to the rest of the sample data for which only one rater is used for scoring, although such generalization is often made implicitly in practice. If the interrater reliability estimate from part of a sample is available, the score reliability for the rest of the sample data for which only one rater is used for scoring can be estimated both within the famework of classical reliability thery and that of generalizability theory. As intuitively expected, score reliability when only one rater is used for scoring can be estimated both within the framework of classical reliability theory and that of generalizability theory. As intuitively expected, score reliability when only one rater is used for scoring is lower than the score reliability for which two raters are used. The authors procide a sample of published studies in different disciplines that inappropriately generalized reliability coefficients involving several raters to scores generated by a single rater.

Opini Anda

Klik untuk menuliskan opini Anda tentang koleksi ini!

Kembali