lnterrater Agreement Reconsidered : An Alternative to The r(WG) Indices  

Oleh:

Hauenstein, Neil M.A. ; Brown, Reagan D.

Jenis: Article from Journal - ilmiah internasional
Dalam koleksi: Organizational Research Methods vol. 8 no. 2 (Apr. 2005), page 165-184.
Topik: Interrater Agreement; interrater agerement; interrater reliability; kappa
Fulltext: 165.pdf (163.85KB)

Ketersediaan

Perpustakaan Pusat (Semanggi) Nomor Panggil: OO3.6 Non-tandon: 1 (dapat dipinjam: 0) Tandon: tidak ada

Lihat Detail Induk

Isi artikel

For continuous constructs, the most frequently used index of interrate agreement (rWG(L)) can be problematic. Typically rWG(L) is estimated with the assumption that a uniform distribution represents no agreement. The authors review the limitations of this uniform null rWG(L) index and discuss alternative methods for measuring interrater agreement. A new interrater agreement statistic aWG(L), is proposed. The authors derive then aWG(L) statistic and demonstrate that aWG(L) is an analogue to cohen's kappa, an interrater agreement index for nominal data. A comparison is made between agreement estimates based on the uniform rWG(L) and aWG(L) and issues such as minimum sample size and practical significance levels are discussed. The authors close with recommendation sregarding the use of rWG(L) / rWG(J) when a uniform null is assumed rWG(L) / rWG(J) indices that do not assume a uniform null aWG(L) / aWG(J) indices, and generalizability estimates of interrater agreement.

Opini Anda

Klik untuk menuliskan opini Anda tentang koleksi ini!

Kembali