A Measure of Agreement for Interval or Nominal Multivariate Observations by Different Sets of Judges  

Oleh:

Janson, Harald ; Olsson, Ulf

Jenis: Article from Journal - ilmiah internasional
Dalam koleksi: Educational and Psychological Measurement vol. 64 no. 1 (2004), page 62-70.
Topik: AGREEMENT; interrater reliability; multivariate analysis; rating; measurement
Fulltext: 62.pdf (88.33KB)

Ketersediaan

Perpustakaan Pusat (Semanggi) Nomor Panggil: EE30.10 Non-tandon: 1 (dapat dipinjam: 0) Tandon: tidak ada

Lihat Detail Induk

Isi artikel

This article addresses the problem of accounting overall multivariate chance - corrected inter observer agreement when targets have been rated by different sets of judges (not necessarily equal in number). The proposed approach builds on janson and olsson's multivariate generalization of cohen's kappa but incorporates weighting for number of judges and applies an expression for expected disagreement suitable for the case with different judges. The authors suggest that the attractiveness of this approach to multivariate agreement measurement lies in the interpretability of the terms of expected and observed disagreement as average distances between observations, and that addressing agreement without regard to the covariance structure among variables has advantages in simplicity and interpretability. Correspondences to earlier approaches are noted and application of the proposed measure in exemplified using hypothetical data sets.

Opini Anda

Klik untuk menuliskan opini Anda tentang koleksi ini!

Kembali