The Restriction of Variance Hypothesis and Interrater Reliability and Agreement : Are Ratings From Multiple Sources Really Dissimilar ?  

Oleh:

James, Lawrence R. ; Kaiser, Robert B. ; Burgess, Jennifer R. D. ; LeBreton, James M. ; Atchley, E. Kate

Jenis: Article from Journal - ilmiah internasional
Dalam koleksi: Organizational Research Methods vol. 6 no. 1 (2003), page 80-128.
Topik: variance components; studies; statistical analysis; performance appraisal; methods; feedback; management reviews; management development; organizational behaviour
Fulltext: 80.pdf (266.14KB)

Ketersediaan

Perpustakaan Pusat (Semanggi) Nomor Panggil: OO3.4 Non-tandon: 1 (dapat dipinjam: 0) Tandon: tidak ada

Lihat Detail Induk

Isi artikel

The fundamental assumption underlying the use of 360 - degree assessments is that ratings from different source provide unique and meaningful information about the target manager's performance. Extant research appears to support this assumption by demonstrating low correlations between rating sources. This article reexamines the support of this assumption, suggesting that past research has been distorted by a statistical artifact - restriction of variance in job performance. This artifact reducs the amount of between - target variance in ratings and attenuates traditional correlation - based estimates of rating similarity. Results obtained from a monte carlo simulation and two field studies support this restriction of variance hypothesis. Non correlation - based methods of assessing interrater agreement indicated that agreement between sources was about as high as agreement within sources. Thus, different sources did not appear to be furnishing substantially unique information. The authors conclude by questioning common practice in 360 - degree assessments and offering suggestions for future research and application.

Opini Anda

Klik untuk menuliskan opini Anda tentang koleksi ini!

Kembali