Exploring Differential Item Functioning in A 360-Degree Assessment : Rater Source and Method of Delivery  

Oleh:

Penny, James A.

Jenis: Article from Journal - ilmiah internasional
Dalam koleksi: Organizational Research Methods vol. 6 no. 1 (2003), page 61-79.
Topik: functioning style; management reviews; management develpment; organizational behaviour; polls & surveys; performance appraisal; studies; models; methods; feedback
Fulltext: 61.pdf (151.05KB)

Ketersediaan

Perpustakaan Pusat (Semanggi) Nomor Panggil: OO3.4 Non-tandon: 1 (dapat dipinjam: 0) Tandon: tidak ada

Lihat Detail Induk

Isi artikel

This research used logistic regression to model item responses from a popular 360 - degree assessment for development survey. The model used method of survey delivery and rater group to identify items exhibiting differential item functioning (DIF). The methods of survey delivery were pencil- and -paper and online by web page. The rater groups were self, boss, peer and direct report. The sample consited of 374 survey families where a survey family was a set of four surveys : self, boss, peer and direct report. Half the survey families were pencil- and - paper administration, half were online administration. The flagging procedure used effect size from wald chi - square statistics. Results indicated little evidence that DIF existed due to method of survey delivery, lending additional support for the use of the internet to deliver 360 degree surveys. Approximately 10% of items exhibited DIF attributable to rater group, though in every instance the magnitude of the DIF was small, suggesting that the impact of DIF on the 360 - degree feedback could be slight. There was no evidence of an itneraction between method of delivery and rater group. The maximum likelihood parameter estimates indicated DIF resulted from either hierarchical complexity or contingency theory. This research suggested that such forms of DIF could be naturally occuring phenomena in 360 - degree assessment because both contingency and complexity can influence the perceptions by raters of a manager's performance.

Opini Anda

Klik untuk menuliskan opini Anda tentang koleksi ini!

Kembali