An Alternative Decision-Making Procedure for Performance Assessments: Using the Multifaceted Rash Model to Generate Cut Estimates  

Oleh:

Kozaki, Yoko

Jenis: Article from Journal - e-Journal
Dalam koleksi: Language Assessment Quarterly vol. 7 no. 1 (2010), page 75-95.
Fulltext: Language Assessment Quarterly, 7,75–95,.pdf (401.92KB)

Isi artikel

This article describes an alternative approach to setting standards for performance assessments. The procedure was designed for use in low-budget, relatively low-stakes contexts where it is not possible to bring expert judges together. The procedure that allowed participant judges to work individually throughout the process was an effort to compensate for the lack of face-to-face interactions between judges. The viability of the proposed procedure in generating workable cut estimates was examined via its application to a certification examination in medical translation. Data were collected from a case study conducted by Kozaki (2004) and its replication, which were linked together by the Multifaceted Rasch Model into a single frame of reference. The results showed that the judges’ intentions were overall well represented in the generated cut estimates and that the decision making was realistic. It is suggested that the proposed procedure should offer a viable alternative in relatively lowstakes environments to full-fledged standard-setting procedures and that thus it may be of benefit to examiners who need principled approaches to setting cut estimates for performance assessments with constrained budgets.

Opini Anda

Klik untuk menuliskan opini Anda tentang koleksi ini!

Kembali