Holistic Rubric vs Analytic Rubric : How Raters Use These Assessments in Scoring EFL Students’ Writing in Indonesia  

Oleh:

Hoinbala, Festif Rudolf

Jenis: Article from Proceeding
Dalam koleksi: The 62st TEFLIN International Conference: Teaching and Assessing L2 Learners in the 21st Century, Denpasar, 14-16th September 2015, Book 3, page 100-112.
Topik: holistic scoring rubric; analytic scoring rubric; inter-rater reliability; intra-rater reliability
Fulltext: hal 100.pdf (11.0MB)

Isi artikel

The aim of the present study was to analyse the use of holistic and analytic rubric in scoring the essay of EFL students in Indonesia. By comparing the inter-rater reliability and intra-rater reliability, this study analysed what both of these rubrics tell us in assessing students’ writing. 28 student’s essays were evaluated by four raters in Artha Wacana Christian University in Indonesia using their own version of holistic rubric at first hand. Two sessions of rater training were conducted before they assessed the same essays using analytic scoring method which developed from The Jacobs et al. (1981) ESL Composition Profile. The result showed that there were significant positive consistencies among and between the raters in holistic, analytic, and each component of analytic scoring method (in term of inter-rater reliability). However, two negative correlations between raters were found in the mechanics component of analytic indicating different ways of raters in assessing this component. This study also revealed that one rater performed extremely weak correlation in intra-rater reliability while the others were in the moderate level. Accordingly some recommendations were stated in order to develop further research based on the result of this study.

Opini Anda

Klik untuk menuliskan opini Anda tentang koleksi ini!

Kembali