Trait Ratings for Automated Essay Grading  

Oleh:

Shermis, Mark D. ; Keith, Timothy Z. ; Page, Ellis B. ; Harrington, Susanmarie ; Koch, Chantal Mees

Jenis: Article from Journal - ilmiah internasional
Dalam koleksi: Educational and Psychological Measurement vol. 62 no. 1 (2002), page 5-18.
Topik: RATING; automation; academic grading; essays; educational software
Fulltext: 5.pdf (102.65KB)

Ketersediaan

Perpustakaan Pusat (Semanggi) Nomor Panggil: EE30.7 Non-tandon: 1 (dapat dipinjam: 0) Tandon: tidak ada

Lihat Detail Induk

Isi artikel

This study employed an automoted grader to evaluate essays, both holistically and with the rating of traits (content, organization, style, mechanics, and creativity) for web based students essays serving as placement tests at a large midwestern university. The authors report the results of two combined experiments, based on random selection from 1,193 essays. In the first experiment, the essays of 807 students were used to create statistical predictions for the essay - grading software. In the second experiment, the ratings from a separate, random sample of 386 essays were used to compare the ratings of six human judges against thoses generated by the computer. The interjudge correlation of the human raters alone was r = 0,71. But the interrater reliability of all sxi judges in combination with computer scoring reached 0,83. The essay - grading software was an efficient means for evaluating the essays, with a capacity for grading approximately six documents every second. Other potential feedback measures for use in writing courses are also discussed.

Opini Anda

Klik untuk menuliskan opini Anda tentang koleksi ini!

Kembali