An Expansion and Practical Evaluation of Expected Classification Accuracy  

Oleh:

Martineau, Joseph A.

Jenis: Article from Journal - ilmiah internasional
Dalam koleksi: Applied Psychological Measurement vol. 31 no. 3 (May 2007), page 181-194.
Topik: expected classification accuracy; individual classification accuracy; aggregate classification accuracy; sample size; measurement error; classification error
Fulltext: 181.pdf (389.91KB)

Isi artikel

Rudner (2001, 2005) described an expected classification accuracy index for determining the asymptotic expectation of accuracy of classifications of examinees into score categories. This article expands on that exposition by evaluating the index as it is likely to be used in practice (as a point estimate of classification accuracy), provides a related index of expected proportion in each score category, derives ameasurement error–based standard error of expected proportion in each category, applies the methods to a large-scale state assessment database, and analyzes the benefits and limitations of the methodology. This study demonstrates that Rudner’s index as a point estimate is slightly positively biased but nevertheless useful for groups with reasonably large numbers of examinees. It also reinforces the inappropriateness of estimating proportions in score categories for many small groups.

Opini Anda

Klik untuk menuliskan opini Anda tentang koleksi ini!

Kembali