Severity of Organized Item Theft in Computerized Adaptive Testing: A Simulation Study  

Oleh:

Qing, Yi ; Jinming, Zhang ; Hua-Hua, Chang

Jenis: Article from Journal - ilmiah internasional
Dalam koleksi: Applied Psychological Measurement vol. 32 no. 7 (Oct. 2008), page 543-558.
Topik: test security; computerized adaptive testing; organized item theft; itemselection methods
Fulltext: 543.pdf (159.91KB)

Isi artikel

Criteria had been proposed for assessing the severity of possible test security violations for computerized tests with high-stakes outcomes. However, these criteria resulted fromtheoretical derivations that assumed uniformly randomized item selection. This study investigated potential damage caused by organized itemtheft in computerized adaptive testing (CAT) for two realistic item selectionmethods,maximumitem information and a-stratified with content blocking, using the randomized method as a baseline for comparison. Damage caused by organized itemtheft was evaluated by the number of compromised items each examinee could encounter and the impact of the compromised items on examinees’ ability estimates. Severity of test security violation was assessed under self-organized and organized itemtheft simulation scenarios. Results indicated that though itemtheft could cause severe damage to CAT with either item selectionmethod, themaximum item information method wasmore vulnerable to the organized item theft simulation thanwas the a-stratifiedmethod.

Opini Anda

Klik untuk menuliskan opini Anda tentang koleksi ini!

Kembali