Multiple Maximum Exposure Rates in Computerized Adaptive Testing  

Oleh:

Barrada, Juan Ramón ; Veldkamp, Bernard P. ; Olea, Julio

Jenis: Article from Journal - ilmiah internasional
Dalam koleksi: Applied Psychological Measurement vol. 33 no. 1 (Jan. 2009), page 58-73.
Topik: computerized adaptive testing; item exposure control; test security; item selection
Fulltext: 58.pdf (307.16KB)

Isi artikel

Computerized adaptive testing is subject to security problems, as the itembank content remains operative over long periods and administration time is flexible for examinees. Spreading the content of a part of the item bank could lead to an overestimation of the examinees’ trait level. The most common way of reducing this risk is to impose amaximum exposure rate (rmax) that no itemshould exceed. Several methods have been proposed with this aim. All of thesemethods establish a single value of rmax throughout the test. This study presents a new method, themultiple-rmax method, that defines asmany values of rmax as the number of items presented in the test. In this way, it is possible to impose a high degree of randomness in item selection at the beginning of the test, leaving the administration of items with the best psychometric properties to the moment when the trait level estimation is most accurate. The implementation of themultiple-rmax method is described and is tested in simulated itembanks and in an operative bank. Comparedwith a single maximumexposuremethod, the new method has a more balanced usage of the itembank and delays the possible distortion of trait estimation due to security problems, with either no or only slight decrements of measurement accuracy.

Opini Anda

Klik untuk menuliskan opini Anda tentang koleksi ini!

Kembali