Analysis of Cross-Cultural Comparability of PISA 2009 Scores  

Oleh:

Moors, Guy ; Kankaras, Milos

Jenis: Article from Journal - ilmiah internasional
Dalam koleksi: Journal of Cross-Cultural Psychology (http://journals.sagepub.com/home/jcca) vol. 45 no. 3 (Apr. 2014), page 381-399.
Topik: Measurement Equivalence; PISA; Differential Item Functioning; Cross-cultural Research; Educational Measurement
Fulltext: Journal of Cross-Cultural Psychology-2014-Kankara--381-99.pdf (690.28KB)

Ketersediaan

Perpustakaan Pusat (Semanggi) Nomor Panggil: JJ86.33 Non-tandon: 1 (dapat dipinjam: 0) Tandon: tidak ada

Lihat Detail Induk

Isi artikel

The Program for International Student Assessment (PISA) is a large-scale cross-national study that measures academic competencies of 15-year-old students in mathematics, reading, and science from more than 50 countries/economies around the world. PISA results are usually aggregated and presented in so-called “league tables,” in which countries are compared and ranked in each of the three scales. However, to compare results obtained from different groups/countries, one must first be sure that the tests measure the same competencies in all cultures. In this paper, this is tested by examining the level of measurement equivalence in the 2009 PISA data set using an item response theory approach (IRT) and analyzing differential item functioning (DIF). Measurement in-equivalence was found in the form of uniform DIF. In-equivalence occurred in a majority of test questions in all three scales researched and is, on average, of moderate size. It varies considerably both across items and across countries. When this uniform DIF is accounted for in the in-equivalent model, the resulting country scores change considerably in the cases of the “Mathematics,” “Science,” and especially, “Reading” scale. These changes tend to occur simultaneously and in the same direction in groups of regional countries. The most affected seems to be Southeast Asian countries/territories whose scores, although among the highest in the initial, homogeneous model, additionally increase when accounting for in-equivalence in the scales.

Opini Anda

Klik untuk menuliskan opini Anda tentang koleksi ini!

Kembali