Effect of Differential Item Functioning on Computer Adaptive Testing Under Different Conditions

Şahin Kürşad M., YALÇIN S.

Applied Psychological Measurement, cilt.48, sa.7-8, ss.303-322, 2024 (SSCI) identifier

  • Yayın Türü: Makale / Tam Makale
  • Cilt numarası: 48 Sayı: 7-8
  • Basım Tarihi: 2024
  • Doi Numarası: 10.1177/01466216241284295
  • Dergi Adı: Applied Psychological Measurement
  • Derginin Tarandığı İndeksler: Social Sciences Citation Index (SSCI), Scopus, Academic Search Premier, IBZ Online, Business Source Elite, Business Source Premier, EBSCO Education Source, Psycinfo
  • Sayfa Sayıları: ss.303-322
  • Anahtar Kelimeler: computer adaptive tests, differential item functioning, measurement precision, test effectiveness, test information function
  • TED Üniversitesi Adresli: Evet

Özet

This study provides an overview of the effect of differential item functioning (DIF) on measurement precision, test information function (TIF), and test effectiveness in computer adaptive tests (CATs). Simulated data for the study was produced and analyzed with the Rstudio. During the data generation process, item pool size, DIF type, DIF percentage, item selection method for CAT, and the test termination rules were considered changed conditions. Sample size and ability parameter distribution, Item Response Theory (IRT) model, DIF size, ability estimation method, test starting rule, and item usage frequency method regarding CAT conditions were considered fixed conditions. To examine the effect of DIF, measurement precision, TIF and test effectiveness were calculated. Results show DIF has negative effects on measurement precision, TIF, and test effectiveness. In particular, statistically significant effects of the percentage DIF items and DIF type are observed on measurement precision.