Compromised item detection: A Bayesian change‐point perspective
British Journal of Mathematical and Statistical Psychology · 2023-02 · 76 (1) · 131-153
DOI: 10.1111/bmsp.12286 ↗Kurz gefasst
Fachartikel in der Zeitschrift British Journal of Mathematical and Statistical Psychology, online erschienen am 07.09.2022. Verfasst von Yang Du und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Educational Psychology, University of Illinois, Urbana-Champaign, Urbana-Champaign, Illinois, USA. Hauptthemen laut MEDLINE: Knowledge. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 29 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).
Abstract (Originalsprache)
Psychometric methods for accurate and timely detection of item compromise have been a long‐standing topic. While Bayesian methods can incorporate prior knowledge or expert inputs as additional information for item compromise detection, they have not been employed in item compromise detection itself. The current study proposes a two‐phase Bayesian change‐point framework for both stationary and real‐time detection of changes in each item's compromise status. In Phase I, a stationary Bayesian change‐point model for compromise detection is fitted to the observed responses over a specified time‐frame. The model produces parameter estimates for the change‐point of each item from uncompromised to compromised, as well as structural parameters accounting for the post‐change response distribution. Using the post‐change model identified in Phase I, the Shiryaev procedure for sequential testing is employed in Phase II for real‐time monitoring of item compromise. The proposed methods are evaluated in terms of parameter recovery, detection accuracy, and detection efficiency under various simulation conditions and in a real data example. The proposed method also showed superior detection accuracy and efficiency compared to the cumulative sum procedure.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Educational Psychology, University of Illinois, Urbana-Champaign, Urbana-Champaign, Illinois, USA.
- Department of Psychology and Statistics, University of Illinois, Urbana-Champaign, Urbana-Champaign, Illinois, USA.
- Department of Educational Studies, Purdue University, West Lafayette, Indiana, USA.
ORCID-Profile: Yang Du
Zitieren
APA
Du, Y., Zhang, S., & Chang, H. H. (2023). Compromised item detection: A Bayesian change‐point perspective. British Journal of Mathematical and Statistical Psychology, 76(1), 131-153. https://doi.org/10.1111/bmsp.12286
Vancouver
Du Y, Zhang S, Chang HH. Compromised item detection: A Bayesian change‐point perspective. British Journal of Mathematical and Statistical Psychology. 2023;76(1):131-153. doi:10.1111/bmsp.12286
BibTeX
@article{Du2023,
author = {Du, Yang and Zhang, Susu and Chang, Hua-Hua},
title = {Compromised item detection: A Bayesian change‐point perspective},
journal = {British Journal of Mathematical and Statistical Psychology},
year = {2023},
volume = {76},
number = {1},
pages = {131--153},
doi = {10.1111/bmsp.12286}
}
EUVIMED