EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

Compromised item detection: A Bayesian change‐point perspective

Yang Du iD, Susu Zhang, Hua-Hua Chang

British Journal of Mathematical and Statistical Psychology · 2023-02 · 76 (1) · 131-153

DOI: 10.1111/bmsp.12286 ↗

Kurz gefasst

Fachartikel in der Zeitschrift British Journal of Mathematical and Statistical Psychology, online erschienen am 07.09.2022. Verfasst von Yang Du und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Educational Psychology, University of Illinois, Urbana-Champaign, Urbana-Champaign, Illinois, USA. Hauptthemen laut MEDLINE: Knowledge. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 29 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Psychometric methods for accurate and timely detection of item compromise have been a long‐standing topic. While Bayesian methods can incorporate prior knowledge or expert inputs as additional information for item compromise detection, they have not been employed in item compromise detection itself. The current study proposes a two‐phase Bayesian change‐point framework for both stationary and real‐time detection of changes in each item's compromise status. In Phase I, a stationary Bayesian change‐point model for compromise detection is fitted to the observed responses over a specified time‐frame. The model produces parameter estimates for the change‐point of each item from uncompromised to compromised, as well as structural parameters accounting for the post‐change response distribution. Using the post‐change model identified in Phase I, the Shiryaev procedure for sequential testing is employed in Phase II for real‐time monitoring of item compromise. The proposed methods are evaluated in terms of parameter recovery, detection accuracy, and detection efficiency under various simulation conditions and in a real data example. The proposed method also showed superior detection accuracy and efficiency compared to the cumulative sum procedure.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

KnowledgeBayes TheoremComputer SimulationPsychometrics

Stichwörter der Autor:innen

Bayesian change-point detectionShiryaev procedurecomputerized testsitem compromisetest security

Autor:innen und Institutionen

  • Department of Educational Psychology, University of Illinois, Urbana-Champaign, Urbana-Champaign, Illinois, USA.
  • Department of Psychology and Statistics, University of Illinois, Urbana-Champaign, Urbana-Champaign, Illinois, USA.
  • Department of Educational Studies, Purdue University, West Lafayette, Indiana, USA.

ORCID-Profile: Yang Du

Zitieren

APA

Du, Y., Zhang, S., & Chang, H. H. (2023). Compromised item detection: A Bayesian change‐point perspective. British Journal of Mathematical and Statistical Psychology, 76(1), 131-153. https://doi.org/10.1111/bmsp.12286

Vancouver

Du Y, Zhang S, Chang HH. Compromised item detection: A Bayesian change‐point perspective. British Journal of Mathematical and Statistical Psychology. 2023;76(1):131-153. doi:10.1111/bmsp.12286

BibTeX
@article{Du2023,
  author = {Du, Yang and Zhang, Susu and Chang, Hua-Hua},
  title = {Compromised item detection: A Bayesian change‐point perspective},
  journal = {British Journal of Mathematical and Statistical Psychology},
  year = {2023},
  volume = {76},
  number = {1},
  pages = {131--153},
  doi = {10.1111/bmsp.12286}
}
Kostenlos starten →