Idiographic interrater reliability measures for intensive longitudinal multirater data
British Journal of Mathematical and Statistical Psychology · 2026-11 · 79 (3) · 547-568
DOI: 10.1111/bmsp.70022 ↗Kurz gefasst
Fachartikel in der Zeitschrift British Journal of Mathematical and Statistical Psychology, online erschienen am 20.12.2025. Verfasst von Tobias Koch und 4 weiteren Autor:innen. Beteiligte Einrichtung: Friedrich-Schiller-Universität Jena, Jena, Germany. Hauptthemen laut MEDLINE: Models, Statistical. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 49 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Interrater reliability plays a crucial role in various areas of psychology. In this article, we propose a multilevel latent time series model for intensive longitudinal data with structurally different raters (e.g., self‐reports and partner reports). The new MR‐MLTS model enables researchers to estimate idiographic (person‐specific) rater consistency coefficients for contemporaneous or dynamic rater agreement. Additionally, the model allows rater consistency coefficients to be linked to external explanatory or outcome variables. It can be implemented in Mplus as well as in the newly developed R package mlts . We illustrate the model using data from an intensive longitudinal multirater study involving 100 heterosexual couples (200 individuals) assessed across 86 time points. Our findings show that relationship duration and partner cognitive resources positively predict rater consistency for the innovations. Results from a simulation study indicate that the number of time points is critical for accurately estimating idiographic rater consistency coefficients, whereas the number of participants is important for accurately recovering the random effect variances. We discuss advantages, limitations, and future extensions of the MR‐MLTS model.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Friedrich-Schiller-Universität Jena, Jena, Germany.
- Leipzig University, Leipzig, Germany.
ORCID-Profile: Tobias Koch, Miriam F Jaehne, Michaela Riediger, Antje Rauers, Jana Holtmann
Zitieren
APA
Koch, T., Jaehne, M. F., Riediger, M., Rauers, A., & Holtmann, J. (2026). Idiographic interrater reliability measures for intensive longitudinal multirater data. British Journal of Mathematical and Statistical Psychology, 79(3), 547-568. https://doi.org/10.1111/bmsp.70022
Vancouver
Koch T, Jaehne MF, Riediger M, Rauers A, Holtmann J. Idiographic interrater reliability measures for intensive longitudinal multirater data. British Journal of Mathematical and Statistical Psychology. 2026;79(3):547-568. doi:10.1111/bmsp.70022
BibTeX
@article{Koch2026,
author = {Koch, Tobias and Jaehne, Miriam F and Riediger, Michaela and Rauers, Antje and Holtmann, Jana},
title = {Idiographic interrater reliability measures for intensive longitudinal multirater data},
journal = {British Journal of Mathematical and Statistical Psychology},
year = {2026},
volume = {79},
number = {3},
pages = {547--568},
doi = {10.1111/bmsp.70022}
}
EUVIMED