EUVIMEDEUVIMED entdecken
Open Access

Rater Training for a Multi-Site, International Clinical Trial:What Mood Symptoms may be most Difficult to Rate?

Martha Sajatovic, Richa Gaur, Curtis Tatsuoka, Susan De Santi, Nathan Lee, Judith Laredo, Sulabh Tripathi

Psychopharmacology Bulletin · 12.08.2025 · 44 (3) · 5-14

DOI: 10.64719/pb.4074 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Psychopharmacology Bulletin, online erschienen am 12.08.2025. Verfasst von Martha Sajatovic und 6 weiteren Autor:innen. Beteiligte Einrichtung: Dr. Sajatovic, MD, Department of Psychiatry and of Neurology, Case Western Reserve University School of Medicine, Cleveland, OH. Dr. Gaur, PhD, Assoc…. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 27 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Aims

Given resource constraints in conducting clinical trials, it is critical that rater training focuses on scale items wherein standardization is most challenging. This analysis examined mood disorder symptom ratings submitted in an online rater training program conducted preparatory to the initiation of a multi-site, international mood disorder treatment trial. Ratings were entered online and analyzed for consistency and variability, and compared to established standards (Gold Consensus Ratings/ GCRs).

Methods

Raters participated in web-based rater training on the Hamilton Depression Rating Scale (HAM-D), Montgomery Asberg Rating Scale (MADRS), and Young Mania Rating Scale (YMRS). Training included integration of didactic materials and videos of two bipolar depressed patients interviewed by two U.S. clinicians. Raters viewed the videos and rated the mood scales. Inter-rater agreement was assessed using Kappa statistics. Ratings between the raters and the GCRs for individual scale items were assessed using McNemar test for paired binomial proportions.

Results

194 raters from 16 countries, 80 sites and speaking 20 different languages participated. Interrater agreement on videos ratings ranged from substantial to moderate (HAM-D, Kappa video A = 0.72, video B = 0.65, p < 0.001), (MADRS, Kappa = 0.65 and 0.47, p < 0.001), (YMRS, Kappa = 0.75, and 0.64, p < 0.001). There was no significant difference on agreement based upon on English proficiency, clinical experience, or by country. Scale items that differed from the GCR on the HAM-D were depressed mood, delayed insomnia, retardation, and anxiety (psychic). Items that differed on the MADRS were apparent sadness, inner tension, concentration difficulties, lassitude and inability to feel. Items that differed on the YMRS were irritability and disruptive behavior.

Conclusions

Identification of specific rating scale items in which rater variability is greatest may facilitate training approaches that target these areas for more efficient training in international clinical trials.

Schlagwörter

Stichwörter der Autor:innen

bipolar disorderclinical trialsdepressionrating scales

Autor:innen und Institutionen

  • Dr. Sajatovic, MD, Department of Psychiatry and of Neurology, Case Western Reserve University School of Medicine, Cleveland, OH. Dr. Gaur, PhD, Associate Director, Rater Training Services, PharmaNet/i3, Sydney, Australi…

Zitieren

APA

Sajatovic, M., Gaur, R., Tatsuoka, C., De Santi, S., Lee, N., Laredo, J., & Tripathi, S. (2025). Rater Training for a Multi-Site, International Clinical Trial:What Mood Symptoms may be most Difficult to Rate?. Psychopharmacology Bulletin, 44(3), 5-14. https://doi.org/10.64719/pb.4074

Vancouver

Sajatovic M, Gaur R, Tatsuoka C, De Santi S, Lee N, Laredo J, et al. Rater Training for a Multi-Site, International Clinical Trial:What Mood Symptoms may be most Difficult to Rate?. Psychopharmacology Bulletin. 2025;44(3):5-14. doi:10.64719/pb.4074

BibTeX
@article{Sajatovic2025,
  author = {Sajatovic, Martha and Gaur, Richa and Tatsuoka, Curtis and De Santi, Susan and Lee, Nathan and Laredo, Judith and Tripathi, Sulabh},
  title = {Rater Training for a Multi-Site, International Clinical Trial:What Mood Symptoms may be most Difficult to Rate?},
  journal = {Psychopharmacology Bulletin},
  year = {2025},
  volume = {44},
  number = {3},
  pages = {5--14},
  doi = {10.64719/pb.4074}
}
Kostenlos starten →