EUVIMEDEUVIMED entdecken
CrossrefInfokarte

Quality and Readability of ChatGPT and Gemini Responses to Patient Questions About Systemic Isotretinoin: Comparative Evaluation Study

Elif Bal Avcı, Buğra Burç Dağtaş, Dilara İlhan Erdil, Ozan Erdem, Andaç Salman, Selçuk Korkmaz, Sezgi Sarıkaya Solak

JMIR Dermatology · 2026-10-30 · 9 · e99780-e99780

DOI: 10.2196/99780 ↗
AbstractBibliografische Angaben

Abstract

Abstract Background The use of AI in health care is rapidly expanding due to its accessibility, with growing reliance among both physicians and patients. Objective This study evaluated ChatGPT (OpenAI) and Gemini (Google) responses to patient questions on systemic isotretinoin. Methods A total of 40 commonly anticipated patient questions were developed based on online sources and patient education materials and categorized into 5 groups. Responses were generated using the January 2025 free versions of ChatGPT (GPT-4o) and Gemini 2.0 Flash. A total of 5 experienced dermatologists evaluated the responses in a blinded manner using a 5-point Likert scale assessing accuracy, clarity, completeness, usefulness, and overall quality score (Global Quality Score [GQS]). Readability was measured using Flesch-Kincaid Grade Level (FKGL), Flesch Reading Ease, and Simple Measure of Gobbledygook (SMOG) index scores. Mixed-effects modeling was performed to adjust for reviewer and question variability, and intraclass correlation coefficients (ICCs) were calculated to assess interrater reliability. Results ChatGPT achieved significantly higher ratings in accuracy, completeness, usefulness, and GQS, while clarity showed a nonsignificant trend. When questions were analyzed by subtype, no statistically significant differences were observed between models across evaluation parameters. Mixed-effects modeling confirmed higher odds of superior ratings for ChatGPT across domains (odds ratios [ORs] 1.82‐5.88; all P

Wissen, das zu Ihrer Arbeit passt.

Vom kostenlosen Einstieg über die persönliche Recherche bis zur vollständigen Research Suite.

Tarife ansehen →

Sind alle Verlagsvolltexte enthalten?

Nein. Bibliografische Nachweise, Abstracts und Volltexte sind unterschiedliche Inhalte. Ob ein Volltext verfügbar ist, hängt von der Quelle, Open Access und Ihren vorhandenen Lizenzen ab. Ein EUVIMED-Tarif ersetzt keine zusätzlichen Verlagsrechte.

Tarife ansehen →