EUVIMEDObjevte EUVIMED
CrossrefInformační karta

Evaluating Large Language Models for Preoperative Patient Education in Superior Capsular Reconstruction: Comparative Study of Claude, GPT, and Gemini

Yukang Liu, Hua Li, Jianfeng Ouyang, Zhaowen Xue, Min Wang, Hebei He, Bin Song, Xiaofei Zheng, Wenyi Gan

JMIR Perioperative Medicine · 2025-06-12 · 8 · e70047-e70047

DOI: 10.2196/70047 ↗
AbstraktBibliografické údaje

Abstrakt

Abstract Background Large language models (LLMs) are revolutionizing natural language processing, increasingly applied in clinical settings to enhance preoperative patient education. Objective This study aimed to evaluate the effectiveness and applicability of various LLMs in preoperative patient education by analyzing their responses to superior capsular reconstruction (SCR)–related inquiries. Methods In total, 10 sports medicine clinical experts formulated 11 SCR issues and developed preoperative patient education strategies during a webinar, inputting 12 text commands into Claude-3-Opus (Anthropic), GPT-4-Turbo (OpenAI), and Gemini-1.5-Pro (Google DeepMind). A total of 3 experts assessed the language models’ responses for correctness, completeness, logic, potential harm, and overall satisfaction, while preoperative education documents were evaluated using DISCERN questionnaire and Patient Education Materials Assessment Tool instruments, and reviewed by 5 postoperative patients for readability and educational value; readability of all responses was also analyzed using the cntext package and py-readability-metrics. Results Between July 1 and August 17, 2024, sports medicine experts and patients evaluated 33 responses and 3 preoperative patient education documents generated by 3 language models regarding SCR surgery. For the 11 query responses, clinicians rated Gemini significantly higher than Claude in all categories ( P

Znalosti, které odpovídají vaší práci.

Od bezplatného začátku přes osobní rešerše literatury až po kompletní Research Suite.

Zobrazit tarify →

Jsou zahrnuty všechny plné texty vydavatelů?

Ne. Bibliografické záznamy, abstrakty a plné texty jsou různé typy obsahu. To, zda je plný text dostupný, závisí na zdroji, Open Access a vašich stávajících licencích. Tarif EUVIMED nenahrazuje dodatečná vydavatelská práva.

Zobrazit tarify →