Evaluating the performance of ChatGPT in responding to myotonic dystrophy type 1 patient inquiries: a specialist physician-based study
Yazarlar (4)
Dr. Öğr. Üyesi Gülşah ÇELİK Kastamonu Üniversitesi, Türkiye
Dr. Öğr. Üyesi Hanife Hale Hekim Sağlık Bilimleri Üniversitesi, Türkiye
Meral Bilgilisoy Filiz
Sağlık Bilimleri Üniversitesi, Türkiye
Naciye Füsun Toraman
Sağlık Bilimleri Üniversitesi, Türkiye
Makale Türü Açık Erişim Özgün Makale (SSCI, AHCI, SCI, SCI-Exp dergilerinde yayınlanan tam makale)
Dergi Adı BMC Neurology (Q3)
Dergi ISSN 1471-2377 Dergi Bilgileri (2026)
Dergi Tarandığı Indeksler SCI-Expanded
Makale Dili Türkçe Basım Tarihi 05-2026
Kabul Tarihi 15-05-2026 Yayınlanma Tarihi 25-05-2026
Cilt / Sayı / Sayfa 26 / 1 / – DOI 10.1186/s12883-026-05005-1
Makale Linki https://doi.org/10.1186/s12883-026-05005-1
UAK Araştırma Alanları
Fiziksel Tıp ve Rehabilitasyon
Özet
Background: Advancements in artificial intelligence have led to the widespread use of large language models such as ChatGPT in healthcare communication. Myotonic dystrophy type 1, a chronic and multisystemic neuromuscular disorder, poses significant challenges for patients in understanding disease progression, symptom management, and future planning. Given the scarcity of specialized resources for rare diseases, AI-based tools may offer valuable support by delivering accessible and relevant information. This study aimed to evaluate ChatGPT-4o’s performance in addressing patient-centered questions about myotonic dystrophy type 1. Methods: This descriptive methodological study utilized ten frequently asked patient-style questions concerning myotonic dystrophy type 1, posed to ChatGPT-4o in Turkish using a standardized zero-shot prompting approach. A total of 53 specialist physicians in Physical Medicine and Rehabilitation and Neurology assessed the responses using a structured rubric across five domains: accuracy, currency, comprehensiveness, usefulness, and understandability. Each response was scored from 1 to 5. Results: ChatGPT-4o achieved high specialist physicians’ satisfaction across all domains, with over 80% of responses rated ≥ 4. Accuracy received the highest score (85.7%), followed by usefulness and comprehensiveness (above 82%). Currency and understandability were rated slightly lower (81.9% and 81.5%, respectively). Conclusion: ChatGPT-4o generated responses that were generally accurate, relevant, and understandable, demonstrating promise as an accessible resource for rare disease contexts such as myotonic dystrophy type 1. It also showed strong potential as a supportive informational tool for specialist physicians. Ongoing model refinement and integration with up-to-date clinical data are essential to optimize its performance and ensure its safe, equitable use in healthcare communication.
Anahtar Kelimeler
Artificial intelligence | ChatGPT | Expert opinion | Large language models | Myotonic dystrophy
Pdf İndir Creative Commons License
BM Sürdürülebilir Kalkınma Amaçları
Atıf Sayıları
Web of Science 1
Scopus 1
PubMed 1
Evaluating the performance of ChatGPT in responding to myotonic dystrophy type 1 patient inquiries: a specialist physician-based study