EUVIMEDEUVIMED entdecken
VergleichsstudieOpen Access · CC BY 4.0

Assessment of CDASI scoring by a multimodal large language model: a comparative study with expert assessors

Marco Fornaro, Vincenzo Venerito, Swapnasha Panigrahi, Sara Sabbagh, Florenzo Iannone, Latika Gupta

Rheumatology International · 08.07.2026 · 46 (7)

DOI: 10.1007/s00296-026-06205-1 ↗

Kurz gefasst

Vergleichsstudie in der Zeitschrift Rheumatology International, online erschienen am 08.07.2026. Verfasst von Marco Fornaro und 5 weiteren Autor:innen. Beteiligte Einrichtung: Unit of Rheumatology, Department of Precision and Regenerative Medicine, University of Bari, Area Jonica (DiMePRe-J), Bari, Italy. Hauptthemen laut MEDLINE: Dermatomyositis. Die Arbeit nennt 16 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Large language models (LLMs) with multimodal capabilities may support automated assessment of cutaneous disease activity in dermatomyositis (DM). We evaluated the performance of Claude v3.5 Sonnet in scoring the Cutaneous Dermatomyositis Disease Area and Severity Index (CDASI) compared with expert rheumatologists. Thirty published DM cases with available clinical images were retrospectively analyzed. Two expert rheumatologists independently scored CDASI activity and damage domains. Claude v3.5 Sonnet assessed the same images using structured prompting based on CDASI definitions. Agreement was evaluated using intraclass correlation coefficients (ICCs) with a two-way random-effects model for absolute agreement. The LLM demonstrated better agreement for activity than for damage assessment. Global CDASI activity showed good agreement with expert raters (ICC 0.71, 95% CI 0.45–0.86), whereas damage reliability was lower (ICC 0.41, 95% CI 0.25–0.67). Agreement was moderate for activity-related domains including erythema (ICC 0.61), scaling (ICC 0.57), and erosions (ICC 0.57), while lower concordance was observed for chronic damage-related features such as poikiloderma (ICC 0.47, 95% CI 0.10–0.73). Hand assessments demonstrated the strongest performance, particularly for periungual changes (ICC 1.0, 95% CI 1.0–1.0) and global hand scores (ICC 0.95, 95% CI 0.91–0.97). The model also markedly reduced evaluation time compared with clinicians (42 s vs. 8.4 min per case), corresponding to an approximately 92% reduction in scoring time. Multimodal LLMs demonstrated promising agreement with expert raters for CDASI activity assessment and markedly improved efficiency, although lower reliability in damage domains reinforces the continued need for physician oversight.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

DermatomyositisHumansLarge Language ModelsSeverity of Illness IndexReproducibility of ResultsRetrospective StudiesObserver VariationPredictive Value of TestsRheumatologists

Stichwörter der Autor:innen

Artificial intelligenceDermatomyositisDisease activityLarge language modelsSkin diseases

Autor:innen und Institutionen

  • Unit of Rheumatology, Department of Precision and Regenerative Medicine, University of Bari, Area Jonica (DiMePRe-J), Bari, Italy.
  • University of Birmingham, Birmingham, UK.
  • Division of Rheumatology, Department of Pediatrics, Medical College of Wisconsin, Milwaukee, USA.
  • Department of Rheumatology, Royal Wolverhampton Hospitals NHS Trust, Wolverhampton, UK. drlatikagupta@gmail.com.
  • Department of Infection, School of Infection, Infammation and Immunology, College of Medicine and Health, University of Birmingham, Birmingham, UK. drlatikagupta@gmail.com.
  • Francis Crick Institute, London, UK. drlatikagupta@gmail.com.

Zitieren

APA

Fornaro, M., Venerito, V., Panigrahi, S., Sabbagh, S., Iannone, F., & Gupta, L. (2026). Assessment of CDASI scoring by a multimodal large language model: a comparative study with expert assessors. Rheumatology International, 46(7). https://doi.org/10.1007/s00296-026-06205-1

Vancouver

Fornaro M, Venerito V, Panigrahi S, Sabbagh S, Iannone F, Gupta L. Assessment of CDASI scoring by a multimodal large language model: a comparative study with expert assessors. Rheumatology International. 2026;46(7). doi:10.1007/s00296-026-06205-1

BibTeX
@article{Fornaro2026,
  author = {Fornaro, Marco and Venerito, Vincenzo and Panigrahi, Swapnasha and Sabbagh, Sara and Iannone, Florenzo and Gupta, Latika},
  title = {Assessment of CDASI scoring by a multimodal large language model: a comparative study with expert assessors},
  journal = {Rheumatology International},
  year = {2026},
  volume = {46},
  number = {7},
  doi = {10.1007/s00296-026-06205-1}
}
Kostenlos starten →