EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A Modular Evaluation of AI-Assisted Clinical Documentation

Julien Delaunay, Maissaa Sarkis, Jordi Solé-Casals, Jordi Cusido

Applied Sciences · 10.07.2026 · 16 (14) · 6961

DOI: 10.3390/app16146961 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 10.07.2026. Verfasst von Julien Delaunay und 3 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 74 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Spanish Ministry for Digital Transformation and Public Function, European Union.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Clinical documentation in Electronic Health Records (EHRs) remains a substantial source of administrative burden for clinicians. In this study, we evaluate a modular AI-assisted clinical documentation pipeline using two complementary approaches: (1) a controlled benchmark based on multilingual synthetic clinical dialogues, and (2) an observational analysis of real-world usage traces from routine deployments. The benchmark enables systematic comparison of ASR–LLM configurations under fully controlled conditions, using metrics for transcription accuracy (Word Error Rate and Medical WER), report-generation quality, and modeled processing cost. Within this benchmark setting, Voxtral showed the strongest ASR performance among the evaluated models, while GPT-4o and Gemini 1.5 Pro showed the strongest report-generation performance under the automated evaluation used in this study. The real-world trace analysis should be interpreted as descriptive evidence of operational use, not as prospective clinical validation or as a direct evaluation of any single benchmarked configuration. Taken together, the results support the use of this pipeline as a human-supervised draft-generation tool that still requires clinician review, local workflow evaluation, and prospective clinical validation before broader deployment.

Förderung

  • Spanish Ministry for Digital Transformation and Public Function
  • European Union

Zitieren

APA

Delaunay, J., Sarkis, M., Solé-Casals, J., & Cusido, J. (2026). A Modular Evaluation of AI-Assisted Clinical Documentation. Applied Sciences, 16(14), 6961. https://doi.org/10.3390/app16146961

Vancouver

Delaunay J, Sarkis M, Solé-Casals J, Cusido J. A Modular Evaluation of AI-Assisted Clinical Documentation. Applied Sciences. 2026;16(14):6961. doi:10.3390/app16146961

BibTeX
@article{Delaunay2026,
  author = {Delaunay, Julien and Sarkis, Maissaa and Solé-Casals, Jordi and Cusido, Jordi},
  title = {A Modular Evaluation of AI-Assisted Clinical Documentation},
  journal = {Applied Sciences},
  year = {2026},
  volume = {16},
  number = {14},
  pages = {6961},
  doi = {10.3390/app16146961}
}
Kostenlos starten →