Implementation and Evaluation of an Open-Source Chatbot for Patient Information Leaflets
Future Internet · 09.03.2026 · 18 (3) · 139
DOI: 10.3390/fi18030139 ↗Kurz gefasst
Fachartikel in der Zeitschrift Future Internet, online erschienen am 09.03.2026. Verfasst von Lisa Heiler und 3 weiteren Autor:innen. Die Arbeit nennt 22 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Accessing and understanding medication information can be challenging for many people, especially when patient information leaflets (PILs) are long, complex, and printed in small font. This study presents MediChat, an open-source, locally executable chatbot designed to provide reliable, easy-to-read answers to medication-related questions based exclusively on official PILs. MediChat follows a retrieval-augmented generation (RAG) architecture: PILs from the Austrian Medicinal Product Index are received via API, converted to text, split into overlapping chunks, embedded, and stored in a Chroma vector database. From there the top-k relevant chunks are retrieved, and Llama 3.1 generates German responses based on this evidence. The system was evaluated using a hybrid framework. Quantitatively, 200 yes/no questions across ten drugs were answered with 80% accuracy, overall precision 0.977, recall 0.686, F1-score 0.806, and a mean response time of 727 ms. Qualitatively, two personas were used in eight simulated dialogues. Response times were around 1.1–1.3 s, and task completion exceeded 85% with high ratings for relevance and quantity. These results indicate that an open-source RAG chatbot can deliver leaflet-grounded, user-friendly medication information and provide a reproducible template for future healthcare chatbot evaluations.
Zitieren
APA
Heiler, L., Kirchsteiger, K., Hanke, S., & Bödenler, M. (2026). Implementation and Evaluation of an Open-Source Chatbot for Patient Information Leaflets. Future Internet, 18(3), 139. https://doi.org/10.3390/fi18030139
Vancouver
Heiler L, Kirchsteiger K, Hanke S, Bödenler M. Implementation and Evaluation of an Open-Source Chatbot for Patient Information Leaflets. Future Internet. 2026;18(3):139. doi:10.3390/fi18030139
BibTeX
@article{Heiler2026,
author = {Heiler, Lisa and Kirchsteiger, Katharina and Hanke, Sten and Bödenler, Markus},
title = {Implementation and Evaluation of an Open-Source Chatbot for Patient Information Leaflets},
journal = {Future Internet},
year = {2026},
volume = {18},
number = {3},
pages = {139},
doi = {10.3390/fi18030139}
}
EUVIMED