EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Implementation and Evaluation of an Open-Source Chatbot for Patient Information Leaflets

Lisa Heiler, Katharina Kirchsteiger, Sten Hanke, Markus Bödenler

Future Internet · 09.03.2026 · 18 (3) · 139

DOI: 10.3390/fi18030139 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Future Internet, online erschienen am 09.03.2026. Verfasst von Lisa Heiler und 3 weiteren Autor:innen. Die Arbeit nennt 22 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Accessing and understanding medication information can be challenging for many people, especially when patient information leaflets (PILs) are long, complex, and printed in small font. This study presents MediChat, an open-source, locally executable chatbot designed to provide reliable, easy-to-read answers to medication-related questions based exclusively on official PILs. MediChat follows a retrieval-augmented generation (RAG) architecture: PILs from the Austrian Medicinal Product Index are received via API, converted to text, split into overlapping chunks, embedded, and stored in a Chroma vector database. From there the top-k relevant chunks are retrieved, and Llama 3.1 generates German responses based on this evidence. The system was evaluated using a hybrid framework. Quantitatively, 200 yes/no questions across ten drugs were answered with 80% accuracy, overall precision 0.977, recall 0.686, F1-score 0.806, and a mean response time of 727 ms. Qualitatively, two personas were used in eight simulated dialogues. Response times were around 1.1–1.3 s, and task completion exceeded 85% with high ratings for relevance and quantity. These results indicate that an open-source RAG chatbot can deliver leaflet-grounded, user-friendly medication information and provide a reproducible template for future healthcare chatbot evaluations.

Zitieren

APA

Heiler, L., Kirchsteiger, K., Hanke, S., & Bödenler, M. (2026). Implementation and Evaluation of an Open-Source Chatbot for Patient Information Leaflets. Future Internet, 18(3), 139. https://doi.org/10.3390/fi18030139

Vancouver

Heiler L, Kirchsteiger K, Hanke S, Bödenler M. Implementation and Evaluation of an Open-Source Chatbot for Patient Information Leaflets. Future Internet. 2026;18(3):139. doi:10.3390/fi18030139

BibTeX
@article{Heiler2026,
  author = {Heiler, Lisa and Kirchsteiger, Katharina and Hanke, Sten and Bödenler, Markus},
  title = {Implementation and Evaluation of an Open-Source Chatbot for Patient Information Leaflets},
  journal = {Future Internet},
  year = {2026},
  volume = {18},
  number = {3},
  pages = {139},
  doi = {10.3390/fi18030139}
}
Kostenlos starten →