Retrieval-augmented generation for personalized physician recommendations in online medical services: model development study
Optimizations in Applied Machine Learning · 2025
DOI: 10.71070/oaml.v5i1.141 ↗Kurz gefasst
Fachartikel in der Zeitschrift Optimizations in Applied Machine Learning, 2025. Verfasst von Yingbin Zheng und 7 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).
Abstract (Originalsprache)
Web-based medical services have expanded access to healthcare through remote consultations and streamlined scheduling, but personalized physician recommendations remain limited due to reliance on manual triage. This study developed and validated a Retrieval-Augmented Generation-Based Physician Recommendation (RAGPR) model to enhance triage performance. Using 646,383 consultation records from the Internet Hospital of the First Affiliated Hospital of Xiamen University, we evaluated embedding models (FastText, SBERT, OpenAI) for clustering and classification, as well as large language models (Mistral, GPT-4o-mini, GPT-4o). Three triage staff also assessed model efficiency via questionnaires. Results showed that FastText performed poorly (F1-score 46%), while SBERT and OpenAI achieved 95% and 96%. Among LLMs, GPT-4o reached the highest F1-score (95%) with a performance rating of 4.67, followed by Mistral (94%, 4.56) and GPT-4o-mini (92%, 4.45). Considering accuracy, cost, and implementation, SBERT and Mistral were optimal. The RAGPR model offers a scalable approach to improving accuracy and personalization in online patient– physician matching.
Zitieren
APA
Zheng, Y., Yan, Y., Chen, S., Cai, Y., Ren, K., Liu, Y., Zhuang, J., & Zhao, M. (2025). Retrieval-augmented generation for personalized physician recommendations in online medical services: model development study. Optimizations in Applied Machine Learning. https://doi.org/10.71070/oaml.v5i1.141
Vancouver
Zheng Y, Yan Y, Chen S, Cai Y, Ren K, Liu Y, et al. Retrieval-augmented generation for personalized physician recommendations in online medical services: model development study. Optimizations in Applied Machine Learning. 2025. doi:10.71070/oaml.v5i1.141
BibTeX
@article{Zheng2025,
author = {Zheng, Yingbin and Yan, Yiwei and Chen, Sai and Cai, Yunping and Ren, Kun and Liu, Yishan and Zhuang, Jiaying and Zhao, Min},
title = {Retrieval-augmented generation for personalized physician recommendations in online medical services: model development study},
journal = {Optimizations in Applied Machine Learning},
year = {2025},
doi = {10.71070/oaml.v5i1.141}
}
EUVIMED