EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

Retrieval-augmented generation for personalized physician recommendations in online medical services: model development study

Yingbin Zheng, Yiwei Yan, Sai Chen, Yunping Cai, Kun Ren, Yishan Liu, Jiaying Zhuang, Min Zhao

Optimizations in Applied Machine Learning · 2025

DOI: 10.71070/oaml.v5i1.141 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Optimizations in Applied Machine Learning, 2025. Verfasst von Yingbin Zheng und 7 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Web-based medical services have expanded access to healthcare through remote consultations and streamlined scheduling, but personalized physician recommendations remain limited due to reliance on manual triage. This study developed and validated a Retrieval-Augmented Generation-Based Physician Recommendation (RAGPR) model to enhance triage performance. Using 646,383 consultation records from the Internet Hospital of the First Affiliated Hospital of Xiamen University, we evaluated embedding models (FastText, SBERT, OpenAI) for clustering and classification, as well as large language models (Mistral, GPT-4o-mini, GPT-4o). Three triage staff also assessed model efficiency via questionnaires. Results showed that FastText performed poorly (F1-score 46%), while SBERT and OpenAI achieved 95% and 96%. Among LLMs, GPT-4o reached the highest F1-score (95%) with a performance rating of 4.67, followed by Mistral (94%, 4.56) and GPT-4o-mini (92%, 4.45). Considering accuracy, cost, and implementation, SBERT and Mistral were optimal. The RAGPR model offers a scalable approach to improving accuracy and personalization in online patient– physician matching.

Zitieren

APA

Zheng, Y., Yan, Y., Chen, S., Cai, Y., Ren, K., Liu, Y., Zhuang, J., & Zhao, M. (2025). Retrieval-augmented generation for personalized physician recommendations in online medical services: model development study. Optimizations in Applied Machine Learning. https://doi.org/10.71070/oaml.v5i1.141

Vancouver

Zheng Y, Yan Y, Chen S, Cai Y, Ren K, Liu Y, et al. Retrieval-augmented generation for personalized physician recommendations in online medical services: model development study. Optimizations in Applied Machine Learning. 2025. doi:10.71070/oaml.v5i1.141

BibTeX
@article{Zheng2025,
  author = {Zheng, Yingbin and Yan, Yiwei and Chen, Sai and Cai, Yunping and Ren, Kun and Liu, Yishan and Zhuang, Jiaying and Zhao, Min},
  title = {Retrieval-augmented generation for personalized physician recommendations in online medical services: model development study},
  journal = {Optimizations in Applied Machine Learning},
  year = {2025},
  doi = {10.71070/oaml.v5i1.141}
}
Kostenlos starten →