EUVIMEDEUVIMED entdecken
Open Access

Evaluation of Diagnostic Recommendations Embedded in Medication Alerts: Prospective Single-Arm Interventional Study

Yu-Chen Liu iD, Guan-Ling Lin iD, Jeremiah Scholl iD, Yi-Chun Hung iD, Yu-Jing Lin iD, Yu-Chuan Li iD, Hsuan-Chia Yang iD

Journal of Medical Internet Research · 27.05.2025 · 27 · e70731

DOI: 10.2196/70731 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Medical Internet Research, online erschienen am 27.05.2025. Verfasst von Yu-Chen Liu und 6 weiteren Autor:innen. Beteiligte Einrichtung: School of Nursing, College of Medicine, National Taiwan University, Taipei, Taiwan. Hauptthemen laut MEDLINE: Decision Support Systems, Clinical, Medical Order Entry Systems. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 38 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Potentially inappropriate prescribing in outpatient care contributes to adverse outcomes and health care inefficiencies. Clinical decision support systems (CDSS) offer promising solutions, but their effectiveness is often constrained by incomplete medical records.

Objective

This study aims to evaluate the effectiveness of a machine learning–based CDSS for enhancing diagnostic recommendations, which are system-suggested diagnoses, ensuring that each prescribed medication has a corresponding diagnosis documented and meets medication appropriateness.

Methods

This prospective single-arm interventional study was conducted over 1 year in the outpatient departments of a hospital. The system provided diagnostic recommendations based on machine learning algorithms trained on data from the National Health Insurance Research Database. Outcome measures included alert rates, acceptance rates of diagnostic recommendations, and variability in system performance across specialties. Descriptive and trend analyses were used to evaluate the system’s effectiveness.

Results

This study included 438,558 prescriptions from 44 physicians across 23 specialties, involving 125,000 unique patients in the outpatient departments of a regional teaching hospital. MedGuard, embedded with diagnostic recommendations, achieved an overall alert rate of 2.28% and a diagnostic recommendation acceptance rate of 56.55%. All accepted recommendations resulted in actionable changes, including prescription adjustments or the addition of missing diagnoses. Ophthalmology achieved the highest acceptance rate at 96.59%, while rheumatology, surgery, psychiatry, and infectious disease recorded acceptance rates of 0%, 0%, 24.74%, and 35%, respectively. Over the years, acceptance rates for potentially inappropriate prescriptions stabilized at 51%, despite increasing prescription volumes.

Conclusions

This study demonstrates the potential of embedding diagnostic recommendations into alerts within a machine learning–based clinical decision support system to improve diagnostic completeness and support safer outpatient care. Future efforts should refine alerts to align with specialty-specific workflows and validate their effectiveness in diverse clinical settings.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Decision Support Systems, ClinicalMedical Order Entry SystemsProspective StudiesHumansMachine Learning

Stichwörter der Autor:innen

MedGuardalert fatigueclinical decision support systemdiagnostic recommendationsmachine learningoutpatient carepotentially inappropriate prescribing

Autor:innen und Institutionen

  • School of Nursing, College of Medicine, National Taiwan University, Taipei, Taiwan.
  • Graduate Institute of Biomedical Informatics, College of Medical Science and Technology, Taipei Medical University, Taipei, Taiwan.
  • AESOP Technology, Taipei, Taiwan.
  • Department of Pharmacy, Tungs' Taichung MetroHarbor Hospital, Taichung, Taiwan.
  • International Center for Health Information Technology (ICHIT), Taipei Medical University, Taipei, Taiwan.
  • Clinical Big Data Research Center, Taipei Medical University Hospital, Taipei, Taiwan.

ORCID-Profile: Yu-Chen Liu, Guan-Ling Lin, Jeremiah Scholl, Yi-Chun Hung, Yu-Jing Lin, Yu-Chuan Li, Hsuan-Chia Yang

Zitieren

APA

Liu, Y. C., Lin, G. L., Scholl, J., Hung, Y. C., Lin, Y. J., Li, Y. C., & Yang, H. C. (2025). Evaluation of Diagnostic Recommendations Embedded in Medication Alerts: Prospective Single-Arm Interventional Study. Journal of Medical Internet Research, 27, e70731. https://doi.org/10.2196/70731

Vancouver

Liu YC, Lin GL, Scholl J, Hung YC, Lin YJ, Li YC, et al. Evaluation of Diagnostic Recommendations Embedded in Medication Alerts: Prospective Single-Arm Interventional Study. Journal of Medical Internet Research. 2025;27:e70731. doi:10.2196/70731

BibTeX
@article{Liu2025,
  author = {Liu, Yu-Chen and Lin, Guan-Ling and Scholl, Jeremiah and Hung, Yi-Chun and Lin, Yu-Jing and Li, Yu-Chuan and Yang, Hsuan-Chia},
  title = {Evaluation of Diagnostic Recommendations Embedded in Medication Alerts: Prospective Single-Arm Interventional Study},
  journal = {Journal of Medical Internet Research},
  year = {2025},
  volume = {27},
  pages = {e70731},
  doi = {10.2196/70731}
}
Kostenlos starten →