EUVIMEDDécouvrir EUVIMED
Open access

Evaluation of Diagnostic Recommendations Embedded in Medication Alerts: Prospective Single-Arm Interventional Study

Yu-Chen Liu iD, Guan-Ling Lin iD, Jeremiah Scholl iD, Yi-Chun Hung iD, Yu-Jing Lin iD, Yu-Chuan Li iD, Hsuan-Chia Yang iD

Journal of Medical Internet Research · 2025-05-27 · 27 · e70731

DOI: 10.2196/70731 ↗

At a glance

Journal article in Journal of Medical Internet Research, published online on 2025-05-27. Written by Yu-Chen Liu and 6 co-authors. Institution: School of Nursing, College of Medicine, National Taiwan University, Taipei, Taiwan. Major MEDLINE topics: Decision Support Systems, Clinical, Medical Order Entry Systems. Cited 3 times so far (Crossref); 38 references. The full text is freely available in PubMed Central.

RésuméSubjectsRéférences bibliographiquesCiteRelated studies

Abstract (original language)

Background

Potentially inappropriate prescribing in outpatient care contributes to adverse outcomes and health care inefficiencies. Clinical decision support systems (CDSS) offer promising solutions, but their effectiveness is often constrained by incomplete medical records.

Objective

This study aims to evaluate the effectiveness of a machine learning–based CDSS for enhancing diagnostic recommendations, which are system-suggested diagnoses, ensuring that each prescribed medication has a corresponding diagnosis documented and meets medication appropriateness.

Methods

This prospective single-arm interventional study was conducted over 1 year in the outpatient departments of a hospital. The system provided diagnostic recommendations based on machine learning algorithms trained on data from the National Health Insurance Research Database. Outcome measures included alert rates, acceptance rates of diagnostic recommendations, and variability in system performance across specialties. Descriptive and trend analyses were used to evaluate the system’s effectiveness.

Results

This study included 438,558 prescriptions from 44 physicians across 23 specialties, involving 125,000 unique patients in the outpatient departments of a regional teaching hospital. MedGuard, embedded with diagnostic recommendations, achieved an overall alert rate of 2.28% and a diagnostic recommendation acceptance rate of 56.55%. All accepted recommendations resulted in actionable changes, including prescription adjustments or the addition of missing diagnoses. Ophthalmology achieved the highest acceptance rate at 96.59%, while rheumatology, surgery, psychiatry, and infectious disease recorded acceptance rates of 0%, 0%, 24.74%, and 35%, respectively. Over the years, acceptance rates for potentially inappropriate prescriptions stabilized at 51%, despite increasing prescription volumes.

Conclusions

This study demonstrates the potential of embedding diagnostic recommendations into alerts within a machine learning–based clinical decision support system to improve diagnostic completeness and support safer outpatient care. Future efforts should refine alerts to align with specialty-specific workflows and validate their effectiveness in diverse clinical settings.

Subjects

MeSH terms (MEDLINE)

Decision Support Systems, ClinicalMedical Order Entry SystemsProspective StudiesHumansMachine Learning

Author keywords

MedGuardalert fatigueclinical decision support systemdiagnostic recommendationsmachine learningoutpatient carepotentially inappropriate prescribing

Authors and institutions

  • School of Nursing, College of Medicine, National Taiwan University, Taipei, Taiwan.
  • Graduate Institute of Biomedical Informatics, College of Medical Science and Technology, Taipei Medical University, Taipei, Taiwan.
  • AESOP Technology, Taipei, Taiwan.
  • Department of Pharmacy, Tungs' Taichung MetroHarbor Hospital, Taichung, Taiwan.
  • International Center for Health Information Technology (ICHIT), Taipei Medical University, Taipei, Taiwan.
  • Clinical Big Data Research Center, Taipei Medical University Hospital, Taipei, Taiwan.

ORCID profiles: Yu-Chen Liu, Guan-Ling Lin, Jeremiah Scholl, Yi-Chun Hung, Yu-Jing Lin, Yu-Chuan Li, Hsuan-Chia Yang

Cite

APA

Liu, Y. C., Lin, G. L., Scholl, J., Hung, Y. C., Lin, Y. J., Li, Y. C., & Yang, H. C. (2025). Evaluation of Diagnostic Recommendations Embedded in Medication Alerts: Prospective Single-Arm Interventional Study. Journal of Medical Internet Research, 27, e70731. https://doi.org/10.2196/70731

Vancouver

Liu YC, Lin GL, Scholl J, Hung YC, Lin YJ, Li YC, et al. Evaluation of Diagnostic Recommendations Embedded in Medication Alerts: Prospective Single-Arm Interventional Study. Journal of Medical Internet Research. 2025;27:e70731. doi:10.2196/70731

BibTeX
@article{Liu2025,
  author = {Liu, Yu-Chen and Lin, Guan-Ling and Scholl, Jeremiah and Hung, Yi-Chun and Lin, Yu-Jing and Li, Yu-Chuan and Yang, Hsuan-Chia},
  title = {Evaluation of Diagnostic Recommendations Embedded in Medication Alerts: Prospective Single-Arm Interventional Study},
  journal = {Journal of Medical Internet Research},
  year = {2025},
  volume = {27},
  pages = {e70731},
  doi = {10.2196/70731}
}
Start for free →