EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Enhancing Medical Department Prediction in Chinese Clinical Records via BERT Fine-Tuning and Rare-Class Augmentation

Mohammed Salah Ibrahim, Mohammed Al-Jabbar, Rida E Moustafa

Journal of Artificial Intelligence in Medical Applications · 2025

DOI: 10.65511/jaima.v1i1.735 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Artificial Intelligence in Medical Applications, 2025. Verfasst von Mohammed Salah Ibrahim und 2 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Accurately predicting the appropriate referral department from clinical records is essential for improving triage efficiency, resource allocation, and overall hospital workflow. In this study, we present an end-to-end pipeline for department prediction using unstructured Chinese electronic health records (EHRs) from the publicly available MedCD dataset. The dataset contains detailed admission notes written in natural Chinese, which often introduce challenges such as class imbalance and linguistic variability. To address these issues, we applied a series of preprocessing steps, including the removal of incomplete records, the consolidation of closely related departments (e.g., orthopedic sub-units), and the exclusion of labels with very low sample frequency. To further mitigate class imbalance, we used nlpcda, a Chinese-specific data augmentation toolkit, which generated additional samples for underrepresented classes through synonym substitution and textual perturbation. The augmented dataset was then balanced using class-weighted loss functions. For classification, we fine-tuned the Chinese-BERT-wwm-ext model on the processed dataset. Evaluation across multiple runs demonstrated clear performance gains, particularly in macro and weighted F1-scores. Overall accuracy reached 91%, while the macro F1-score improved from 0.66 (baseline) to 0.89 after augmentation. Departments with historically limited data—such as Radiology, Emergency Medicine, and Pain Management—showed marked improvement. In addition, we reported Top-3 prediction accuracy to better reflect real-world triage scenarios, where the correct department may reasonably be among the top three recommendations. These findings highlight the value of combining language-specific data augmentation with fine-tuned deep learning models for clinical text classification, especially in low-resource healthcare settings.

Zitieren

APA

Ibrahim, M. S., Al-Jabbar, M., & Moustafa, R. E. (2025). Enhancing Medical Department Prediction in Chinese Clinical Records via BERT Fine-Tuning and Rare-Class Augmentation. Journal of Artificial Intelligence in Medical Applications. https://doi.org/10.65511/jaima.v1i1.735

Vancouver

Ibrahim MS, Al-Jabbar M, Moustafa RE. Enhancing Medical Department Prediction in Chinese Clinical Records via BERT Fine-Tuning and Rare-Class Augmentation. Journal of Artificial Intelligence in Medical Applications. 2025. doi:10.65511/jaima.v1i1.735

BibTeX
@article{Ibrahim2025,
  author = {Ibrahim, Mohammed Salah and Al-Jabbar, Mohammed and Moustafa, Rida E},
  title = {Enhancing Medical Department Prediction in Chinese Clinical Records via BERT Fine-Tuning and Rare-Class Augmentation},
  journal = {Journal of Artificial Intelligence in Medical Applications},
  year = {2025},
  doi = {10.65511/jaima.v1i1.735}
}
Kostenlos starten →