Enhancing Medical Department Prediction in Chinese Clinical Records via BERT Fine-Tuning and Rare-Class Augmentation
Journal of Artificial Intelligence in Medical Applications · 2025
DOI: 10.65511/jaima.v1i1.735 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Artificial Intelligence in Medical Applications, 2025. Verfasst von Mohammed Salah Ibrahim und 2 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Accurately predicting the appropriate referral department from clinical records is essential for improving triage efficiency, resource allocation, and overall hospital workflow. In this study, we present an end-to-end pipeline for department prediction using unstructured Chinese electronic health records (EHRs) from the publicly available MedCD dataset. The dataset contains detailed admission notes written in natural Chinese, which often introduce challenges such as class imbalance and linguistic variability. To address these issues, we applied a series of preprocessing steps, including the removal of incomplete records, the consolidation of closely related departments (e.g., orthopedic sub-units), and the exclusion of labels with very low sample frequency. To further mitigate class imbalance, we used nlpcda, a Chinese-specific data augmentation toolkit, which generated additional samples for underrepresented classes through synonym substitution and textual perturbation. The augmented dataset was then balanced using class-weighted loss functions. For classification, we fine-tuned the Chinese-BERT-wwm-ext model on the processed dataset. Evaluation across multiple runs demonstrated clear performance gains, particularly in macro and weighted F1-scores. Overall accuracy reached 91%, while the macro F1-score improved from 0.66 (baseline) to 0.89 after augmentation. Departments with historically limited data—such as Radiology, Emergency Medicine, and Pain Management—showed marked improvement. In addition, we reported Top-3 prediction accuracy to better reflect real-world triage scenarios, where the correct department may reasonably be among the top three recommendations. These findings highlight the value of combining language-specific data augmentation with fine-tuned deep learning models for clinical text classification, especially in low-resource healthcare settings.
Zitieren
APA
Ibrahim, M. S., Al-Jabbar, M., & Moustafa, R. E. (2025). Enhancing Medical Department Prediction in Chinese Clinical Records via BERT Fine-Tuning and Rare-Class Augmentation. Journal of Artificial Intelligence in Medical Applications. https://doi.org/10.65511/jaima.v1i1.735
Vancouver
Ibrahim MS, Al-Jabbar M, Moustafa RE. Enhancing Medical Department Prediction in Chinese Clinical Records via BERT Fine-Tuning and Rare-Class Augmentation. Journal of Artificial Intelligence in Medical Applications. 2025. doi:10.65511/jaima.v1i1.735
BibTeX
@article{Ibrahim2025,
author = {Ibrahim, Mohammed Salah and Al-Jabbar, Mohammed and Moustafa, Rida E},
title = {Enhancing Medical Department Prediction in Chinese Clinical Records via BERT Fine-Tuning and Rare-Class Augmentation},
journal = {Journal of Artificial Intelligence in Medical Applications},
year = {2025},
doi = {10.65511/jaima.v1i1.735}
}
EUVIMED