EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Contextual Semantic Pattern Recognition for Mental Health Monitoring Using ClinicalBERT Transformers

Junjun Sun iD

Brain and Behavior · 2026-11 · 16 (11)

DOI: 10.1002/brb3.71879 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Brain and Behavior, online erschienen am 02.11.2026. Verfasst von Junjun Sun. Beteiligte Einrichtung: School of Foreign Languages, Shandong Vocational and Technical University of International Studies, Rizhao, Shandong, China. Hauptthemen laut MEDLINE: Pattern Recognition, Automated, Semantics, Mental Disorders, Mental Health. Die Arbeit nennt 54 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Purpose

This study aimed to develop an interpretable ClinicalBERT‐based framework for mental health monitoring using structured clinical data.

Method

Because the Mental Health Diagnosis and Treatment Monitoring dataset contains structured patient attributes rather than free‐text clinical narratives, a structured‐to‐text transformation module was used to convert the records into contextual descriptions suitable for ClinicalBERT. The proposed model was compared with Random Forest, XGBoost, Bidirectional Encoder Representations from Transformers (BERT), TabTransformer, and a Deep Neural Network, and to strengthen the experimental comparison, contemporary tabular transformer models, including SAINT and FT‐Transformer, were also evaluated. Model performance was assessed using accuracy, precision, recall, and F1‐score. Cross‐validation, confidence interval analysis, statistical significance testing, and ablation experiments were conducted to examine the reliability of the results. SHAP and LIME were used to explain global feature contributions and individual predictions. Finding ClinicalBERT achieved an accuracy of 90.2%, a precision of 90.5%, a recall of 90.4%, and an F1‐score of 90.6%, outperforming all comparison models. The additional validation analyses supported the stability of the results. SHAP and LIME further identified the patient attributes that contributed most strongly to the model's predictions.

Conclusion

The findings indicate that structured clinical records can be transformed into contextual representations for transformer‐based mental health monitoring. The framework combines predictive performance with interpretable output, although its evaluation is currently limited to a single dataset. Further validation using multi‐institutional and prospective data is required.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Pattern Recognition, AutomatedSemanticsMental DisordersMental HealthHumans

Stichwörter der Autor:innen

ClinicalBERTTransformerscontextual semantic representationdeep learningexplainable artificial intelligencemental health monitoring

Autor:innen und Institutionen

  • School of Foreign Languages, Shandong Vocational and Technical University of International Studies, Rizhao, Shandong, China.

ORCID-Profile: Junjun Sun

Zitieren

APA

Sun, J. (2026). Contextual Semantic Pattern Recognition for Mental Health Monitoring Using ClinicalBERT Transformers. Brain and Behavior, 16(11). https://doi.org/10.1002/brb3.71879

Vancouver

Sun J. Contextual Semantic Pattern Recognition for Mental Health Monitoring Using ClinicalBERT Transformers. Brain and Behavior. 2026;16(11). doi:10.1002/brb3.71879

BibTeX
@article{Sun2026,
  author = {Sun, Junjun},
  title = {Contextual Semantic Pattern Recognition for Mental Health Monitoring Using ClinicalBERT Transformers},
  journal = {Brain and Behavior},
  year = {2026},
  volume = {16},
  number = {11},
  doi = {10.1002/brb3.71879}
}
Kostenlos starten →