BERT vs. Logistic Regression: Classifying Mental Health-Related Text Using Machine Learning and Natural Language Processing
International Journal of Computer Applications · 16.05.2026 · 187 (104) · 32-39
DOI: 10.5120/ijca1dc7d28ef5a6 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal of Computer Applications, online erschienen am 16.05.2026. Verfasst von Amila Hrnjić und 1 weiteren Autor:innen.
Abstract (Originalsprache)
With the rise of mental health discussions in online spaces, the ability to automatically detect emotionally sensitive content has become increasingly important.This study compares traditional machine learning (ML) methods with deep learning models to evaluate their effectiveness in classifying mental health-related texts.Two models were tested: Logistic regression (LR) with TF-IDF features and the BERT transformer model.A balanced dataset containing labeled text samples was used, with standard natural language processing (NLP) preprocessing applied.Model performance was evaluated using precision, recall, F1-score, and AUC.Results show that BERT outperforms logistic regression across all metrics, achieving an F1-score of 0.95 and an AUC of 0.99.Confusion matrices and ROC curves confirmed BERT's superior accuracy and its ability to reduce false classifications.These findings highlight the strength of deep learning models in understanding nuanced language, which is crucial in the mental health domain.Overall, the study confirms that transformer-based models like BERT offer a more reliable approach to classifying emotionally sensitive content, with promising applications in early detection tools and mental health support systems.
Zitieren
APA
Hrnjić, A., & Altoka, Z. (2026). BERT vs. Logistic Regression: Classifying Mental Health-Related Text Using Machine Learning and Natural Language Processing. International Journal of Computer Applications, 187(104), 32-39. https://doi.org/10.5120/ijca1dc7d28ef5a6
Vancouver
Hrnjić A, Altoka Z. BERT vs. Logistic Regression: Classifying Mental Health-Related Text Using Machine Learning and Natural Language Processing. International Journal of Computer Applications. 2026;187(104):32-39. doi:10.5120/ijca1dc7d28ef5a6
BibTeX
@article{Hrnji2026,
author = {Hrnjić, Amila and Altoka, Zerina},
title = {BERT vs. Logistic Regression: Classifying Mental Health-Related Text Using Machine Learning and Natural Language Processing},
journal = {International Journal of Computer Applications},
year = {2026},
volume = {187},
number = {104},
pages = {32--39},
doi = {10.5120/ijca1dc7d28ef5a6}
}
EUVIMED