Multi-Level Depression Severity Detection with Deep Transformers and Enhanced Machine Learning Techniques
AI · 15.07.2025 · 6 (7) · 157
DOI: 10.3390/ai6070157 ↗Kurz gefasst
Fachartikel in der Zeitschrift AI, online erschienen am 15.07.2025. Verfasst von Nisar Hussain und 6 weiteren Autor:innen. Die Arbeit wurde bisher 22-mal zitiert (Crossref) und nennt 40 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: CONACYT, Mexico, Secretaría de Investigación y Posgrado of the Instituto Politécnico Nacional, Mexico, Microsoft through the Microsoft Latin America PhD Award.
Abstract (Originalsprache)
Depression is now one of the most common mental health concerns in the digital era, calling for powerful computational tools for its detection and its level of severity estimation. A multi-level depression severity detection framework in the Reddit social media network is proposed in this study, and posts are classified into four levels: minimum, mild, moderate, and severe. We take a dual approach using classical machine learning (ML) algorithms and recent Transformer-based architectures. For the ML track, we build ten classifiers, including Logistic Regression, SVM, Naive Bayes, Random Forest, XGBoost, Gradient Boosting, K-NN, Decision Tree, AdaBoost, and Extra Trees, with two recently proposed embedding methods, Word2Vec and GloVe embeddings, and we fine-tune them for mental health text classification. Of these, XGBoost yields the highest F1-score of 94.01 using GloVe embeddings. For the deep learning track, we fine-tune ten Transformer models, covering BERT, RoBERTa, XLM-RoBERTa, MentalBERT, BioBERT, RoBERTa-large, DistilBERT, DeBERTa, Longformer, and ALBERT. The highest performance was achieved by the MentalBERT model, with an F1-score of 97.31, followed by RoBERTa (96.27) and RoBERTa-large (96.14). Our results demonstrate that, to the best of the authors’ knowledge, domain-transferred Transformers outperform non-Transformer-based ML methods in capturing subtle linguistic cues indicative of different levels of depression, thereby highlighting their potential for fine-grained mental health monitoring in online settings.
Förderung
- CONACYT, Mexico
- Secretaría de Investigación y Posgrado of the Instituto Politécnico Nacional, Mexico
- Microsoft through the Microsoft Latin America PhD Award
Zitieren
APA
Hussain, N., Qasim, A., Mehak, G., Zain, M., Sidorov, G., Gelbukh, A., & Kolesnikova, O. (2025). Multi-Level Depression Severity Detection with Deep Transformers and Enhanced Machine Learning Techniques. AI, 6(7), 157. https://doi.org/10.3390/ai6070157
Vancouver
Hussain N, Qasim A, Mehak G, Zain M, Sidorov G, Gelbukh A, et al. Multi-Level Depression Severity Detection with Deep Transformers and Enhanced Machine Learning Techniques. AI. 2025;6(7):157. doi:10.3390/ai6070157
BibTeX
@article{Hussain2025,
author = {Hussain, Nisar and Qasim, Amna and Mehak, Gull and Zain, Muhammad and Sidorov, Grigori and Gelbukh, Alexander and Kolesnikova, Olga},
title = {Multi-Level Depression Severity Detection with Deep Transformers and Enhanced Machine Learning Techniques},
journal = {AI},
year = {2025},
volume = {6},
number = {7},
pages = {157},
doi = {10.3390/ai6070157}
}
EUVIMED