SpADE-BERT: Multilingual BERT-Based Model with Trigram-Sensitive Tokenization, Tuned for Depression Detection in Spanish Texts
AI · 01.02.2026 · 7 (2) · 48
DOI: 10.3390/ai7020048 ↗Kurz gefasst
Fachartikel in der Zeitschrift AI, online erschienen am 01.02.2026. Verfasst von Abdiel Reyes-Vera und 3 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 54 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: SIP-IPN.
Themen: Depression
Abstract (Originalsprache)
This article proposes an automated approach, based on artificial intelligence techniques, for detecting indicators of depression in texts written in Spanish. Among the main contributions is the construction of a new specialized corpus, supervised by mental health professionals and based on the Beck Depression Inventory. Text processing included linguistic techniques such as lemmatization, stopword removal, and structural transformation using trigrams. As part of the work, SpADE-BERT was designed, a model based on multilingual BERT with a tokenization scheme adapted to incorporate trigrams directly from the input phase. This modification allowed for more robust interaction between the local context and semantic representations. SpADE-BERT was evaluated against multiple approaches reported in the literature, which employ algorithms such as logistic regression, support vector machines, decision trees, and Random Forest with advanced configurations and specialized preprocessing. In all cases, our model showed consistently superior performance on metrics such as precision, recall, and F1-score. The results show that integrating deep language models with adapted tokenization strategies can significantly strengthen the automated identification of linguistic signals associated with depression in Spanish texts.
Förderung
- SIP-IPN
Zitieren
APA
Reyes-Vera, A., Saldana-Perez, M., Moreno-Ibarra, M., & Posadas-Durán, J. P. F. (2026). SpADE-BERT: Multilingual BERT-Based Model with Trigram-Sensitive Tokenization, Tuned for Depression Detection in Spanish Texts. AI, 7(2), 48. https://doi.org/10.3390/ai7020048
Vancouver
Reyes-Vera A, Saldana-Perez M, Moreno-Ibarra M, Posadas-Durán JPF. SpADE-BERT: Multilingual BERT-Based Model with Trigram-Sensitive Tokenization, Tuned for Depression Detection in Spanish Texts. AI. 2026;7(2):48. doi:10.3390/ai7020048
BibTeX
@article{ReyesVera2026,
author = {Reyes-Vera, Abdiel and Saldana-Perez, Magdalena and Moreno-Ibarra, Marco and Posadas-Durán, Juan Pablo Francisco},
title = {SpADE-BERT: Multilingual BERT-Based Model with Trigram-Sensitive Tokenization, Tuned for Depression Detection in Spanish Texts},
journal = {AI},
year = {2026},
volume = {7},
number = {2},
pages = {48},
doi = {10.3390/ai7020048}
}
EUVIMED