EUVIMEDOpdag EUVIMED
Mixed-Methods-Studie

Development of Depression Data Sets and a Language Model for Depression Detection: Mixed Methods Study

Faye Beatriz Tumaliuan, Lorelie Grepo, Eugene Rex Jalao

JMIR Data · 2024

DOI: 10.2196/53365 ↗

At a glance

Mixed-Methods-Studie in JMIR Data, 2024. Written by Faye Beatriz Tumaliuan and 2 co-authors. Cited 3 times so far (Crossref); 44 references.

AbstractBibliografiske oplysningerCiteRelated studies

Abstract (original language)

Background

Depression detection in social media has gained attention in recent years with the help of natural language processing (NLP) techniques. Because of the low-resource standing of Filipino depression data, valid data sets need to be created to aid various machine learning techniques in depression detection classification tasks.

Objective

The primary objective is to build a depression corpus of Philippine Twitter users who were clinically diagnosed with depression by mental health professionals and develop from this a corpus of depression symptoms that can later serve as a baseline for predicting depression symptoms in the Filipino and English languages.

Methods

The proposed process included the implementation of clinical screening methods with the help of clinical psychologists in the recruitment of study participants who were young adults aged 18 to 30 years. A total of 72 participants were assessed by clinical psychologists and provided their Twitter data: 60 with depression and 12 with no depression. Six participants provided 2 Twitter accounts each, making 78 Twitter accounts. A data set was developed consisting of depression symptom–annotated tweets with 13 depression categories. These were created through manual annotation in a process constructed, guided, and validated by clinical psychologists.

Results

Three annotators completed the process for approximately 79,614 tweets, resulting in a substantial interannotator agreement score of 0.735 using Fleiss κ and a 95.59% psychologist validation score. A word2vec language model was developed using Filipino and English data sets to create a 300-feature word embedding that can be used in various machine learning techniques for NLP.

Conclusions

This study contributes to depression research by constructing depression data sets from social media to aid NLP in the Philippine setting. These 2 validated data sets can be significant in user detection or tweet-level detection of depression in young adults in further studies.

Cite

APA

Tumaliuan, F. B., Grepo, L., & Jalao, E. R. (2024). Development of Depression Data Sets and a Language Model for Depression Detection: Mixed Methods Study. JMIR Data. https://doi.org/10.2196/53365

Vancouver

Tumaliuan FB, Grepo L, Jalao ER. Development of Depression Data Sets and a Language Model for Depression Detection: Mixed Methods Study. JMIR Data. 2024. doi:10.2196/53365

BibTeX
@article{Tumaliuan2024,
  author = {Tumaliuan, Faye Beatriz and Grepo, Lorelie and Jalao, Eugene Rex},
  title = {Development of Depression Data Sets and a Language Model for Depression Detection: Mixed Methods Study},
  journal = {JMIR Data},
  year = {2024},
  doi = {10.2196/53365}
}
Start for free →