EUVIMEDEUVIMED entdecken
Open Access

Gender Bias When Using Artificial Intelligence to Assess Anorexia Nervosa on Social Media: Data-Driven Study

David Solans Noguero iD, Diana Ramírez-Cifuentes iD, Esteban Andrés Ríssola iD, Ana Freire iD

Journal of Medical Internet Research · 08.06.2023 · 25 · e45184

DOI: 10.2196/45184 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Medical Internet Research, online erschienen am 08.06.2023. Verfasst von David Solans Noguero und 3 weiteren Autor:innen. Beteiligte Einrichtung: Telefonica I+D, Telefónica Research, Barcelona, Spain. Hauptthemen laut MEDLINE: Anorexia Nervosa, Social Media, Feeding and Eating Disorders. Die Arbeit wurde bisher 22-mal zitiert (Crossref) und nennt 55 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Social media sites are becoming an increasingly important source of information about mental health disorders. Among them, eating disorders are complex psychological problems that involve unhealthy eating habits. In particular, there is evidence showing that signs and symptoms of anorexia nervosa can be traced in social media platforms. Knowing that input data biases tend to be amplified by artificial intelligence algorithms and, in particular, machine learning, these methods should be revised to mitigate biased discrimination in such important domains.

Objective

The main goal of this study was to detect and analyze the performance disparities across genders in algorithms trained for the detection of anorexia nervosa on social media posts. We used a collection of automated predictors trained on a data set in Spanish containing cases of 177 users that showed signs of anorexia (471,262 tweets) and 326 control cases (910,967 tweets).

Methods

We first inspected the predictive performance differences between the algorithms for male and female users. Once biases were detected, we applied a feature-level bias characterization to evaluate the source of such biases and performed a comparative analysis of such features and those that are relevant for clinicians. Finally, we showcased different bias mitigation strategies to develop fairer automated classifiers, particularly for risk assessment in sensitive domains.

Results

Our results revealed concerning predictive performance differences, with substantially higher false negative rates (FNRs) for female samples (FNR=0.082) compared with male samples (FNR=0.005). The findings show that biological processes and suicide risk factors were relevant for classifying positive male cases, whereas age, emotions, and personal concerns were more relevant for female cases. We also proposed techniques for bias mitigation, and we could see that, even though disparities can be mitigated, they cannot be eliminated.

Conclusions

We concluded that more attention should be paid to the assessment of biases in automated methods dedicated to the detection of mental health issues. This is particularly relevant before the deployment of systems that are thought to assist clinicians, especially considering that the outputs of such systems can have an impact on the diagnosis of people at risk.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Anorexia NervosaSocial MediaFeeding and Eating DisordersFemaleHumansMaleArtificial IntelligenceSexism

Stichwörter der Autor:innen

anorexia nervosaartificial intelligencegender biassocial media

Autor:innen und Institutionen

  • Telefonica I+D, Telefónica Research, Barcelona, Spain.
  • Web Science and Social Computing group, Universidad Pompeu Fabra, Barcelona, Spain.
  • Computer Vision Center, Bellaterra (Cerdanyola del Vallès), Spain.
  • Departamento de Ciencias Básicas, Universidad Nacional de Luján, Luján, Argentina.
  • Innovation and Sustainability Data Lab, UPF Barcelona School of Management, Barcelona, Spain.

ORCID-Profile: David Solans Noguero, Diana Ramírez-Cifuentes, Esteban Andrés Ríssola, Ana Freire

Zitieren

APA

Solans Noguero, D., Ramírez-Cifuentes, D., Ríssola, E. A., & Freire, A. (2023). Gender Bias When Using Artificial Intelligence to Assess Anorexia Nervosa on Social Media: Data-Driven Study. Journal of Medical Internet Research, 25, e45184. https://doi.org/10.2196/45184

Vancouver

Solans Noguero D, Ramírez-Cifuentes D, Ríssola EA, Freire A. Gender Bias When Using Artificial Intelligence to Assess Anorexia Nervosa on Social Media: Data-Driven Study. Journal of Medical Internet Research. 2023;25:e45184. doi:10.2196/45184

BibTeX
@article{SolansNoguero2023,
  author = {Solans Noguero, David and Ramírez-Cifuentes, Diana and Ríssola, Esteban Andrés and Freire, Ana},
  title = {Gender Bias When Using Artificial Intelligence to Assess Anorexia Nervosa on Social Media: Data-Driven Study},
  journal = {Journal of Medical Internet Research},
  year = {2023},
  volume = {25},
  pages = {e45184},
  doi = {10.2196/45184}
}
Kostenlos starten →