EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

Evaluation of BERT-Based Models on Patient Data from French Social Media

Emma Le Priol, Manissa Talmatkadi, Stéphane Schück, Nathalie Texier, Anita Burgun

Studies in Health Technology and Informatics · 2024

DOI: 10.3233/shti240556 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Studies in Health Technology and Informatics, 2024. Verfasst von Emma Le Priol und 4 weiteren Autor:innen. Beteiligte Einrichtung: HeKA team, Inria, Inserm, France. Hauptthemen laut MEDLINE: Social Media. Die Arbeit wurde bisher 1-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

With the objective of extracting new knowledge about rare diseases from social media messages, we evaluated three models on a Named Entity Recognition (NER) task, consisting of extracting phenotypes and treatments from social media messages. We trained the three models on a dataset with social media messages about Developmental and Epileptic Encephalopathies and more common diseases. This preliminary study revealed that CamemBERT and CamemBERT-bio exhibit similar performance on social media testimonials, slightly outperforming DrBERT. It also highlighted that their performance was lower on this type of data than on structured health datasets. Limitations, including a narrow focus on NER performance and dataset-specific evaluation, call for further research to fully assess model capabilities on larger and more diverse datasets.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Social MediaFranceHumansNatural Language ProcessingData MiningRare Diseases

Stichwörter der Autor:innen

BERTFrenchdevelopmental and epileptic encephalopathieshealthrare diseasestransformersword embeddings

Autor:innen und Institutionen

  • HeKA team, Inria, Inserm, France.
  • Université Paris-Cité, France.
  • Kap Code, Paris, France.
  • Clinical Bioinformatics group, Institut Imagine, France.
  • Department of Medical Informatics, Necker Hospital, AP-HP, France.

Zitieren

APA

Le Priol, E., Talmatkadi, M., Schück, S., Texier, N., & Burgun, A. (2024). Evaluation of BERT-Based Models on Patient Data from French Social Media. Studies in Health Technology and Informatics. https://doi.org/10.3233/shti240556

Vancouver

Le Priol E, Talmatkadi M, Schück S, Texier N, Burgun A. Evaluation of BERT-Based Models on Patient Data from French Social Media. Studies in Health Technology and Informatics. 2024. doi:10.3233/shti240556

BibTeX
@article{LePriol2024,
  author = {Le Priol, Emma and Talmatkadi, Manissa and Schück, Stéphane and Texier, Nathalie and Burgun, Anita},
  title = {Evaluation of BERT-Based Models on Patient Data from French Social Media},
  journal = {Studies in Health Technology and Informatics},
  year = {2024},
  doi = {10.3233/shti240556}
}
Kostenlos starten →