Evaluation of BERT-Based Models on Patient Data from French Social Media
Studies in Health Technology and Informatics · 2024
DOI: 10.3233/shti240556 ↗Kurz gefasst
Fachartikel in der Zeitschrift Studies in Health Technology and Informatics, 2024. Verfasst von Emma Le Priol und 4 weiteren Autor:innen. Beteiligte Einrichtung: HeKA team, Inria, Inserm, France. Hauptthemen laut MEDLINE: Social Media. Die Arbeit wurde bisher 1-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).
Abstract (Originalsprache)
With the objective of extracting new knowledge about rare diseases from social media messages, we evaluated three models on a Named Entity Recognition (NER) task, consisting of extracting phenotypes and treatments from social media messages. We trained the three models on a dataset with social media messages about Developmental and Epileptic Encephalopathies and more common diseases. This preliminary study revealed that CamemBERT and CamemBERT-bio exhibit similar performance on social media testimonials, slightly outperforming DrBERT. It also highlighted that their performance was lower on this type of data than on structured health datasets. Limitations, including a narrow focus on NER performance and dataset-specific evaluation, call for further research to fully assess model capabilities on larger and more diverse datasets.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- HeKA team, Inria, Inserm, France.
- Université Paris-Cité, France.
- Kap Code, Paris, France.
- Clinical Bioinformatics group, Institut Imagine, France.
- Department of Medical Informatics, Necker Hospital, AP-HP, France.
Zitieren
APA
Le Priol, E., Talmatkadi, M., Schück, S., Texier, N., & Burgun, A. (2024). Evaluation of BERT-Based Models on Patient Data from French Social Media. Studies in Health Technology and Informatics. https://doi.org/10.3233/shti240556
Vancouver
Le Priol E, Talmatkadi M, Schück S, Texier N, Burgun A. Evaluation of BERT-Based Models on Patient Data from French Social Media. Studies in Health Technology and Informatics. 2024. doi:10.3233/shti240556
BibTeX
@article{LePriol2024,
author = {Le Priol, Emma and Talmatkadi, Manissa and Schück, Stéphane and Texier, Nathalie and Burgun, Anita},
title = {Evaluation of BERT-Based Models on Patient Data from French Social Media},
journal = {Studies in Health Technology and Informatics},
year = {2024},
doi = {10.3233/shti240556}
}
EUVIMED