EUVIMEDEUVIMED entdecken
Open Access

Semi-supervised learning from small annotated data and large unlabeled data for fine-grained Participants, Intervention, Comparison, and Outcomes entity recognition

Fangyi Chen iD, Gongbo Zhang iD, Yilu Fang iD, Yifan Peng iD, Chunhua Weng iD

Journal of the American Medical Informatics Association · 2025

DOI: 10.1093/jamia/ocae326 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of the American Medical Informatics Association, 2025. Verfasst von Fangyi Chen und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Biomedical Informatics, Columbia University, New York, NY 10032, United States. Hauptthemen laut MEDLINE: Supervised Machine Learning, Natural Language Processing, Data Mining, Information Storage and Retrieval. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 59 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: NHGRI NIH HHS, NLM NIH HHS, NCATS NIH HHS.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Objective

Extracting PICO elements—Participants, Intervention, Comparison, and Outcomes—from clinical trial literature is essential for clinical evidence retrieval, appraisal, and synthesis. Existing approaches do not distinguish the attributes of PICO entities. This study aims to develop a named entity recognition (NER) model to extract PICO entities with fine granularities. Materials and Methods Using a corpus of 2511 abstracts with PICO mentions from 4 public datasets, we developed a semi-supervised method to facilitate the training of a NER model, FinePICO, by combining limited annotated data of PICO entities and abundant unlabeled data. For evaluation, we divided the entire dataset into 2 subsets: a smaller group with annotations and a larger group without annotations. We then established the theoretical lower and upper performance bounds based on the performance of supervised learning models trained solely on the small, annotated subset and on the entire set with complete annotations, respectively. Finally, we evaluated FinePICO on both the smaller annotated subset and the larger, initially unannotated subset. We measured the performance of FinePICO using precision, recall, and F1.

Results

Our method achieved precision/recall/F1 of 0.567/0.636/0.60, respectively, using a small set of annotated samples, outperforming the baseline model (F1: 0.437) by more than 16%. The model demonstrates generalizability to a different PICO framework and to another corpus, which consistently outperforms the benchmark in diverse experimental settings (P-value < .001).

Discussion

We developed FinePICO to recognize fine-grained PICO entities from text and validated its performance across diverse experimental settings, highlighting the feasibility of using semi-supervised learning (SSL) techniques to enhance PICO entities extraction. Future work can focus on optimizing SSL algorithms to improve efficiency and reduce computational costs.

Conclusion

This study contributes a generalizable and effective semi-supervised approach leveraging large unlabeled data together with small, annotated data for fine-grained PICO extraction.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Supervised Machine LearningNatural Language ProcessingData MiningInformation Storage and RetrievalClinical Trials as TopicHumans

Stichwörter der Autor:innen

PICO extractionfine-grained PICO extractionnamed entity recognitionsemi-supervised learning

Autor:innen und Institutionen

  • Department of Biomedical Informatics, Columbia University, New York, NY 10032, United States.
  • Department of Population Health Sciences, Weill Cornell Medicine, New York, NY 10065, United States.

ORCID-Profile: Fangyi Chen, Gongbo Zhang, Yilu Fang, Yifan Peng, Chunhua Weng

Förderung

  • NHGRI NIH HHS
  • NLM NIH HHS
  • NCATS NIH HHS
  • NIH HHS
  • National Library of Medicine
  • National Human Genome Research Institute
  • National Center for Advancing Translational Sciences
  • National Institutes of Health

Zitieren

APA

Chen, F., Zhang, G., Fang, Y., Peng, Y., & Weng, C. (2025). Semi-supervised learning from small annotated data and large unlabeled data for fine-grained Participants, Intervention, Comparison, and Outcomes entity recognition. Journal of the American Medical Informatics Association. https://doi.org/10.1093/jamia/ocae326

Vancouver

Chen F, Zhang G, Fang Y, Peng Y, Weng C. Semi-supervised learning from small annotated data and large unlabeled data for fine-grained Participants, Intervention, Comparison, and Outcomes entity recognition. Journal of the American Medical Informatics Association. 2025. doi:10.1093/jamia/ocae326

BibTeX
@article{Chen2025,
  author = {Chen, Fangyi and Zhang, Gongbo and Fang, Yilu and Peng, Yifan and Weng, Chunhua},
  title = {Semi-supervised learning from small annotated data and large unlabeled data for fine-grained Participants, Intervention, Comparison, and Outcomes entity recognition},
  journal = {Journal of the American Medical Informatics Association},
  year = {2025},
  doi = {10.1093/jamia/ocae326}
}
Kostenlos starten →