EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Comprehensive benchmarking of large language models for RNA secondary structure prediction

Luciano I Zablocki iD, Leandro A Bugnon iD, Matias Gerard, Leandro Di Persia iD, Georgina Stegmayer iD, Diego H Milone iD

Briefings in Bioinformatics · 04.03.2025 · 26 (2)

DOI: 10.1093/bib/bbaf137 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Briefings in Bioinformatics, online erschienen am 10.04.2025. Verfasst von Luciano I Zablocki und 5 weiteren Autor:innen. Beteiligte Einrichtung: Research Institute for Signals, Systems and Computational Intelligence, sinc (i), FICH-UNL/CONICET, Ruta Nacional Nº 168, km 472.4, Santa Fe (3000), …. Hauptthemen laut MEDLINE: RNA, Nucleic Acid Conformation. Die Arbeit wurde bisher 29-mal zitiert (Crossref) und nennt 79 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In recent years, inspired by the success of large language models (LLMs) for DNA and proteins, several LLMs for RNA have also been developed. These models take massive RNA datasets as inputs and learn, in a self-supervised way, how to represent each RNA base with a semantically rich numerical vector. This is done under the hypothesis that obtaining high-quality RNA representations can enhance data-costly downstream tasks, such as the fundamental RNA secondary structure prediction problem. However, existing RNA-LLM have not been evaluated for this task in a unified experimental setup. Since they are pretrained models, assessment of their generalization capabilities on new structures is a crucial aspect. Nonetheless, this has been just partially addressed in literature. In this work we present a comprehensive experimental and comparative analysis of pretrained RNA-LLM that have been recently proposed. We evaluate the use of these representations for the secondary structure prediction task with a common deep learning architecture. The RNA-LLM were assessed with increasing generalization difficulty on benchmark datasets. Results showed that two LLMs clearly outperform the other models, and revealed significant challenges for generalization in low-homology scenarios. Moreover, in this study we provide curated benchmark datasets of increasing complexity and a unified experimental setup for this scientific endeavor. Source code and curated benchmark datasets with increasing complexity are available in the repository: https://github.com/sinc-lab/rna-llm-folding/.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

RNANucleic Acid ConformationBenchmarkingComputational BiologyDeep LearningLarge Language Models

Stichwörter der Autor:innen

RNA structurelarge language models

Substanzen

RNA

Autor:innen und Institutionen

  • Research Institute for Signals, Systems and Computational Intelligence, sinc (i), FICH-UNL/CONICET, Ruta Nacional Nº 168, km 472.4, Santa Fe (3000), Argentina.

ORCID-Profile: Luciano I Zablocki, Leandro A Bugnon, Leandro Di Persia, Georgina Stegmayer, Diego H Milone

Zitieren

APA

Zablocki, L. I., Bugnon, L. A., Gerard, M., Di Persia, L., Stegmayer, G., & Milone, D. H. (2025). Comprehensive benchmarking of large language models for RNA secondary structure prediction. Briefings in Bioinformatics, 26(2). https://doi.org/10.1093/bib/bbaf137

Vancouver

Zablocki LI, Bugnon LA, Gerard M, Di Persia L, Stegmayer G, Milone DH. Comprehensive benchmarking of large language models for RNA secondary structure prediction. Briefings in Bioinformatics. 2025;26(2). doi:10.1093/bib/bbaf137

BibTeX
@article{Zablocki2025,
  author = {Zablocki, Luciano I and Bugnon, Leandro A and Gerard, Matias and Di Persia, Leandro and Stegmayer, Georgina and Milone, Diego H},
  title = {Comprehensive benchmarking of large language models for RNA secondary structure prediction},
  journal = {Briefings in Bioinformatics},
  year = {2025},
  volume = {26},
  number = {2},
  doi = {10.1093/bib/bbaf137}
}
Kostenlos starten →