EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

GENA-LM: a family of open-source foundational DNA language models for long sequences

Veniamin Fishman iD, Yuri Kuratov iD, Aleksei Shmelev iD, Maxim Petrov, Dmitry Penzar iD, Denis Shepelin, Nikolay Chekanov iD, Olga Kardymon iD, Mikhail Burtsev iD

Nucleic Acids Research · 11.01.2025 · 53 (2)

DOI: 10.1093/nar/gkae1310 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Nucleic Acids Research, online erschienen am 15.01.2025. Verfasst von Veniamin Fishman und 8 weiteren Autor:innen. Beteiligte Einrichtung: AIRI, Presnenskaya embankment, 6 st22, Moscow, 123112, Russia. Hauptthemen laut MEDLINE: Software, Genomics, DNA, Sequence Analysis, DNA. Die Arbeit wurde bisher 105-mal zitiert (Crossref) und nennt 65 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0). Gefördert von: AIRI.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Recent advancements in genomics, propelled by artificial intelligence, have unlocked unprecedented capabilities in interpreting genomic sequences, mitigating the need for exhaustive experimental analysis of complex, intertwined molecular processes inherent in DNA function. A significant challenge, however, resides in accurately decoding genomic sequences, which inherently involves comprehending rich contextual information dispersed across thousands of nucleotides. To address this need, we introduce GENA language model (GENA-LM), a suite of transformer-based foundational DNA language models capable of handling input lengths up to 36 000 base pairs. Notably, integrating the newly developed recurrent memory mechanism allows these models to process even larger DNA segments. We provide pre-trained versions of GENA-LM, including multispecies and taxon-specific models, demonstrating their capability for fine-tuning and addressing a spectrum of complex biological tasks with modest computational demands. While language models have already achieved significant breakthroughs in protein biology, GENA-LM showcases a similarly promising potential for reshaping the landscape of genomics and multi-omics data analysis. All models are publicly available on GitHub (https://github.com/AIRI-Institute/GENA_LM) and on HuggingFace (https://huggingface.co/AIRI-Institute). In addition, we provide a web service (https://dnalm.airi.net/) allowing user-friendly DNA annotation with GENA-LM models.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

SoftwareGenomicsDNASequence Analysis, DNAHumansArtificial Intelligence

Substanzen

DNA

Autor:innen und Institutionen

  • AIRI, Presnenskaya embankment, 6 st22, Moscow, 123112, Russia.
  • Institute of Cytology and Genetics, Prospekt Akademika Lavrent'yeva, 10, Novosibirsk, 630090, Russia.
  • Moscow Institute of Physics and Technology, 9 Institutskiy per., Dolgoprudny, Moscow, 141701, Russia.
  • HSE University, International laboratory of statistical and computational genomics, Moscow, 109028, Russia.
  • London Institute for Mathematical Sciences Royal Institution, 21 Albemarle St, London W1S 4BS, UK.

ORCID-Profile: Veniamin Fishman, Yuri Kuratov, Aleksei Shmelev, Dmitry Penzar, Nikolay Chekanov, Olga Kardymon, Mikhail Burtsev

Förderung

  • AIRI

Zitieren

APA

Fishman, V., Kuratov, Y., Shmelev, A., Petrov, M., Penzar, D., Shepelin, D., Chekanov, N., Kardymon, O., & Burtsev, M. (2025). GENA-LM: a family of open-source foundational DNA language models for long sequences. Nucleic Acids Research, 53(2). https://doi.org/10.1093/nar/gkae1310

Vancouver

Fishman V, Kuratov Y, Shmelev A, Petrov M, Penzar D, Shepelin D, et al. GENA-LM: a family of open-source foundational DNA language models for long sequences. Nucleic Acids Research. 2025;53(2). doi:10.1093/nar/gkae1310

BibTeX
@article{Fishman2025,
  author = {Fishman, Veniamin and Kuratov, Yuri and Shmelev, Aleksei and Petrov, Maxim and Penzar, Dmitry and Shepelin, Denis and Chekanov, Nikolay and Kardymon, Olga and Burtsev, Mikhail},
  title = {GENA-LM: a family of open-source foundational DNA language models for long sequences},
  journal = {Nucleic Acids Research},
  year = {2025},
  volume = {53},
  number = {2},
  doi = {10.1093/nar/gkae1310}
}
Kostenlos starten →