A transformer-based language model reveals developmental constraint and network complexity during zebrafish embryogenesis
PNAS Nexus · 29.06.2026 · 5 (7)
DOI: 10.1093/pnasnexus/pgag223 ↗Kurz gefasst
Fachartikel in der Zeitschrift PNAS Nexus, online erschienen am 18.06.2026. Verfasst von Juan F Poyatos. Beteiligte Einrichtung: National Museum of Natural Sciences (MNCN-CSIC), Madrid 28006, Spain. Die Arbeit nennt 34 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0). Gefördert von: MICIU, AEI, ERDF.
Abstract (Originalsprache)
Understanding how regulatory complexity and constraint shape organismal development remains a central challenge in biology. The developmental hourglass framework posits that mid-embryogenesis—the phylotypic stage—is a period of heightened conservation and coordinated regulatory organization. We test this hypothesis using Zebraformer, a transformer-based language model trained on single-cell transcriptomic data from zebrafish embryos. Zebraformer learns context-sensitive representations that capture temporal progression, anatomical identity, and regulatory relationships, yielding gene and cell embeddings that recapitulate the developmental axis and increasing transcriptional divergence over time. In contrast, attention-derived gene networks reveal a transient reorganization of regulatory architecture during the phylotypic stage, marked by tightly coordinated gene modules, reduced cross-module connectivity, and diminished local redundancy. Sensitivity to perturbation emerges specifically when regulatory interaction structure is taken into account, rather than from perturbation magnitude alone, highlighting that constraint during this stage is embedded in network topology rather than representational fragility. These findings are supported by graph-theoretic metrics and gene ontology enrichment analyses. Together, our results refine the hourglass framework by localizing developmental constraint to the architecture of gene regulatory networks and demonstrate that language models can extract interpretable biological structure from high-dimensional single-cell data.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- National Museum of Natural Sciences (MNCN-CSIC), Madrid 28006, Spain.
ORCID-Profile: Juan F Poyatos
Förderung
- MICIU
- AEI
- ERDF
Zitieren
APA
Poyatos, J. F. (2026). A transformer-based language model reveals developmental constraint and network complexity during zebrafish embryogenesis. PNAS Nexus, 5(7). https://doi.org/10.1093/pnasnexus/pgag223
Vancouver
Poyatos JF. A transformer-based language model reveals developmental constraint and network complexity during zebrafish embryogenesis. PNAS Nexus. 2026;5(7). doi:10.1093/pnasnexus/pgag223
BibTeX
@article{Poyatos2026,
author = {Poyatos, Juan F},
title = {A transformer-based language model reveals developmental constraint and network complexity during zebrafish embryogenesis},
journal = {PNAS Nexus},
year = {2026},
volume = {5},
number = {7},
doi = {10.1093/pnasnexus/pgag223}
}
EUVIMED