GP-DHT: A dual-head transformer with supervised contrastive learning for shared-gene pretraining and single-cell GRN prediction
PLOS One · 2026
DOI: 10.1371/journal.pone.0359164 ↗Kurz gefasst
Fachartikel in der Zeitschrift PLOS One, 2026. Verfasst von Shuai Yan und 3 weiteren Autor:innen. Beteiligte Einrichtung: School of Information Engineering, Jingdezhen Ceramic University, Jingdezhen, Jiangxi, China. Hauptthemen laut MEDLINE: Gene Regulatory Networks, Single-Cell Analysis, Computational Biology, Supervised Machine Learning. Die Arbeit nennt 36 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China.
Abstract (Originalsprache)
Gene Regulatory Networks (GRNs) are crucial for understanding cell fate decisions and disease mechanisms. However, inferring GRNs from single-cell RNA sequencing remains challenging due to noise, data sparsity, and species-specific distribution variations. We propose GP-DHT (Gene Pair–Dual Head Transformer), a single-cell GRN inference framework that pre-trains gene representations on a unified shared gene space using the BEELINE datasets of humans and mice. It models gene-cell expression relationships through a multi-relational heterograph and predicts transcription factor (TF)-target regulatory links using a dual-head Transformer. These two heads correspond to complementary task objectives: a classification head for regulatory link prediction and a projection head for gene pair-level supervised contrastive learning. This design enables the model to optimize both prediction accuracy and representation separability in a sparse single-cell setting. The human-mouse shared-gene stage is used to initialize expression-derived gene representations in a harmonized gene space. During dataset-wise supervised training, GenePairSupCon is applied within each training fold to regularize gene-pair representations, followed by fine-tuning and evaluation within each BEELINE dataset. To enhance reproducibility and interpretability, we further clarify the mapping of orthologous genes and gene symbol unification, TF-level data partitioning and leakage control, negative label sensitivity, and quantitative embedding quality assessment. Hard negative example experiments show that negative label construction has a substantial impact on task difficulty, while supervised contrastive learning significantly improves the separability of embeddings, as measured by Silhouette score, Davies-Bouldin index, Calinski-Harabasz score, and inter/intra distance ratio. GP-DHT can also recover prior-supported candidate regulatory modules and provide additional interpretable support through post-hoc pair-level attribution analysis on frozen predictors. In summary, these results support GP-DHT as a robust shared gene representation learning framework for dataset-level single-cell GRN prediction.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Substanzen
Autor:innen und Institutionen
- School of Information Engineering, Jingdezhen Ceramic University, Jingdezhen, Jiangxi, China.
ORCID-Profile: Xiang Cheng
Förderung
- National Natural Science Foundation of China
Zitieren
APA
Yan, S., Yu, Q., Dai, W., & Cheng, X. (2026). GP-DHT: A dual-head transformer with supervised contrastive learning for shared-gene pretraining and single-cell GRN prediction. PLOS One. https://doi.org/10.1371/journal.pone.0359164
Vancouver
Yan S, Yu Q, Dai W, Cheng X. GP-DHT: A dual-head transformer with supervised contrastive learning for shared-gene pretraining and single-cell GRN prediction. PLOS One. 2026. doi:10.1371/journal.pone.0359164
BibTeX
@article{Yan2026,
author = {Yan, Shuai and Yu, Qingzhi and Dai, Wenfeng and Cheng, Xiang},
title = {GP-DHT: A dual-head transformer with supervised contrastive learning for shared-gene pretraining and single-cell GRN prediction},
journal = {PLOS One},
year = {2026},
doi = {10.1371/journal.pone.0359164}
}
EUVIMED