EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Bayesian hyperparameter optimization improves scGPT fine-tuning for single-cell multi-omics integration

Darren Yu Jun Tay, Nguyen Quoc Khanh Le iD, Matthew Chin Heng Chua

Bioinformatics · 02.07.2026 · 42 (7)

DOI: 10.1093/bioinformatics/btag374 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Bioinformatics, online erschienen am 12.06.2026. Verfasst von Darren Yu Jun Tay und 2 weiteren Autor:innen. Beteiligte Einrichtung: Science Research Programme, Catholic Junior College, Singapore 297822, Singapore. Hauptthemen laut MEDLINE: Multiomics, Single-Cell Analysis, Computational Biology, Software. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 39 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Science and Technology Council.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Motivation Foundation models such as scGPT have demonstrated strong potential for single-cell multi-omics integration; however, their downstream performance is highly sensitive to hyperparameter selection. Manual fine-tuning remains computationally expensive, dataset-dependent, and often irreproducible. Despite the increasing adoption of foundation models in single-cell analysis, systematic strategies for robust hyperparameter optimization remain underexplored. Results We developed a Bayesian optimization framework based on Tree-structured Parzen Estimators (TPE) for automated fine-tuning of scGPT and evaluated its performance on two benchmark bone marrow mononuclear cell (BMMC) multi-omics datasets, including CITE-seq and GSE194122 datasets. Across datasets, Bayesian optimization consistently improved biological conservation and batch integration metrics compared with default scGPT configurations. On the original BMMC benchmark, optimization improved AvgBIO from 0.59 to 0.67 and PCR from 0.33 to 0.52. On the GSE194122 dataset, the default configuration exhibited unstable convergence and weak biological preservation (AvgBIO = 0.19; ARI = 0.007), whereas Bayesian optimization substantially improved integration performance (AvgBIO = 0.60; ARI = 0.63) while reducing validation loss from 137 to 47.1. These findings demonstrate substantial dataset-specific sensitivity of scGPT fine-tuning and highlight the importance of automated optimization for stable deployment across heterogeneous multi-omics datasets. Our study demonstrates that Bayesian optimization provides an effective and reproducible strategy for stabilizing scGPT fine-tuning across diverse single-cell multi-omics datasets. Rather than introducing a new integration architecture, this work emphasizes the importance of systematic optimization for improving robustness and reproducibility of foundation-model applications in computational biology. Availability and implementation Our model and dataset are freely available at: https://github.com/daren642/scGPT_multiomic_tuning.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

MultiomicsSingle-Cell AnalysisComputational BiologySoftwareBayes TheoremAlgorithmsHumans

Autor:innen und Institutionen

  • Science Research Programme, Catholic Junior College, Singapore 297822, Singapore.
  • AIBioMed Lab, Taipei Medical University, Taipei 110, Taiwan.
  • In-Service Master Program in Artificial Intelligence in Medicine, College of Medicine, Taipei Medical University, Taipei 110, Taiwan.
  • Translational Imaging Research Center, Taipei Medical University Hospital, Taipei 110, Taiwan.
  • Department of Biomedical Informatics, Yong Loo Lin School of Medicine, National University of Singapore, Singapore 119615, Singapore.

ORCID-Profile: Nguyen Quoc Khanh Le

Förderung

  • National Science and Technology Council

Zitieren

APA

Tay, D. Y. J., Le, N. Q. K., & Chua, M. C. H. (2026). Bayesian hyperparameter optimization improves scGPT fine-tuning for single-cell multi-omics integration. Bioinformatics, 42(7). https://doi.org/10.1093/bioinformatics/btag374

Vancouver

Tay DYJ, Le NQK, Chua MCH. Bayesian hyperparameter optimization improves scGPT fine-tuning for single-cell multi-omics integration. Bioinformatics. 2026;42(7). doi:10.1093/bioinformatics/btag374

BibTeX
@article{Tay2026,
  author = {Tay, Darren Yu Jun and Le, Nguyen Quoc Khanh and Chua, Matthew Chin Heng},
  title = {Bayesian hyperparameter optimization improves scGPT fine-tuning for single-cell multi-omics integration},
  journal = {Bioinformatics},
  year = {2026},
  volume = {42},
  number = {7},
  doi = {10.1093/bioinformatics/btag374}
}
Kostenlos starten →