EUVIMEDOpdag EUVIMED
Open access · CC BY 4.0

Dynamic Factor Analysis for Sparse and Irregular Longitudinal Data: An Application to Metabolite Measurements in a COVID‐19 Study

Jiachen Cai iD, Robert J B Goudie, Brian D M Tom iD

Statistics in Medicine · 2026

DOI: 10.1002/sim.70499 ↗

At a glance

Journal article in Statistics in Medicine, 2026. Written by Jiachen Cai and 2 co-authors. Institution: MRC Biostatistics Unit, University of Cambridge, Cambridge, UK. Major MEDLINE topics: COVID-19. Cited 1 times so far (Crossref); 44 references. The full text is freely available (open access, CC BY 4.0). Funded by: Medical Research Council.

AbstractSubjectsBibliografiske oplysningerCiteRelated studies

Abstract (original language)

Factor analysis (FA) can be used to identify key biomarkers in biological processes by assuming that latent biological pathways (statistically, “latent factors”) drive the activity of measurable biomarkers (“observed variables”). However, biological pathways often interact, meaning that the classical FA assumption of independence between factors is questionable. Motivated by sparsely and irregularly collected longitudinal measurements of metabolites in a COVID‐19 study, we propose a dynamic factor analysis model that accounts for cross‐correlations between pathways via a multi‐output Gaussian processes (MOGP) prior on the factor trajectories. To mitigate against overfitting caused by sparsity of longitudinal measurements, we introduce a roughness penalty upon MOGP hyperparameters and allow for non‐zero mean functions. We also propose a scalable stochastic expectation maximization (StEM) algorithm that, in simulations, is both 20 times faster and provides more accurate and stable MOGP hyperparameter estimates than a previously‐proposed Monte Carlo Expectation Maximization algorithm. In the motivating COVID‐19 study, our methodology identifies a kynurenine pathway that affects the clinical severity of patients with COVID‐19 disease and uncovers the role of the biomarker taurine. Our R package DFA4SIL implements the proposed method.

Subjects

MeSH terms (MEDLINE)

COVID-19HumansLongitudinal StudiesAlgorithmsBiomarkersFactor Analysis, StatisticalMonte Carlo MethodComputer SimulationSARS-CoV-2Normal DistributionModels, StatisticalPandemicsStochastic Processes

Author keywords

COVID‐19dynamic factor analysislongitudinal high‐dimensional datamulti‐output Gaussian processsparse datastochastic expectation maximization

Substances

Biomarkers

Authors and institutions

  • MRC Biostatistics Unit, University of Cambridge, Cambridge, UK.

ORCID profiles: Jiachen Cai, Brian D M Tom

Funding

  • Medical Research Council

Cite

APA

Cai, J., Goudie, R. J. B., & Tom, B. D. M. (2026). Dynamic Factor Analysis for Sparse and Irregular Longitudinal Data: An Application to Metabolite Measurements in a COVID‐19 Study. Statistics in Medicine. https://doi.org/10.1002/sim.70499

Vancouver

Cai J, Goudie RJB, Tom BDM. Dynamic Factor Analysis for Sparse and Irregular Longitudinal Data: An Application to Metabolite Measurements in a COVID‐19 Study. Statistics in Medicine. 2026. doi:10.1002/sim.70499

BibTeX
@article{Cai2026,
  author = {Cai, Jiachen and Goudie, Robert J B and Tom, Brian D M},
  title = {Dynamic Factor Analysis for Sparse and Irregular Longitudinal Data: An Application to Metabolite Measurements in a COVID‐19 Study},
  journal = {Statistics in Medicine},
  year = {2026},
  doi = {10.1002/sim.70499}
}
Start for free →