Dynamic Factor Analysis for Sparse and Irregular Longitudinal Data: An Application to Metabolite Measurements in a COVID‐19 Study
Statistics in Medicine · 2026
DOI: 10.1002/sim.70499 ↗At a glance
Journal article in Statistics in Medicine, 2026. Written by Jiachen Cai and 2 co-authors. Institution: MRC Biostatistics Unit, University of Cambridge, Cambridge, UK. Major MEDLINE topics: COVID-19. Cited 1 times so far (Crossref); 44 references. The full text is freely available (open access, CC BY 4.0). Funded by: Medical Research Council.
Abstract (original language)
Factor analysis (FA) can be used to identify key biomarkers in biological processes by assuming that latent biological pathways (statistically, “latent factors”) drive the activity of measurable biomarkers (“observed variables”). However, biological pathways often interact, meaning that the classical FA assumption of independence between factors is questionable. Motivated by sparsely and irregularly collected longitudinal measurements of metabolites in a COVID‐19 study, we propose a dynamic factor analysis model that accounts for cross‐correlations between pathways via a multi‐output Gaussian processes (MOGP) prior on the factor trajectories. To mitigate against overfitting caused by sparsity of longitudinal measurements, we introduce a roughness penalty upon MOGP hyperparameters and allow for non‐zero mean functions. We also propose a scalable stochastic expectation maximization (StEM) algorithm that, in simulations, is both 20 times faster and provides more accurate and stable MOGP hyperparameter estimates than a previously‐proposed Monte Carlo Expectation Maximization algorithm. In the motivating COVID‐19 study, our methodology identifies a kynurenine pathway that affects the clinical severity of patients with COVID‐19 disease and uncovers the role of the biomarker taurine. Our R package DFA4SIL implements the proposed method.
Subjects
MeSH terms (MEDLINE)
Author keywords
Substances
Authors and institutions
- MRC Biostatistics Unit, University of Cambridge, Cambridge, UK.
ORCID profiles: Jiachen Cai, Brian D M Tom
Funding
- Medical Research Council
Cite
APA
Cai, J., Goudie, R. J. B., & Tom, B. D. M. (2026). Dynamic Factor Analysis for Sparse and Irregular Longitudinal Data: An Application to Metabolite Measurements in a COVID‐19 Study. Statistics in Medicine. https://doi.org/10.1002/sim.70499
Vancouver
Cai J, Goudie RJB, Tom BDM. Dynamic Factor Analysis for Sparse and Irregular Longitudinal Data: An Application to Metabolite Measurements in a COVID‐19 Study. Statistics in Medicine. 2026. doi:10.1002/sim.70499
BibTeX
@article{Cai2026,
author = {Cai, Jiachen and Goudie, Robert J B and Tom, Brian D M},
title = {Dynamic Factor Analysis for Sparse and Irregular Longitudinal Data: An Application to Metabolite Measurements in a COVID‐19 Study},
journal = {Statistics in Medicine},
year = {2026},
doi = {10.1002/sim.70499}
}
EUVIMED