Instability of LLM text embeddings for unsupervised dimension reduction of tabular data
Frontiers in Bioinformatics · 27.07.2026 · 6
DOI: 10.3389/fbinf.2026.1851023 ↗Kurz gefasst
Fachartikel in der Zeitschrift Frontiers in Bioinformatics, online erschienen am 27.07.2026. Verfasst von Jun Li und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Applied and Computational Mathematics and Statistics, University of Notre Dame, Notre Dame, IN, United States. Die Arbeit nennt 39 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Large language model (LLM) text embeddings have recently been used for supervised learning on tabular data by serializing each observation into text and then converting the text into a dense fixed-length vector. This strategy is appealing for biomedical tabular data, which are often mixed-type and contain missing values, because it produces a complete numeric representation even when some original entries are missing. However, its suitability for unsupervised tasks remains unclear. Here we evaluate the use of LLM-derived text embeddings for dimension reduction of tabular data, focusing on biological and clinical datasets. We compare an LLM embedding-based approach with a direct tabular approach that computes dissimilarities directly from the original variables. Because unsupervised dimension reduction has no ground-truth low-dimensional target, we assess performance through stability under perturbation. Across multiple datasets and analysis settings, the LLM embedding-based approach is consistently less stable than the direct tabular approach. In particular, small amounts of additional missingness and random permutation of feature order can substantially alter the resulting low-dimensional representation. These results suggest that the straightforward use of LLM text embeddings is not reliable for unsupervised dimension reduction of tabular data.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Applied and Computational Mathematics and Statistics, University of Notre Dame, Notre Dame, IN, United States.
- The Awty International School, Houston, TX, United States.
- The John Cooper School, The Woodlands, TX, United States.
- Round Rock High School, Round Rock, TX, United States.
- Shanghai American School Puxi, Shanghai, China.
Zitieren
APA
Li, J., Gou, Y., Su, S., Xu, M., & Chen, B. (2026). Instability of LLM text embeddings for unsupervised dimension reduction of tabular data. Frontiers in Bioinformatics, 6. https://doi.org/10.3389/fbinf.2026.1851023
Vancouver
Li J, Gou Y, Su S, Xu M, Chen B. Instability of LLM text embeddings for unsupervised dimension reduction of tabular data. Frontiers in Bioinformatics. 2026;6. doi:10.3389/fbinf.2026.1851023
BibTeX
@article{Li2026,
author = {Li, Jun and Gou, Yixuan and Su, Shawn and Xu, Mujun and Chen, Brendan},
title = {Instability of LLM text embeddings for unsupervised dimension reduction of tabular data},
journal = {Frontiers in Bioinformatics},
year = {2026},
volume = {6},
doi = {10.3389/fbinf.2026.1851023}
}
EUVIMED