On the literary landscapes of vector embeddings
Computational Humanities Research · 2025
DOI: 10.1017/chr.2025.10015 ↗Kurz gefasst
Fachartikel in der Zeitschrift Computational Humanities Research, 2025. Verfasst von Daniel Rockmore und 4 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
From the early use of TF-IDF to the high-dimensional outputs of deep learning, vector space embeddings of text, at a scale ranging from token to document, are at the heart of all machine analysis and generation of text. In this article, we present the first large-scale comparison of a sampling of such techniques on a range of classification tasks on a large corpus of current literature drawn from the well-known Books3 data set. Specifically, we compare TF-IDF, Doc2vec and several Transformer-based embeddings on a variety of text-specific tasks. Using industry-standard BISAC codes as a proxy for genre, we compare embeddings in their ability to preserve information about genre. We further compare these embeddings in their ability to encode inter- and intra-book similarity. All of these comparisons take place at the book “chunk” (1,024 tokens) level. We find Transformer-based (“neural”) embeddings to be best, in the sense of their ability to respect genre and authorship, although almost all embedding techniques produce sensible constructions of a “literary landscape” as embodied by the Books3 corpus. These experiments suggest the possibility of using deep learning embeddings not only for advances in generative AI, but also a potential tool for book discovery and as an aid to various forms of more traditional comparative textual analysis.
Zitieren
APA
Rockmore, D., Chen, J., Jebelli, M. J. L., Riddell, A., & Stropkay, H. (2025). On the literary landscapes of vector embeddings. Computational Humanities Research. https://doi.org/10.1017/chr.2025.10015
Vancouver
Rockmore D, Chen J, Jebelli MJL, Riddell A, Stropkay H. On the literary landscapes of vector embeddings. Computational Humanities Research. 2025. doi:10.1017/chr.2025.10015
BibTeX
@article{Rockmore2025,
author = {Rockmore, Daniel and Chen, Jiayi and Jebelli, Mohammad Javad Latifi and Riddell, Allen and Stropkay, Harrison},
title = {On the literary landscapes of vector embeddings},
journal = {Computational Humanities Research},
year = {2025},
doi = {10.1017/chr.2025.10015}
}
EUVIMED