EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Textual Similarity in Organizational Research: Review of Applications, Consistency of Methods, and Best Practice Recommendations

Siyi Liu, Louis Hickman, Linus Dahlander, Henning Piezunka

Organizational Research Methods · 27.04.2026

DOI: 10.1177/10944281261432629 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Organizational Research Methods, online erschienen am 27.04.2026. Verfasst von Siyi Liu und 3 weiteren Autor:innen. Die Arbeit nennt 128 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Organizational research increasingly uses natural language processing (NLP) to measure textual similarity. Despite common usage, the meaning and consistency of similarity measures (e.g., cosine similarity and Euclidean distance) across common NLP methods (e.g., n -grams and document embeddings) is unclear. This risks misalignment between theoretical constructs and textual measures, undermining the comparability of findings across studies. To address this gap, we review studies using textual similarity in organizational and psychological research, finding a jingle-jangle fallacy: identical labels are used for similarity estimates from different NLP methods, and different labels are used for the same method. Additionally, we examine the consistency of similarity measures across and within NLP methods. Different transformer-based embeddings’ similarity results are interchangeable. However, n -grams yield distinct, inconsistent results and are less appropriate for estimating similarity with distance measures. When applied to multi-word inputs, dictionaries and word embeddings return similar results reflecting linguistic style. We provide best practice recommendations and example code for operationalizing textual similarity, including clarifying which NLP methods correspond to content similarity, linguistic style similarity, and semantic similarity at the word, sentence, and document-levels of analysis.

Zitieren

APA

Liu, S., Hickman, L., Dahlander, L., & Piezunka, H. (2026). Textual Similarity in Organizational Research: Review of Applications, Consistency of Methods, and Best Practice Recommendations. Organizational Research Methods. https://doi.org/10.1177/10944281261432629

Vancouver

Liu S, Hickman L, Dahlander L, Piezunka H. Textual Similarity in Organizational Research: Review of Applications, Consistency of Methods, and Best Practice Recommendations. Organizational Research Methods. 2026. doi:10.1177/10944281261432629

BibTeX
@article{Liu2026,
  author = {Liu, Siyi and Hickman, Louis and Dahlander, Linus and Piezunka, Henning},
  title = {Textual Similarity in Organizational Research: Review of Applications, Consistency of Methods, and Best Practice Recommendations},
  journal = {Organizational Research Methods},
  year = {2026},
  doi = {10.1177/10944281261432629}
}
Kostenlos starten →