EUVIMEDEUVIMED entdecken
StudienprotokollOpen Access · CC BY-NC-ND 4.0

TACOMORE: Exploring a replicable prompting protocol for LLM-assisted corpus analysis

Bingru Li, Han Wang, Nicholas Groom

Applied Corpus Linguistics · 2026-12 · 6 (3) · 100250

DOI: 10.1016/j.acorp.2026.100250 ↗

Kurz gefasst

Studienprotokoll in der Zeitschrift Applied Corpus Linguistics, 2026-12. Verfasst von Bingru Li und 2 weiteren Autor:innen. Die Arbeit nennt 50 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

As corpus linguistics continues to scale, researchers are facing a growing methodological bottleneck: while computational tools can easily count billions of words, the qualitative interpretation of these data remains a slow and labor-intensive human task. Large Language Models (LLMs) offer a promising way to automate this process, yet their integration into the field is often hindered by concerns over black-box unpredictability and a lack of replicability. This study introduces TACOMORE, a structured prompting framework designed to transform ad-hoc AI interactions into a standardized linguistic protocol. Built upon four foundational principles (Task, Context, Model, and Replicability), the framework guides LLMs to move beyond generic probability prediction to anchoring their reasoning in the specific co-occurrence patterns of a target corpus. We applied this framework to three core corpus tasks, i.e., the analysis of keywords, collocates, and concordances, using an open corpus of COVID-19 research abstracts. After testing three LLMs, we found that while structured prompting improves accuracy and replicability, inherent limitations regarding hallucination persist. This research offers a critical lens into the role of LLMs in corpus linguistics, highlighting their potential as complementary tools while emphasizing the irreplaceable role of human validation.

Zitieren

APA

Li, B., Wang, H., & Groom, N. (2026). TACOMORE: Exploring a replicable prompting protocol for LLM-assisted corpus analysis. Applied Corpus Linguistics, 6(3), 100250. https://doi.org/10.1016/j.acorp.2026.100250

Vancouver

Li B, Wang H, Groom N. TACOMORE: Exploring a replicable prompting protocol for LLM-assisted corpus analysis. Applied Corpus Linguistics. 2026;6(3):100250. doi:10.1016/j.acorp.2026.100250

BibTeX
@article{Li2026,
  author = {Li, Bingru and Wang, Han and Groom, Nicholas},
  title = {TACOMORE: Exploring a replicable prompting protocol for LLM-assisted corpus analysis},
  journal = {Applied Corpus Linguistics},
  year = {2026},
  volume = {6},
  number = {3},
  pages = {100250},
  doi = {10.1016/j.acorp.2026.100250}
}
Kostenlos starten →