EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Could this be next for corpus linguistics? Methods of semi-automatic data annotation with contextualized word embeddings

Lauren Fonteyn, Enrique Manjavacas, Nina Haket, Aletta G. Dorst, Eva Kruijt

Linguistics Vanguard · 31.12.2024 · 10 (1) · 587-602

DOI: 10.1515/lingvan-2022-0142 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Linguistics Vanguard, online erschienen am 25.06.2024. Verfasst von Lauren Fonteyn und 4 weiteren Autor:innen. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 74 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Platform Digital Infrastructure Social Sciences and Humanities.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This paper explores how linguistic data annotation can be made (semi-)automatic by means of machine learning. More specifically, we focus on the use of “contextualized word embeddings” (i.e. vectorized representations of the meaning of word tokens based on the sentential context in which they appear) extracted by large language models (LLMs). In three example case studies, we assess how the contextualized embeddings generated by LLMs can be combined with different machine learning approaches to serve as a flexible, adaptable semi-automated data annotation tool for corpus linguists. Subsequently, to evaluate which approach is most reliable across the different case studies, we use a Bayesian framework for model comparison, which estimates the probability that the performance of a given classification approach is stronger than that of an alternative approach. Our results indicate that combining contextualized word embeddings with metric fine-tuning yield highly accurate automatic annotations.

Förderung

  • Platform Digital Infrastructure Social Sciences and Humanities

Zitieren

APA

Fonteyn, L., Manjavacas, E., Haket, N., Dorst, A. G., & Kruijt, E. (2024). Could this be next for corpus linguistics? Methods of semi-automatic data annotation with contextualized word embeddings. Linguistics Vanguard, 10(1), 587-602. https://doi.org/10.1515/lingvan-2022-0142

Vancouver

Fonteyn L, Manjavacas E, Haket N, Dorst AG, Kruijt E. Could this be next for corpus linguistics? Methods of semi-automatic data annotation with contextualized word embeddings. Linguistics Vanguard. 2024;10(1):587-602. doi:10.1515/lingvan-2022-0142

BibTeX
@article{Fonteyn2024,
  author = {Fonteyn, Lauren and Manjavacas, Enrique and Haket, Nina and Dorst, Aletta G. and Kruijt, Eva},
  title = {Could this be next for corpus linguistics? Methods of semi-automatic data annotation with contextualized word embeddings},
  journal = {Linguistics Vanguard},
  year = {2024},
  volume = {10},
  number = {1},
  pages = {587--602},
  doi = {10.1515/lingvan-2022-0142}
}
Kostenlos starten →