Could this be next for corpus linguistics? Methods of semi-automatic data annotation with contextualized word embeddings
Linguistics Vanguard · 31.12.2024 · 10 (1) · 587-602
DOI: 10.1515/lingvan-2022-0142 ↗Kurz gefasst
Fachartikel in der Zeitschrift Linguistics Vanguard, online erschienen am 25.06.2024. Verfasst von Lauren Fonteyn und 4 weiteren Autor:innen. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 74 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Platform Digital Infrastructure Social Sciences and Humanities.
Abstract (Originalsprache)
This paper explores how linguistic data annotation can be made (semi-)automatic by means of machine learning. More specifically, we focus on the use of “contextualized word embeddings” (i.e. vectorized representations of the meaning of word tokens based on the sentential context in which they appear) extracted by large language models (LLMs). In three example case studies, we assess how the contextualized embeddings generated by LLMs can be combined with different machine learning approaches to serve as a flexible, adaptable semi-automated data annotation tool for corpus linguists. Subsequently, to evaluate which approach is most reliable across the different case studies, we use a Bayesian framework for model comparison, which estimates the probability that the performance of a given classification approach is stronger than that of an alternative approach. Our results indicate that combining contextualized word embeddings with metric fine-tuning yield highly accurate automatic annotations.
Förderung
- Platform Digital Infrastructure Social Sciences and Humanities
Zitieren
APA
Fonteyn, L., Manjavacas, E., Haket, N., Dorst, A. G., & Kruijt, E. (2024). Could this be next for corpus linguistics? Methods of semi-automatic data annotation with contextualized word embeddings. Linguistics Vanguard, 10(1), 587-602. https://doi.org/10.1515/lingvan-2022-0142
Vancouver
Fonteyn L, Manjavacas E, Haket N, Dorst AG, Kruijt E. Could this be next for corpus linguistics? Methods of semi-automatic data annotation with contextualized word embeddings. Linguistics Vanguard. 2024;10(1):587-602. doi:10.1515/lingvan-2022-0142
BibTeX
@article{Fonteyn2024,
author = {Fonteyn, Lauren and Manjavacas, Enrique and Haket, Nina and Dorst, Aletta G. and Kruijt, Eva},
title = {Could this be next for corpus linguistics? Methods of semi-automatic data annotation with contextualized word embeddings},
journal = {Linguistics Vanguard},
year = {2024},
volume = {10},
number = {1},
pages = {587--602},
doi = {10.1515/lingvan-2022-0142}
}
EUVIMED