EUVIMEDEUVIMED entdecken
Crossref

Assessing the potential of LLM-assisted annotation for corpus-based pragmatics and discourse analysis

Danni Yu, Luyang Li, Hang Su, Matteo Fuoli

International Journal of Corpus Linguistics · 31.12.2024 · 29 (4) · 534-561

DOI: 10.1075/ijcl.23087.yu ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Journal of Corpus Linguistics, online erschienen am 03.06.2024. Verfasst von Danni Yu und 3 weiteren Autor:innen. Die Arbeit wurde bisher 74-mal zitiert (Crossref) und nennt 48 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Certain forms of linguistic annotation, like part of speech and semantic tagging, can be automated with high accuracy. However, manual annotation is still necessary for complex pragmatic and discursive features that lack a direct mapping to lexical forms. This manual process is time-consuming and error-prone, limiting the scalability of function-to-form approaches in corpus linguistics. To address this, our study explores the possibility of using large language models (LLMs) to automate pragma-discursive corpus annotation. We compare GPT-3.5 (the model behind the free-to-use version of ChatGPT), GPT-4 (the model underpinning the precise mode of Bing chatbot), and a human coder in annotating apology components in English based on the local grammar framework. We find that GPT-4 outperformed GPT-3.5, with accuracy approaching that of a human coder. These results suggest that LLMs can be successfully deployed to aid pragma-discursive corpus annotation, making the process more efficient, scalable, and accessible.

Zitieren

APA

Yu, D., Li, L., Su, H., & Fuoli, M. (2024). Assessing the potential of LLM-assisted annotation for corpus-based pragmatics and discourse analysis. International Journal of Corpus Linguistics, 29(4), 534-561. https://doi.org/10.1075/ijcl.23087.yu

Vancouver

Yu D, Li L, Su H, Fuoli M. Assessing the potential of LLM-assisted annotation for corpus-based pragmatics and discourse analysis. International Journal of Corpus Linguistics. 2024;29(4):534-561. doi:10.1075/ijcl.23087.yu

BibTeX
@article{Yu2024,
  author = {Yu, Danni and Li, Luyang and Su, Hang and Fuoli, Matteo},
  title = {Assessing the potential of LLM-assisted annotation for corpus-based pragmatics and discourse analysis},
  journal = {International Journal of Corpus Linguistics},
  year = {2024},
  volume = {29},
  number = {4},
  pages = {534--561},
  doi = {10.1075/ijcl.23087.yu}
}
Kostenlos starten →