Descriptive adequacy and Large Language Models
Journal of Language Modelling · 2026
DOI: 10.15398/jlm.526 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Language Modelling, 2026. Verfasst von E.G. Ruys und 1 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Generative language models produce unconstrained text with few grammatical errors. But full linguistic competence also requires the ability to associate grammatical sentences with the correct syntactic structures, resulting in the correct semantic interpretations. We performed experiments to establish whether five commercially available LLMs are able to distinguish structurally ambiguous sentences from unambiguous ones in Dutch, and to assign the correct interpretations to the unambiguous variants. In order to minimize the effects of pragmatics, an additional experiment was performed with stimuli containing pseudowords. The results are compared with results obtained from human subjects. It is found that the LLMs tested indeed show an ability to recognize structural ambiguity and to choose the correct semantic interpretations, although they perform worse than humans, and show different biases.
Zitieren
APA
Ruys, E., & Mulders, I. (2026). Descriptive adequacy and Large Language Models. Journal of Language Modelling. https://doi.org/10.15398/jlm.526
Vancouver
Ruys E, Mulders I. Descriptive adequacy and Large Language Models. Journal of Language Modelling. 2026. doi:10.15398/jlm.526
BibTeX
@article{Ruys2026,
author = {Ruys, E.G. and Mulders, Iris},
title = {Descriptive adequacy and Large Language Models},
journal = {Journal of Language Modelling},
year = {2026},
doi = {10.15398/jlm.526}
}
EUVIMED