Transformer-Maze: An Accessible Incremental Processing Measurement Tool
eScholarship (California Digital Library) · 13.07.2023
DOI: 10.48448/14qw-q738 ↗Kurz gefasst
Fachartikel in der Zeitschrift eScholarship (California Digital Library), erschienen am 13.07.2023. Verfasst von Cognitive Science Society 2023 und 2 weiteren Autor:innen.
Abstract (Originalsprache)
The lesser known G(rammatical)-Maze task (Forster, Guerrera, & Elliot, 2009) is arguably a better choice than self-paced reading (Mitchell, 2004) for detecting difficulty from word to word in online sentence processing over crowdsourcing platforms. In G-Maze, a participant must choose between each successive word in a sentence and a distractor word that does not make sense based on the preceding context. If a participant chooses the distractor as opposed to the actual word, then the trial ends and they may not complete the sentence. Thus, G-Maze automatically filters out data from inattentive participants, and more effectively localizes differences in processing difficulty. Still, the effort required to pick contextually inappropriate distractors for hundreds of words might cause an experimenter to hesitate before picking this method. To save experimenters this time and effort, Boyce, Futrell, and Levy (2020) developed A(uto)-Maze, a tool that automatically generates distractors using a computational language model. We now introduce the next generation of A-Maze: T(ransformer)-Maze. Transformer models are the current state of the art in natural language processing, and thousands, pretrained in a variety of languages, are freely available on the internet, specifically through Huggingface’s Transformers package (Wolf et al., 2020). In our validation experiment, T-Maze proves itself to be as effective as G-Maze with handmade materials, run in a lab. This tool thus allows psycholinguists to easily gather high-quality online sentence processing data in many different languages.
Schlagwörter
Zitieren
APA
2023, C. S. S., Gibson, E. A. F., & Heuser, A. (2023). Transformer-Maze: An Accessible Incremental Processing Measurement Tool. eScholarship (California Digital Library). https://doi.org/10.48448/14qw-q738
Vancouver
2023 CSS, Gibson EAF, Heuser A. Transformer-Maze: An Accessible Incremental Processing Measurement Tool. eScholarship (California Digital Library). 2023. doi:10.48448/14qw-q738
BibTeX
@article{2023,
author = {2023, Cognitive Science Society and Gibson, Edward A. F. and Heuser, Annika},
title = {Transformer-Maze: An Accessible Incremental Processing Measurement Tool},
journal = {eScholarship (California Digital Library)},
year = {2023},
doi = {10.48448/14qw-q738}
}
EUVIMED