A process‐oriented perspective on pre‐service teachers' self‐efficacy and their motivational messages: Using large language models to classify teachers' speech
British Journal of Educational Psychology · 2025
DOI: 10.1111/bjep.12779 ↗Kurz gefasst
Fachartikel in der Zeitschrift British Journal of Educational Psychology, 2025. Verfasst von Olivia Metzner und 6 weiteren Autor:innen. Beteiligte Einrichtung: Department of Educational Sciences, University of Potsdam, Potsdam, Germany. Hauptthemen laut MEDLINE: Motivation, School Teachers, Self Efficacy. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 74 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Background
Recent studies have examined the relation between teacher motivation, motivational messages and student learning but are limited to an achievement‐related context, primarily using survey data. Moreover, our understanding of the relation between various teacher characteristics, such as teacher self‐efficacy (TSE), and their motivational message use remains limited.
Aims
Our study tested whether teacher speech can be classified into self‐determination (SDT)‐based motivational messages and reliably assessed with a large language model (LLM). Additionally, we analysed the relation between pre‐service TSE and their motivational message use. Sample For our first aim, we used human‐rater annotations from 119 pre‐service teachers' classroom recordings. For our second aim, we used data from 103 pre‐service teachers (52.69% female; M age = 22.98, SD age = 3.26, Min age = 19, Max age = 34) who participated in a survey and were video‐recorded while teaching.
Methods
First, we manually classified pre‐service teachers' motivational messages based on transcripts and used human‐rater annotations to fine‐tune an LLM. Second, we analysed the relation between pre‐service TSE and motivational message use. Results and Conclusions The fine‐tuned LLM demonstrated promising performance in assessing SDT‐based motivational messages but needs further refining to assess thwarting messages. The analysis with human annotation showed that pre‐service TSE for classroom management positively affected the frequency of relatedness‐supportive messages. Pre‐service TSE for student engagement increased the likelihood of never using a competence‐ or relatedness‐thwarting message. Pre‐service TSE for instructional strategies reduced the frequency of autonomy‐supportive messages. LLM‐based analyses showed slightly different results but did not contradict human annotation‐based analyses.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Educational Sciences, University of Potsdam, Potsdam, Germany.
- Chair of Artificial Intelligence and Intelligent Systems, Hasso-Plattner-Institute/University of Potsdam, Potsdam, Germany.
- Department of General, Intercultural and International Comparative Education as well as Educational Psychology (EW1), University of Hamburg, Hamburg, Germany.
- Institute for Psychology in Education, University of Münster, Münster, Germany.
- Department of Research on Teaching and Teacher Education, Kiel University, Kiel, Germany.
- Institute for Psychology of Learning and Instruction (IPL), Kiel University, Kiel, Germany.
ORCID-Profile: Olivia Metzner, Wendy Symes, Yizhen Huang, Lena Keller, Gerard de Melo, Rebecca Lazarides
Zitieren
APA
Metzner, O., Wang, Y., Symes, W., Huang, Y., Keller, L., de Melo, G., & Lazarides, R. (2025). A process‐oriented perspective on pre‐service teachers' self‐efficacy and their motivational messages: Using large language models to classify teachers' speech. British Journal of Educational Psychology. https://doi.org/10.1111/bjep.12779
Vancouver
Metzner O, Wang Y, Symes W, Huang Y, Keller L, de Melo G, et al. A process‐oriented perspective on pre‐service teachers' self‐efficacy and their motivational messages: Using large language models to classify teachers' speech. British Journal of Educational Psychology. 2025. doi:10.1111/bjep.12779
BibTeX
@article{Metzner2025,
author = {Metzner, Olivia and Wang, Yindong and Symes, Wendy and Huang, Yizhen and Keller, Lena and de Melo, Gerard and Lazarides, Rebecca},
title = {A process‐oriented perspective on pre‐service teachers' self‐efficacy and their motivational messages: Using large language models to classify teachers' speech},
journal = {British Journal of Educational Psychology},
year = {2025},
doi = {10.1111/bjep.12779}
}
EUVIMED