EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A process‐oriented perspective on pre‐service teachers' self‐efficacy and their motivational messages: Using large language models to classify teachers' speech

Olivia Metzner iD, Yindong Wang, Wendy Symes iD, Yizhen Huang iD, Lena Keller iD, Gerard de Melo iD, Rebecca Lazarides iD

British Journal of Educational Psychology · 2025

DOI: 10.1111/bjep.12779 ↗

Kurz gefasst

Fachartikel in der Zeitschrift British Journal of Educational Psychology, 2025. Verfasst von Olivia Metzner und 6 weiteren Autor:innen. Beteiligte Einrichtung: Department of Educational Sciences, University of Potsdam, Potsdam, Germany. Hauptthemen laut MEDLINE: Motivation, School Teachers, Self Efficacy. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 74 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Recent studies have examined the relation between teacher motivation, motivational messages and student learning but are limited to an achievement‐related context, primarily using survey data. Moreover, our understanding of the relation between various teacher characteristics, such as teacher self‐efficacy (TSE), and their motivational message use remains limited.

Aims

Our study tested whether teacher speech can be classified into self‐determination (SDT)‐based motivational messages and reliably assessed with a large language model (LLM). Additionally, we analysed the relation between pre‐service TSE and their motivational message use. Sample For our first aim, we used human‐rater annotations from 119 pre‐service teachers' classroom recordings. For our second aim, we used data from 103 pre‐service teachers (52.69% female; M age = 22.98, SD age = 3.26, Min age = 19, Max age = 34) who participated in a survey and were video‐recorded while teaching.

Methods

First, we manually classified pre‐service teachers' motivational messages based on transcripts and used human‐rater annotations to fine‐tune an LLM. Second, we analysed the relation between pre‐service TSE and motivational message use. Results and Conclusions The fine‐tuned LLM demonstrated promising performance in assessing SDT‐based motivational messages but needs further refining to assess thwarting messages. The analysis with human annotation showed that pre‐service TSE for classroom management positively affected the frequency of relatedness‐supportive messages. Pre‐service TSE for student engagement increased the likelihood of never using a competence‐ or relatedness‐thwarting message. Pre‐service TSE for instructional strategies reduced the frequency of autonomy‐supportive messages. LLM‐based analyses showed slightly different results but did not contradict human annotation‐based analyses.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

MotivationSchool TeachersSelf EfficacyHumansMaleFemaleAdultYoung AdultPersonal AutonomyLarge Language Models

Stichwörter der Autor:innen

artificial intelligencelarge language modelsmotivational messagesself‐determination theoryteacher self‐efficacy

Autor:innen und Institutionen

  • Department of Educational Sciences, University of Potsdam, Potsdam, Germany.
  • Chair of Artificial Intelligence and Intelligent Systems, Hasso-Plattner-Institute/University of Potsdam, Potsdam, Germany.
  • Department of General, Intercultural and International Comparative Education as well as Educational Psychology (EW1), University of Hamburg, Hamburg, Germany.
  • Institute for Psychology in Education, University of Münster, Münster, Germany.
  • Department of Research on Teaching and Teacher Education, Kiel University, Kiel, Germany.
  • Institute for Psychology of Learning and Instruction (IPL), Kiel University, Kiel, Germany.

ORCID-Profile: Olivia Metzner, Wendy Symes, Yizhen Huang, Lena Keller, Gerard de Melo, Rebecca Lazarides

Zitieren

APA

Metzner, O., Wang, Y., Symes, W., Huang, Y., Keller, L., de Melo, G., & Lazarides, R. (2025). A process‐oriented perspective on pre‐service teachers' self‐efficacy and their motivational messages: Using large language models to classify teachers' speech. British Journal of Educational Psychology. https://doi.org/10.1111/bjep.12779

Vancouver

Metzner O, Wang Y, Symes W, Huang Y, Keller L, de Melo G, et al. A process‐oriented perspective on pre‐service teachers' self‐efficacy and their motivational messages: Using large language models to classify teachers' speech. British Journal of Educational Psychology. 2025. doi:10.1111/bjep.12779

BibTeX
@article{Metzner2025,
  author = {Metzner, Olivia and Wang, Yindong and Symes, Wendy and Huang, Yizhen and Keller, Lena and de Melo, Gerard and Lazarides, Rebecca},
  title = {A process‐oriented perspective on pre‐service teachers' self‐efficacy and their motivational messages: Using large language models to classify teachers' speech},
  journal = {British Journal of Educational Psychology},
  year = {2025},
  doi = {10.1111/bjep.12779}
}
Kostenlos starten →