EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Mapping the Distribution and Depth of Metacognitive Processes in Generative AI-Assisted Learning: Evidence from Interaction Logs and Concurrent Think-Aloud Protocols

Shijin Li iD, Junjian Liu iD

Behavioral Sciences · 09.08.2026 · 16 (8) · 1365

DOI: 10.3390/bs16081365 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Behavioral Sciences, online erschienen am 09.08.2026. Verfasst von Shijin Li und 1 weiteren Autor:innen. Beteiligte Einrichtung: Jing Hengyi School of Education, Hangzhou Normal University, No. 2318, Yu Hang Tang Road, Hangzhou 311121, China. Die Arbeit nennt 48 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: the Youth Fund Project of Humanities and Social Sciences of the Ministry of Education, Major Humanities and Social Sciences Research Projects in Zhejiang Higher Education Institutions, Zhejiang Province Education Science Planning General Planning Project.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Generative artificial intelligence (GenAI) is increasingly used as a cognitive aid in education, yet no single process measure captures how learners monitor and control GenAI-assisted work. Guided by a reciprocal monitoring-control account of metacognition, this descriptive, exploratory study examined what interaction logs and concurrent think-aloud speech make observable during a 90 min instructional-design task. Seventy-nine undergraduates from 11 majors completed the task with DeepSeek support. The same two-dimensional rubric was applied separately to both records: each retained semantic unit received one primary operational category (planning, monitoring, or regulation) and one evidence-depth label (implicit, awareness, strategic, or reflective). Planning was treated as prospective control and regulation as adaptive control after evaluation or feedback. The interaction-log and think-aloud records yielded 274 and 193 retained instances, respectively. In both sources, regulation was the most frequent primary label and monitoring the least frequent, while evidence-depth ratings were concentrated at awareness and strategic. The combined strategic and reflective share was 25.4 percentage points higher in think-aloud than in interaction-log monitoring units and 9.9 points higher in think-aloud than in interaction-log planning units; for regulation, it was 14.0 points higher in interaction-log than in think-aloud units. These aggregate contrasts are descriptive because coded instances are nested within participants and the sources are paired within individuals. The central contribution is that verbalized monitoring information and enacted control leave different observable traces. Combining the sources therefore provides a fuller account of metacognitive activity than either record alone, without establishing monitoring accuracy, process effectiveness, or learning outcomes.

Schlagwörter

Stichwörter der Autor:innen

generative AIhuman–AI interactioninteraction logsmetacognitive processesmonitoring and controlthink-aloud protocol

Autor:innen und Institutionen

  • Jing Hengyi School of Education, Hangzhou Normal University, No. 2318, Yu Hang Tang Road, Hangzhou 311121, China.
  • Chinese Education Modernization Research Institute, Hangzhou Normal University, Hangzhou 311121, China.

ORCID-Profile: Shijin Li, Junjian Liu

Förderung

  • the Youth Fund Project of Humanities and Social Sciences of the Ministry of Education
  • Major Humanities and Social Sciences Research Projects in Zhejiang Higher Education Institutions
  • Zhejiang Province Education Science Planning General Planning Project
  • Teaching Construction and Reform Project of Hangzhou Normal University

Zitieren

APA

Li, S., & Liu, J. (2026). Mapping the Distribution and Depth of Metacognitive Processes in Generative AI-Assisted Learning: Evidence from Interaction Logs and Concurrent Think-Aloud Protocols. Behavioral Sciences, 16(8), 1365. https://doi.org/10.3390/bs16081365

Vancouver

Li S, Liu J. Mapping the Distribution and Depth of Metacognitive Processes in Generative AI-Assisted Learning: Evidence from Interaction Logs and Concurrent Think-Aloud Protocols. Behavioral Sciences. 2026;16(8):1365. doi:10.3390/bs16081365

BibTeX
@article{Li2026,
  author = {Li, Shijin and Liu, Junjian},
  title = {Mapping the Distribution and Depth of Metacognitive Processes in Generative AI-Assisted Learning: Evidence from Interaction Logs and Concurrent Think-Aloud Protocols},
  journal = {Behavioral Sciences},
  year = {2026},
  volume = {16},
  number = {8},
  pages = {1365},
  doi = {10.3390/bs16081365}
}
Kostenlos starten →