Self-reported mentalizing and AI differentiation: An empirical study with implications for construct validity
Journal of High School Science · 05.07.2026 · 10 (3)
DOI: 10.64336/001c.164666 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of High School Science, online erschienen am 05.07.2026. Verfasst von Shivaani Sankarlingam. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-SA 4.0).
Abstract (Originalsprache)
Generative artificial intelligence (gAI) systems are increasingly capable of producing human-like writing, yet little is known about the cognitive factors that influence an individual’s ability to distinguish AI-generated from human-authored text. This study investigated whether self-reported mentalizing, measured using the Multidimensional Mentalizing Questionnaire (MMQ), was associated with performance on an AI differentiation task involving scientific abstracts and news headlines generated using a contemporary large language model. To evaluate this relationship, multiple complementary analytical approaches were employed, including Pearson correlation, multiple linear regression, principal component analysis, bootstrap resampling, cross-validation, and model comparison. Participants performed near chance overall, and no MMQ composite, individual factor, or latent component demonstrated a robust association with AI differentiation performance after correction for multiple comparisons and evaluation of out-of-sample generalizability. Although one MMQ factor (Reflexivity) showed a nominal association with AI news headline differentiation, this relationship was not robust across validation procedures.These findings indicate that self-reported mentalizing, as operationalized by the MMQ, did not reliably predict performance on the present AI differentiation task. However, the results should be interpreted cautiously because AI differentiation itself remains an emerging construct. Unlike many psychological tasks that involve relatively stable human behaviors, AI differentiation depends on identifying outputs from rapidly evolving algorithmic systems whose stylistic characteristics change across model generations. Consequently, it remains uncertain whether AI differentiation represents a stable psychological construct with enduring cognitive determinants or performance against a temporally specific technological artifact. The present findings therefore apply to the specific experimental paradigm and LLM generation examined and highlight the need for future research to establish the construct validity and temporal stability of AI differentiation before drawing broader conclusions regarding its cognitive predictors.
Zitieren
APA
Sankarlingam, S. (2026). Self-reported mentalizing and AI differentiation: An empirical study with implications for construct validity. Journal of High School Science, 10(3). https://doi.org/10.64336/001c.164666
Vancouver
Sankarlingam S. Self-reported mentalizing and AI differentiation: An empirical study with implications for construct validity. Journal of High School Science. 2026;10(3). doi:10.64336/001c.164666
BibTeX
@article{Sankarlingam2026,
author = {Sankarlingam, Shivaani},
title = {Self-reported mentalizing and AI differentiation: An empirical study with implications for construct validity},
journal = {Journal of High School Science},
year = {2026},
volume = {10},
number = {3},
doi = {10.64336/001c.164666}
}
EUVIMED