Prediction of a task-specific AI-reliance choice from facial expression and galvanic skin response signals
PLOS One · 20.11.2026 · 21 (11) · e0363436
DOI: 10.1371/journal.pone.0363436 ↗Kurz gefasst
Fachartikel in der Zeitschrift PLOS One, online erschienen am 20.11.2026. Verfasst von Hamid Shamszare und 1 weiteren Autor:innen. Die Arbeit nennt 42 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: West Virginia University.
Abstract (Originalsprache)
Background
Reliance on AI-supported health recommendations is consequential, but a single behavioral source-selection decision is not equivalent to multidimensional psychological trust. Biosignals may contain predictive information before a choice, although small-sample multimodal models require leakage-free evaluation and cautious interpretation.
Purpose
This study evaluated whether facial-expression probabilities and galvanic skin response (GSR) features predict a task-specific binary choice of an AI-labeled rather than doctor-labeled recommendation in a simulated ADHD assessment. The outcome is treated as a behavioral indicator of reliance rather than a direct measure of psychological trust.
Method
This cross-sectional laboratory analysis included a cohort of 60 participants (40 AI-labeled and 20 doctor-labeled choices). Eight facial-expression probabilities and two GSR phasic features were evaluated in prespecified Early (6–3 s) and Proximal (3–0 s) windows. Ten repeats of participant-level stratified five-fold cross-validation were used. Scaling and SMOTETomek resampling occurred only within training folds, and the logistic stacking meta-learner was trained on strictly cross-fitted base-model probabilities. Model-specific 95% confidence intervals and paired AUC differences were estimated with 10,000 stratified participant bootstrap samples; five paired tests were Holm-adjusted.
Results
Early-window ROC-AUCs were 0.643 (95% CI 0.490–0.786) for Face, 0.430 (0.287–0.578) for GSR, and 0.526 (0.375–0.679) for stacking. Proximal-window ROC-AUCs were 0.550 (0.399–0.699), 0.381 (0.240–0.530), and 0.376 (0.229–0.529), respectively. Stacking did not outperform either modality. Early stacking was worse than Early Face (ΔAUC = −0.116, 95% CI −0.183 to −0.056; Holm-adjusted p = 0.002); the other adjusted paired comparisons were not significant.
Conclusion
Multimodal stacking did not improve prediction in this small exploratory sample. These results do not establish either a general advantage or a lack of value of multimodal fusion. They do not support deployment or direct trust detection. Larger studies with verified synchronization, repeated decisions, independent trust measures, and external validation are required.
Förderung
- West Virginia University
Zitieren
APA
Shamszare, H., & Choudhury, A. (2026). Prediction of a task-specific AI-reliance choice from facial expression and galvanic skin response signals. PLOS One, 21(11), e0363436. https://doi.org/10.1371/journal.pone.0363436
Vancouver
Shamszare H, Choudhury A. Prediction of a task-specific AI-reliance choice from facial expression and galvanic skin response signals. PLOS One. 2026;21(11):e0363436. doi:10.1371/journal.pone.0363436
BibTeX
@article{Shamszare2026,
author = {Shamszare, Hamid and Choudhury, Avishek},
title = {Prediction of a task-specific AI-reliance choice from facial expression and galvanic skin response signals},
journal = {PLOS One},
year = {2026},
volume = {21},
number = {11},
pages = {e0363436},
doi = {10.1371/journal.pone.0363436}
}
EUVIMED