EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Prediction of a task-specific AI-reliance choice from facial expression and galvanic skin response signals

Hamid Shamszare, Avishek Choudhury

PLOS One · 20.11.2026 · 21 (11) · e0363436

DOI: 10.1371/journal.pone.0363436 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PLOS One, online erschienen am 20.11.2026. Verfasst von Hamid Shamszare und 1 weiteren Autor:innen. Die Arbeit nennt 42 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: West Virginia University.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Reliance on AI-supported health recommendations is consequential, but a single behavioral source-selection decision is not equivalent to multidimensional psychological trust. Biosignals may contain predictive information before a choice, although small-sample multimodal models require leakage-free evaluation and cautious interpretation.

Purpose

This study evaluated whether facial-expression probabilities and galvanic skin response (GSR) features predict a task-specific binary choice of an AI-labeled rather than doctor-labeled recommendation in a simulated ADHD assessment. The outcome is treated as a behavioral indicator of reliance rather than a direct measure of psychological trust.

Method

This cross-sectional laboratory analysis included a cohort of 60 participants (40 AI-labeled and 20 doctor-labeled choices). Eight facial-expression probabilities and two GSR phasic features were evaluated in prespecified Early (6–3 s) and Proximal (3–0 s) windows. Ten repeats of participant-level stratified five-fold cross-validation were used. Scaling and SMOTETomek resampling occurred only within training folds, and the logistic stacking meta-learner was trained on strictly cross-fitted base-model probabilities. Model-specific 95% confidence intervals and paired AUC differences were estimated with 10,000 stratified participant bootstrap samples; five paired tests were Holm-adjusted.

Results

Early-window ROC-AUCs were 0.643 (95% CI 0.490–0.786) for Face, 0.430 (0.287–0.578) for GSR, and 0.526 (0.375–0.679) for stacking. Proximal-window ROC-AUCs were 0.550 (0.399–0.699), 0.381 (0.240–0.530), and 0.376 (0.229–0.529), respectively. Stacking did not outperform either modality. Early stacking was worse than Early Face (ΔAUC = −0.116, 95% CI −0.183 to −0.056; Holm-adjusted p = 0.002); the other adjusted paired comparisons were not significant.

Conclusion

Multimodal stacking did not improve prediction in this small exploratory sample. These results do not establish either a general advantage or a lack of value of multimodal fusion. They do not support deployment or direct trust detection. Larger studies with verified synchronization, repeated decisions, independent trust measures, and external validation are required.

Förderung

  • West Virginia University

Zitieren

APA

Shamszare, H., & Choudhury, A. (2026). Prediction of a task-specific AI-reliance choice from facial expression and galvanic skin response signals. PLOS One, 21(11), e0363436. https://doi.org/10.1371/journal.pone.0363436

Vancouver

Shamszare H, Choudhury A. Prediction of a task-specific AI-reliance choice from facial expression and galvanic skin response signals. PLOS One. 2026;21(11):e0363436. doi:10.1371/journal.pone.0363436

BibTeX
@article{Shamszare2026,
  author = {Shamszare, Hamid and Choudhury, Avishek},
  title = {Prediction of a task-specific AI-reliance choice from facial expression and galvanic skin response signals},
  journal = {PLOS One},
  year = {2026},
  volume = {21},
  number = {11},
  pages = {e0363436},
  doi = {10.1371/journal.pone.0363436}
}
Kostenlos starten →