A computational neuroimaging study of reinforcement learning and goal-directed exploration in schizophrenia spectrum disorders
Psychological Medicine · 2023-10 · 53 (14) · 6600-6610
DOI: 10.1017/s0033291722003993 ↗Kurz gefasst
Fachartikel in der Zeitschrift Psychological Medicine, online erschienen am 08.02.2023. Verfasst von A J Culbreth und 7 weiteren Autor:innen. Beteiligte Einrichtung: Department of Psychiatry, Maryland Psychiatric Research Center (MPRC), University of Maryland School of Medicine, Baltimore, MD, USA. Hauptthemen laut MEDLINE: Magnetic Resonance Imaging, Schizophrenia, Reinforcement, Psychology, Reward. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 30 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: NIMH NIH HHS.
Abstract (Originalsprache)
Background
Prior evidence indicates that negative symptom severity and cognitive deficits, in people with schizophrenia (PSZ), relate to measures of reward-seeking and loss-avoidance behavior (implicating the ventral striatum/VS), as well as uncertainty-driven exploration (reliant on rostrolateral prefrontal cortex/rlPFC). While neural correlates of reward-seeking and loss-avoidance have been examined in PSZ, neural correlates of uncertainty-driven exploration have not. Understanding neural correlates of uncertainty-driven exploration is an important next step that could reveal insights to how this mechanism of cognitive and negative symptoms manifest at a neural level.
Methods
We acquired fMRI data from 29 PSZ and 36 controls performing the Temporal Utility Integration decision-making task. Computational analyses estimated parameters corresponding to learning rates for both positive and negative reward prediction errors (RPEs) and the degree to which participates relied on representations of relative uncertainty. Trial-wise estimates of expected value, certainty, and RPEs were generated to model fMRI data.
Results
Behaviorally, PSZ demonstrated reduced reward-seeking behavior compared to controls, and negative symptoms were positively correlated with loss-avoidance behavior. This finding of a bias toward loss avoidance learning in PSZ is consistent with previous work. Surprisingly, neither behavioral measures of exploration nor neural correlates of uncertainty in the rlPFC differed significantly between groups. However, we showed that trial-wise estimates of relative uncertainty in the rlPFC distinguished participants who engaged in exploratory behavior from those who did not. rlPFC activation was positively associated with intellectual function.
Conclusions
These results further elucidate the nature of reinforcement learning and decision-making in PSZ and healthy volunteers.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Psychiatry, Maryland Psychiatric Research Center (MPRC), University of Maryland School of Medicine, Baltimore, MD, USA.
- Signant Health, San Diego, CA, USA.
- Department of Cognitive, Linguistic and Psychological Sciences, Brown University, Providence, RI, USA.
- Department of Psychiatry and Brown Institute for Brain Science, Brown University, Providence, RI, USA.
- School of Health and Care Management, Arden University, Berlin, Germany.
- Applied LifeSciences & Systems, Morrisville, NC, USA.
ORCID-Profile: J A Waltz
Förderung
- NIMH NIH HHS
Zitieren
APA
Culbreth, A. J., Schwartz, E. K., Frank, M. J., Brown, E. C., Xu, Z., Chen, S., Gold, J. M., & Waltz, J. A. (2023). A computational neuroimaging study of reinforcement learning and goal-directed exploration in schizophrenia spectrum disorders. Psychological Medicine, 53(14), 6600-6610. https://doi.org/10.1017/s0033291722003993
Vancouver
Culbreth AJ, Schwartz EK, Frank MJ, Brown EC, Xu Z, Chen S, et al. A computational neuroimaging study of reinforcement learning and goal-directed exploration in schizophrenia spectrum disorders. Psychological Medicine. 2023;53(14):6600-6610. doi:10.1017/s0033291722003993
BibTeX
@article{Culbreth2023,
author = {Culbreth, A J and Schwartz, E K and Frank, M J and Brown, E C and Xu, Z and Chen, S and Gold, J M and Waltz, J A},
title = {A computational neuroimaging study of reinforcement learning and goal-directed exploration in schizophrenia spectrum disorders},
journal = {Psychological Medicine},
year = {2023},
volume = {53},
number = {14},
pages = {6600--6610},
doi = {10.1017/s0033291722003993}
}
EUVIMED