EUVIMEDObjevte EUVIMED
Open access

Reliability of Decision-Making and Reinforcement Learning Computational Parameters

Anahit Mkrtchian iD, Vincent Valton iD, Jonathan P Roiser iD

Computational Psychiatry · 2023-02-08 · 7 (1) · 30

DOI: 10.5334/cpsy.86 ↗

At a glance

Journal article in Computational Psychiatry, published online on 2023-02-08. Written by Anahit Mkrtchian and 2 co-authors. Institution: Neuroscience and Mental Health Group, Institute of Cognitive Neuroscience, University College London, London, United Kingdom. Cited 36 times so far (Crossref); 68 references. The full text is freely available in PubMed Central. Funded by: Wellcome Trust.

AbstraktSubjectsBibliografické údajeCiteRelated studies

Abstract (original language)

Computational models can offer mechanistic insight into cognition and therefore have the potential to transform our understanding of psychiatric disorders and their treatment. For translational efforts to be successful, it is imperative that computational measures capture individual characteristics reliably. Here we examine the reliability of reinforcement learning and economic models derived from two commonly used tasks. Healthy individuals (N = 50) completed a restless four-armed bandit and a calibrated gambling task twice, two weeks apart. Reward and punishment learning rates from the reinforcement learning model showed good reliability and reward and punishment sensitivity from the same model had fair reliability; while risk aversion and loss aversion parameters from a prospect theory model exhibited good and excellent reliability, respectively. Both models were further able to predict future behaviour above chance within individuals. This prediction was better when based on participants' own model parameters than other participants' parameter estimates. These results suggest that reinforcement learning, and particularly prospect theory parameters, as derived from a restless four-armed bandit and a calibrated gambling task, can be measured reliably to assess learning and decision-making mechanisms. Overall, these findings indicate the translational potential of clinically-relevant computational parameters for precision psychiatry.

Subjects

Author keywords

Computational psychiatryDecision-makingGamblingProspect theoryReinforcement learningReliability

Authors and institutions

  • Neuroscience and Mental Health Group, Institute of Cognitive Neuroscience, University College London, London, United Kingdom.
  • Applied Computational Psychiatry Lab, Mental Health Neuroscience Department, Division of Psychiatry and Max Planck Centre for Computational Psychiatry and Ageing Research, Queen Square Institute of Neurology, University…

ORCID profiles: Anahit Mkrtchian, Vincent Valton, Jonathan P Roiser

Funding

  • Wellcome Trust

Cite

APA

Mkrtchian, A., Valton, V., & Roiser, J. P. (2023). Reliability of Decision-Making and Reinforcement Learning Computational Parameters. Computational Psychiatry, 7(1), 30. https://doi.org/10.5334/cpsy.86

Vancouver

Mkrtchian A, Valton V, Roiser JP. Reliability of Decision-Making and Reinforcement Learning Computational Parameters. Computational Psychiatry. 2023;7(1):30. doi:10.5334/cpsy.86

BibTeX
@article{Mkrtchian2023,
  author = {Mkrtchian, Anahit and Valton, Vincent and Roiser, Jonathan P},
  title = {Reliability of Decision-Making and Reinforcement Learning Computational Parameters},
  journal = {Computational Psychiatry},
  year = {2023},
  volume = {7},
  number = {1},
  pages = {30},
  doi = {10.5334/cpsy.86}
}
Start for free →