Catecholaminergic modulation of meta-learning

The remarkable expedience of human learning is thought to be underpinned by meta-learning, whereby slow accumulative learning processes are rapidly adjusted to the current learning environment. To date, the neurobiological implementation of meta-learning remains unclear. A burgeoning literature argu...

Full description

Saved in:
Bibliographic Details
Published ineLife Vol. 8
Main Authors Cook, Jennifer L, Swart, Jennifer C, Froböse, Monja I, Diaconescu, Andreea O, Geurts, Dirk EM, den Ouden, Hanneke EM, Cools, Roshan
Format Journal Article
LanguageEnglish
Published England eLife Sciences Publications Ltd 18.12.2019
eLife Sciences Publications, Ltd
Subjects
Online AccessGet full text
ISSN2050-084X
2050-084X
DOI10.7554/eLife.51439

Cover

Abstract The remarkable expedience of human learning is thought to be underpinned by meta-learning, whereby slow accumulative learning processes are rapidly adjusted to the current learning environment. To date, the neurobiological implementation of meta-learning remains unclear. A burgeoning literature argues for an important role for the catecholamines dopamine and noradrenaline in meta-learning. Here, we tested the hypothesis that enhancing catecholamine function modulates the ability to optimise a meta-learning parameter (learning rate) as a function of environmental volatility. 102 participants completed a task which required learning in stable phases, where the probability of reinforcement was constant, and volatile phases, where probabilities changed every 10–30 trials. The catecholamine transporter blocker methylphenidate enhanced participants’ ability to adapt learning rate: Under methylphenidate, compared with placebo, participants exhibited higher learning rates in volatile relative to stable phases. Furthermore, this effect was significant only with respect to direct learning based on the participants’ own experience, there was no significant effect on inferred-value learning where stimulus values had to be inferred. These data demonstrate a causal link between catecholaminergic modulation and the adjustment of the meta-learning parameter learning rate.
AbstractList The remarkable expedience of human learning is thought to be underpinned by meta-learning, whereby slow accumulative learning processes are rapidly adjusted to the current learning environment. To date, the neurobiological implementation of meta-learning remains unclear. A burgeoning literature argues for an important role for the catecholamines dopamine and noradrenaline in meta-learning. Here, we tested the hypothesis that enhancing catecholamine function modulates the ability to optimise a meta-learning parameter (learning rate) as a function of environmental volatility. 102 participants completed a task which required learning in stable phases, where the probability of reinforcement was constant, and volatile phases, where probabilities changed every 10-30 trials. The catecholamine transporter blocker methylphenidate enhanced participants' ability to adapt learning rate: Under methylphenidate, compared with placebo, participants exhibited higher learning rates in volatile relative to stable phases. Furthermore, this effect was significant only with respect to direct learning based on the participants' own experience, there was no significant effect on inferred-value learning where stimulus values had to be inferred. These data demonstrate a causal link between catecholaminergic modulation and the adjustment of the meta-learning parameter learning rate.The remarkable expedience of human learning is thought to be underpinned by meta-learning, whereby slow accumulative learning processes are rapidly adjusted to the current learning environment. To date, the neurobiological implementation of meta-learning remains unclear. A burgeoning literature argues for an important role for the catecholamines dopamine and noradrenaline in meta-learning. Here, we tested the hypothesis that enhancing catecholamine function modulates the ability to optimise a meta-learning parameter (learning rate) as a function of environmental volatility. 102 participants completed a task which required learning in stable phases, where the probability of reinforcement was constant, and volatile phases, where probabilities changed every 10-30 trials. The catecholamine transporter blocker methylphenidate enhanced participants' ability to adapt learning rate: Under methylphenidate, compared with placebo, participants exhibited higher learning rates in volatile relative to stable phases. Furthermore, this effect was significant only with respect to direct learning based on the participants' own experience, there was no significant effect on inferred-value learning where stimulus values had to be inferred. These data demonstrate a causal link between catecholaminergic modulation and the adjustment of the meta-learning parameter learning rate.
The remarkable expedience of human learning is thought to be underpinned by meta-learning, whereby slow accumulative learning processes are rapidly adjusted to the current learning environment. To date, the neurobiological implementation of meta-learning remains unclear. A burgeoning literature argues for an important role for the catecholamines dopamine and noradrenaline in meta-learning. Here, we tested the hypothesis that enhancing catecholamine function modulates the ability to optimise a meta-learning parameter (learning rate) as a function of environmental volatility. 102 participants completed a task which required learning in stable phases, where the probability of reinforcement was constant, and volatile phases, where probabilities changed every 10–30 trials. The catecholamine transporter blocker methylphenidate enhanced participants’ ability to adapt learning rate: Under methylphenidate, compared with placebo, participants exhibited higher learning rates in volatile relative to stable phases. Furthermore, this effect was significant only with respect to direct learning based on the participants’ own experience, there was no significant effect on inferred-value learning where stimulus values had to be inferred. These data demonstrate a causal link between catecholaminergic modulation and the adjustment of the meta-learning parameter learning rate.
Author Geurts, Dirk EM
Cools, Roshan
Swart, Jennifer C
Froböse, Monja I
Diaconescu, Andreea O
den Ouden, Hanneke EM
Cook, Jennifer L
Author_xml – sequence: 1
  givenname: Jennifer L
  orcidid: 0000-0003-4916-8667
  surname: Cook
  fullname: Cook, Jennifer L
  organization: School of Psychology, University of Birmingham, Birmingham, United Kingdom
– sequence: 2
  givenname: Jennifer C
  orcidid: 0000-0003-0989-332X
  surname: Swart
  fullname: Swart, Jennifer C
  organization: Donders Institute for Brain, Cognition and Behaviour, Centre for Cognitive Neuroimaging, Radboud University, Nijmegen, Netherlands
– sequence: 3
  givenname: Monja I
  surname: Froböse
  fullname: Froböse, Monja I
  organization: Donders Institute for Brain, Cognition and Behaviour, Centre for Cognitive Neuroimaging, Radboud University, Nijmegen, Netherlands
– sequence: 4
  givenname: Andreea O
  orcidid: 0000-0002-3633-9757
  surname: Diaconescu
  fullname: Diaconescu, Andreea O
  organization: Translational Neuromodeling Unit, Institute for Biomedical Engineering, University of Zurich and ETH Zurich, Zurich, Switzerland, Department of Psychiatry, University of Basel, Basel, Switzerland, Krembil Centre for Neuroinformatics,CAMH, University of Toronto, Toronto, Canada
– sequence: 5
  givenname: Dirk EM
  surname: Geurts
  fullname: Geurts, Dirk EM
  organization: Donders Institute for Brain, Cognition and Behaviour, Centre for Cognitive Neuroimaging, Radboud University, Nijmegen, Netherlands, Department of Psychiatry, Radboud University Medical Centre, Nijmegen, Netherlands
– sequence: 6
  givenname: Hanneke EM
  surname: den Ouden
  fullname: den Ouden, Hanneke EM
  organization: Donders Institute for Brain, Cognition and Behaviour, Centre for Cognitive Neuroimaging, Radboud University, Nijmegen, Netherlands
– sequence: 7
  givenname: Roshan
  surname: Cools
  fullname: Cools, Roshan
  organization: Donders Institute for Brain, Cognition and Behaviour, Centre for Cognitive Neuroimaging, Radboud University, Nijmegen, Netherlands, Department of Psychiatry, Radboud University Medical Centre, Nijmegen, Netherlands
BackLink https://www.ncbi.nlm.nih.gov/pubmed/31850844$$D View this record in MEDLINE/PubMed
BookMark eNptkc1rGzEQxUVJadI0p96LoZdA2VSypB3pUiimHwFDLin0JvTpyGilVLsb6H8f2U5DEqrLiJnfPJ703qKjXLJH6D3BF8A5--zXMfgLThiVr9DJEnPcYcF-Hz25H6OzcdzidoAJQeQbdEyJ4G3ETlC30pO3NyXpIWZfN9EuhuLmpKdY8qKExeAn3SWva4558w69DjqN_uyhnqJf379dr35266sfl6uv684y4FNHl4FIFwQADdhQ6whlxDqjoafSSOeYDcChB9NTbYIVTGrgIgRhwWCG6Sm6POi6orfqtsZB17-q6Kj2jVI3Stcp2uQV5ZJbsCYYAOal1I4DDs4EYJxSyprWl4PW7WwG76zPU9XpmejzSY43alPuVC-B0X5n5vxBoJY_sx8nNcTR-pR09mUe1ZIuBWUgKGnoxxfotsw1t69qFJOk5wzvHH146ujRyr9UGvDpANhaxrH68IgQrHaxq33sah97o8kL2sZpn197Tkz_3bkHQ4qv8A
CitedBy_id crossref_primary_10_1007_s00213_021_05974_w
crossref_primary_10_1016_j_neubiorev_2023_105123
crossref_primary_10_1016_j_cub_2020_10_052
crossref_primary_10_7554_eLife_74893
crossref_primary_10_1016_j_cub_2020_10_043
crossref_primary_10_1126_sciadv_add0501
crossref_primary_10_1162_opmi_a_00139
crossref_primary_10_1098_rsos_230027
crossref_primary_10_1007_s11229_024_04632_w
crossref_primary_10_1038_s44159_024_00304_1
crossref_primary_10_1016_j_bbr_2024_115213
crossref_primary_10_1038_s41467_023_44358_w
crossref_primary_10_1038_s41467_024_54395_8
crossref_primary_10_3758_s13415_021_00919_4
crossref_primary_10_1093_cercor_bhac046
crossref_primary_10_1371_journal_pcbi_1011978
Cites_doi 10.1016/j.pscychresns.2011.09.011
10.1162/jocn_a_01065
10.1016/0306-4522(91)90196-U
10.1002/1097-4679(199511)51:6<768::AID-JCLP2270510607>3.0.CO;2-1
10.7554/eLife.22169
10.1007/s00213-008-1250-4
10.3389/fnbeh.2013.00160
10.1038/nn1103
10.1111/j.1551-6709.2009.01010.x
10.1523/JNEUROSCI.0822-10.2010
10.1523/JNEUROSCI.2749-13.2013
10.1016/j.neuroimage.2009.03.025
10.1093/cercor/bhr117
10.1037/a0030852
10.1037/0022-3514.54.6.1063
10.1093/cercor/bhn095
10.1007/s00213-008-1097-8
10.1017/CBO9781139087759
10.1152/jn.00158.2010
10.1111/j.2044-8341.1974.tb02285.x
10.1371/journal.pbio.1002575
10.1523/JNEUROSCI.1979-16.2016
10.3389/fnins.2011.00115
10.1038/npp.2011.337
10.1038/nature07538
10.1093/comjnl/13.3.317
10.1016/j.neuroscience.2008.01.064
10.1090/S0025-5718-1970-0274029-X
10.1046/j.1471-4159.1997.68052032.x
10.1523/JNEUROSCI.4475-07.2008
10.1038/nature03287
10.1016/S0022-5371(80)90312-6
10.1037/xge0000523
10.7554/eLife.39404
10.1038/nn1954
10.1146/annurev.neuro.28.061604.135709
10.1093/scan/nsw171
10.1017/neu.2013.29
10.1016/S0893-6080(02)00228-9
10.1038/nn.3961
10.1037/0022-3514.67.2.319
10.1080/09548980601004024
10.1002/hbm.22466
10.1016/j.tins.2005.09.002
10.1523/JNEUROSCI.16-05-01936.1996
10.1038/nn1575
10.1038/sj.npp.1301235
10.1016/j.neuron.2018.06.033
10.1038/npp.2013.100
10.1016/j.biopsych.2008.04.037
10.1002/syn.10038
10.1038/s41593-018-0147-8
10.1371/journal.pcbi.1006370
10.1016/S0893-6080(02)00044-8
10.1016/j.neuron.2017.03.044
10.1016/j.cogbrainres.2004.07.007
10.1016/1048-9843(93)90003-C
10.1007/s00213-017-4723-5
10.1073/pnas.1316259111
10.1207/s15327752jpa5201_2
10.1016/j.cub.2014.10.014
10.1016/j.neuroscience.2005.09.031
10.1093/cercor/bhr114
10.1073/pnas.0905191106
10.1037/0012-1649.27.5.763
10.1016/j.jmp.2015.10.003
10.1038/s41386-018-0088-7
10.1016/j.neunet.2006.05.044
10.1093/imamat/6.1.76
10.1126/science.1185778
10.1111/j.1460-9568.2007.05612.x
10.1016/j.neuron.2013.11.028
10.1371/journal.pcbi.1003441
10.1016/j.neuron.2005.04.026
10.1016/j.neuron.2008.11.027
10.1016/j.neuron.2014.10.013
10.1016/j.cognition.2016.04.002
10.1016/j.tics.2019.02.006
10.2165/00003088-199937060-00002
10.1038/nn.2250
10.1016/j.biopsych.2011.03.028
10.1090/S0025-5718-1970-0258249-6
10.1101/303982
10.1371/journal.pcbi.1003810
10.1038/nn.3130
10.1207/s15327752jpa6703_13
10.1017/CBO9780511544156.008
10.1016/j.cub.2010.04.055
10.1016/j.biopsych.2008.05.015
10.1163/156856897X00357
10.1016/j.neuron.2015.11.028
10.1016/j.conb.2017.10.006
10.1016/j.nlm.2017.12.002
10.1126/science.1255514
10.3758/CABN.10.2.252
10.1037/a0025180
10.3389/fnbeh.2013.00218
10.1207/s15327752jpa4803_13
10.1126/science.275.5306.1593
10.1371/journal.pcbi.1006043
10.1371/journal.pcbi.1005171
10.1371/journal.pcbi.1002028
10.1016/0166-4328(90)90118-X
10.1093/scan/nst077
10.1163/156856897X00366
ContentType Journal Article
Copyright 2019, Cook et al.
2019, Cook et al. This work is published under http://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
2019, Cook et al 2019 Cook et al
Copyright_xml – notice: 2019, Cook et al.
– notice: 2019, Cook et al. This work is published under http://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
– notice: 2019, Cook et al 2019 Cook et al
DBID AAYXX
CITATION
CGR
CUY
CVF
ECM
EIF
NPM
3V.
7X7
7XB
88E
88I
8FE
8FH
8FI
8FJ
8FK
ABUWG
AFKRA
AZQEC
BBNVY
BENPR
BHPHI
CCPQU
DWQXO
FYUFA
GHDGH
GNUQQ
HCIFZ
K9.
LK8
M0S
M1P
M2P
M7P
PHGZM
PHGZT
PIMPY
PJZUB
PKEHL
PPXIY
PQEST
PQGLB
PQQKQ
PQUKI
PRINS
Q9U
7X8
5PM
DOA
DOI 10.7554/eLife.51439
DatabaseName CrossRef
Medline
MEDLINE
MEDLINE (Ovid)
MEDLINE
MEDLINE
PubMed
ProQuest Central (Corporate)
Health & Medical Collection
ProQuest Central (purchase pre-March 2016)
Medical Database (Alumni Edition)
Science Database (Alumni Edition)
ProQuest SciTech Collection
ProQuest Natural Science Collection
ProQuest Hospital Collection
Hospital Premium Collection (Alumni Edition)
ProQuest Central (Alumni) (purchase pre-March 2016)
ProQuest Central (Alumni)
ProQuest Central UK/Ireland
ProQuest Central Essentials
Biological Science Database
ProQuest Central
Natural Science Collection
ProQuest One
ProQuest Central Korea
Proquest Health Research Premium Collection
Health Research Premium Collection (Alumni)
ProQuest Central Student
SciTech Premium Collection
ProQuest Health & Medical Complete (Alumni)
Biological Sciences
Health & Medical Collection (Alumni)
Medical Database
Science Database
Biological Science Database
ProQuest Central Premium
ProQuest One Academic
Publicly Available Content Database
ProQuest Health & Medical Research Collection
ProQuest One Academic Middle East (New)
ProQuest One Health & Nursing
ProQuest One Academic Eastern Edition (DO NOT USE)
ProQuest One Applied & Life Sciences
ProQuest One Academic
ProQuest One Academic UKI Edition
ProQuest Central China
ProQuest Central Basic
MEDLINE - Academic
PubMed Central (Full Participant titles)
Directory of Open Access Journals (DOAJ) (Open Access)
DatabaseTitle CrossRef
MEDLINE
Medline Complete
MEDLINE with Full Text
PubMed
MEDLINE (Ovid)
Publicly Available Content Database
ProQuest Central Student
ProQuest One Academic Middle East (New)
ProQuest Central Essentials
ProQuest Health & Medical Complete (Alumni)
ProQuest Central (Alumni Edition)
SciTech Premium Collection
ProQuest One Community College
ProQuest One Health & Nursing
ProQuest Natural Science Collection
ProQuest Central China
ProQuest Central
ProQuest One Applied & Life Sciences
ProQuest Health & Medical Research Collection
Health Research Premium Collection
Health and Medicine Complete (Alumni Edition)
Natural Science Collection
ProQuest Central Korea
Health & Medical Research Collection
Biological Science Collection
ProQuest Central (New)
ProQuest Medical Library (Alumni)
ProQuest Science Journals (Alumni Edition)
ProQuest Biological Science Collection
ProQuest Central Basic
ProQuest Science Journals
ProQuest One Academic Eastern Edition
ProQuest Hospital Collection
Health Research Premium Collection (Alumni)
Biological Science Database
ProQuest SciTech Collection
ProQuest Hospital Collection (Alumni)
ProQuest Health & Medical Complete
ProQuest Medical Library
ProQuest One Academic UKI Edition
ProQuest One Academic
ProQuest One Academic (New)
ProQuest Central (Alumni)
MEDLINE - Academic
DatabaseTitleList MEDLINE - Academic


CrossRef
Publicly Available Content Database
MEDLINE
Database_xml – sequence: 1
  dbid: DOA
  name: DOAJ Open Access Full Text
  url: https://www.doaj.org/
  sourceTypes: Open Website
– sequence: 2
  dbid: NPM
  name: PubMed
  url: https://proxy.k.utb.cz/login?url=http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed
  sourceTypes: Index Database
– sequence: 3
  dbid: EIF
  name: MEDLINE
  url: https://proxy.k.utb.cz/login?url=https://www.webofscience.com/wos/medline/basic-search
  sourceTypes: Index Database
– sequence: 4
  dbid: BENPR
  name: ProQuest Central
  url: http://www.proquest.com/pqcentral?accountid=15518
  sourceTypes: Aggregation Database
DeliveryMethod fulltext_linktorsrc
Discipline Biology
EISSN 2050-084X
ExternalDocumentID oai_doaj_org_article_3595c7cbfb774e99ad570fdbf7453334
PMC6974360
31850844
10_7554_eLife_51439
Genre Research Support, Non-U.S. Gov't
Journal Article
GrantInformation_xml – fundername: University of Birmingham
  grantid: Birmingham Fellows Programme
– fundername: James S. McDonnell Foundation
  grantid: James McDonnell scholar award
– fundername: ZonMw
  grantid: 92003576
– fundername: Nederlandse Organisatie voor Wetenschappelijk Onderzoek
  grantid: Vici Award 453-14-005
– fundername: Swiss National Foundation
  grantid: PZ00P3_167952
– fundername: Nederlandse Organisatie voor Wetenschappelijk Onderzoek
  grantid: Veni Grant 451-11-004
– fundername: Nederlandse Organisatie voor Wetenschappelijk Onderzoek
  grantid: Research talent grant 406-14-028
– fundername: H2020 European Research Council
  grantid: ERC Starting Grant 757583
– fundername: Swiss National Science Foundation
  grantid: PZ00P3_167952
– fundername: Nederlandse Organisatie voor Wetenschappelijk Onderzoek
  grantid: Vici Award 53-14-005
– fundername: ;
– fundername: ;
  grantid: Research talent grant 406-14-028
– fundername: ;
  grantid: 92003576
– fundername: ;
  grantid: PZ00P3_167952
– fundername: ;
  grantid: Veni Grant 451-11-004
– fundername: ;
  grantid: Vici Award 453-14-005
– fundername: ;
  grantid: ERC Starting Grant 757583
– fundername: ;
  grantid: Birmingham Fellows Programme
– fundername: ;
  grantid: James McDonnell scholar award
GroupedDBID 53G
5VS
7X7
88E
88I
8FE
8FH
8FI
8FJ
AAFWJ
AAKDD
AAYXX
ABUWG
ACGFO
ACGOD
ACPRK
ADBBV
ADRAZ
AENEX
AFKRA
AFPKN
ALIPV
ALMA_UNASSIGNED_HOLDINGS
AOIJS
AZQEC
BAWUL
BBNVY
BCNDV
BENPR
BHPHI
BPHCQ
BVXVI
CCPQU
CITATION
DIK
DWQXO
EMOBN
FYUFA
GNUQQ
GROUPED_DOAJ
GX1
HCIFZ
HMCUK
HYE
IAO
IEA
IHR
INH
INR
ISR
ITC
KQ8
LK8
M1P
M2P
M48
M7P
M~E
NQS
OK1
PGMZT
PHGZM
PHGZT
PIMPY
PQQKQ
PROAC
PSQYO
RHI
RNS
RPM
UKHRP
CGR
CUY
CVF
ECM
EIF
NPM
3V.
7XB
8FK
K9.
PJZUB
PKEHL
PPXIY
PQEST
PQGLB
PQUKI
PRINS
Q9U
7X8
PUEGO
5PM
ID FETCH-LOGICAL-c475t-32f19df8773f0b3cd1341cdba7639b9dd4cf75767b63abfc849a758ff8c7b0403
IEDL.DBID M48
ISSN 2050-084X
IngestDate Wed Aug 27 01:23:43 EDT 2025
Thu Aug 21 14:08:41 EDT 2025
Fri Sep 05 13:49:54 EDT 2025
Fri Jul 25 10:32:56 EDT 2025
Thu Apr 03 07:02:34 EDT 2025
Thu Apr 24 23:09:05 EDT 2025
Tue Jul 01 04:12:54 EDT 2025
IsDoiOpenAccess true
IsOpenAccess true
IsPeerReviewed true
IsScholarly true
Keywords methylphenidate
meta-learning
neuroscience
learning rate
noradrenaline
volatility
dopamine
human
Language English
License http://creativecommons.org/licenses/by/4.0
2019, Cook et al.
This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c475t-32f19df8773f0b3cd1341cdba7639b9dd4cf75767b63abfc849a758ff8c7b0403
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
content type line 23
These authors contributed equally to this work.
ORCID 0000-0002-3633-9757
0000-0003-0989-332X
0000-0003-4916-8667
OpenAccessLink http://journals.scholarsportal.info/openUrl.xqy?doi=10.7554/eLife.51439
PMID 31850844
PQID 2349165404
PQPubID 2045579
ParticipantIDs doaj_primary_oai_doaj_org_article_3595c7cbfb774e99ad570fdbf7453334
pubmedcentral_primary_oai_pubmedcentral_nih_gov_6974360
proquest_miscellaneous_2328347831
proquest_journals_2349165404
pubmed_primary_31850844
crossref_primary_10_7554_eLife_51439
crossref_citationtrail_10_7554_eLife_51439
ProviderPackageCode CITATION
AAYXX
PublicationCentury 2000
PublicationDate 2019-12-18
PublicationDateYYYYMMDD 2019-12-18
PublicationDate_xml – month: 12
  year: 2019
  text: 2019-12-18
  day: 18
PublicationDecade 2010
PublicationPlace England
PublicationPlace_xml – name: England
– name: Cambridge
PublicationTitle eLife
PublicationTitleAlternate Elife
PublicationYear 2019
Publisher eLife Sciences Publications Ltd
eLife Sciences Publications, Ltd
Publisher_xml – name: eLife Sciences Publications Ltd
– name: eLife Sciences Publications, Ltd
References Brainard (bib13) 1997; 10
Moussawi (bib79) 2009; 12
Jepma (bib55) 2016; 12
Lapiz (bib66) 2006; 137
Silvetti (bib100) 2018; 14
Joshi (bib56) 2016; 89
Grace (bib50) 1991; 41
Pasupathy (bib85) 2005; 433
Cook (bib25) 2018
Dienes (bib37) 2016; 72
Botvinick (bib10) 2019; 23
Barratt (bib4) 2012
Schweighofer (bib94) 2003; 16
Massi (bib75) 2018; 99
Bond (bib9) 1974; 47
Carver (bib21) 1994; 67
Dayan (bib30) 2006; 17
Muller (bib80) 2019; 8
Wang (bib109) 2018; 21
Schmand (bib92) 1991; 22
Kim (bib58) 2014; 26
Beck (bib5) 1996; 67
Broyden (bib16) 1970; 6
Behrens (bib7) 2008; 456
Daunizeau (bib29) 2014; 10
Heyes (bib51) 2012; 126
Schultz (bib93) 1997; 275
Wechsler (bib111) 2008
Preuschoff (bib88) 2011; 5
Aston-Jones (bib1) 2007
Diederen (bib36) 2017; 37
Bouret (bib11) 2005; 28
van der Schaaf (bib106) 2013; 38
Zimet (bib114) 1988; 52
Collins (bib23) 2016; 152
Krugel (bib61) 2009; 106
Volkow (bib107) 2002; 43
Fletcher (bib43) 1970; 13
Lieder (bib71) 2018; 14
Campbell-Meiklejohn (bib19) 2010; 20
Klucharev (bib60) 2009; 61
Collins (bib22) 2013; 120
Tait (bib105) 2007; 25
Newman (bib84) 2008; 200
Browning (bib15) 2015; 18
Duan (bib39) 2016
Floresco (bib44) 2003; 6
Behrens (bib6) 2007; 10
Doya (bib38) 2002; 15
Yagishita (bib112) 2014; 345
Montague (bib78) 1996; 16
Nassar (bib82) 2010; 30
Patton (bib86) 1995; 51
Rescorla (bib90) 1972
Geurts (bib47) 2013; 33
Cools (bib26) 2008; 28
Devilbiss (bib33) 2008; 64
Silvetti (bib99) 2013; 7
Howlett (bib52) 2017; 234
Seu (bib96) 2009; 202
Wang (bib108) 2016
Landau (bib63) 2009; 19
Langdon (bib64) 2018; 49
Watson (bib110) 1988; 54
Frank (bib45) 2012; 22
MacKay (bib73) 2003
Braams (bib12) 2014; 9
Cacioppo (bib18) 1984; 48
Cools (bib27) 2011; 69
Delgado (bib31) 2005; 8
Daneman (bib28) 1980; 19
Lapiz (bib65) 2007; 32
Biele (bib8) 2009; 33
Buckholtz (bib17) 2010; 329
Diaconescu (bib34) 2014; 10
Stephan (bib103) 2009; 46
Farashahi (bib42) 2017; 94
Murphy (bib81) 2014; 35
Devauges (bib32) 1990; 39
Lohani (bib72) 2018; 43
JASP Team (bib54) 2018
Lee (bib70) 2014
Pelli (bib87) 1997; 10
Lee (bib68) 2004; 22
Swart (bib104) 2017; 6
Fallon (bib41) 2017; 29
Kimko (bib59) 1999; 37
Badre (bib3) 2012; 22
McGuire (bib77) 2014; 84
Aston-Jones (bib2) 2005; 28
Froböse (bib46) 2018; 147
Campbell-Meiklejohn (bib20) 2012; 37
Diaconescu (bib35) 2017; 12
Nassar (bib83) 2012; 15
Salthouse (bib91) 1991; 27
Shanno (bib97) 1970; 24
Marshall (bib74) 2016; 14
Kuczenski (bib62) 1997; 68
Durstewitz (bib40) 2008; 64
Set (bib95) 2014; 111
Huys (bib53) 2011; 7
Reeves (bib89) 2012; 202
Spielberger (bib102) 1983
Kalma (bib57) 1993; 4
Sharpe (bib98) 2018; 153
Soltani (bib101) 2006; 19
Lee (bib69) 2014; 81
McGaughy (bib76) 2008; 153
Cook (bib24) 2014; 24
Goldfarb (bib49) 1970; 24
Lavín (bib67) 2013; 7
Gilzenrat (bib48) 2010; 10
Yu (bib113) 2005; 46
Bromberg-Martin (bib14) 2010; 104
References_xml – volume: 202
  start-page: 60
  year: 2012
  ident: bib89
  article-title: Limbic striatal dopamine D2/3 receptor availability is associated with non-planning impulsivity in healthy adults after exclusion of potential dissimulators
  publication-title: Psychiatry Research: Neuroimaging
  doi: 10.1016/j.pscychresns.2011.09.011
– volume: 29
  start-page: 652
  year: 2017
  ident: bib41
  article-title: The neurocognitive cost of enhancing cognition with methylphenidate: improved distractor resistance but impaired updating
  publication-title: Journal of Cognitive Neuroscience
  doi: 10.1162/jocn_a_01065
– volume: 41
  start-page: 1
  year: 1991
  ident: bib50
  article-title: Phasic versus tonic dopamine release and the modulation of dopamine system responsivity: a hypothesis for the etiology of schizophrenia
  publication-title: Neuroscience
  doi: 10.1016/0306-4522(91)90196-U
– volume: 51
  start-page: 768
  year: 1995
  ident: bib86
  article-title: Factor structure of the barratt impulsiveness scale
  publication-title: Journal of Clinical Psychology
  doi: 10.1002/1097-4679(199511)51:6<768::AID-JCLP2270510607>3.0.CO;2-1
– volume: 6
  year: 2017
  ident: bib104
  article-title: Catecholaminergic challenge uncovers distinct pavlovian and instrumental mechanisms of motivated (in)action
  publication-title: eLife
  doi: 10.7554/eLife.22169
– volume: 202
  start-page: 505
  year: 2009
  ident: bib96
  article-title: Inhibition of the norepinephrine transporter improves behavioral flexibility in rats and monkeys
  publication-title: Psychopharmacology
  doi: 10.1007/s00213-008-1250-4
– volume: 7
  year: 2013
  ident: bib99
  article-title: The influence of the noradrenergic system on optimal control of neural plasticity
  publication-title: Frontiers in Behavioral Neuroscience
  doi: 10.3389/fnbeh.2013.00160
– volume: 6
  start-page: 968
  year: 2003
  ident: bib44
  article-title: Afferent modulation of dopamine neuron firing differentially regulates tonic and phasic dopamine transmission
  publication-title: Nature Neuroscience
  doi: 10.1038/nn1103
– volume: 33
  start-page: 206
  year: 2009
  ident: bib8
  article-title: Computational models for the combination of advice and individual learning
  publication-title: Cognitive Science
  doi: 10.1111/j.1551-6709.2009.01010.x
– volume: 30
  start-page: 12366
  year: 2010
  ident: bib82
  article-title: An approximately bayesian delta-rule model explains the dynamics of belief updating in a changing environment
  publication-title: Journal of Neuroscience
  doi: 10.1523/JNEUROSCI.0822-10.2010
– volume: 33
  start-page: 18932
  year: 2013
  ident: bib47
  article-title: Serotonin and aversive pavlovian control of instrumental behavior in humans
  publication-title: Journal of Neuroscience
  doi: 10.1523/JNEUROSCI.2749-13.2013
– volume: 46
  start-page: 1004
  year: 2009
  ident: bib103
  article-title: Bayesian model selection for group studies
  publication-title: NeuroImage
  doi: 10.1016/j.neuroimage.2009.03.025
– year: 2018
  ident: bib54
  article-title: JASP (Version 0.8.6)[Computer software]
– volume: 22
  start-page: 527
  year: 2012
  ident: bib3
  article-title: Mechanisms of hierarchical reinforcement learning in cortico-striatal circuits 2: evidence from fMRI
  publication-title: Cerebral Cortex
  doi: 10.1093/cercor/bhr117
– volume: 120
  start-page: 190
  year: 2013
  ident: bib22
  article-title: Cognitive control over learning: creating, clustering, and generalizing task-set structure
  publication-title: Psychological Review
  doi: 10.1037/a0030852
– volume: 54
  start-page: 1063
  year: 1988
  ident: bib110
  article-title: Development and validation of brief measures of positive and negative affect: the PANAS scales
  publication-title: Journal of Personality and Social Psychology
  doi: 10.1037/0022-3514.54.6.1063
– volume: 19
  start-page: 445
  year: 2009
  ident: bib63
  article-title: Striatal dopamine and working memory
  publication-title: Cerebral Cortex
  doi: 10.1093/cercor/bhn095
– volume-title: arXiv
  year: 2016
  ident: bib39
  article-title: RL2: fast reinforcement learning via slow reinforcement learning
– volume: 200
  start-page: 39
  year: 2008
  ident: bib84
  article-title: Atomoxetine reverses attentional deficits produced by noradrenergic deafferentation of medial prefrontal cortex
  publication-title: Psychopharmacology
  doi: 10.1007/s00213-008-1097-8
– volume-title: Bayesian Cognitive Modeling: A Practical Course
  year: 2014
  ident: bib70
  doi: 10.1017/CBO9781139087759
– volume: 104
  start-page: 1068
  year: 2010
  ident: bib14
  article-title: A pallidus-habenula-dopamine pathway signals inferred stimulus values
  publication-title: Journal of Neurophysiology
  doi: 10.1152/jn.00158.2010
– volume: 47
  start-page: 211
  year: 1974
  ident: bib9
  article-title: The use of analogue scales in rating subjective feelings
  publication-title: British Journal of Medical Psychology
  doi: 10.1111/j.2044-8341.1974.tb02285.x
– volume: 14
  year: 2016
  ident: bib74
  article-title: Pharmacological fingerprints of contextual uncertainty
  publication-title: PLOS Biology
  doi: 10.1371/journal.pbio.1002575
– volume: 37
  start-page: 1708
  year: 2017
  ident: bib36
  article-title: Dopamine modulates adaptive prediction error coding in the human midbrain and striatum
  publication-title: The Journal of Neuroscience
  doi: 10.1523/JNEUROSCI.1979-16.2016
– volume-title: arXiv
  year: 2016
  ident: bib108
  article-title: Learning to reinforcement learn
– volume: 5
  year: 2011
  ident: bib88
  article-title: Pupil dilation signals surprise: evidence for noradrenaline's Role in Decision Making
  publication-title: Frontiers in Neuroscience
  doi: 10.3389/fnins.2011.00115
– volume: 37
  start-page: 1517
  year: 2012
  ident: bib20
  article-title: Modulation of social influence by methylphenidate
  publication-title: Neuropsychopharmacology
  doi: 10.1038/npp.2011.337
– volume-title: Social class on campus
  year: 2012
  ident: bib4
  article-title: The Barratt Simplified Measure of Social Status (BSMSS)
– volume: 456
  start-page: 245
  year: 2008
  ident: bib7
  article-title: Associative learning of social value
  publication-title: Nature
  doi: 10.1038/nature07538
– volume: 13
  start-page: 317
  year: 1970
  ident: bib43
  article-title: A new approach to variable metric algorithms
  publication-title: The Computer Journal
  doi: 10.1093/comjnl/13.3.317
– volume: 153
  start-page: 63
  year: 2008
  ident: bib76
  article-title: Noradrenergic, but not cholinergic, deafferentation of prefrontal cortex impairs attentional set-shifting
  publication-title: Neuroscience
  doi: 10.1016/j.neuroscience.2008.01.064
– volume: 24
  start-page: 647
  year: 1970
  ident: bib97
  article-title: Conditioning of quasi-Newton methods for function minimization
  publication-title: Mathematics of Computation
  doi: 10.1090/S0025-5718-1970-0274029-X
– volume: 68
  start-page: 2032
  year: 1997
  ident: bib62
  article-title: Effects of methylphenidate on extracellular dopamine, serotonin, and norepinephrine: comparison with amphetamine
  publication-title: Journal of Neurochemistry
  doi: 10.1046/j.1471-4159.1997.68052032.x
– volume: 28
  start-page: 1208
  year: 2008
  ident: bib26
  article-title: Working memory capacity predicts dopamine synthesis capacity in the human striatum
  publication-title: Journal of Neuroscience
  doi: 10.1523/JNEUROSCI.4475-07.2008
– volume: 433
  start-page: 873
  year: 2005
  ident: bib85
  article-title: Different time courses of learning-related activity in the prefrontal cortex and striatum
  publication-title: Nature
  doi: 10.1038/nature03287
– volume: 19
  start-page: 450
  year: 1980
  ident: bib28
  article-title: Individual differences in working memory and reading
  publication-title: Journal of Verbal Learning and Verbal Behavior
  doi: 10.1016/S0022-5371(80)90312-6
– volume: 147
  start-page: 1763
  year: 2018
  ident: bib46
  article-title: Catecholaminergic modulation of the avoidance of cognitive control
  publication-title: Journal of Experimental Psychology: General
  doi: 10.1037/xge0000523
– volume: 8
  year: 2019
  ident: bib80
  article-title: Control of entropy in neural models of environmental state
  publication-title: eLife
  doi: 10.7554/eLife.39404
– volume: 10
  start-page: 1214
  year: 2007
  ident: bib6
  article-title: Learning the value of information in an uncertain world
  publication-title: Nature Neuroscience
  doi: 10.1038/nn1954
– volume: 28
  start-page: 403
  year: 2005
  ident: bib2
  article-title: An integrative theory of locus coeruleus-norepinephrine function: adaptive gain and optimal performance
  publication-title: Annual Review of Neuroscience
  doi: 10.1146/annurev.neuro.28.061604.135709
– volume: 12
  start-page: 618
  year: 2017
  ident: bib35
  article-title: Hierarchical prediction errors in midbrain and septum during social learning
  publication-title: Social Cognitive and Affective Neuroscience
  doi: 10.1093/scan/nsw171
– volume: 26
  start-page: 35
  year: 2014
  ident: bib58
  article-title: Dopamine D(2/3) receptor availability and human cognitive impulsivity: a high-resolution positron emission tomography imaging study with [¹¹C]raclopride
  publication-title: Acta Neuropsychiatrica
  doi: 10.1017/neu.2013.29
– volume: 16
  start-page: 5
  year: 2003
  ident: bib94
  article-title: Meta-learning in reinforcement learning
  publication-title: Neural Networks
  doi: 10.1016/S0893-6080(02)00228-9
– volume: 18
  start-page: 590
  year: 2015
  ident: bib15
  article-title: Anxious individuals have difficulty learning the causal statistics of aversive environments
  publication-title: Nature Neuroscience
  doi: 10.1038/nn.3961
– volume: 67
  start-page: 319
  year: 1994
  ident: bib21
  article-title: Behavioral inhibition, behavioral activation, and affective responses to impending reward and punishment: the BIS/BAS scales
  publication-title: Journal of Personality and Social Psychology
  doi: 10.1037/0022-3514.67.2.319
– volume: 17
  start-page: 335
  year: 2006
  ident: bib30
  article-title: Phasic norepinephrine: a neural interrupt signal for unexpected events
  publication-title: Network: Computation in Neural Systems
  doi: 10.1080/09548980601004024
– volume: 35
  start-page: 4140
  year: 2014
  ident: bib81
  article-title: Pupil diameter covaries with BOLD activity in human locus coeruleus
  publication-title: Human Brain Mapping
  doi: 10.1002/hbm.22466
– volume: 28
  start-page: 574
  year: 2005
  ident: bib11
  article-title: Network reset: a simplified overarching theory of locus coeruleus noradrenaline function
  publication-title: Trends in Neurosciences
  doi: 10.1016/j.tins.2005.09.002
– volume: 16
  start-page: 1936
  year: 1996
  ident: bib78
  article-title: A framework for mesencephalic dopamine systems based on predictive hebbian learning
  publication-title: The Journal of Neuroscience
  doi: 10.1523/JNEUROSCI.16-05-01936.1996
– volume: 8
  start-page: 1611
  year: 2005
  ident: bib31
  article-title: Perceptions of moral character modulate the neural systems of reward during the trust game
  publication-title: Nature Neuroscience
  doi: 10.1038/nn1575
– volume: 32
  start-page: 1000
  year: 2007
  ident: bib65
  article-title: Chronic treatment with desipramine improves cognitive performance of rats in an attentional set-shifting test
  publication-title: Neuropsychopharmacology
  doi: 10.1038/sj.npp.1301235
– volume: 99
  start-page: 598
  year: 2018
  ident: bib75
  article-title: Volatility facilitates value updating in the prefrontal cortex
  publication-title: Neuron
  doi: 10.1016/j.neuron.2018.06.033
– volume: 38
  start-page: 2011
  year: 2013
  ident: bib106
  article-title: Working memory capacity predicts effects of methylphenidate on reversal learning
  publication-title: Neuropsychopharmacology
  doi: 10.1038/npp.2013.100
– volume: 64
  start-page: 626
  year: 2008
  ident: bib33
  article-title: Cognition-enhancing doses of methylphenidate preferentially increase prefrontal cortex neuronal responsiveness
  publication-title: Biological Psychiatry
  doi: 10.1016/j.biopsych.2008.04.037
– volume: 43
  start-page: 181
  year: 2002
  ident: bib107
  article-title: Relationship between blockade of dopamine transporters by oral methylphenidate and the increases in extracellular dopamine: therapeutic implications
  publication-title: Synapse
  doi: 10.1002/syn.10038
– volume: 21
  start-page: 860
  year: 2018
  ident: bib109
  article-title: Prefrontal cortex as a meta-reinforcement learning system
  publication-title: Nature Neuroscience
  doi: 10.1038/s41593-018-0147-8
– volume: 14
  year: 2018
  ident: bib100
  article-title: Dorsal anterior cingulate-brainstem ensemble as a reinforcement meta-learner
  publication-title: PLOS Computational Biology
  doi: 10.1371/journal.pcbi.1006370
– volume: 15
  start-page: 495
  year: 2002
  ident: bib38
  article-title: Metalearning and neuromodulation
  publication-title: Neural Networks
  doi: 10.1016/S0893-6080(02)00044-8
– volume: 94
  start-page: 401
  year: 2017
  ident: bib42
  article-title: Metaplasticity as a neural substrate for adaptive learning and choice under uncertainty
  publication-title: Neuron
  doi: 10.1016/j.neuron.2017.03.044
– volume: 22
  start-page: 45
  year: 2004
  ident: bib68
  article-title: Reinforcement learning and decision making in monkeys during a competitive game
  publication-title: Cognitive Brain Research
  doi: 10.1016/j.cogbrainres.2004.07.007
– volume: 4
  start-page: 45
  year: 1993
  ident: bib57
  article-title: Sociable and aggressive dominance: personality differences in leadership style?
  publication-title: The Leadership Quarterly
  doi: 10.1016/1048-9843(93)90003-C
– volume: 234
  start-page: 3353
  year: 2017
  ident: bib52
  article-title: The effect of single-dose methylphenidate on the rate of error-driven learning in healthy males: a randomized controlled trial
  publication-title: Psychopharmacology
  doi: 10.1007/s00213-017-4723-5
– volume: 111
  start-page: 9615
  year: 2014
  ident: bib95
  article-title: Dissociable contribution of prefrontal and striatal dopaminergic genes to learning in economic games
  publication-title: PNAS
  doi: 10.1073/pnas.1316259111
– volume: 52
  start-page: 30
  year: 1988
  ident: bib114
  article-title: The multidimensional scale of perceived social support
  publication-title: Journal of Personality Assessment
  doi: 10.1207/s15327752jpa5201_2
– volume: 24
  start-page: 2812
  year: 2014
  ident: bib24
  article-title: The social dominance paradox
  publication-title: Current Biology
  doi: 10.1016/j.cub.2014.10.014
– volume: 137
  start-page: 1039
  year: 2006
  ident: bib66
  article-title: Noradrenergic modulation of cognitive function in rat medial prefrontal cortex as measured by attentional set shifting capability
  publication-title: Neuroscience
  doi: 10.1016/j.neuroscience.2005.09.031
– volume: 22
  start-page: 509
  year: 2012
  ident: bib45
  article-title: Mechanisms of hierarchical reinforcement learning in corticostriatal circuits 1: computational analysis
  publication-title: Cerebral Cortex
  doi: 10.1093/cercor/bhr114
– volume: 106
  start-page: 17951
  year: 2009
  ident: bib61
  article-title: Genetic variation in dopaminergic neuromodulation influences the ability to rapidly and flexibly adapt decisions
  publication-title: PNAS
  doi: 10.1073/pnas.0905191106
– volume: 27
  start-page: 763
  year: 1991
  ident: bib91
  article-title: Decomposing adult age differences in working memory
  publication-title: Developmental Psychology
  doi: 10.1037/0012-1649.27.5.763
– volume: 72
  start-page: 78
  year: 2016
  ident: bib37
  article-title: How Bayes factors change scientific practice
  publication-title: Journal of Mathematical Psychology
  doi: 10.1016/j.jmp.2015.10.003
– volume-title: Information Theory Inference and Learning Algorithms
  year: 2003
  ident: bib73
– volume-title: Wechsler Adult Intelligence Scale (WAIS-IV)
  year: 2008
  ident: bib111
– volume: 43
  start-page: 2083
  year: 2018
  ident: bib72
  article-title: Burst activation of dopamine neurons produces prolonged post-burst availability of actively released dopamine
  publication-title: Neuropsychopharmacology
  doi: 10.1038/s41386-018-0088-7
– volume-title: Manual for the State-Trait Anxiety Inventory (Form Y) (Palo Alto)
  year: 1983
  ident: bib102
– volume: 19
  start-page: 1075
  year: 2006
  ident: bib101
  article-title: Neural mechanism for stochastic behaviour during a competitive game
  publication-title: Neural Networks
  doi: 10.1016/j.neunet.2006.05.044
– volume: 6
  start-page: 76
  year: 1970
  ident: bib16
  article-title: The convergence of a class of Double-rank minimization algorithms 1. general considerations
  publication-title: IMA Journal of Applied Mathematics
  doi: 10.1093/imamat/6.1.76
– volume: 329
  year: 2010
  ident: bib17
  article-title: Dopaminergic network differences in human impulsivity
  publication-title: Science
  doi: 10.1126/science.1185778
– volume: 25
  start-page: 3719
  year: 2007
  ident: bib105
  article-title: Lesions of the dorsal noradrenergic bundle impair attentional set-shifting in the rat
  publication-title: European Journal of Neuroscience
  doi: 10.1111/j.1460-9568.2007.05612.x
– volume: 81
  start-page: 687
  year: 2014
  ident: bib69
  article-title: Neural computations underlying arbitration between model-based and model-free learning
  publication-title: Neuron
  doi: 10.1016/j.neuron.2013.11.028
– volume: 10
  year: 2014
  ident: bib29
  article-title: VBA: a probabilistic treatment of nonlinear models for neurobiological and behavioural data
  publication-title: PLOS Computational Biology
  doi: 10.1371/journal.pcbi.1003441
– volume: 46
  start-page: 681
  year: 2005
  ident: bib113
  article-title: Uncertainty, neuromodulation, and attention
  publication-title: Neuron
  doi: 10.1016/j.neuron.2005.04.026
– volume: 61
  start-page: 140
  year: 2009
  ident: bib60
  article-title: Reinforcement learning signal predicts social conformity
  publication-title: Neuron
  doi: 10.1016/j.neuron.2008.11.027
– volume: 84
  start-page: 870
  year: 2014
  ident: bib77
  article-title: Functionally dissociable influences on learning rate in a dynamic environment
  publication-title: Neuron
  doi: 10.1016/j.neuron.2014.10.013
– volume: 152
  start-page: 160
  year: 2016
  ident: bib23
  article-title: Neural signature of hierarchically structured expectations predicts clustering and transfer of rule sets in reinforcement learning
  publication-title: Cognition
  doi: 10.1016/j.cognition.2016.04.002
– volume: 22
  start-page: 15
  year: 1991
  ident: bib92
  article-title: The dutch reading test for adults: a measure of premorbid intelligence level
  publication-title: Tijdschrift Voor Gerontologie en Geriatrie
– volume: 23
  start-page: 408
  year: 2019
  ident: bib10
  article-title: Reinforcement learning, fast and slow
  publication-title: Trends in Cognitive Sciences
  doi: 10.1016/j.tics.2019.02.006
– volume: 37
  start-page: 457
  year: 1999
  ident: bib59
  article-title: Pharmacokinetics and clinical effectiveness of methylphenidate
  publication-title: Clinical Pharmacokinetics
  doi: 10.2165/00003088-199937060-00002
– volume: 12
  start-page: 182
  year: 2009
  ident: bib79
  article-title: N-Acetylcysteine reverses cocaine-induced metaplasticity
  publication-title: Nature Neuroscience
  doi: 10.1038/nn.2250
– volume: 69
  start-page: e113
  year: 2011
  ident: bib27
  article-title: Inverted-U-shaped dopamine actions on human working memory and cognitive control
  publication-title: Biological Psychiatry
  doi: 10.1016/j.biopsych.2011.03.028
– volume: 24
  start-page: 23
  year: 1970
  ident: bib49
  article-title: A family of variable-metric methods derived by variational means
  publication-title: Mathematics of Computation
  doi: 10.1090/S0025-5718-1970-0258249-6
– volume-title: bioRxiv
  year: 2018
  ident: bib25
  article-title: Catecholamine challenge uncovers distinct mechanisms for direct versus indirect, but not social versus Non-Social, learning
  doi: 10.1101/303982
– volume: 10
  year: 2014
  ident: bib34
  article-title: Inferring on the intentions of others by hierarchical bayesian learning
  publication-title: PLOS Computational Biology
  doi: 10.1371/journal.pcbi.1003810
– volume: 15
  start-page: 1040
  year: 2012
  ident: bib83
  article-title: Rational regulation of learning dynamics by pupil-linked arousal systems
  publication-title: Nature Neuroscience
  doi: 10.1038/nn.3130
– volume: 67
  start-page: 588
  year: 1996
  ident: bib5
  article-title: Comparison of beck depression inventories -IA and -II in psychiatric outpatients
  publication-title: Journal of Personality Assessment
  doi: 10.1207/s15327752jpa6703_13
– start-page: 196
  volume-title: Brain Norepinephrine
  year: 2007
  ident: bib1
  doi: 10.1017/CBO9780511544156.008
– volume: 20
  start-page: 1165
  year: 2010
  ident: bib19
  article-title: How the opinion of others affects our valuation of objects
  publication-title: Current Biology
  doi: 10.1016/j.cub.2010.04.055
– volume: 64
  start-page: 739
  year: 2008
  ident: bib40
  article-title: The dual-state theory of prefrontal cortex dopamine function with relevance to catechol-o-methyltransferase genotypes and schizophrenia
  publication-title: Biological Psychiatry
  doi: 10.1016/j.biopsych.2008.05.015
– start-page: 64
  volume-title: Classical Conditioning II: Current Research and Theory
  year: 1972
  ident: bib90
– volume: 10
  start-page: 433
  year: 1997
  ident: bib13
  article-title: The psychophysics toolbox
  publication-title: Spatial Vision
  doi: 10.1163/156856897X00357
– volume: 89
  start-page: 221
  year: 2016
  ident: bib56
  article-title: Relationships between pupil diameter and neuronal activity in the locus coeruleus, Colliculi, and cingulate cortex
  publication-title: Neuron
  doi: 10.1016/j.neuron.2015.11.028
– volume: 49
  start-page: 1
  year: 2018
  ident: bib64
  article-title: Model-based predictions for dopamine
  publication-title: Current Opinion in Neurobiology
  doi: 10.1016/j.conb.2017.10.006
– volume: 153
  start-page: 131
  year: 2018
  ident: bib98
  article-title: Evaluation of the hypothesis that phasic dopamine constitutes a cached-value signal
  publication-title: Neurobiology of Learning and Memory
  doi: 10.1016/j.nlm.2017.12.002
– volume: 345
  start-page: 1616
  year: 2014
  ident: bib112
  article-title: A critical time window for dopamine actions on the structural plasticity of dendritic spines
  publication-title: Science
  doi: 10.1126/science.1255514
– volume: 10
  start-page: 252
  year: 2010
  ident: bib48
  article-title: Pupil diameter tracks changes in control state predicted by the adaptive gain theory of locus coeruleus function
  publication-title: Cognitive, Affective, & Behavioral Neuroscience
  doi: 10.3758/CABN.10.2.252
– volume: 126
  start-page: 193
  year: 2012
  ident: bib51
  article-title: What's social about social learning?
  publication-title: Journal of Comparative Psychology
  doi: 10.1037/a0025180
– volume: 7
  year: 2013
  ident: bib67
  article-title: Pupil dilation signals uncertainty and surprise in a learning gambling task
  publication-title: Frontiers in Behavioral Neuroscience
  doi: 10.3389/fnbeh.2013.00218
– volume: 48
  start-page: 306
  year: 1984
  ident: bib18
  article-title: The efficient assessment of need for cognition
  publication-title: Journal of Personality Assessment
  doi: 10.1207/s15327752jpa4803_13
– volume: 275
  start-page: 1593
  year: 1997
  ident: bib93
  article-title: A neural substrate of prediction and reward
  publication-title: Science
  doi: 10.1126/science.275.5306.1593
– volume: 14
  year: 2018
  ident: bib71
  article-title: Rational metareasoning and the plasticity of cognitive control
  publication-title: PLOS Computational Biology
  doi: 10.1371/journal.pcbi.1006043
– volume: 12
  year: 2016
  ident: bib55
  article-title: Catecholaminergic regulation of learning rate in a dynamic environment
  publication-title: PLOS Computational Biology
  doi: 10.1371/journal.pcbi.1005171
– volume: 7
  year: 2011
  ident: bib53
  article-title: Disentangling the roles of approach, activation and Valence in instrumental and pavlovian responding
  publication-title: PLOS Computational Biology
  doi: 10.1371/journal.pcbi.1002028
– volume: 39
  start-page: 19
  year: 1990
  ident: bib32
  article-title: Activation of the noradrenergic system facilitates an attentional shift in the rat
  publication-title: Behavioural Brain Research
  doi: 10.1016/0166-4328(90)90118-X
– volume: 9
  start-page: 1030
  year: 2014
  ident: bib12
  article-title: Reward-related neural responses are dependent on the beneficiary
  publication-title: Social Cognitive and Affective Neuroscience
  doi: 10.1093/scan/nst077
– volume: 10
  start-page: 437
  year: 1997
  ident: bib87
  article-title: The VideoToolbox software for visual psychophysics: transforming numbers into movies
  publication-title: Spatial Vision
  doi: 10.1163/156856897X00366
SSID ssj0000748819
Score 2.3488607
Snippet The remarkable expedience of human learning is thought to be underpinned by meta-learning, whereby slow accumulative learning processes are rapidly adjusted to...
SourceID doaj
pubmedcentral
proquest
pubmed
crossref
SourceType Open Website
Open Access Repository
Aggregation Database
Index Database
Enrichment Source
SubjectTerms Adolescent
Adult
Catecholamines
Dopamine
Dopamine - metabolism
Dopamine Uptake Inhibitors - administration & dosage
Female
Humans
Hypotheses
Learning
Learning - drug effects
Learning curves
learning rate
Male
meta-learning
Methylphenidate
Methylphenidate - administration & dosage
Neuroscience
noradrenaline
Norepinephrine
Norepinephrine - metabolism
Placebos - administration & dosage
School environment
Volatility
Young Adult
SummonAdditionalLinks – databaseName: Directory of Open Access Journals (DOAJ) (Open Access)
  dbid: DOA
  link: http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrV3PS8MwFA4yELyIv51OqbCTEJcuaZMcdTiGqCcHu5X81IHrRLeD_70vaTc2GXjx2ryW9L2k7_vavu8h1NYc1oH2GtuuyzHLmcKQBLuYQuo1WWZJqsL7jqfnfDBkD6NstNLqK_wTVskDV47rhMJRww1cDoCKk1LZjBNvtecMkAqNSqBEkhUyFZ_BHBZmKquCPA4ps-Mex97dBHgg11JQVOrfBC9__yW5knb6e2i3xovJbTXPfbTlygO0XXWQ_D5EuKeCCivw00ms4hubZDK1dUuuZOqTiZspXLeGeD1Cw_79S2-A6w4I2DCezTDt-lRaLzinnmhqbJBfM1YreCpILa1lxnNgDFznVGlvBJMKCID3wnAN25Meo0Y5Ld0pSjiYUuEF0BvPBHBH63MN-ArcaYnKWRNdL5xSmFoePHSpeC-AJgQPFtGDRfRgE7WXxh-VKsZms7vg3aVJkLKOByDARR3g4q8AN1FrEZui3l9fRZcyGeqwCAxfLYdhZ4TPHap003mwAejEuKBpE51UoVzOJNSME8HgbL4W5LWpro-U47eovp0DA6M5OfuPeztHOwDAYj-KVLRQY_Y5dxcAcmb6Mq7nHzfA-1s
  priority: 102
  providerName: Directory of Open Access Journals
– databaseName: Health & Medical Collection
  dbid: 7X7
  link: http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwfV3da9swEBdbymAvo-2-srXDhT4NtNiWbMlPpS0NYax7WiBvRp9ZoLGzNnnof787WXGXEvZqneE4nXS_k3T3I-RcC_AD7TW1uSspL7miEARzyiD0mqKwaabwvOP2ZzmZ8u-zYhYP3B7is8rtnhg2atsaPCMf5YxXWHmT8ovVH4qsUXi7Gik0XpKDDJAIUjeImejPWCA8Soh4XVmegMA5cj8W3n1DkFDtBKLQr38fyHz-VvKf4DM-JG8iakwuu2k-Ii9cc0xedTySj28JvVbYixWy1GWo5VuYZNnaSMyVtD5ZurWikSBi_o5Mxze_ric08iBQw0Wxpiz3WWW9FIL5VDNjsQmbsVrB3lDpylpuvIC8QeiSKe2N5JWCNMB7aYSGRcrek0HTNu4jSQSIMuklJDmeS8ggrS81oCxbCJuqkg_J161RahObhCNXxV0NyQJasA4WrIMFh-S8F151vTH2i12hdXsRbGgdPrT38zqujxrrg40w4DWAR11VKdAo9VZ7wQGQMlDsZDs3dVxlD_WTTwzJWT8M6wMvPVTj2g3KAIDiQrJsSD50U9lrgpXjqeTwt9iZ5B1Vd0eaxe_Qg7uEPIyV6af_q_WZvAaAFfgmMnlCBuv7jTsFELPWX4Kn_gXLpPKN
  priority: 102
  providerName: ProQuest
Title Catecholaminergic modulation of meta-learning
URI https://www.ncbi.nlm.nih.gov/pubmed/31850844
https://www.proquest.com/docview/2349165404
https://www.proquest.com/docview/2328347831
https://pubmed.ncbi.nlm.nih.gov/PMC6974360
https://doaj.org/article/3595c7cbfb774e99ad570fdbf7453334
Volume 8
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrV1LaxsxEB7yoNBLafp0m5ot5FSQu2tpd6RTSEJCKG0opQbfFj0TQ7zbug40_74j7drUwcdcVyOQ5qH5ZqWZATgySHpggmFu7CsmKqEZOcEx4-R6bVm6vNDxf8e3q-pyIr5My-kOrJpx9gz8szW0i_2kJovb0d_f98dk8IRfR0je8LP_Ogt-FD2_2oX9dFEU3_D1OD8dyUh6WqguP-_hnA2PlAr3b0ObDx9N_ueFLp7Dsx4-ZiedvA9gxzcv4EnXUPL-JbAzHYuy0p7mKalvZrN56_oOXVkbsrlfatZ3irh-BZOL859nl6xviMCswHLJ-DgUygWJyENuuHWxGpt1RtMhoYxyTtiAFECgqbg2wUqhNMUDIUiLhqyVv4a9pm38W8iQSLkMkqKdICSFki5UhuCWK9HluhID-LRiSm37auGxacVtTVFD5GCdOFgnDg7gaE38qyuSsZ3sNHJ3TRIrW6cP7eK67g2ljonCFi2pDwFTr5SmFeXBmYCCkCmnhR2uZFOvtKUec6FiWlZOwx_Xw2Qo8fZDN769izSEpARKXgzgTSfK9UpiCnkuBc3GDSFvLHVzpJndpGLcFQVkvMrfPcbe3sNTwmOpPUUhD2FvubjzHwjzLM0QdnGKQ9g_Pb_6_mOY_hwMk47_A9aLBbg
linkProvider Scholars Portal
linkToHtml http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwtV3dT9RAEJ_gEaMvxm9PUWuCLyYrve62u30gRhByyHExBhLelv3ES7wW4Yjhn_Nvc7bdVs8Q33htp81kdqbzm93O_ADWNUc_0F4Tm7mCsIIpgkkwIxRTr8lzm45U2O84mBbjI_b5OD9egV9dL0z4rbL7JjYfalubsEe-kVFWhs6blH04-0ECa1Q4Xe0oNFSkVrCbzYix2Nix765-Ygl3sbn3Cdf7bZbt7hxuj0lkGSCG8XxBaOZHpfWCc-pTTY0NI86M1Qojr9Sltcx4jqic64Iq7Y1gpUKQ7b0wXGMIUHzvLVhlYQNlAKtbO9MvX_tdHkzQAnNu2xjIMXVvuMnMu_cBppRLqbBhDLgO5v77t-Zf6W_3PtyLuDX52DraA1hx1UO43TJZXj0Csq3CNFisk-dNN-HMJPPaRmqwpPbJ3C0UiRQVp4_h6EZs9AQGVV25Z5BwFKXCCyyzPBNYw1pfaMR5Nuc2VQUbwrvOKNLEMeWBLeO7xHIlWFA2FpSNBYew3guftdM5rhfbCtbtRcJI7eZCfX4qY4TK0KFsuEG_RUTsylKhRqm32nOGkJiiYmvd2sgY5xfyj1cO4U1_GyM0HLuoytWXQQYhHOOCjobwtF3KXpPQu54Khk_zpUVeUnX5TjX71kwBL7ASpEX6_P9qvYY748ODiZzsTfdfwF2Eew37xUiswWBxfuleIqRa6FfRbxM4uelQ-Q2GEDbS
linkToPdf http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwtV1Lb9QwEB6VViAuiDcLBYJULkhms7ETO4cK0ceqpWVVISr15vpZVuomfWyF-hf5VYwTJ7Co4tZrMolG45nMN45nPoA1zdEPtNfEZq4grGCKYBLMCMXUa_LcpiMV9ju-ToqdQ_blKD9agl9dL0w4Vtl9E5sPta1N2CMfZpSVofMmZUMfj0UcbI0_nZ2TwCAV_rR2dBoq0izY9WbcWGzy2HPXP7Gcu1zf3cK1f59l4-3vmzskMg4Qw3g-JzTzo9J6wTn1qabGhnFnxmqFUVjq0lpmPEeEznVBlfZGsFIh4PZeGK4xHCi-9w6scMz6WAiubGxPDr71Oz6YrAXm37ZJkGMaH7r9qXcfA2QpF9Jiwx5wE-T99-TmX6lw_BAeRAybfG6d7hEsueox3G1ZLa-fANlUYTIs1syzprNwapJZbSNNWFL7ZObmikS6ipOncHgrNnoGy1VduReQcBSlwgssuTwTWM9aX2jEfDbnNlUFG8CHzijSxJHlgTnjVGLpEiwoGwvKxoIDWOuFz9pJHTeLbQTr9iJhvHZzob44kTFaZehWNtygDyM6dmWpUKPUW-05Q3hMUbHVbm1kjPlL-cdDB_Cuv43RGn7BqMrVV0EG4Rzjgo4G8Lxdyl6T0MeeCoZP84VFXlB18U41_dFMBC-wKqRF-vL_ar2Fexgycn93svcK7iPya4gwRmIVlucXV-41oqu5fhPdNoHj246U3-oSOxY
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Catecholaminergic+modulation+of+meta-learning&rft.jtitle=eLife&rft.au=Jennifer+L+Cook&rft.au=Jennifer+C+Swart&rft.au=Monja+I+Frob%C3%B6se&rft.au=Andreea+O+Diaconescu&rft.date=2019-12-18&rft.pub=eLife+Sciences+Publications+Ltd&rft.eissn=2050-084X&rft.volume=8&rft_id=info:doi/10.7554%2FeLife.51439&rft.externalDBID=DOA&rft.externalDocID=oai_doaj_org_article_3595c7cbfb774e99ad570fdbf7453334
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2050-084X&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2050-084X&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2050-084X&client=summon