Catecholaminergic modulation of meta-learning
The remarkable expedience of human learning is thought to be underpinned by meta-learning, whereby slow accumulative learning processes are rapidly adjusted to the current learning environment. To date, the neurobiological implementation of meta-learning remains unclear. A burgeoning literature argu...
Saved in:
Published in | eLife Vol. 8 |
---|---|
Main Authors | , , , , , , |
Format | Journal Article |
Language | English |
Published |
England
eLife Sciences Publications Ltd
18.12.2019
eLife Sciences Publications, Ltd |
Subjects | |
Online Access | Get full text |
ISSN | 2050-084X 2050-084X |
DOI | 10.7554/eLife.51439 |
Cover
Abstract | The remarkable expedience of human learning is thought to be underpinned by meta-learning, whereby slow accumulative learning processes are rapidly adjusted to the current learning environment. To date, the neurobiological implementation of meta-learning remains unclear. A burgeoning literature argues for an important role for the catecholamines dopamine and noradrenaline in meta-learning. Here, we tested the hypothesis that enhancing catecholamine function modulates the ability to optimise a meta-learning parameter (learning rate) as a function of environmental volatility. 102 participants completed a task which required learning in stable phases, where the probability of reinforcement was constant, and volatile phases, where probabilities changed every 10–30 trials. The catecholamine transporter blocker methylphenidate enhanced participants’ ability to adapt learning rate: Under methylphenidate, compared with placebo, participants exhibited higher learning rates in volatile relative to stable phases. Furthermore, this effect was significant only with respect to direct learning based on the participants’ own experience, there was no significant effect on inferred-value learning where stimulus values had to be inferred. These data demonstrate a causal link between catecholaminergic modulation and the adjustment of the meta-learning parameter learning rate. |
---|---|
AbstractList | The remarkable expedience of human learning is thought to be underpinned by meta-learning, whereby slow accumulative learning processes are rapidly adjusted to the current learning environment. To date, the neurobiological implementation of meta-learning remains unclear. A burgeoning literature argues for an important role for the catecholamines dopamine and noradrenaline in meta-learning. Here, we tested the hypothesis that enhancing catecholamine function modulates the ability to optimise a meta-learning parameter (learning rate) as a function of environmental volatility. 102 participants completed a task which required learning in stable phases, where the probability of reinforcement was constant, and volatile phases, where probabilities changed every 10-30 trials. The catecholamine transporter blocker methylphenidate enhanced participants' ability to adapt learning rate: Under methylphenidate, compared with placebo, participants exhibited higher learning rates in volatile relative to stable phases. Furthermore, this effect was significant only with respect to direct learning based on the participants' own experience, there was no significant effect on inferred-value learning where stimulus values had to be inferred. These data demonstrate a causal link between catecholaminergic modulation and the adjustment of the meta-learning parameter learning rate.The remarkable expedience of human learning is thought to be underpinned by meta-learning, whereby slow accumulative learning processes are rapidly adjusted to the current learning environment. To date, the neurobiological implementation of meta-learning remains unclear. A burgeoning literature argues for an important role for the catecholamines dopamine and noradrenaline in meta-learning. Here, we tested the hypothesis that enhancing catecholamine function modulates the ability to optimise a meta-learning parameter (learning rate) as a function of environmental volatility. 102 participants completed a task which required learning in stable phases, where the probability of reinforcement was constant, and volatile phases, where probabilities changed every 10-30 trials. The catecholamine transporter blocker methylphenidate enhanced participants' ability to adapt learning rate: Under methylphenidate, compared with placebo, participants exhibited higher learning rates in volatile relative to stable phases. Furthermore, this effect was significant only with respect to direct learning based on the participants' own experience, there was no significant effect on inferred-value learning where stimulus values had to be inferred. These data demonstrate a causal link between catecholaminergic modulation and the adjustment of the meta-learning parameter learning rate. The remarkable expedience of human learning is thought to be underpinned by meta-learning, whereby slow accumulative learning processes are rapidly adjusted to the current learning environment. To date, the neurobiological implementation of meta-learning remains unclear. A burgeoning literature argues for an important role for the catecholamines dopamine and noradrenaline in meta-learning. Here, we tested the hypothesis that enhancing catecholamine function modulates the ability to optimise a meta-learning parameter (learning rate) as a function of environmental volatility. 102 participants completed a task which required learning in stable phases, where the probability of reinforcement was constant, and volatile phases, where probabilities changed every 10–30 trials. The catecholamine transporter blocker methylphenidate enhanced participants’ ability to adapt learning rate: Under methylphenidate, compared with placebo, participants exhibited higher learning rates in volatile relative to stable phases. Furthermore, this effect was significant only with respect to direct learning based on the participants’ own experience, there was no significant effect on inferred-value learning where stimulus values had to be inferred. These data demonstrate a causal link between catecholaminergic modulation and the adjustment of the meta-learning parameter learning rate. |
Author | Geurts, Dirk EM Cools, Roshan Swart, Jennifer C Froböse, Monja I Diaconescu, Andreea O den Ouden, Hanneke EM Cook, Jennifer L |
Author_xml | – sequence: 1 givenname: Jennifer L orcidid: 0000-0003-4916-8667 surname: Cook fullname: Cook, Jennifer L organization: School of Psychology, University of Birmingham, Birmingham, United Kingdom – sequence: 2 givenname: Jennifer C orcidid: 0000-0003-0989-332X surname: Swart fullname: Swart, Jennifer C organization: Donders Institute for Brain, Cognition and Behaviour, Centre for Cognitive Neuroimaging, Radboud University, Nijmegen, Netherlands – sequence: 3 givenname: Monja I surname: Froböse fullname: Froböse, Monja I organization: Donders Institute for Brain, Cognition and Behaviour, Centre for Cognitive Neuroimaging, Radboud University, Nijmegen, Netherlands – sequence: 4 givenname: Andreea O orcidid: 0000-0002-3633-9757 surname: Diaconescu fullname: Diaconescu, Andreea O organization: Translational Neuromodeling Unit, Institute for Biomedical Engineering, University of Zurich and ETH Zurich, Zurich, Switzerland, Department of Psychiatry, University of Basel, Basel, Switzerland, Krembil Centre for Neuroinformatics,CAMH, University of Toronto, Toronto, Canada – sequence: 5 givenname: Dirk EM surname: Geurts fullname: Geurts, Dirk EM organization: Donders Institute for Brain, Cognition and Behaviour, Centre for Cognitive Neuroimaging, Radboud University, Nijmegen, Netherlands, Department of Psychiatry, Radboud University Medical Centre, Nijmegen, Netherlands – sequence: 6 givenname: Hanneke EM surname: den Ouden fullname: den Ouden, Hanneke EM organization: Donders Institute for Brain, Cognition and Behaviour, Centre for Cognitive Neuroimaging, Radboud University, Nijmegen, Netherlands – sequence: 7 givenname: Roshan surname: Cools fullname: Cools, Roshan organization: Donders Institute for Brain, Cognition and Behaviour, Centre for Cognitive Neuroimaging, Radboud University, Nijmegen, Netherlands, Department of Psychiatry, Radboud University Medical Centre, Nijmegen, Netherlands |
BackLink | https://www.ncbi.nlm.nih.gov/pubmed/31850844$$D View this record in MEDLINE/PubMed |
BookMark | eNptkc1rGzEQxUVJadI0p96LoZdA2VSypB3pUiimHwFDLin0JvTpyGilVLsb6H8f2U5DEqrLiJnfPJ703qKjXLJH6D3BF8A5--zXMfgLThiVr9DJEnPcYcF-Hz25H6OzcdzidoAJQeQbdEyJ4G3ETlC30pO3NyXpIWZfN9EuhuLmpKdY8qKExeAn3SWva4558w69DjqN_uyhnqJf379dr35266sfl6uv684y4FNHl4FIFwQADdhQ6whlxDqjoafSSOeYDcChB9NTbYIVTGrgIgRhwWCG6Sm6POi6orfqtsZB17-q6Kj2jVI3Stcp2uQV5ZJbsCYYAOal1I4DDs4EYJxSyprWl4PW7WwG76zPU9XpmejzSY43alPuVC-B0X5n5vxBoJY_sx8nNcTR-pR09mUe1ZIuBWUgKGnoxxfotsw1t69qFJOk5wzvHH146ujRyr9UGvDpANhaxrH68IgQrHaxq33sah97o8kL2sZpn197Tkz_3bkHQ4qv8A |
CitedBy_id | crossref_primary_10_1007_s00213_021_05974_w crossref_primary_10_1016_j_neubiorev_2023_105123 crossref_primary_10_1016_j_cub_2020_10_052 crossref_primary_10_7554_eLife_74893 crossref_primary_10_1016_j_cub_2020_10_043 crossref_primary_10_1126_sciadv_add0501 crossref_primary_10_1162_opmi_a_00139 crossref_primary_10_1098_rsos_230027 crossref_primary_10_1007_s11229_024_04632_w crossref_primary_10_1038_s44159_024_00304_1 crossref_primary_10_1016_j_bbr_2024_115213 crossref_primary_10_1038_s41467_023_44358_w crossref_primary_10_1038_s41467_024_54395_8 crossref_primary_10_3758_s13415_021_00919_4 crossref_primary_10_1093_cercor_bhac046 crossref_primary_10_1371_journal_pcbi_1011978 |
Cites_doi | 10.1016/j.pscychresns.2011.09.011 10.1162/jocn_a_01065 10.1016/0306-4522(91)90196-U 10.1002/1097-4679(199511)51:6<768::AID-JCLP2270510607>3.0.CO;2-1 10.7554/eLife.22169 10.1007/s00213-008-1250-4 10.3389/fnbeh.2013.00160 10.1038/nn1103 10.1111/j.1551-6709.2009.01010.x 10.1523/JNEUROSCI.0822-10.2010 10.1523/JNEUROSCI.2749-13.2013 10.1016/j.neuroimage.2009.03.025 10.1093/cercor/bhr117 10.1037/a0030852 10.1037/0022-3514.54.6.1063 10.1093/cercor/bhn095 10.1007/s00213-008-1097-8 10.1017/CBO9781139087759 10.1152/jn.00158.2010 10.1111/j.2044-8341.1974.tb02285.x 10.1371/journal.pbio.1002575 10.1523/JNEUROSCI.1979-16.2016 10.3389/fnins.2011.00115 10.1038/npp.2011.337 10.1038/nature07538 10.1093/comjnl/13.3.317 10.1016/j.neuroscience.2008.01.064 10.1090/S0025-5718-1970-0274029-X 10.1046/j.1471-4159.1997.68052032.x 10.1523/JNEUROSCI.4475-07.2008 10.1038/nature03287 10.1016/S0022-5371(80)90312-6 10.1037/xge0000523 10.7554/eLife.39404 10.1038/nn1954 10.1146/annurev.neuro.28.061604.135709 10.1093/scan/nsw171 10.1017/neu.2013.29 10.1016/S0893-6080(02)00228-9 10.1038/nn.3961 10.1037/0022-3514.67.2.319 10.1080/09548980601004024 10.1002/hbm.22466 10.1016/j.tins.2005.09.002 10.1523/JNEUROSCI.16-05-01936.1996 10.1038/nn1575 10.1038/sj.npp.1301235 10.1016/j.neuron.2018.06.033 10.1038/npp.2013.100 10.1016/j.biopsych.2008.04.037 10.1002/syn.10038 10.1038/s41593-018-0147-8 10.1371/journal.pcbi.1006370 10.1016/S0893-6080(02)00044-8 10.1016/j.neuron.2017.03.044 10.1016/j.cogbrainres.2004.07.007 10.1016/1048-9843(93)90003-C 10.1007/s00213-017-4723-5 10.1073/pnas.1316259111 10.1207/s15327752jpa5201_2 10.1016/j.cub.2014.10.014 10.1016/j.neuroscience.2005.09.031 10.1093/cercor/bhr114 10.1073/pnas.0905191106 10.1037/0012-1649.27.5.763 10.1016/j.jmp.2015.10.003 10.1038/s41386-018-0088-7 10.1016/j.neunet.2006.05.044 10.1093/imamat/6.1.76 10.1126/science.1185778 10.1111/j.1460-9568.2007.05612.x 10.1016/j.neuron.2013.11.028 10.1371/journal.pcbi.1003441 10.1016/j.neuron.2005.04.026 10.1016/j.neuron.2008.11.027 10.1016/j.neuron.2014.10.013 10.1016/j.cognition.2016.04.002 10.1016/j.tics.2019.02.006 10.2165/00003088-199937060-00002 10.1038/nn.2250 10.1016/j.biopsych.2011.03.028 10.1090/S0025-5718-1970-0258249-6 10.1101/303982 10.1371/journal.pcbi.1003810 10.1038/nn.3130 10.1207/s15327752jpa6703_13 10.1017/CBO9780511544156.008 10.1016/j.cub.2010.04.055 10.1016/j.biopsych.2008.05.015 10.1163/156856897X00357 10.1016/j.neuron.2015.11.028 10.1016/j.conb.2017.10.006 10.1016/j.nlm.2017.12.002 10.1126/science.1255514 10.3758/CABN.10.2.252 10.1037/a0025180 10.3389/fnbeh.2013.00218 10.1207/s15327752jpa4803_13 10.1126/science.275.5306.1593 10.1371/journal.pcbi.1006043 10.1371/journal.pcbi.1005171 10.1371/journal.pcbi.1002028 10.1016/0166-4328(90)90118-X 10.1093/scan/nst077 10.1163/156856897X00366 |
ContentType | Journal Article |
Copyright | 2019, Cook et al. 2019, Cook et al. This work is published under http://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License. 2019, Cook et al 2019 Cook et al |
Copyright_xml | – notice: 2019, Cook et al. – notice: 2019, Cook et al. This work is published under http://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License. – notice: 2019, Cook et al 2019 Cook et al |
DBID | AAYXX CITATION CGR CUY CVF ECM EIF NPM 3V. 7X7 7XB 88E 88I 8FE 8FH 8FI 8FJ 8FK ABUWG AFKRA AZQEC BBNVY BENPR BHPHI CCPQU DWQXO FYUFA GHDGH GNUQQ HCIFZ K9. LK8 M0S M1P M2P M7P PHGZM PHGZT PIMPY PJZUB PKEHL PPXIY PQEST PQGLB PQQKQ PQUKI PRINS Q9U 7X8 5PM DOA |
DOI | 10.7554/eLife.51439 |
DatabaseName | CrossRef Medline MEDLINE MEDLINE (Ovid) MEDLINE MEDLINE PubMed ProQuest Central (Corporate) Health & Medical Collection ProQuest Central (purchase pre-March 2016) Medical Database (Alumni Edition) Science Database (Alumni Edition) ProQuest SciTech Collection ProQuest Natural Science Collection ProQuest Hospital Collection Hospital Premium Collection (Alumni Edition) ProQuest Central (Alumni) (purchase pre-March 2016) ProQuest Central (Alumni) ProQuest Central UK/Ireland ProQuest Central Essentials Biological Science Database ProQuest Central Natural Science Collection ProQuest One ProQuest Central Korea Proquest Health Research Premium Collection Health Research Premium Collection (Alumni) ProQuest Central Student SciTech Premium Collection ProQuest Health & Medical Complete (Alumni) Biological Sciences Health & Medical Collection (Alumni) Medical Database Science Database Biological Science Database ProQuest Central Premium ProQuest One Academic Publicly Available Content Database ProQuest Health & Medical Research Collection ProQuest One Academic Middle East (New) ProQuest One Health & Nursing ProQuest One Academic Eastern Edition (DO NOT USE) ProQuest One Applied & Life Sciences ProQuest One Academic ProQuest One Academic UKI Edition ProQuest Central China ProQuest Central Basic MEDLINE - Academic PubMed Central (Full Participant titles) Directory of Open Access Journals (DOAJ) (Open Access) |
DatabaseTitle | CrossRef MEDLINE Medline Complete MEDLINE with Full Text PubMed MEDLINE (Ovid) Publicly Available Content Database ProQuest Central Student ProQuest One Academic Middle East (New) ProQuest Central Essentials ProQuest Health & Medical Complete (Alumni) ProQuest Central (Alumni Edition) SciTech Premium Collection ProQuest One Community College ProQuest One Health & Nursing ProQuest Natural Science Collection ProQuest Central China ProQuest Central ProQuest One Applied & Life Sciences ProQuest Health & Medical Research Collection Health Research Premium Collection Health and Medicine Complete (Alumni Edition) Natural Science Collection ProQuest Central Korea Health & Medical Research Collection Biological Science Collection ProQuest Central (New) ProQuest Medical Library (Alumni) ProQuest Science Journals (Alumni Edition) ProQuest Biological Science Collection ProQuest Central Basic ProQuest Science Journals ProQuest One Academic Eastern Edition ProQuest Hospital Collection Health Research Premium Collection (Alumni) Biological Science Database ProQuest SciTech Collection ProQuest Hospital Collection (Alumni) ProQuest Health & Medical Complete ProQuest Medical Library ProQuest One Academic UKI Edition ProQuest One Academic ProQuest One Academic (New) ProQuest Central (Alumni) MEDLINE - Academic |
DatabaseTitleList | MEDLINE - Academic CrossRef Publicly Available Content Database MEDLINE |
Database_xml | – sequence: 1 dbid: DOA name: DOAJ Open Access Full Text url: https://www.doaj.org/ sourceTypes: Open Website – sequence: 2 dbid: NPM name: PubMed url: https://proxy.k.utb.cz/login?url=http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed sourceTypes: Index Database – sequence: 3 dbid: EIF name: MEDLINE url: https://proxy.k.utb.cz/login?url=https://www.webofscience.com/wos/medline/basic-search sourceTypes: Index Database – sequence: 4 dbid: BENPR name: ProQuest Central url: http://www.proquest.com/pqcentral?accountid=15518 sourceTypes: Aggregation Database |
DeliveryMethod | fulltext_linktorsrc |
Discipline | Biology |
EISSN | 2050-084X |
ExternalDocumentID | oai_doaj_org_article_3595c7cbfb774e99ad570fdbf7453334 PMC6974360 31850844 10_7554_eLife_51439 |
Genre | Research Support, Non-U.S. Gov't Journal Article |
GrantInformation_xml | – fundername: University of Birmingham grantid: Birmingham Fellows Programme – fundername: James S. McDonnell Foundation grantid: James McDonnell scholar award – fundername: ZonMw grantid: 92003576 – fundername: Nederlandse Organisatie voor Wetenschappelijk Onderzoek grantid: Vici Award 453-14-005 – fundername: Swiss National Foundation grantid: PZ00P3_167952 – fundername: Nederlandse Organisatie voor Wetenschappelijk Onderzoek grantid: Veni Grant 451-11-004 – fundername: Nederlandse Organisatie voor Wetenschappelijk Onderzoek grantid: Research talent grant 406-14-028 – fundername: H2020 European Research Council grantid: ERC Starting Grant 757583 – fundername: Swiss National Science Foundation grantid: PZ00P3_167952 – fundername: Nederlandse Organisatie voor Wetenschappelijk Onderzoek grantid: Vici Award 53-14-005 – fundername: ; – fundername: ; grantid: Research talent grant 406-14-028 – fundername: ; grantid: 92003576 – fundername: ; grantid: PZ00P3_167952 – fundername: ; grantid: Veni Grant 451-11-004 – fundername: ; grantid: Vici Award 453-14-005 – fundername: ; grantid: ERC Starting Grant 757583 – fundername: ; grantid: Birmingham Fellows Programme – fundername: ; grantid: James McDonnell scholar award |
GroupedDBID | 53G 5VS 7X7 88E 88I 8FE 8FH 8FI 8FJ AAFWJ AAKDD AAYXX ABUWG ACGFO ACGOD ACPRK ADBBV ADRAZ AENEX AFKRA AFPKN ALIPV ALMA_UNASSIGNED_HOLDINGS AOIJS AZQEC BAWUL BBNVY BCNDV BENPR BHPHI BPHCQ BVXVI CCPQU CITATION DIK DWQXO EMOBN FYUFA GNUQQ GROUPED_DOAJ GX1 HCIFZ HMCUK HYE IAO IEA IHR INH INR ISR ITC KQ8 LK8 M1P M2P M48 M7P M~E NQS OK1 PGMZT PHGZM PHGZT PIMPY PQQKQ PROAC PSQYO RHI RNS RPM UKHRP CGR CUY CVF ECM EIF NPM 3V. 7XB 8FK K9. PJZUB PKEHL PPXIY PQEST PQGLB PQUKI PRINS Q9U 7X8 PUEGO 5PM |
ID | FETCH-LOGICAL-c475t-32f19df8773f0b3cd1341cdba7639b9dd4cf75767b63abfc849a758ff8c7b0403 |
IEDL.DBID | M48 |
ISSN | 2050-084X |
IngestDate | Wed Aug 27 01:23:43 EDT 2025 Thu Aug 21 14:08:41 EDT 2025 Fri Sep 05 13:49:54 EDT 2025 Fri Jul 25 10:32:56 EDT 2025 Thu Apr 03 07:02:34 EDT 2025 Thu Apr 24 23:09:05 EDT 2025 Tue Jul 01 04:12:54 EDT 2025 |
IsDoiOpenAccess | true |
IsOpenAccess | true |
IsPeerReviewed | true |
IsScholarly | true |
Keywords | methylphenidate meta-learning neuroscience learning rate noradrenaline volatility dopamine human |
Language | English |
License | http://creativecommons.org/licenses/by/4.0 2019, Cook et al. This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited. |
LinkModel | DirectLink |
MergedId | FETCHMERGED-LOGICAL-c475t-32f19df8773f0b3cd1341cdba7639b9dd4cf75767b63abfc849a758ff8c7b0403 |
Notes | ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 14 content type line 23 These authors contributed equally to this work. |
ORCID | 0000-0002-3633-9757 0000-0003-0989-332X 0000-0003-4916-8667 |
OpenAccessLink | http://journals.scholarsportal.info/openUrl.xqy?doi=10.7554/eLife.51439 |
PMID | 31850844 |
PQID | 2349165404 |
PQPubID | 2045579 |
ParticipantIDs | doaj_primary_oai_doaj_org_article_3595c7cbfb774e99ad570fdbf7453334 pubmedcentral_primary_oai_pubmedcentral_nih_gov_6974360 proquest_miscellaneous_2328347831 proquest_journals_2349165404 pubmed_primary_31850844 crossref_primary_10_7554_eLife_51439 crossref_citationtrail_10_7554_eLife_51439 |
ProviderPackageCode | CITATION AAYXX |
PublicationCentury | 2000 |
PublicationDate | 2019-12-18 |
PublicationDateYYYYMMDD | 2019-12-18 |
PublicationDate_xml | – month: 12 year: 2019 text: 2019-12-18 day: 18 |
PublicationDecade | 2010 |
PublicationPlace | England |
PublicationPlace_xml | – name: England – name: Cambridge |
PublicationTitle | eLife |
PublicationTitleAlternate | Elife |
PublicationYear | 2019 |
Publisher | eLife Sciences Publications Ltd eLife Sciences Publications, Ltd |
Publisher_xml | – name: eLife Sciences Publications Ltd – name: eLife Sciences Publications, Ltd |
References | Brainard (bib13) 1997; 10 Moussawi (bib79) 2009; 12 Jepma (bib55) 2016; 12 Lapiz (bib66) 2006; 137 Silvetti (bib100) 2018; 14 Joshi (bib56) 2016; 89 Grace (bib50) 1991; 41 Pasupathy (bib85) 2005; 433 Cook (bib25) 2018 Dienes (bib37) 2016; 72 Botvinick (bib10) 2019; 23 Barratt (bib4) 2012 Schweighofer (bib94) 2003; 16 Massi (bib75) 2018; 99 Bond (bib9) 1974; 47 Carver (bib21) 1994; 67 Dayan (bib30) 2006; 17 Muller (bib80) 2019; 8 Wang (bib109) 2018; 21 Schmand (bib92) 1991; 22 Kim (bib58) 2014; 26 Beck (bib5) 1996; 67 Broyden (bib16) 1970; 6 Behrens (bib7) 2008; 456 Daunizeau (bib29) 2014; 10 Heyes (bib51) 2012; 126 Schultz (bib93) 1997; 275 Wechsler (bib111) 2008 Preuschoff (bib88) 2011; 5 Aston-Jones (bib1) 2007 Diederen (bib36) 2017; 37 Bouret (bib11) 2005; 28 van der Schaaf (bib106) 2013; 38 Zimet (bib114) 1988; 52 Collins (bib23) 2016; 152 Krugel (bib61) 2009; 106 Volkow (bib107) 2002; 43 Fletcher (bib43) 1970; 13 Lieder (bib71) 2018; 14 Campbell-Meiklejohn (bib19) 2010; 20 Klucharev (bib60) 2009; 61 Collins (bib22) 2013; 120 Tait (bib105) 2007; 25 Newman (bib84) 2008; 200 Browning (bib15) 2015; 18 Duan (bib39) 2016 Floresco (bib44) 2003; 6 Behrens (bib6) 2007; 10 Doya (bib38) 2002; 15 Yagishita (bib112) 2014; 345 Montague (bib78) 1996; 16 Nassar (bib82) 2010; 30 Patton (bib86) 1995; 51 Rescorla (bib90) 1972 Geurts (bib47) 2013; 33 Cools (bib26) 2008; 28 Devilbiss (bib33) 2008; 64 Silvetti (bib99) 2013; 7 Howlett (bib52) 2017; 234 Seu (bib96) 2009; 202 Wang (bib108) 2016 Landau (bib63) 2009; 19 Langdon (bib64) 2018; 49 Watson (bib110) 1988; 54 Frank (bib45) 2012; 22 MacKay (bib73) 2003 Braams (bib12) 2014; 9 Cacioppo (bib18) 1984; 48 Cools (bib27) 2011; 69 Delgado (bib31) 2005; 8 Daneman (bib28) 1980; 19 Lapiz (bib65) 2007; 32 Biele (bib8) 2009; 33 Buckholtz (bib17) 2010; 329 Diaconescu (bib34) 2014; 10 Stephan (bib103) 2009; 46 Farashahi (bib42) 2017; 94 Murphy (bib81) 2014; 35 Devauges (bib32) 1990; 39 Lohani (bib72) 2018; 43 JASP Team (bib54) 2018 Lee (bib70) 2014 Pelli (bib87) 1997; 10 Lee (bib68) 2004; 22 Swart (bib104) 2017; 6 Fallon (bib41) 2017; 29 Kimko (bib59) 1999; 37 Badre (bib3) 2012; 22 McGuire (bib77) 2014; 84 Aston-Jones (bib2) 2005; 28 Froböse (bib46) 2018; 147 Campbell-Meiklejohn (bib20) 2012; 37 Diaconescu (bib35) 2017; 12 Nassar (bib83) 2012; 15 Salthouse (bib91) 1991; 27 Shanno (bib97) 1970; 24 Marshall (bib74) 2016; 14 Kuczenski (bib62) 1997; 68 Durstewitz (bib40) 2008; 64 Set (bib95) 2014; 111 Huys (bib53) 2011; 7 Reeves (bib89) 2012; 202 Spielberger (bib102) 1983 Kalma (bib57) 1993; 4 Sharpe (bib98) 2018; 153 Soltani (bib101) 2006; 19 Lee (bib69) 2014; 81 McGaughy (bib76) 2008; 153 Cook (bib24) 2014; 24 Goldfarb (bib49) 1970; 24 Lavín (bib67) 2013; 7 Gilzenrat (bib48) 2010; 10 Yu (bib113) 2005; 46 Bromberg-Martin (bib14) 2010; 104 |
References_xml | – volume: 202 start-page: 60 year: 2012 ident: bib89 article-title: Limbic striatal dopamine D2/3 receptor availability is associated with non-planning impulsivity in healthy adults after exclusion of potential dissimulators publication-title: Psychiatry Research: Neuroimaging doi: 10.1016/j.pscychresns.2011.09.011 – volume: 29 start-page: 652 year: 2017 ident: bib41 article-title: The neurocognitive cost of enhancing cognition with methylphenidate: improved distractor resistance but impaired updating publication-title: Journal of Cognitive Neuroscience doi: 10.1162/jocn_a_01065 – volume: 41 start-page: 1 year: 1991 ident: bib50 article-title: Phasic versus tonic dopamine release and the modulation of dopamine system responsivity: a hypothesis for the etiology of schizophrenia publication-title: Neuroscience doi: 10.1016/0306-4522(91)90196-U – volume: 51 start-page: 768 year: 1995 ident: bib86 article-title: Factor structure of the barratt impulsiveness scale publication-title: Journal of Clinical Psychology doi: 10.1002/1097-4679(199511)51:6<768::AID-JCLP2270510607>3.0.CO;2-1 – volume: 6 year: 2017 ident: bib104 article-title: Catecholaminergic challenge uncovers distinct pavlovian and instrumental mechanisms of motivated (in)action publication-title: eLife doi: 10.7554/eLife.22169 – volume: 202 start-page: 505 year: 2009 ident: bib96 article-title: Inhibition of the norepinephrine transporter improves behavioral flexibility in rats and monkeys publication-title: Psychopharmacology doi: 10.1007/s00213-008-1250-4 – volume: 7 year: 2013 ident: bib99 article-title: The influence of the noradrenergic system on optimal control of neural plasticity publication-title: Frontiers in Behavioral Neuroscience doi: 10.3389/fnbeh.2013.00160 – volume: 6 start-page: 968 year: 2003 ident: bib44 article-title: Afferent modulation of dopamine neuron firing differentially regulates tonic and phasic dopamine transmission publication-title: Nature Neuroscience doi: 10.1038/nn1103 – volume: 33 start-page: 206 year: 2009 ident: bib8 article-title: Computational models for the combination of advice and individual learning publication-title: Cognitive Science doi: 10.1111/j.1551-6709.2009.01010.x – volume: 30 start-page: 12366 year: 2010 ident: bib82 article-title: An approximately bayesian delta-rule model explains the dynamics of belief updating in a changing environment publication-title: Journal of Neuroscience doi: 10.1523/JNEUROSCI.0822-10.2010 – volume: 33 start-page: 18932 year: 2013 ident: bib47 article-title: Serotonin and aversive pavlovian control of instrumental behavior in humans publication-title: Journal of Neuroscience doi: 10.1523/JNEUROSCI.2749-13.2013 – volume: 46 start-page: 1004 year: 2009 ident: bib103 article-title: Bayesian model selection for group studies publication-title: NeuroImage doi: 10.1016/j.neuroimage.2009.03.025 – year: 2018 ident: bib54 article-title: JASP (Version 0.8.6)[Computer software] – volume: 22 start-page: 527 year: 2012 ident: bib3 article-title: Mechanisms of hierarchical reinforcement learning in cortico-striatal circuits 2: evidence from fMRI publication-title: Cerebral Cortex doi: 10.1093/cercor/bhr117 – volume: 120 start-page: 190 year: 2013 ident: bib22 article-title: Cognitive control over learning: creating, clustering, and generalizing task-set structure publication-title: Psychological Review doi: 10.1037/a0030852 – volume: 54 start-page: 1063 year: 1988 ident: bib110 article-title: Development and validation of brief measures of positive and negative affect: the PANAS scales publication-title: Journal of Personality and Social Psychology doi: 10.1037/0022-3514.54.6.1063 – volume: 19 start-page: 445 year: 2009 ident: bib63 article-title: Striatal dopamine and working memory publication-title: Cerebral Cortex doi: 10.1093/cercor/bhn095 – volume-title: arXiv year: 2016 ident: bib39 article-title: RL2: fast reinforcement learning via slow reinforcement learning – volume: 200 start-page: 39 year: 2008 ident: bib84 article-title: Atomoxetine reverses attentional deficits produced by noradrenergic deafferentation of medial prefrontal cortex publication-title: Psychopharmacology doi: 10.1007/s00213-008-1097-8 – volume-title: Bayesian Cognitive Modeling: A Practical Course year: 2014 ident: bib70 doi: 10.1017/CBO9781139087759 – volume: 104 start-page: 1068 year: 2010 ident: bib14 article-title: A pallidus-habenula-dopamine pathway signals inferred stimulus values publication-title: Journal of Neurophysiology doi: 10.1152/jn.00158.2010 – volume: 47 start-page: 211 year: 1974 ident: bib9 article-title: The use of analogue scales in rating subjective feelings publication-title: British Journal of Medical Psychology doi: 10.1111/j.2044-8341.1974.tb02285.x – volume: 14 year: 2016 ident: bib74 article-title: Pharmacological fingerprints of contextual uncertainty publication-title: PLOS Biology doi: 10.1371/journal.pbio.1002575 – volume: 37 start-page: 1708 year: 2017 ident: bib36 article-title: Dopamine modulates adaptive prediction error coding in the human midbrain and striatum publication-title: The Journal of Neuroscience doi: 10.1523/JNEUROSCI.1979-16.2016 – volume-title: arXiv year: 2016 ident: bib108 article-title: Learning to reinforcement learn – volume: 5 year: 2011 ident: bib88 article-title: Pupil dilation signals surprise: evidence for noradrenaline's Role in Decision Making publication-title: Frontiers in Neuroscience doi: 10.3389/fnins.2011.00115 – volume: 37 start-page: 1517 year: 2012 ident: bib20 article-title: Modulation of social influence by methylphenidate publication-title: Neuropsychopharmacology doi: 10.1038/npp.2011.337 – volume-title: Social class on campus year: 2012 ident: bib4 article-title: The Barratt Simplified Measure of Social Status (BSMSS) – volume: 456 start-page: 245 year: 2008 ident: bib7 article-title: Associative learning of social value publication-title: Nature doi: 10.1038/nature07538 – volume: 13 start-page: 317 year: 1970 ident: bib43 article-title: A new approach to variable metric algorithms publication-title: The Computer Journal doi: 10.1093/comjnl/13.3.317 – volume: 153 start-page: 63 year: 2008 ident: bib76 article-title: Noradrenergic, but not cholinergic, deafferentation of prefrontal cortex impairs attentional set-shifting publication-title: Neuroscience doi: 10.1016/j.neuroscience.2008.01.064 – volume: 24 start-page: 647 year: 1970 ident: bib97 article-title: Conditioning of quasi-Newton methods for function minimization publication-title: Mathematics of Computation doi: 10.1090/S0025-5718-1970-0274029-X – volume: 68 start-page: 2032 year: 1997 ident: bib62 article-title: Effects of methylphenidate on extracellular dopamine, serotonin, and norepinephrine: comparison with amphetamine publication-title: Journal of Neurochemistry doi: 10.1046/j.1471-4159.1997.68052032.x – volume: 28 start-page: 1208 year: 2008 ident: bib26 article-title: Working memory capacity predicts dopamine synthesis capacity in the human striatum publication-title: Journal of Neuroscience doi: 10.1523/JNEUROSCI.4475-07.2008 – volume: 433 start-page: 873 year: 2005 ident: bib85 article-title: Different time courses of learning-related activity in the prefrontal cortex and striatum publication-title: Nature doi: 10.1038/nature03287 – volume: 19 start-page: 450 year: 1980 ident: bib28 article-title: Individual differences in working memory and reading publication-title: Journal of Verbal Learning and Verbal Behavior doi: 10.1016/S0022-5371(80)90312-6 – volume: 147 start-page: 1763 year: 2018 ident: bib46 article-title: Catecholaminergic modulation of the avoidance of cognitive control publication-title: Journal of Experimental Psychology: General doi: 10.1037/xge0000523 – volume: 8 year: 2019 ident: bib80 article-title: Control of entropy in neural models of environmental state publication-title: eLife doi: 10.7554/eLife.39404 – volume: 10 start-page: 1214 year: 2007 ident: bib6 article-title: Learning the value of information in an uncertain world publication-title: Nature Neuroscience doi: 10.1038/nn1954 – volume: 28 start-page: 403 year: 2005 ident: bib2 article-title: An integrative theory of locus coeruleus-norepinephrine function: adaptive gain and optimal performance publication-title: Annual Review of Neuroscience doi: 10.1146/annurev.neuro.28.061604.135709 – volume: 12 start-page: 618 year: 2017 ident: bib35 article-title: Hierarchical prediction errors in midbrain and septum during social learning publication-title: Social Cognitive and Affective Neuroscience doi: 10.1093/scan/nsw171 – volume: 26 start-page: 35 year: 2014 ident: bib58 article-title: Dopamine D(2/3) receptor availability and human cognitive impulsivity: a high-resolution positron emission tomography imaging study with [¹¹C]raclopride publication-title: Acta Neuropsychiatrica doi: 10.1017/neu.2013.29 – volume: 16 start-page: 5 year: 2003 ident: bib94 article-title: Meta-learning in reinforcement learning publication-title: Neural Networks doi: 10.1016/S0893-6080(02)00228-9 – volume: 18 start-page: 590 year: 2015 ident: bib15 article-title: Anxious individuals have difficulty learning the causal statistics of aversive environments publication-title: Nature Neuroscience doi: 10.1038/nn.3961 – volume: 67 start-page: 319 year: 1994 ident: bib21 article-title: Behavioral inhibition, behavioral activation, and affective responses to impending reward and punishment: the BIS/BAS scales publication-title: Journal of Personality and Social Psychology doi: 10.1037/0022-3514.67.2.319 – volume: 17 start-page: 335 year: 2006 ident: bib30 article-title: Phasic norepinephrine: a neural interrupt signal for unexpected events publication-title: Network: Computation in Neural Systems doi: 10.1080/09548980601004024 – volume: 35 start-page: 4140 year: 2014 ident: bib81 article-title: Pupil diameter covaries with BOLD activity in human locus coeruleus publication-title: Human Brain Mapping doi: 10.1002/hbm.22466 – volume: 28 start-page: 574 year: 2005 ident: bib11 article-title: Network reset: a simplified overarching theory of locus coeruleus noradrenaline function publication-title: Trends in Neurosciences doi: 10.1016/j.tins.2005.09.002 – volume: 16 start-page: 1936 year: 1996 ident: bib78 article-title: A framework for mesencephalic dopamine systems based on predictive hebbian learning publication-title: The Journal of Neuroscience doi: 10.1523/JNEUROSCI.16-05-01936.1996 – volume: 8 start-page: 1611 year: 2005 ident: bib31 article-title: Perceptions of moral character modulate the neural systems of reward during the trust game publication-title: Nature Neuroscience doi: 10.1038/nn1575 – volume: 32 start-page: 1000 year: 2007 ident: bib65 article-title: Chronic treatment with desipramine improves cognitive performance of rats in an attentional set-shifting test publication-title: Neuropsychopharmacology doi: 10.1038/sj.npp.1301235 – volume: 99 start-page: 598 year: 2018 ident: bib75 article-title: Volatility facilitates value updating in the prefrontal cortex publication-title: Neuron doi: 10.1016/j.neuron.2018.06.033 – volume: 38 start-page: 2011 year: 2013 ident: bib106 article-title: Working memory capacity predicts effects of methylphenidate on reversal learning publication-title: Neuropsychopharmacology doi: 10.1038/npp.2013.100 – volume: 64 start-page: 626 year: 2008 ident: bib33 article-title: Cognition-enhancing doses of methylphenidate preferentially increase prefrontal cortex neuronal responsiveness publication-title: Biological Psychiatry doi: 10.1016/j.biopsych.2008.04.037 – volume: 43 start-page: 181 year: 2002 ident: bib107 article-title: Relationship between blockade of dopamine transporters by oral methylphenidate and the increases in extracellular dopamine: therapeutic implications publication-title: Synapse doi: 10.1002/syn.10038 – volume: 21 start-page: 860 year: 2018 ident: bib109 article-title: Prefrontal cortex as a meta-reinforcement learning system publication-title: Nature Neuroscience doi: 10.1038/s41593-018-0147-8 – volume: 14 year: 2018 ident: bib100 article-title: Dorsal anterior cingulate-brainstem ensemble as a reinforcement meta-learner publication-title: PLOS Computational Biology doi: 10.1371/journal.pcbi.1006370 – volume: 15 start-page: 495 year: 2002 ident: bib38 article-title: Metalearning and neuromodulation publication-title: Neural Networks doi: 10.1016/S0893-6080(02)00044-8 – volume: 94 start-page: 401 year: 2017 ident: bib42 article-title: Metaplasticity as a neural substrate for adaptive learning and choice under uncertainty publication-title: Neuron doi: 10.1016/j.neuron.2017.03.044 – volume: 22 start-page: 45 year: 2004 ident: bib68 article-title: Reinforcement learning and decision making in monkeys during a competitive game publication-title: Cognitive Brain Research doi: 10.1016/j.cogbrainres.2004.07.007 – volume: 4 start-page: 45 year: 1993 ident: bib57 article-title: Sociable and aggressive dominance: personality differences in leadership style? publication-title: The Leadership Quarterly doi: 10.1016/1048-9843(93)90003-C – volume: 234 start-page: 3353 year: 2017 ident: bib52 article-title: The effect of single-dose methylphenidate on the rate of error-driven learning in healthy males: a randomized controlled trial publication-title: Psychopharmacology doi: 10.1007/s00213-017-4723-5 – volume: 111 start-page: 9615 year: 2014 ident: bib95 article-title: Dissociable contribution of prefrontal and striatal dopaminergic genes to learning in economic games publication-title: PNAS doi: 10.1073/pnas.1316259111 – volume: 52 start-page: 30 year: 1988 ident: bib114 article-title: The multidimensional scale of perceived social support publication-title: Journal of Personality Assessment doi: 10.1207/s15327752jpa5201_2 – volume: 24 start-page: 2812 year: 2014 ident: bib24 article-title: The social dominance paradox publication-title: Current Biology doi: 10.1016/j.cub.2014.10.014 – volume: 137 start-page: 1039 year: 2006 ident: bib66 article-title: Noradrenergic modulation of cognitive function in rat medial prefrontal cortex as measured by attentional set shifting capability publication-title: Neuroscience doi: 10.1016/j.neuroscience.2005.09.031 – volume: 22 start-page: 509 year: 2012 ident: bib45 article-title: Mechanisms of hierarchical reinforcement learning in corticostriatal circuits 1: computational analysis publication-title: Cerebral Cortex doi: 10.1093/cercor/bhr114 – volume: 106 start-page: 17951 year: 2009 ident: bib61 article-title: Genetic variation in dopaminergic neuromodulation influences the ability to rapidly and flexibly adapt decisions publication-title: PNAS doi: 10.1073/pnas.0905191106 – volume: 27 start-page: 763 year: 1991 ident: bib91 article-title: Decomposing adult age differences in working memory publication-title: Developmental Psychology doi: 10.1037/0012-1649.27.5.763 – volume: 72 start-page: 78 year: 2016 ident: bib37 article-title: How Bayes factors change scientific practice publication-title: Journal of Mathematical Psychology doi: 10.1016/j.jmp.2015.10.003 – volume-title: Information Theory Inference and Learning Algorithms year: 2003 ident: bib73 – volume-title: Wechsler Adult Intelligence Scale (WAIS-IV) year: 2008 ident: bib111 – volume: 43 start-page: 2083 year: 2018 ident: bib72 article-title: Burst activation of dopamine neurons produces prolonged post-burst availability of actively released dopamine publication-title: Neuropsychopharmacology doi: 10.1038/s41386-018-0088-7 – volume-title: Manual for the State-Trait Anxiety Inventory (Form Y) (Palo Alto) year: 1983 ident: bib102 – volume: 19 start-page: 1075 year: 2006 ident: bib101 article-title: Neural mechanism for stochastic behaviour during a competitive game publication-title: Neural Networks doi: 10.1016/j.neunet.2006.05.044 – volume: 6 start-page: 76 year: 1970 ident: bib16 article-title: The convergence of a class of Double-rank minimization algorithms 1. general considerations publication-title: IMA Journal of Applied Mathematics doi: 10.1093/imamat/6.1.76 – volume: 329 year: 2010 ident: bib17 article-title: Dopaminergic network differences in human impulsivity publication-title: Science doi: 10.1126/science.1185778 – volume: 25 start-page: 3719 year: 2007 ident: bib105 article-title: Lesions of the dorsal noradrenergic bundle impair attentional set-shifting in the rat publication-title: European Journal of Neuroscience doi: 10.1111/j.1460-9568.2007.05612.x – volume: 81 start-page: 687 year: 2014 ident: bib69 article-title: Neural computations underlying arbitration between model-based and model-free learning publication-title: Neuron doi: 10.1016/j.neuron.2013.11.028 – volume: 10 year: 2014 ident: bib29 article-title: VBA: a probabilistic treatment of nonlinear models for neurobiological and behavioural data publication-title: PLOS Computational Biology doi: 10.1371/journal.pcbi.1003441 – volume: 46 start-page: 681 year: 2005 ident: bib113 article-title: Uncertainty, neuromodulation, and attention publication-title: Neuron doi: 10.1016/j.neuron.2005.04.026 – volume: 61 start-page: 140 year: 2009 ident: bib60 article-title: Reinforcement learning signal predicts social conformity publication-title: Neuron doi: 10.1016/j.neuron.2008.11.027 – volume: 84 start-page: 870 year: 2014 ident: bib77 article-title: Functionally dissociable influences on learning rate in a dynamic environment publication-title: Neuron doi: 10.1016/j.neuron.2014.10.013 – volume: 152 start-page: 160 year: 2016 ident: bib23 article-title: Neural signature of hierarchically structured expectations predicts clustering and transfer of rule sets in reinforcement learning publication-title: Cognition doi: 10.1016/j.cognition.2016.04.002 – volume: 22 start-page: 15 year: 1991 ident: bib92 article-title: The dutch reading test for adults: a measure of premorbid intelligence level publication-title: Tijdschrift Voor Gerontologie en Geriatrie – volume: 23 start-page: 408 year: 2019 ident: bib10 article-title: Reinforcement learning, fast and slow publication-title: Trends in Cognitive Sciences doi: 10.1016/j.tics.2019.02.006 – volume: 37 start-page: 457 year: 1999 ident: bib59 article-title: Pharmacokinetics and clinical effectiveness of methylphenidate publication-title: Clinical Pharmacokinetics doi: 10.2165/00003088-199937060-00002 – volume: 12 start-page: 182 year: 2009 ident: bib79 article-title: N-Acetylcysteine reverses cocaine-induced metaplasticity publication-title: Nature Neuroscience doi: 10.1038/nn.2250 – volume: 69 start-page: e113 year: 2011 ident: bib27 article-title: Inverted-U-shaped dopamine actions on human working memory and cognitive control publication-title: Biological Psychiatry doi: 10.1016/j.biopsych.2011.03.028 – volume: 24 start-page: 23 year: 1970 ident: bib49 article-title: A family of variable-metric methods derived by variational means publication-title: Mathematics of Computation doi: 10.1090/S0025-5718-1970-0258249-6 – volume-title: bioRxiv year: 2018 ident: bib25 article-title: Catecholamine challenge uncovers distinct mechanisms for direct versus indirect, but not social versus Non-Social, learning doi: 10.1101/303982 – volume: 10 year: 2014 ident: bib34 article-title: Inferring on the intentions of others by hierarchical bayesian learning publication-title: PLOS Computational Biology doi: 10.1371/journal.pcbi.1003810 – volume: 15 start-page: 1040 year: 2012 ident: bib83 article-title: Rational regulation of learning dynamics by pupil-linked arousal systems publication-title: Nature Neuroscience doi: 10.1038/nn.3130 – volume: 67 start-page: 588 year: 1996 ident: bib5 article-title: Comparison of beck depression inventories -IA and -II in psychiatric outpatients publication-title: Journal of Personality Assessment doi: 10.1207/s15327752jpa6703_13 – start-page: 196 volume-title: Brain Norepinephrine year: 2007 ident: bib1 doi: 10.1017/CBO9780511544156.008 – volume: 20 start-page: 1165 year: 2010 ident: bib19 article-title: How the opinion of others affects our valuation of objects publication-title: Current Biology doi: 10.1016/j.cub.2010.04.055 – volume: 64 start-page: 739 year: 2008 ident: bib40 article-title: The dual-state theory of prefrontal cortex dopamine function with relevance to catechol-o-methyltransferase genotypes and schizophrenia publication-title: Biological Psychiatry doi: 10.1016/j.biopsych.2008.05.015 – start-page: 64 volume-title: Classical Conditioning II: Current Research and Theory year: 1972 ident: bib90 – volume: 10 start-page: 433 year: 1997 ident: bib13 article-title: The psychophysics toolbox publication-title: Spatial Vision doi: 10.1163/156856897X00357 – volume: 89 start-page: 221 year: 2016 ident: bib56 article-title: Relationships between pupil diameter and neuronal activity in the locus coeruleus, Colliculi, and cingulate cortex publication-title: Neuron doi: 10.1016/j.neuron.2015.11.028 – volume: 49 start-page: 1 year: 2018 ident: bib64 article-title: Model-based predictions for dopamine publication-title: Current Opinion in Neurobiology doi: 10.1016/j.conb.2017.10.006 – volume: 153 start-page: 131 year: 2018 ident: bib98 article-title: Evaluation of the hypothesis that phasic dopamine constitutes a cached-value signal publication-title: Neurobiology of Learning and Memory doi: 10.1016/j.nlm.2017.12.002 – volume: 345 start-page: 1616 year: 2014 ident: bib112 article-title: A critical time window for dopamine actions on the structural plasticity of dendritic spines publication-title: Science doi: 10.1126/science.1255514 – volume: 10 start-page: 252 year: 2010 ident: bib48 article-title: Pupil diameter tracks changes in control state predicted by the adaptive gain theory of locus coeruleus function publication-title: Cognitive, Affective, & Behavioral Neuroscience doi: 10.3758/CABN.10.2.252 – volume: 126 start-page: 193 year: 2012 ident: bib51 article-title: What's social about social learning? publication-title: Journal of Comparative Psychology doi: 10.1037/a0025180 – volume: 7 year: 2013 ident: bib67 article-title: Pupil dilation signals uncertainty and surprise in a learning gambling task publication-title: Frontiers in Behavioral Neuroscience doi: 10.3389/fnbeh.2013.00218 – volume: 48 start-page: 306 year: 1984 ident: bib18 article-title: The efficient assessment of need for cognition publication-title: Journal of Personality Assessment doi: 10.1207/s15327752jpa4803_13 – volume: 275 start-page: 1593 year: 1997 ident: bib93 article-title: A neural substrate of prediction and reward publication-title: Science doi: 10.1126/science.275.5306.1593 – volume: 14 year: 2018 ident: bib71 article-title: Rational metareasoning and the plasticity of cognitive control publication-title: PLOS Computational Biology doi: 10.1371/journal.pcbi.1006043 – volume: 12 year: 2016 ident: bib55 article-title: Catecholaminergic regulation of learning rate in a dynamic environment publication-title: PLOS Computational Biology doi: 10.1371/journal.pcbi.1005171 – volume: 7 year: 2011 ident: bib53 article-title: Disentangling the roles of approach, activation and Valence in instrumental and pavlovian responding publication-title: PLOS Computational Biology doi: 10.1371/journal.pcbi.1002028 – volume: 39 start-page: 19 year: 1990 ident: bib32 article-title: Activation of the noradrenergic system facilitates an attentional shift in the rat publication-title: Behavioural Brain Research doi: 10.1016/0166-4328(90)90118-X – volume: 9 start-page: 1030 year: 2014 ident: bib12 article-title: Reward-related neural responses are dependent on the beneficiary publication-title: Social Cognitive and Affective Neuroscience doi: 10.1093/scan/nst077 – volume: 10 start-page: 437 year: 1997 ident: bib87 article-title: The VideoToolbox software for visual psychophysics: transforming numbers into movies publication-title: Spatial Vision doi: 10.1163/156856897X00366 |
SSID | ssj0000748819 |
Score | 2.3488607 |
Snippet | The remarkable expedience of human learning is thought to be underpinned by meta-learning, whereby slow accumulative learning processes are rapidly adjusted to... |
SourceID | doaj pubmedcentral proquest pubmed crossref |
SourceType | Open Website Open Access Repository Aggregation Database Index Database Enrichment Source |
SubjectTerms | Adolescent Adult Catecholamines Dopamine Dopamine - metabolism Dopamine Uptake Inhibitors - administration & dosage Female Humans Hypotheses Learning Learning - drug effects Learning curves learning rate Male meta-learning Methylphenidate Methylphenidate - administration & dosage Neuroscience noradrenaline Norepinephrine Norepinephrine - metabolism Placebos - administration & dosage School environment Volatility Young Adult |
SummonAdditionalLinks | – databaseName: Directory of Open Access Journals (DOAJ) (Open Access) dbid: DOA link: http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrV3PS8MwFA4yELyIv51OqbCTEJcuaZMcdTiGqCcHu5X81IHrRLeD_70vaTc2GXjx2ryW9L2k7_vavu8h1NYc1oH2GtuuyzHLmcKQBLuYQuo1WWZJqsL7jqfnfDBkD6NstNLqK_wTVskDV47rhMJRww1cDoCKk1LZjBNvtecMkAqNSqBEkhUyFZ_BHBZmKquCPA4ps-Mex97dBHgg11JQVOrfBC9__yW5knb6e2i3xovJbTXPfbTlygO0XXWQ_D5EuKeCCivw00ms4hubZDK1dUuuZOqTiZspXLeGeD1Cw_79S2-A6w4I2DCezTDt-lRaLzinnmhqbJBfM1YreCpILa1lxnNgDFznVGlvBJMKCID3wnAN25Meo0Y5Ld0pSjiYUuEF0BvPBHBH63MN-ArcaYnKWRNdL5xSmFoePHSpeC-AJgQPFtGDRfRgE7WXxh-VKsZms7vg3aVJkLKOByDARR3g4q8AN1FrEZui3l9fRZcyGeqwCAxfLYdhZ4TPHap003mwAejEuKBpE51UoVzOJNSME8HgbL4W5LWpro-U47eovp0DA6M5OfuPeztHOwDAYj-KVLRQY_Y5dxcAcmb6Mq7nHzfA-1s priority: 102 providerName: Directory of Open Access Journals – databaseName: Health & Medical Collection dbid: 7X7 link: http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwfV3da9swEBdbymAvo-2-srXDhT4NtNiWbMlPpS0NYax7WiBvRp9ZoLGzNnnof787WXGXEvZqneE4nXS_k3T3I-RcC_AD7TW1uSspL7miEARzyiD0mqKwaabwvOP2ZzmZ8u-zYhYP3B7is8rtnhg2atsaPCMf5YxXWHmT8ovVH4qsUXi7Gik0XpKDDJAIUjeImejPWCA8Soh4XVmegMA5cj8W3n1DkFDtBKLQr38fyHz-VvKf4DM-JG8iakwuu2k-Ii9cc0xedTySj28JvVbYixWy1GWo5VuYZNnaSMyVtD5ZurWikSBi_o5Mxze_ric08iBQw0Wxpiz3WWW9FIL5VDNjsQmbsVrB3lDpylpuvIC8QeiSKe2N5JWCNMB7aYSGRcrek0HTNu4jSQSIMuklJDmeS8ggrS81oCxbCJuqkg_J161RahObhCNXxV0NyQJasA4WrIMFh-S8F151vTH2i12hdXsRbGgdPrT38zqujxrrg40w4DWAR11VKdAo9VZ7wQGQMlDsZDs3dVxlD_WTTwzJWT8M6wMvPVTj2g3KAIDiQrJsSD50U9lrgpXjqeTwt9iZ5B1Vd0eaxe_Qg7uEPIyV6af_q_WZvAaAFfgmMnlCBuv7jTsFELPWX4Kn_gXLpPKN priority: 102 providerName: ProQuest |
Title | Catecholaminergic modulation of meta-learning |
URI | https://www.ncbi.nlm.nih.gov/pubmed/31850844 https://www.proquest.com/docview/2349165404 https://www.proquest.com/docview/2328347831 https://pubmed.ncbi.nlm.nih.gov/PMC6974360 https://doaj.org/article/3595c7cbfb774e99ad570fdbf7453334 |
Volume | 8 |
hasFullText | 1 |
inHoldings | 1 |
isFullTextHit | |
isPrint | |
link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrV1LaxsxEB7yoNBLafp0m5ot5FSQu2tpd6RTSEJCKG0opQbfFj0TQ7zbug40_74j7drUwcdcVyOQ5qH5ZqWZATgySHpggmFu7CsmKqEZOcEx4-R6bVm6vNDxf8e3q-pyIr5My-kOrJpx9gz8szW0i_2kJovb0d_f98dk8IRfR0je8LP_Ogt-FD2_2oX9dFEU3_D1OD8dyUh6WqguP-_hnA2PlAr3b0ObDx9N_ueFLp7Dsx4-ZiedvA9gxzcv4EnXUPL-JbAzHYuy0p7mKalvZrN56_oOXVkbsrlfatZ3irh-BZOL859nl6xviMCswHLJ-DgUygWJyENuuHWxGpt1RtMhoYxyTtiAFECgqbg2wUqhNMUDIUiLhqyVv4a9pm38W8iQSLkMkqKdICSFki5UhuCWK9HluhID-LRiSm37auGxacVtTVFD5GCdOFgnDg7gaE38qyuSsZ3sNHJ3TRIrW6cP7eK67g2ljonCFi2pDwFTr5SmFeXBmYCCkCmnhR2uZFOvtKUec6FiWlZOwx_Xw2Qo8fZDN769izSEpARKXgzgTSfK9UpiCnkuBc3GDSFvLHVzpJndpGLcFQVkvMrfPcbe3sNTwmOpPUUhD2FvubjzHwjzLM0QdnGKQ9g_Pb_6_mOY_hwMk47_A9aLBbg |
linkProvider | Scholars Portal |
linkToHtml | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwtV3dT9RAEJ_gEaMvxm9PUWuCLyYrve62u30gRhByyHExBhLelv3ES7wW4Yjhn_Nvc7bdVs8Q33htp81kdqbzm93O_ADWNUc_0F4Tm7mCsIIpgkkwIxRTr8lzm45U2O84mBbjI_b5OD9egV9dL0z4rbL7JjYfalubsEe-kVFWhs6blH04-0ECa1Q4Xe0oNFSkVrCbzYix2Nix765-Ygl3sbn3Cdf7bZbt7hxuj0lkGSCG8XxBaOZHpfWCc-pTTY0NI86M1Qojr9Sltcx4jqic64Iq7Y1gpUKQ7b0wXGMIUHzvLVhlYQNlAKtbO9MvX_tdHkzQAnNu2xjIMXVvuMnMu_cBppRLqbBhDLgO5v77t-Zf6W_3PtyLuDX52DraA1hx1UO43TJZXj0Csq3CNFisk-dNN-HMJPPaRmqwpPbJ3C0UiRQVp4_h6EZs9AQGVV25Z5BwFKXCCyyzPBNYw1pfaMR5Nuc2VQUbwrvOKNLEMeWBLeO7xHIlWFA2FpSNBYew3guftdM5rhfbCtbtRcJI7eZCfX4qY4TK0KFsuEG_RUTsylKhRqm32nOGkJiiYmvd2sgY5xfyj1cO4U1_GyM0HLuoytWXQQYhHOOCjobwtF3KXpPQu54Khk_zpUVeUnX5TjX71kwBL7ASpEX6_P9qvYY748ODiZzsTfdfwF2Eew37xUiswWBxfuleIqRa6FfRbxM4uelQ-Q2GEDbS |
linkToPdf | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwtV1Lb9QwEB6VViAuiDcLBYJULkhms7ETO4cK0ceqpWVVISr15vpZVuomfWyF-hf5VYwTJ7Co4tZrMolG45nMN45nPoA1zdEPtNfEZq4grGCKYBLMCMXUa_LcpiMV9ju-ToqdQ_blKD9agl9dL0w4Vtl9E5sPta1N2CMfZpSVofMmZUMfj0UcbI0_nZ2TwCAV_rR2dBoq0izY9WbcWGzy2HPXP7Gcu1zf3cK1f59l4-3vmzskMg4Qw3g-JzTzo9J6wTn1qabGhnFnxmqFUVjq0lpmPEeEznVBlfZGsFIh4PZeGK4xHCi-9w6scMz6WAiubGxPDr71Oz6YrAXm37ZJkGMaH7r9qXcfA2QpF9Jiwx5wE-T99-TmX6lw_BAeRAybfG6d7hEsueox3G1ZLa-fANlUYTIs1syzprNwapJZbSNNWFL7ZObmikS6ipOncHgrNnoGy1VduReQcBSlwgssuTwTWM9aX2jEfDbnNlUFG8CHzijSxJHlgTnjVGLpEiwoGwvKxoIDWOuFz9pJHTeLbQTr9iJhvHZzob44kTFaZehWNtygDyM6dmWpUKPUW-05Q3hMUbHVbm1kjPlL-cdDB_Cuv43RGn7BqMrVV0EG4Rzjgo4G8Lxdyl6T0MeeCoZP84VFXlB18U41_dFMBC-wKqRF-vL_ar2Fexgycn93svcK7iPya4gwRmIVlucXV-41oqu5fhPdNoHj246U3-oSOxY |
openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Catecholaminergic+modulation+of+meta-learning&rft.jtitle=eLife&rft.au=Jennifer+L+Cook&rft.au=Jennifer+C+Swart&rft.au=Monja+I+Frob%C3%B6se&rft.au=Andreea+O+Diaconescu&rft.date=2019-12-18&rft.pub=eLife+Sciences+Publications+Ltd&rft.eissn=2050-084X&rft.volume=8&rft_id=info:doi/10.7554%2FeLife.51439&rft.externalDBID=DOA&rft.externalDocID=oai_doaj_org_article_3595c7cbfb774e99ad570fdbf7453334 |
thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2050-084X&client=summon |
thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2050-084X&client=summon |
thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2050-084X&client=summon |