Document Detail


Dopamine neurons can represent context-dependent prediction error.
MedLine Citation:
PMID:  14741107     Owner:  NLM     Status:  MEDLINE    
Abstract/OtherAbstract:
Midbrain dopamine (DA) neurons are thought to encode reward prediction error. Reward prediction can be improved if any relevant context is taken into account. We found that monkey DA neurons can encode a context-dependent prediction error. In the first noncontextual task, a light stimulus was randomly followed by reward, with a fixed equal probability. The response of DA neurons was positively correlated with the number of preceding unrewarded trials and could be simulated by a conventional temporal difference (TD) model. In the second contextual task, a reward-indicating light stimulus was presented with the probability that, while fixed overall, was incremented as a function of the number of preceding unrewarded trials. The DA neuronal response then was negatively correlated with this number. This history effect corresponded to the prediction error based on the conditional probability of reward and could be simulated only by implementing the relevant context into the TD model.
Authors:
Hiroyuki Nakahara; Hideaki Itoh; Reiko Kawagoe; Yoriko Takikawa; Okihide Hikosaka
Related Documents :
60217 - Dependence of reward contingent positive variation (rcpv) and cortical synchronization ...
21456287 - Out-coupling efficiency enhancement of organic light emitting diode device by sio2-uv h...
16811797 - Errorless discrimination established by differential autoshaping.
14263777 - Signal detection in fixed-ratio schedules.
21406217 - No graded responses of finger muscles to tms during motor imagery of isometric finger f...
11067977 - Ocular pursuit responses to repeated, single-cycle sinusoids reveal behavior compatible...
Publication Detail:
Type:  Journal Article; Research Support, Non-U.S. Gov't; Research Support, U.S. Gov't, Non-P.H.S.    
Journal Detail:
Title:  Neuron     Volume:  41     ISSN:  0896-6273     ISO Abbreviation:  Neuron     Publication Date:  2004 Jan 
Date Detail:
Created Date:  2004-01-26     Completed Date:  2005-08-31     Revised Date:  2014-03-25    
Medline Journal Info:
Nlm Unique ID:  8809320     Medline TA:  Neuron     Country:  United States    
Other Details:
Languages:  eng     Pagination:  269-80     Citation Subset:  IM    
Export Citation:
APA/MLA Format     Download EndNote     Download BibTex
MeSH Terms
Descriptor/Qualifier:
Algorithms
Animals
Conditioning, Classical / physiology
Conditioning, Operant
Cues
Dopamine / physiology*
Eye Movements / physiology
Light
Macaca
Male
Mesencephalon / physiology*
Models, Neurological
Neurons / physiology*
Reinforcement Schedule
Reward*
Chemical
Reg. No./Substance:
VTD58H1Z2X/Dopamine

From MEDLINE®/PubMed®, a database of the U.S. National Library of Medicine


Previous Document:  Bidirectional modification of presynaptic neuronal excitability accompanying spike timing-dependent ...
Next Document:  Modulation of caudate activity by action contingency.