Document Detail


Dopamine neurons can represent context-dependent prediction error.
MedLine Citation:
PMID:  14741107     Owner:  NLM     Status:  MEDLINE    
Abstract/OtherAbstract:
Midbrain dopamine (DA) neurons are thought to encode reward prediction error. Reward prediction can be improved if any relevant context is taken into account. We found that monkey DA neurons can encode a context-dependent prediction error. In the first noncontextual task, a light stimulus was randomly followed by reward, with a fixed equal probability. The response of DA neurons was positively correlated with the number of preceding unrewarded trials and could be simulated by a conventional temporal difference (TD) model. In the second contextual task, a reward-indicating light stimulus was presented with the probability that, while fixed overall, was incremented as a function of the number of preceding unrewarded trials. The DA neuronal response then was negatively correlated with this number. This history effect corresponded to the prediction error based on the conditional probability of reward and could be simulated only by implementing the relevant context into the TD model.
Authors:
Hiroyuki Nakahara; Hideaki Itoh; Reiko Kawagoe; Yoriko Takikawa; Okihide Hikosaka
Related Documents :
2025387 - Subcortical adaptive filtering in the auditory system: associative receptive field plas...
16811507 - Response rate under varying frequency of non-contingent reinforcement.
16811897 - Matching with a trio of concurrent variable-interval schedules of reinforcement.
1311107 - Conditioned facilitatory modulation of the response to an aversive stimulus in the crab...
20968367 - Subjective scaling of spatial room acoustic parameters influenced by visual environment...
23039407 - An improved broadband matched field processor for geoacoustic inversion (l).
Publication Detail:
Type:  Journal Article; Research Support, Non-U.S. Gov't; Research Support, U.S. Gov't, Non-P.H.S.    
Journal Detail:
Title:  Neuron     Volume:  41     ISSN:  0896-6273     ISO Abbreviation:  Neuron     Publication Date:  2004 Jan 
Date Detail:
Created Date:  2004-01-26     Completed Date:  2005-08-31     Revised Date:  2014-03-25    
Medline Journal Info:
Nlm Unique ID:  8809320     Medline TA:  Neuron     Country:  United States    
Other Details:
Languages:  eng     Pagination:  269-80     Citation Subset:  IM    
Export Citation:
APA/MLA Format     Download EndNote     Download BibTex
MeSH Terms
Descriptor/Qualifier:
Algorithms
Animals
Conditioning, Classical / physiology
Conditioning, Operant
Cues
Dopamine / physiology*
Eye Movements / physiology
Light
Macaca
Male
Mesencephalon / physiology*
Models, Neurological
Neurons / physiology*
Reinforcement Schedule
Reward*
Chemical
Reg. No./Substance:
VTD58H1Z2X/Dopamine

From MEDLINE®/PubMed®, a database of the U.S. National Library of Medicine


Previous Document:  Bidirectional modification of presynaptic neuronal excitability accompanying spike timing-dependent ...
Next Document:  Modulation of caudate activity by action contingency.