Axiomatic methods, dopamine and reward prediction error.
نویسندگان
چکیده
The phasic firing rate of midbrain dopamine neurons has been shown to respond both to the receipt of rewarding stimuli, and the degree to which such stimuli are anticipated by the recipient. This has led to the hypothesis that these neurons encode reward prediction error (RPE)-the difference between how rewarding an event is, and how rewarding it was expected to be. However, the RPE model is one of a number of competing explanations for dopamine activity that have proved hard to disentangle, mainly because they are couched in terms of latent, or unobservable, variables. This article describes techniques for dealing with latent variables common in economics and decision theory, and reviews work that uses these techniques to provide simple, non-parametric tests of the RPE hypothesis, allowing clear differentiation between competing explanations.
منابع مشابه
Dopamine, Reward Prediction Error, and Economics∗
The neurotransmitter dopamine has been found to play a crucial role in choice, learning and belief formation. The best developed current theory of dopaminergic function is the “reward prediction error” hypothesis that dopamine encodes the difference between the experienced and predicted “reward” of an event. We provide axiomatic foundations for this hypothesis to help bridge the current concept...
متن کاملNeuroeconomics: A Formal Test of Dopamine’s Role in Reinforcement Learning
Over the last two decades, dopamine and reinforcement learning have been increasingly linked. Using a novel, axiomatic approach, a recent study shows that dopamine meets the necessary and sufficient conditions required by the theory to encode a reward prediction error.
متن کاملPhasic dopamine release in the rat nucleus accumbens symmetrically encodes a reward prediction error term.
Making predictions about the rewards associated with environmental stimuli and updating those predictions through feedback is an essential aspect of adaptive behavior. Theorists have argued that dopamine encodes a reward prediction error (RPE) signal that is used in such a reinforcement learning process. Recent work with fMRI has demonstrated that the BOLD signal in dopaminergic target areas me...
متن کاملDopamine reward prediction error coding
Reward prediction errors consist of the differences between received and predicted rewards. They are crucial for basic forms of learning about rewards and make us strive for more rewards-an evolutionary beneficial trait. Most dopamine neurons in the midbrain of humans, monkeys, and rodents signal a reward prediction error; they are activated by more reward than predicted (positive prediction er...
متن کاملThe phasic dopamine signal maturing: from reward via behavioural activation to formal economic utility.
The phasic dopamine reward prediction error response is a major brain signal underlying learning, approach and decision making. This dopamine response consists of two components that reflect, initially, stimulus detection from physical impact and, subsequenttly, reward valuation; dopamine activations by punishers reflect physical impact rather than aversiveness. The dopamine reward signal is di...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- Current opinion in neurobiology
دوره 18 2 شماره
صفحات -
تاریخ انتشار 2008