Addictive drugs have been hypothesized to access the same neurophysiological mechanisms as natural learning systems. These natural learning systems can be modeled through temporal-difference reinforcement learning (TDRL), which requires a reward-error signal that has been hypothesized to be carried by dopamine. TDRL learns to predict reward by driving that reward-error signal to zero. By adding...

Reward contains separable psychological components of learning, incentive motivation and pleasure. Most computational models have focused only on the learning component of reward, but the motivational component is equally important in reward circuitry, and even more directly controls behavior. Modeling the motivational component requires recognition of additional control factors besides learnin...

Background Impulsivity and reward expectancy are commonly interrelated. Waiting impulsivity, measured using the rodent 5-Choice Serial Reaction Time task, predicts compulsive cocaine seeking and sign (or cue) tracking. Here, we assess human waiting impulsivity using a novel translational task, the 4-Choice Serial Reaction Time task, and the relationship with reward cues. Methods Healthy volun...

Reward-prediction errors track the extent to which rewards deviate from expectations, and aid in learning. How do such errors in prediction interact with memory for the rewarding episode? Existing findings point to both cooperative and competitive interactions between learning and memory mechanisms. Here, we investigated whether learning about rewards in a high-risk context, with frequent, larg...

Humor processing involves distinct processing stages including incongruity detection, emotional response, and engagement of mesolimbic reward regions. Dysfunctional reward processing and clinical symptoms in response to humor have been previously described in both hypocretin deficient narcolepsy-cataplexy (NC) and in idiopathic Parkinson disease (PD). For NC patients, humor is the strongest tri...

Estimating reward contingencies and allocating attentional resources to a subset of relevant information are the most important contributors to increasing adaptability of an organism. Although recent evidence suggests that reward- and attention-based guidance recruits overlapping cortical regions and has similar effects on sensory responses, the exact nature of the relationship between the two ...

Reward is a powerful modulator of behavior. Animals and humans are endowed with the ability to learn to associate events and actions with reinforcing stimuli, and exibly adapt their behavior. The experiments described in this thesis use functional magnetic resonance imaging (fMRI) to study the neural mechanisms of reward learning in humans, the neural substrates by which reward associations in ...

Operant conditioning is a form of associative learning through which an animal learns about the consequences of its behavior. Here, we report an appetitive operant conditioning procedure in Aplysia that induces long-term memory. Biophysical changes that accompanied the memory were found in an identified neuron (cell B51) that is considered critical for the expression of behavior that was reward...

Circadian rhythms are endogenously generated near 24-hour variations of physiological and behavioral functions. In humans, disruptions to the circadian system are associated with negative health outcomes, including metabolic, immune, and psychiatric diseases, such as addiction. Animal models suggest bidirectional relationships between the circadian system and drugs of abuse, whereby desynchrony...

Using sensory information for the prediction of future events is essential for survival. Midbrain dopamine neurons are activated by environmental cues that predict rewards, but the cellular mechanisms that underlie this phenomenon remain elusive. We used in vivo voltammetry and in vitro patch-clamp electrophysiology to show that both dopamine release to reward predictive cues and enhanced synap...