Humans can select actions by learning, planning, or retrieving motor memories. Reinforcement Learning (RL) associates these processes with three major classes of strategies for action selection: exploratory RL learns state-action values by exploration, model-based RL uses internal models to simulate future states reached by hypothetical actions, and motor-memory RL selects past successful state...

To investigate neural processes underlying temporal credit assignment in the striatum, we recorded neuronal activity in the dorsomedial and dorsolateral striatum (DMS and DLS, respectively) of rats performing a dynamic foraging task in which a choice has to be remembered until its outcome is revealed for correct credit assignment. Choice signals appeared sequentially, initially in the DMS and t...

Optimal decision making mandates organisms learn the relevant features of choice options. Likewise, knowing how much effort we should expend can assume paramount importance. A mesolimbic network supports reward learning, but it is unclear whether other choice features, such as effort learning, rely on this same network. Using computational fMRI, we show parallel encoding of effort and reward pr...

The striatum plays important motor, associative and cognitive roles in brain functions. However, the rodent dorsolateral (the primate putamen) and dorsomedial (the primate caudate nucleus) striatum are not anatomically separated, making it difficult to distinguish their functions. By contrast, anatomical separation exists between the caudate nucleus and putamen in primates. Here, we successfull...

The dorsal striatum has two functionally-defined subdivisions: a dorsomedial striatum (DMS) region involved in mediating goal-directed behaviors that require conscious effort, and a dorsolateral striatum (DLS) region involved in the execution of habitual behaviors in a familiar sensory context. Consistent with its presumed role in forming stimulus-response (S-R) associations, neurons in DLS rec...

Substantia nigra/ventral tegmental area (SN/VTA) subregions, defined by dopaminergic projections to the striatum, are differentially affected by health (e.g. normal aging) and disease (e.g. Parkinson's disease). This may have an impact on reward processing which relies on dopaminergic regions and circuits. We acquired diffusion tensor imaging (DTI) with probabilistic tractography in 30 healthy ...

Deep brain stimulation (DBS) of the ventral capsule/ventral striatum (VC/VS) reduces symptoms of intractable obsessive-compulsive disorder (OCD), but the mechanism of action is unknown. OCD is characterized by avoidance behaviors that fail to extinguish, and DBS could act, in part, by facilitating extinction of fear. We investigated this possibility by using auditory fear conditioning in rats, ...