Temporal-difference (TD) algorithms have been proposed as models of reinforcement learning (RL). We examine two issues of distributed representation in these TD algorithms: distributed representations of belief and distributed discounting factors. Distributed representation of belief allows the believed state of the world to distribute across sets of equivalent states. Distributed exponential d...

OBJECTIVE To consider the effect of the economic discount rate on health care policy and the rationale for discounting the collective future of society generally. DESIGN A review of the concept of discounting the future vis à vis the present from the points of view of individuals (who pass on) and of societies (that continue) and reconsideration of the application of discounting to typical pu...

Intertemporal choice, the tradeoff among outcomes occurring at different points in time, involves not only benefit options but also those associated with cost. Previous neuroimaging studies have primarily focused on discounting future gains; thus the neural mechanism underlying discounting future losses remains unidentified. Using event-related functional magnetic resonance imaging, we comprehe...

Discounting is a behavioral phenomenon in which the value of an outcome diminishes as a function of its increased delay or decreased probability and is related to substance abuse research because of its theoretical ties with behavioral models of impulsive choice. Research to date suggests that hypothetical outcomes used in discounting research yield data that are indistinguishable from those us...

A probability weighting function (w(p)) is considered to be a nonlinear function of probability (p) in behavioral decision theory. This study proposes a psychophysical model of probability weighting functions derived from a hyperbolic time discounting model and a geometric distribution. The aim of the study is to show probability weighting functions from the point of view of waiting time for a ...

Delay discounting describes the subjective devaluation of a reward when it is delayed. In animals, the adjusting-delay (AD) and increasing-delay (ID) tasks often are used to assess individual differences in, and drug effects on, delay discounting. No study to date, however, has compared systematically the measures of discounting produced in these tasks. The current study examined the correlatio...

INTRODUCTION Given the lack of consensus regarding changes in temporal and probability discounting as a function of smoking abstinence in cigarette smokers, the present study comprehensively examined possible changes in these processes following a period of acute smoking abstinence consistent with elevated withdrawal symptoms and craving. METHODS Computerized temporal and probability discount...

Little is known about the acute effects of drugs of abuse on impulsivity and self-control. In this study, impulsivity was assessed in humans using a computer task that measured delay and probability discounting. Discounting describes how much the value of a reward (or punisher) is decreased when its occurrence is either delayed or uncertain. Twenty-four healthy adult volunteers ingested a moder...

Humans vary in their ability to delay gratification and impulsive decision making is a common feature in various psychiatric disorders. The level of delay discounting is a relatively stable psychological trait, and therefore neural processes implicated in delay discounting are likely to be based on the overall functional organization of the brain (under task-free conditions) in which state-depe...

A human social discount function measures the value to a person of a reward to another person at a given social distance. Just as delay discounting is a hyperbolic function of delay, and probability discounting is a hyperbolic function of odds-against, social discounting is a hyperbolic function of social distance. Experiment 1 obtained individual social, delay, and probability discount functio...