The standard reinforcement learningmodel is powerful enough to deal with never ending trials. By slightly discounting rewards obtained in the future, an infinite walk in the environment is still guaranteed to have a finite expected future reward. This however comes at a price. The discounting may corrupt estimates of the expected return in ending trials. Also in most cases algorithms that can d...

Delayed reward discounting is a behavioral economic index of impulsivity, referring to how much an individual devalues a reward based on its delay in time. As a behavioral process that varies considerably across individuals, delay discounting has been studied extensively as a model for self-control, both in the general population and in clinical samples. There is growing interest in genetic inf...

Pigeons' discounting of probabilistic and delayed food reinforcers was studied using adjusting-amount procedures. In the probability discounting conditions, pigeons chose between an adjusting number of food pellets contingent on a single key peck and a larger, fixed number of pellets contingent on completion of a variable-ratio schedule. In the delay discounting conditions, pigeons chose betwee...

People discount the value of delayed and uncertain outcomes, and how steeply individuals discount is thought to reflect how impulsive they are. From this perspective, steep discounting of delayed outcomes (which fails to maximize long-term welfare) and shallow discounting of probabilistic outcomes (which fails to adequately take risk into account) reflect the same trait of impulsivity. Despite ...

In temporal discounting, animals trade off the time to obtain a reward against the quality of a reward, choosing between a smaller reward available sooner versus a larger reward available later. Similar discounting can apply over space, when animals choose between smaller and closer versus larger and more distant rewards. Most studies of temporal and spatial discounting in non-human animals use...

Humans often prefer a small immediate reward to large reward in the future. This myopic tendency in inter-temporal choice is termed delay discounting, and has been the focus of intensive research in the past decades. Recent studies indicate that the neural regions underlying delay discounting are influenced by the gonadal steroids. However, the specific relationship between the testosterone lev...

BACKGROUND Monetary delay discounting is a measure of impulsivity associated with substance use and abuse, problem gambling, and other health-related outcomes. More recently, delay discounting has been shown to be associated with risky sexual behavior. We analyzed survey data from men who have sex with men who completed a monetary discounting task and reported sexual behaviors in the previous 1...

The delay discounting paradigm was used to examine its utility in understanding motivational factors among socially anxious individuals. Participants (n=88) who reported high and low levels of social anxiety were randomly assigned to either a social threat or non-threat condition and their subsequent rates of discounting were examined. A significant difference in rates of discounting was found ...

In economics, the concept of time discounting introduces weights on future goods to make these less valuable. Yet, both the conceptual motivation for time discounting and its specific functional form remain contested. To address these problems, this paper provides a measurement-theoretic framework of representation for time discounting. The representation theorem characterises time discounting ...