Within-subject differences in degree of delay discounting as a function of order of presentation of hypothetical cash rewards

Procedural variants in estimating delay discounting (DD) have been shown to yield significant differences in estimated degree of DD as well as variations in individual patterns of choice. For example, a recent study found significantly different degrees of DD between groups assessed using either an ascending or descending order of presentation of the immediately available rewards. The purpose of this study was to test for within-subject effects of order of presentation of the immediate rewards in a DD task. In a single session, college students (N = 29) were asked to complete two DD tasks, one with the immediate rewards presented in ascending order and one in descending order. Consistent with previous results, significantly larger mean area under the discounting curve (AUC) was observed when the descending sequence was used compared to the ascending order of presentation; and the correlation between both measurements was moderate. These results suggest that some DD assessment tasks may be sensitive to contextual variables such as order and range of the reward and delay values.     

Parameters of delay discounting assessment: number of trials, effort, and sequential effects.

Procedural variants in estimating delay discounting (DD) have been shown to yield significant within-subject differences in estimated degree of delay discounting as well as variations in the patterns of choice. The purpose of this study was to evaluate the effect of subject control over the number of trials in a delay discounting task, on degree of delay discounting. Participants were assessed with two computerized DD assessments: the full-length method presented participants with a fixed set of 240 trials, and the abbreviated task, where once participants had shown indifference between the immediate and delayed rewards, the remaining trials for that delay value were omitted. While the full-length and abbreviated methods did not differentially affect patterns of choice or estimated delay discounting, the order of presentation (ascending or descending) of immediate rewards produced differences in each measure: rate of delay discounting was significantly lower when estimated with the descending sequence; a larger proportion of area under the discounting curve was concentrated around the indifference point trial with the descending sequence; and a lower correlation was observed between estimates obtained across methods with the descending sequence.     

Pathological gambling severity is associated with impulsivity in a delay discounting procedure

Research and clinical expertise indicates that impulsivity is an underlying feature of pathological gambling. This study examined the extent to which impulsive behavior, defined by the rate of discounting delayed monetary rewards, varies with pathological gambling severity, assessed by the South Oaks Gambling Screen (SOGS). Sixty-two pathological gamblers completed a delay discounting task, the SOGS, the Eysenck impulsivity scale, the Addiction Severity Index (ASI), and questions about gambling and substance use at intake to outpatient treatment for pathological gambling. In the delay discounting task, participants chose between a large delayed reward (US $1000) and smaller more immediate rewards (US $1-$999) across a range of delays (6h to 25 years). The rate at which the delayed reward was discounted (k value) was derived for each participant and linear regression was used to identify the variables that predicted k values. Age, gender, years of education, substance abuse treatment history, and cigarette smoking history failed to significantly predict k values. Scores on the Eysenck impulsivity scale and the SOGS both accounted for a significant proportion of the variance in k values. The predictive value of the SOGS was 1.4 times that of the Eysenck scale. These results indicate that of the measures tested, gambling severity was the best single predictor of impulsive behavior in a delay discounting task in this sample of pathological gamblers.     

Delay of gratification and delay discounting in rats

Delay discounting (DD) and delay of gratification (DG) are two measures of impulsive behavior often viewed as reflecting the same or equivalent processes. However, there are some key differences in the contingencies of reinforcement between the procedures that may have implications for understanding impulsivity. This study used DD and DG procedures to determine if differences in contingencies of reinforcement specified by DD and DG alters how much organisms discount the value of delayed reinforcers. Twenty-four water-deprived rats performed one of two Adjusting Amount procedures, which consisted of repeated choices between a fixed amount of water (250 &mgr;l) delivered after a delay (0, 4, 8, 16, or 32 s) and an adjusting, usually lesser amount delivered immediately. Half of the rats (n=12) performed a DD procedure designed to assess preference for immediate over delayed reinforcers in which they had discrete choices between the immediate and delayed amounts of water. A DG procedure was used for the other half of the rats (n=12). In the DG procedure rats also selected between immediate and delayed alternatives, but if they chose the delayed alternative they could switch to and receive the immediate alternative at any time during the delay to the larger reward. In the DD procedure switching responses were not reinforced but were still recorded and used for analyses. The DD functions of the two groups did not differ significantly. However, at the longer delays, the DG group made significantly fewer switching responses than the DD group. A possible role of response inhibition in the DG procedure is discussed.     

Making Time for Nature: Visual Exposure to Natural Environments Lengthens Subjective Time Perception and Reduces Impulsivity

Impulsivity in delay discounting is associated with maladaptive behaviors such as overeating and drug and alcohol abuse. Researchers have recently noted that delay discounting, even when measured by a brief laboratory task, may be the best predictor of human health related behaviors (e.g., exercise) currently available. Identifying techniques to decrease impulsivity in delay discounting, therefore, could help improve decision-making on a global scale. Visual exposure to natural environments is one recent approach shown to decrease impulsive decision-making in a delay discounting task, although the mechanism driving this result is currently unknown. The present experiment was thus designed to evaluate not only whether visual exposure to natural (mountains, lakes) relative to built (buildings, cities) environments resulted in less impulsivity, but also whether this exposure influenced time perception. Participants were randomly assigned to either a natural environment condition or a built environment condition. Participants viewed photographs of either natural scenes or built scenes before and during a delay discounting task in which they made choices about receiving immediate or delayed hypothetical monetary outcomes. Participants also completed an interval bisection task in which natural or built stimuli were judged as relatively longer or shorter presentation durations. Following the delay discounting and interval bisection tasks, additional measures of time perception were administered, including how many minutes participants thought had passed during the session and a scale measurement of whether time "flew" or "dragged" during the session. Participants exposed to natural as opposed to built scenes were less impulsive and also reported longer subjective session times, although no differences across groups were revealed with the interval bisection task. These results are the first to suggest that decreased impulsivity from exposure to natural as opposed to built environments may be related to lengthened time perception.     

Discounting of sequences of delayed rewards of different amounts

The main purpose of this study was to determine whether the magnitude effect is present in cases where delayed sequences of rewards are discounted. The magnitude effect refers to the inverse relationship between the amount of a reward and the steepness of temporal discounting. This study was conducted with a computer program to estimate the indifference points, which served as indicators of the present subjective value of delayed sequences of small and large rewards. In the indifference point the subjective value of a single, immediate reward was equal to the subjective value of the delayed sequence (or to the value of a single delayed reward). As a control condition, we added an experimental task involving choices between single immediate and single delayed rewards. The experiment showed that the sequences of large rewards are discounted less steeply than are the sequences of small rewards. This finding suggests that the magnitude effect is present within the delayed sequences of rewards. In addition, when outcomes are relatively large, the results suggest that a single reward is discounted less steeply than the sequence of a total nominal value equal to this single reward. However, for relatively small rewards, the difference is not statistically significant. The less steep discounting of sequences of large rewards may explain the reward-bundling effect, which refers to less steep discounting of longer sequences than of shorter ones: longer sequences usually have greater overall nominal value. The present study was conducted on hypothetical rewards, and the results should be validated using real rewards.     

Within-subject comparison of degree of delay discounting using titrating and fixed sequence procedures

Different procedures are often used across experiments to estimate the degree of delay discounting, a common measure of impulsivity. In all procedures, participants indicate their choice between a reward available immediately and one available after a delay. The present experiment determined whether there are differences in the degree of discounting for a hypothetical $100 produced by a procedure that titrates the immediate amount (titrating sequence procedure) versus a procedure that presents a fixed sequence of immediate amounts (fixed sequence procedure) using a within-subject design. The adult human participants showed no significant differences in degree of discounting between procedures as assessed by a hyperboloid model and the Area Under the Curve. Furthermore, the Area Under the Curve values from the two procedures showed a strong positive correlation. These findings suggest there may be no systematic difference between the degree of delay discounting as estimated by the titrating sequence and fixed sequence procedures. Given the apparent similarities in the results, it appears researchers may be justified in basing their choice of which procedure to use on convenience.     

The date-delay framing effect in temporal discounting depends on substance abuse

In the present study, individuals with substance use disorders (n=30) and non-addicted controls (n=30) were presented with a delay-discounting task with time being described either as dates or as temporal intervals. Three main results were obtained. First, in both groups reward size had a large impact on discounting future rewards, with discount rates becoming larger with smaller reward sizes. Second, participants discounted future rewards less strongly when their time of delivery was presented as a date instead of a temporal distance. Third, whereas discount rates of individuals with substance use disorders varied substantially with regard to the presentation of time in the task, the controls changed their choices depending on time presentation only slightly.     

Delay discounting and probability discounting as related to cigarette smoking status in adults

This study examined relations between adult smokers and non-smokers and the devaluation of monetary rewards as a function of delay (delay discounting, DD) or probability (probability discounting, PD). The extent to which individuals discount value, either as a function of a reward being delayed or probabilistic, has been taken to reflect individual differences in impulsivity. Those who discount most are considered most impulsive. Previous research has shown that adult smokers discount the value of delayed rewards more than adult non-smokers. However, in the one published study that examined probability discounting in adult smokers and non-smokers, the smokers did not discount the value of probabilistic rewards more than the non-smoker controls. From this past research, it was hypothesized that measures of delay discounting would differentiate between smokers and non-smokers but that probability discounting would not. Participants were 54 (25 female) adult smokers (n = 25) and non-smokers (n = 29). The smokers all reported smoking at least 20 cigarettes per day, and the non-smokers reported having never smoked. The results indicated that the smokers discounted significantly more than the non-smokers by both delay and probability. Unlike past findings, these results suggest that both delay and probability discounting are related to adult cigarette smoking; however, it also was determined that DD was a significantly stronger predictor of smoking than PD.     

Humans can adopt optimal discounting strategy under real-time constraints

Critical to our many daily choices between larger delayed rewards, and smaller more immediate rewards, are the shape and the steepness of the function that discounts rewards with time. Although research in artificial intelligence favors exponential discounting in uncertain environments, studies with humans and animals have consistently shown hyperbolic discounting. We investigated how humans perform in a reward decision task with temporal constraints, in which each choice affects the time remaining for later trials, and in which the delays vary at each trial. We demonstrated that most of our subjects adopted exponential discounting in this experiment. Further, we confirmed analytically that exponential discounting, with a decay rate comparable to that used by our subjects, maximized the total reward gain in our task. Our results suggest that the particular shape and steepness of temporal discounting is determined by the task that the subject is facing, and question the notion of hyperbolic reward discounting as a universal principle.     

Regional white matter volumes correlate with delay discounting

A preference for immediate gratification is a central feature in addictive processes. However, the neural structures underlying reward delay tolerance are still unclear. Healthy participants (n = 121) completed a delay discounting questionnaire assessing the extent to which they prefer smaller immediate rewards to larger delayed reward after undergoing magnetic resonance imaging (MRI) scanning. Whole brain voxel-based morphometric analysis shows that delay discounting severity was negatively correlated with right prefrontal subgyral white matter volume and positively correlated with white matter volume in parahippocampus/hippocampus, after whole brain correction. This study might better our understanding of the neural basis of impulsivity and addiction.     

Will travel for food: spatial discounting in two new world monkeys

Nonhuman animals steeply discount the future, showing a preference for small, immediate over large, delayed rewards. Currently unclear is whether discounting functions depend on context. Here, we examine the effects of spatial context on discounting in cotton-top tamarins (Saguinus oedipus) and common marmosets (Callithrix jacchus), species known to differ in temporal discounting. We presented subjects with a choice between small, nearby rewards and large, distant rewards. Tamarins traveled farther for the large reward than marmosets, attending to the ratio of reward differences rather than their absolute values. This species difference contrasts with performance on a temporal task in which marmosets waited longer than tamarins for the large reward. These comparative data indicate that context influences choice behavior, with the strongest effect seen in marmosets who discounted more steeply over space than over time. These findings parallel details of each species' feeding ecology. Tamarins range over large distances and feed primarily on insects, which requires using quick, impulsive action. Marmosets range over shorter distances than tamarins and feed primarily on tree exudates, a clumped resource that requires patience to wait for sap to exude. These results show that discounting functions are context specific, shaped by a history of ecological pressures.     

Reduced sensitivity to immediate reward during decision-making in older than younger adults

We examined whether older adults differ from younger adults in the degree to which they favor immediate over delayed rewards during decision-making. To examine the neural correlates of age-related differences in delay discounting we acquired functional MR images while participants made decisions between smaller but sooner and larger but later monetary rewards. The behavioral results show age-related reductions in delay discounting. Less impulsive decision-making in older adults was associated with lower ventral striatal activations to immediate reward. Furthermore, older adults showed an overall higher percentage of delayed choices and reduced activity in the dorsal striatum than younger adults. This points to a reduced reward sensitivity of the dorsal striatum in older adults. Taken together, our findings indicate that less impulsive decision-making in older adults is due to a reduced sensitivity of striatal areas to reward. These age-related changes in reward sensitivity may result from transformations in dopaminergic neuromodulation with age.     

Prefrontal coding of temporally discounted values during intertemporal choice

Reward from a particular action is seldom immediate, and the influence of such delayed outcome on choice decreases with delay. It has been postulated that when faced with immediate and delayed rewards, decision makers choose the option with maximum temporally discounted value. We examined the preference of monkeys for delayed reward in an intertemporal choice task and the neural basis for real-time computation of temporally discounted values in the dorsolateral prefrontal cortex. During this task, the locations of the targets associated with small or large rewards and their corresponding delays were randomly varied. We found that prefrontal neurons often encoded the temporally discounted value of reward expected from a particular option. Furthermore, activity tended to increase with [corrected] discounted values for targets [corrected] presented in the neuron's preferred direction, suggesting that activity related to temporally discounted values in the prefrontal cortex might determine the animal's behavior during intertemporal choice.     

Sex difference in the relationship between salivary testosterone and inter-temporal choice

Humans often prefer a small immediate reward to large reward in the future. This myopic tendency in inter-temporal choice is termed delay discounting, and has been the focus of intensive research in the past decades. Recent studies indicate that the neural regions underlying delay discounting are influenced by the gonadal steroids. However, the specific relationship between the testosterone levels and delay discounting is unclear at this point, especially in females.The present study investigated the relationship between salivary testosterone concentrations and discounting rates in delay- and probability-discounting tasks with healthy males and females. The results revealed a positive correlation between testosterone concentrations and delay-discounting rates in females and a negative correlation in males. Testosterone concentrations were unrelated to probability-discounting rates. Although causal effects of testosterone cannot be certain in this correlational study, if testosterone directly influenced this behavior, observed sex differences in delay discounting may be evidence of a curvilinear effect of testosterone. Alternatively, the findings may reflect inverse pattern of responsiveness to testosterone between male and female neural systems, or basic sex-difference in the neural mechanism underlying delay-discounting independent of testosterone itself.     

Insulin,Central Dopamine D2 Receptors,and Monetary Reward Discounting in Obesity

Animal research finds that insulin regulates dopamine signaling and reward behavior, but similar research in humans is lacking. We investigated whether individual differences in body mass index, percent body fat, pancreatic β-cell function, and dopamine D2 receptor binding were related to reward discounting in obese and non-obese adult men and women. Obese (n = 27; body mass index>30) and non-obese (n = 20; body mass index<30) adults were assessed for percent body fat with dual-energy X-ray absorptiometry and for β-cell function using disposition index. Choice of larger, but delayed or less certain, monetary rewards relative to immediate, certain smaller monetary rewards was measured using delayed and probabilistic reward discounting tasks. Positron emission tomography using a non-displaceable D2-specific radioligand, [¹¹C](N-methyl)benperidol quantified striatal D2 receptor binding. Groups differed in body mass index, percent body fat, and disposition index, but not in striatal D2 receptor specific binding or reward discounting. Higher percent body fat in non-obese women related to preference for a smaller, certain reward over a larger, less likely one (greater probabilistic discounting). Lower β-cell function in the total sample and lower insulin sensitivity in obese related to stronger preference for an immediate and smaller monetary reward over delayed receipt of a larger one (greater delay discounting). In obese adults, higher striatal D2 receptor binding related to greater delay discounting. Interestingly, striatal D2 receptor binding was not significantly related to body mass index, percent body fat, or β-cell function in either group. Our findings indicate that individual differences in percent body fat, β-cell function, and striatal D2 receptor binding may each contribute to altered reward discounting behavior in non-obese and obese individuals. These results raise interesting questions about whether and how striatal D2 receptor binding and metabolic factors, including β-cell function, interact to affect reward discounting in humans.     

Led into Temptation? Rewarding Brand Logos Bias the Neural Encoding of Incidental Economic Decisions

Human decision-making is driven by subjective values assigned to alternative choice options. These valuations are based on reward cues. It is unknown, however, whether complex reward cues, such as brand logos, may bias the neural encoding of subjective value in unrelated decisions. In this functional magnetic resonance imaging (fMRI) study, we subliminally presented brand logos preceding intertemporal choices. We demonstrated that priming biased participants' preferences towards more immediate rewards in the subsequent temporal discounting task. This was associated with modulations of the neural encoding of subjective values of choice options in a network of brain regions, including but not restricted to medial prefrontal cortex. Our findings demonstrate the general susceptibility of the human decision making system to apparently incidental contextual information. We conclude that the brain incorporates seemingly unrelated value information that modifies decision making outside the decision-maker's awareness.     

Delay discounting of real and hypothetical rewards III: steady-state assessments, forced-choice trials, and all real rewards

Human research in delay discounting has omitted several procedures typical of animal studies: forced-choice trials, consequences following each response, and assessment of stable response patterns. The present study manipulated these procedures across two conditions in which real or hypothetical rewards were arranged. Six college students participated in daily sessions, in which steady-state discounting of hypothetical and real rewards was assessed. No systematic effects of repeated exposure to hypothetical rewards was detected when compared with first day assessments of discounting. Likewise, no systematic effect of reward type (real versus hypothetical) was detected. When combined with previous research failing to detect a difference between hypothetical and potentially real rewards, these findings suggest that assessing discounting of hypothetical rewards in single sessions is a practical and valid procedure in the study of delay discounting.     

The Nature of Impulsivity: Visual Exposure to Natural Environments Decreases Impulsive Decision-Making in a Delay Discounting Task

The benefits of visual exposure to natural environments for human well-being in areas of stress reduction, mood improvement, and attention restoration are well documented, but the effects of natural environments on impulsive decision-making remain unknown. Impulsive decision-making in delay discounting offers generality, predictive validity, and insight into decision-making related to unhealthy behaviors. The present experiment evaluated differences in such decision-making in humans experiencing visual exposure to one of the following conditions: natural (e.g., mountains), built (e.g., buildings), or control (e.g., triangles) using a delay discounting task that required participants to choose between immediate and delayed hypothetical monetary outcomes. Participants viewed the images before and during the delay discounting task. Participants were less impulsive in the condition providing visual exposure to natural scenes compared to built and geometric scenes. Results suggest that exposure to natural environments results in decreased impulsive decision-making relative to built environments.     

Single units in the pigeon brain integrate reward amount and time-to-reward in an impulsive choice task

BACKGROUND: Animals prefer small over large rewards when the delays preceding large rewards exceed an individual tolerance limit. Such impulsive choice behavior occurs even in situations in which alternative strategies would yield more optimal outcomes. Behavioral research has shown that an animal's choice is guided by the alternative rewards' subjective values, which are a function of reward amount and time-to-reward. Despite increasing knowledge about the pharmacology and anatomy underlying impulsivity, it is still unknown how the brain combines reward amount and time-to-reward information to represent subjective reward value. RESULTS: We trained pigeons to choose between small, immediate rewards and large rewards delivered after gradually increasing delays. Single-cell recordings in the avian Nidopallium caudolaterale, the presumed functional analog of the mammalian prefrontal cortex, revealed that neural delay activation decreased with increasing delay length but also covaried with the expected reward amount. This integrated neural response was modulated by reward amount and delay, as predicted by a hyperbolical equation, of subjective reward value derived from behavioral studies. Furthermore, the neural activation pattern reflected the current reward preference and the time point of the shift from large to small rewards. CONCLUSIONS: The reported activity was modulated by the temporal devaluation of the anticipated reward in addition to reward amount. Our findings contribute to the understanding of neuropathologies such as drug addiction, pathological gambling, frontal lobe syndrome, and attention-deficit disorders, which are characterized by inappropriate temporal discounting and increased impulsiveness.