Rats bred for high alcohol drinking are more sensitive to delayed and probabilistic outcomes

Alcoholics and heavy drinkers score higher on measures of impulsivity than nonalcoholics and light drinkers. This may be because of factors that predate drug exposure (e.g. genetics). This study examined the role of genetics by comparing impulsivity measures in ethanol-naive rats selectively bred based on their high [high alcohol drinking (HAD)] or low [low alcohol drinking (LAD)] consumption of ethanol. Replicates 1 and 2 of the HAD and LAD rats, developed by the University of Indiana Alcohol Research Center, completed two different discounting tasks. Delay discounting examines sensitivity to rewards that are delayed in time and is commonly used to assess 'choice' impulsivity. Probability discounting examines sensitivity to the uncertain delivery of rewards and has been used to assess risk taking and risk assessment. High alcohol drinking rats discounted delayed and probabilistic rewards more steeply than LAD rats. Discount rates associated with probabilistic and delayed rewards were weakly correlated, while bias was strongly correlated with discount rate in both delay and probability discounting. The results suggest that selective breeding for high alcohol consumption selects for animals that are more sensitive to delayed and probabilistic outcomes. Sensitivity to delayed or probabilistic outcomes may be predictive of future drinking in genetically predisposed individuals.     

The subjective value of delayed and probabilistic outcomes: Outcome size matters for gains but not for losses

The subjective value of a reward (gain) is related to factors such as its size, the delay to its receipt and the probability of its receipt. We examined whether the subjective value of losses was similarly affected by these factors in 128 adults. Participants chose between immediate/certain gains or losses and larger delayed/probabilistic gains or losses. Rewards of $100 were devalued as a function of their delay (“discounted”) relatively less than $10 gains while probabilistic $100 rewards were discounted relatively more than $10 rewards. However, there was no effect of outcome size on discounting of delayed or probabilistic losses. For delayed outcomes of each size, the degree to which gains were discounted was positively correlated with the degree to which losses were discounted, whereas for probabilistic outcomes, no such correlation was observed. These results suggest that the processes underlying the subjective valuation of losses are different from those underlying the subjective valuation of gains.     

Response bias is unaffected by delay length in a delay discounting paradigm

This study examined the contribution of response bias to measures of delay discounting in Long-Evans rats (n = 8) using the adjusting amount procedure. Under this procedure, we assessed preference for 150 μl of 10% sucrose solution delivered following a delay over a variable-amount alternative delivered immediately. Bias was calculated based on relative preference when reinforcers were delivered immediately from both alternatives. We extended this assessment procedure to examine preference when rewards from both alternatives were equally delayed (2, 4, 8, or 16 s) in addition to assessing a traditional delay discounting function. Relative preference was similar across delays and slightly larger than 150 μl. These results indicate that response bias was stable and suggests a relative aversion for the adjusting alternative, which may be due to the variability in reward size associated with that alternative.     

Discounting of sequences of delayed rewards of different amounts

The main purpose of this study was to determine whether the magnitude effect is present in cases where delayed sequences of rewards are discounted. The magnitude effect refers to the inverse relationship between the amount of a reward and the steepness of temporal discounting. This study was conducted with a computer program to estimate the indifference points, which served as indicators of the present subjective value of delayed sequences of small and large rewards. In the indifference point the subjective value of a single, immediate reward was equal to the subjective value of the delayed sequence (or to the value of a single delayed reward). As a control condition, we added an experimental task involving choices between single immediate and single delayed rewards. The experiment showed that the sequences of large rewards are discounted less steeply than are the sequences of small rewards. This finding suggests that the magnitude effect is present within the delayed sequences of rewards. In addition, when outcomes are relatively large, the results suggest that a single reward is discounted less steeply than the sequence of a total nominal value equal to this single reward. However, for relatively small rewards, the difference is not statistically significant. The less steep discounting of sequences of large rewards may explain the reward-bundling effect, which refers to less steep discounting of longer sequences than of shorter ones: longer sequences usually have greater overall nominal value. The present study was conducted on hypothetical rewards, and the results should be validated using real rewards.     

Relations between delay discounting and low to moderate gambling, cannabis, and alcohol problems among university students

Research has generally demonstrated that the discounting of delayed rewards is associated with severity of addictive behaviour. Less clear, however, is the relative strength of the relation for specific addictive behaviours. University students (N = 218) completed a computerized delay discounting task for hypothetical monetary rewards, and gambling, cannabis, and alcohol problem severity was assessed. A multiple regression analysis revealed that while the overall model was significant, only gambling problem severity accounted for delay discounting scores above and beyond cannabis and alcohol problem severity. The results support the hypothesis that delay discounting of hypothetical monetary rewards is more associated with gambling than other addictive behaviour problems, including substance use problems.     

Estimating the subjective value of future rewards: comparison of adjusting-amount and adjusting-delay procedures

The present study examined whether equivalent discounting of delayed rewards is observed with different experimental procedures. If the underlying decision-making process is the same, then similar patterns of results should be observed regardless of procedure, and similar estimates of the subjective value of future rewards (i.e., indifference points) should be obtained. Two experiments compared discounting on three types of procedure: adjusting-delay (AD), adjusting-immediate-amount (AIA), and adjusting-delayed-amount (ADA). For the two procedures for which discounting functions can be established (i.e., AD and AIA), a hyperboloid provided good fits to the data at both the group and individual levels, and individuals' discounting on one procedure tended to be correlated with their discounting on the other. Notably, the AIA procedure produced the more consistent estimates of the degree of discounting, and in particular, discounting on the AIA procedure was unaffected by the order in which choices were presented. Regardless of which of the three procedures was used, however, similar patterns of results were obtained: Participants systematically discounted the value of delayed rewards, and robust magnitude effects were observed. Although each procedure may have its own advantages and disadvantages, use of all three types of procedure in the present study provided converging evidence for common decision-making processes underlying the discounting of delayed rewards.     

Reduced sensitivity to immediate reward during decision-making in older than younger adults

We examined whether older adults differ from younger adults in the degree to which they favor immediate over delayed rewards during decision-making. To examine the neural correlates of age-related differences in delay discounting we acquired functional MR images while participants made decisions between smaller but sooner and larger but later monetary rewards. The behavioral results show age-related reductions in delay discounting. Less impulsive decision-making in older adults was associated with lower ventral striatal activations to immediate reward. Furthermore, older adults showed an overall higher percentage of delayed choices and reduced activity in the dorsal striatum than younger adults. This points to a reduced reward sensitivity of the dorsal striatum in older adults. Taken together, our findings indicate that less impulsive decision-making in older adults is due to a reduced sensitivity of striatal areas to reward. These age-related changes in reward sensitivity may result from transformations in dopaminergic neuromodulation with age.     

The combined effects of delay and probability in discounting

Human discounting studies have frequently observed hyperbolic discounting of rewards that are delayed or probabilistic. However, no studies have systematically combined delay and probability in a single discounting procedure. Indifference points of hypothetical money rewards that are both delayed and probabilistic were determined. Probabilities were converted into comparable delays according to the h/k constant of proportionality determined by , and discounting rates were calculated. These data provided a very good fit to the hyperbolic model of discounting, suggesting that delay and probability can be combined into a single metric in studies of discounting. The inclusion of a magnitude condition found the Magnitude Effect commonly found in studies of temporal discounting. A temporal resolution of uncertainty condition found no effect. The present paper offers a novel statistical method, within an established framework, for the analysis of data from studies of discounting that combine delay and probability.     

Parameters of delay discounting assessment: number of trials, effort, and sequential effects.

Procedural variants in estimating delay discounting (DD) have been shown to yield significant within-subject differences in estimated degree of delay discounting as well as variations in the patterns of choice. The purpose of this study was to evaluate the effect of subject control over the number of trials in a delay discounting task, on degree of delay discounting. Participants were assessed with two computerized DD assessments: the full-length method presented participants with a fixed set of 240 trials, and the abbreviated task, where once participants had shown indifference between the immediate and delayed rewards, the remaining trials for that delay value were omitted. While the full-length and abbreviated methods did not differentially affect patterns of choice or estimated delay discounting, the order of presentation (ascending or descending) of immediate rewards produced differences in each measure: rate of delay discounting was significantly lower when estimated with the descending sequence; a larger proportion of area under the discounting curve was concentrated around the indifference point trial with the descending sequence; and a lower correlation was observed between estimates obtained across methods with the descending sequence.     

Regional white matter volumes correlate with delay discounting

A preference for immediate gratification is a central feature in addictive processes. However, the neural structures underlying reward delay tolerance are still unclear. Healthy participants (n = 121) completed a delay discounting questionnaire assessing the extent to which they prefer smaller immediate rewards to larger delayed reward after undergoing magnetic resonance imaging (MRI) scanning. Whole brain voxel-based morphometric analysis shows that delay discounting severity was negatively correlated with right prefrontal subgyral white matter volume and positively correlated with white matter volume in parahippocampus/hippocampus, after whole brain correction. This study might better our understanding of the neural basis of impulsivity and addiction.     

Temporal discounting predicts risk sensitivity in rhesus macaques

Humans and animals tend both to avoid uncertainty and to prefer immediate over future rewards. The comorbidity of psychiatric disorders such as impulsivity, problem gambling, and addiction suggests that a common mechanism may underlie risk sensitivity and temporal discounting. Nonetheless, the precise relationship between these two traits remains largely unknown. To examine whether risk sensitivity and temporal discounting reflect a common process, we recorded choices made by two rhesus macaques in a visual gambling task while we varied the delay between trials. We found that preference for the risky option declined with increasing delay between sequential choices in the task, even when all other task parameters were held constant. These results were quantitatively predicted by a model that assumed that the subjective expected utility of the risky option is evaluated based on the expected time of the larger payoff. The importance of the larger payoff in this model suggests that the salience of larger payoffs played a critical role in determining the value of risky options. These data suggest that risk sensitivity may be a product of other cognitive processes, and specifically that myopia for the future and the salience of jackpots control the propensity to take a gamble.     

Impulsivity, risk taking, and timing

This study examined the relations among measures of impulsivity and timing. Impulsivity was assessed using delay and probability discounting, and self-report impulsivity (as measured by the Barratt Impulsiveness Scale; BIS-11). Timing was assessed using temporal perception as measured on a temporal bisection task and time perspective (as measured by the Zimbardo Time Perspective Inventory). One hundred and forty three college students completed these measures in a computer laboratory. The degree of delay discounting was positively correlated with the mean and range of the temporal bisection procedure. The degree of delay and probability discounting were also positively correlated. Self-reported motor impulsiveness on the BIS-11 was positively correlated with present hedonism and negatively correlated with future orientation on the ZTPI. Self-reported non-planning on the BIS-11 was positively correlated with fatalism on the ZTPI. These results show that people who overestimate the passage of time (perceive time as passing more quickly) hold less value in delayed rewards. They also confirm previous results regarding the relation between delay and probability discounting, as well as highlight similarities in self-report measures of impulsivity and time perspective.     

The Value of Emotion: How Does Episodic Prospection Modulate Delay Discounting?

Background

Humans often show impatience when making intertemporal choice for monetary rewards, preferring small rewards delivered immediately to larger rewards delivered after a delay, which reflects a fundamental psychological principle: delay discounting. However, we propose that episodic prospection humans can vividly envisage exerts a strong and broad influence on individuals'' delay discounting. Specifically, episodic prospection may affect individuals'' intertemporal choice by the negative or positive emotion of prospection.

Methodology/Principal Findings

The present study explored how episodic prospection modulated delay discounting by emotion. Study 1 showed that participants were more inclined to choose the delayed but larger rewards when they imaged positive future events than when they did not image events; Study 2 showed that participants were more inclined to choose the immediate but smaller rewards when they imaged negative future events than when they did not image events; In contrast, study 3 showed that choice preferences of participants when they imaged neutral future events were the same as when they did not image events.

Conclusions/Significance

By manipulating the emotion valence of episodic prospection, our findings suggested that positive emotion made individuals tend to choose delayed rewards, while negative emotion made individuals tend to choose immediate rewards. Only imaging events with neutral emotion did not affect individuals'' choice preference. Thus, the valence of imaged future events'' emotion might play an important role in individuals'' intertemporal choice. It is possible that the valence of emotion may affect the changed direction (promote or inhibit) of individuals'' delay discounting, while the ability to image future events affects the changed degree of individuals'' delay discounting.     

Pathological gambling severity is associated with impulsivity in a delay discounting procedure

Research and clinical expertise indicates that impulsivity is an underlying feature of pathological gambling. This study examined the extent to which impulsive behavior, defined by the rate of discounting delayed monetary rewards, varies with pathological gambling severity, assessed by the South Oaks Gambling Screen (SOGS). Sixty-two pathological gamblers completed a delay discounting task, the SOGS, the Eysenck impulsivity scale, the Addiction Severity Index (ASI), and questions about gambling and substance use at intake to outpatient treatment for pathological gambling. In the delay discounting task, participants chose between a large delayed reward (US $1000) and smaller more immediate rewards (US $1-$999) across a range of delays (6h to 25 years). The rate at which the delayed reward was discounted (k value) was derived for each participant and linear regression was used to identify the variables that predicted k values. Age, gender, years of education, substance abuse treatment history, and cigarette smoking history failed to significantly predict k values. Scores on the Eysenck impulsivity scale and the SOGS both accounted for a significant proportion of the variance in k values. The predictive value of the SOGS was 1.4 times that of the Eysenck scale. These results indicate that of the measures tested, gambling severity was the best single predictor of impulsive behavior in a delay discounting task in this sample of pathological gamblers.     

Delay and Probability Discounting of Sexual and Monetary Outcomes in Individuals with Cocaine Use Disorders and Matched Controls

Individuals with cocaine use disorders are disproportionately affected by HIV/AIDS, partly due to higher rates of unprotected sex. Recent research suggests delay discounting of condom use is a factor in sexual HIV risk. Delay discounting is a behavioral economic concept describing how delaying an event reduces that event’s value or impact on behavior. Probability discounting is a related concept describing how the uncertainty of an event decreases its impact on behavior. Individuals with cocaine use disorders (n = 23) and matched non-cocaine-using controls (n = 24) were compared in decision-making tasks involving hypothetical outcomes: delay discounting of condom-protected sex (Sexual Delay Discounting Task), delay discounting of money, the effect of sexually transmitted infection (STI) risk on likelihood of condom use (Sexual Probability Discounting Task), and probability discounting of money. The Cocaine group discounted delayed condom-protected sex (i.e., were more likely to have unprotected sex vs. wait for a condom) significantly more than controls in two of four Sexual Delay Discounting Task partner conditions. The Cocaine group also discounted delayed money (i.e., preferred smaller immediate amounts over larger delayed amounts) significantly more than controls. In the Sexual Probability Discounting Task, both groups showed sensitivity to STI risk, however the groups did not differ. The Cocaine group did not consistently discount probabilistic money more or less than controls. Steeper discounting of delayed, but not probabilistic, sexual outcomes may contribute to greater rates of sexual HIV risk among individuals with cocaine use disorders. Probability discounting of sexual outcomes may contribute to risk of unprotected sex in both groups. Correlations showed sexual and monetary results were unrelated, for both delay and probability discounting. The results highlight the importance of studying specific behavioral processes (e.g., delay and probability discounting) with respect to specific outcomes (e.g., monetary and sexual) to understand decision making in problematic behavior.     

Delay discounting and probability discounting as related to cigarette smoking status in adults

This study examined relations between adult smokers and non-smokers and the devaluation of monetary rewards as a function of delay (delay discounting, DD) or probability (probability discounting, PD). The extent to which individuals discount value, either as a function of a reward being delayed or probabilistic, has been taken to reflect individual differences in impulsivity. Those who discount most are considered most impulsive. Previous research has shown that adult smokers discount the value of delayed rewards more than adult non-smokers. However, in the one published study that examined probability discounting in adult smokers and non-smokers, the smokers did not discount the value of probabilistic rewards more than the non-smoker controls. From this past research, it was hypothesized that measures of delay discounting would differentiate between smokers and non-smokers but that probability discounting would not. Participants were 54 (25 female) adult smokers (n = 25) and non-smokers (n = 29). The smokers all reported smoking at least 20 cigarettes per day, and the non-smokers reported having never smoked. The results indicated that the smokers discounted significantly more than the non-smokers by both delay and probability. Unlike past findings, these results suggest that both delay and probability discounting are related to adult cigarette smoking; however, it also was determined that DD was a significantly stronger predictor of smoking than PD.     

Delay discounting and gambling

Delay discounting describes the decline in the value of a reinforcer as the delay to that reinforcer increases. A review of the available studies revealed that steep delay discounting is positively correlated with problem or pathological gambling. One hypothesis regarding this correlation derives from the discounting equation proposed by Mazur (1989). According to the equation, steeper discounting renders the difference between fixed-delayed rewards and gambling-like variable-delayed rewards larger; with the latter being more valuable. The present study was designed to test this prediction by first assessing rats’ impulsive choices across four delays to a larger-later reinforcer. A second condition quantified strength of preference for mixed- over fixed-delays, with the duration of the latter adjusted between sessions to achieve indifference. Strength of preference for the mixed-delay alternative is given by the fixed delay at indifference (lower fixed-delay values reflect stronger preferences). Percent impulsive choice was not correlated with the value of the fixed delay at indifference and, therefore, the prediction of the hyperbolic model of gambling was not supported. A follow-up assessment revealed a significant decrease in impulsive choice after the second condition. This shift in impulsive choice could underlie the failure to observe the predicted correlation between impulsive choice and degree of preference for mixed- over fixed delays.     

Single units in the pigeon brain integrate reward amount and time-to-reward in an impulsive choice task

BACKGROUND: Animals prefer small over large rewards when the delays preceding large rewards exceed an individual tolerance limit. Such impulsive choice behavior occurs even in situations in which alternative strategies would yield more optimal outcomes. Behavioral research has shown that an animal's choice is guided by the alternative rewards' subjective values, which are a function of reward amount and time-to-reward. Despite increasing knowledge about the pharmacology and anatomy underlying impulsivity, it is still unknown how the brain combines reward amount and time-to-reward information to represent subjective reward value. RESULTS: We trained pigeons to choose between small, immediate rewards and large rewards delivered after gradually increasing delays. Single-cell recordings in the avian Nidopallium caudolaterale, the presumed functional analog of the mammalian prefrontal cortex, revealed that neural delay activation decreased with increasing delay length but also covaried with the expected reward amount. This integrated neural response was modulated by reward amount and delay, as predicted by a hyperbolical equation, of subjective reward value derived from behavioral studies. Furthermore, the neural activation pattern reflected the current reward preference and the time point of the shift from large to small rewards. CONCLUSIONS: The reported activity was modulated by the temporal devaluation of the anticipated reward in addition to reward amount. Our findings contribute to the understanding of neuropathologies such as drug addiction, pathological gambling, frontal lobe syndrome, and attention-deficit disorders, which are characterized by inappropriate temporal discounting and increased impulsiveness.     

Associations between diurnal preference,impulsivity and substance use in a young-adult student sample

ABSTRACT

A diurnal preference for eveningness is common in young adulthood and previous research has associated eveningness with anxiety symptoms as well as increased smoking and alcohol use behaviors. There is some evidence that impulsivity might be an important explanatory variable in these associations, but this has not been comprehensively researched. Here we used both subjective and objective measures of impulsivity to characterize impulsive tendencies in young adults and investigated whether trait impulsivity or trait anxiety could mediate the link between eveningness and substance use. A total of 191 university students (169 females), age range 18–25 y, completed the study. Diurnal preference, sleep quality, anxiety, impulsivity, and substance use were assessed by questionnaire. Impulsivity was also measured using a delay discounting task. Eveningness correlated with trait anxiety and trait impulsivity, and these associations were still significant after controlling for sleep quality. On the delayed discounting task, eveningness correlated with a tendency to prefer smaller immediate rewards over delayed, larger ones. Evening types also reported higher levels of alcohol and cigarette use even after controlling for sleep quality. These associations were found to be completely mediated by self-reported impulsivity; anxiety did not contribute. The current results could help inform interventions aiming to reduce substance use in young adult populations.     

Delay discounting of real and hypothetical rewards III: steady-state assessments, forced-choice trials, and all real rewards

Human research in delay discounting has omitted several procedures typical of animal studies: forced-choice trials, consequences following each response, and assessment of stable response patterns. The present study manipulated these procedures across two conditions in which real or hypothetical rewards were arranged. Six college students participated in daily sessions, in which steady-state discounting of hypothetical and real rewards was assessed. No systematic effects of repeated exposure to hypothetical rewards was detected when compared with first day assessments of discounting. Likewise, no systematic effect of reward type (real versus hypothetical) was detected. When combined with previous research failing to detect a difference between hypothetical and potentially real rewards, these findings suggest that assessing discounting of hypothetical rewards in single sessions is a practical and valid procedure in the study of delay discounting.