Delay and Probability Discounting of Sexual and Monetary Outcomes in Individuals with Cocaine Use Disorders and Matched Controls

Individuals with cocaine use disorders are disproportionately affected by HIV/AIDS, partly due to higher rates of unprotected sex. Recent research suggests delay discounting of condom use is a factor in sexual HIV risk. Delay discounting is a behavioral economic concept describing how delaying an event reduces that event’s value or impact on behavior. Probability discounting is a related concept describing how the uncertainty of an event decreases its impact on behavior. Individuals with cocaine use disorders (n = 23) and matched non-cocaine-using controls (n = 24) were compared in decision-making tasks involving hypothetical outcomes: delay discounting of condom-protected sex (Sexual Delay Discounting Task), delay discounting of money, the effect of sexually transmitted infection (STI) risk on likelihood of condom use (Sexual Probability Discounting Task), and probability discounting of money. The Cocaine group discounted delayed condom-protected sex (i.e., were more likely to have unprotected sex vs. wait for a condom) significantly more than controls in two of four Sexual Delay Discounting Task partner conditions. The Cocaine group also discounted delayed money (i.e., preferred smaller immediate amounts over larger delayed amounts) significantly more than controls. In the Sexual Probability Discounting Task, both groups showed sensitivity to STI risk, however the groups did not differ. The Cocaine group did not consistently discount probabilistic money more or less than controls. Steeper discounting of delayed, but not probabilistic, sexual outcomes may contribute to greater rates of sexual HIV risk among individuals with cocaine use disorders. Probability discounting of sexual outcomes may contribute to risk of unprotected sex in both groups. Correlations showed sexual and monetary results were unrelated, for both delay and probability discounting. The results highlight the importance of studying specific behavioral processes (e.g., delay and probability discounting) with respect to specific outcomes (e.g., monetary and sexual) to understand decision making in problematic behavior.     

Discounting of delayed hypothetical money and food: effects of amount

Delay discounting research determines how the value of an outcome is affected by delay to its receipt. Research so far shows that consumable outcomes are discounted more steeply by delay than money. Prior studies, however, have used large amounts of the outcomes (e.g. 100 dollars worth) that would not typically be consumed in one bout, unlike the corresponding amount of money (e.g. 100 dollars ). This experiment examined whether small amounts of food would be discounted more steeply than money, as occurs with larger amounts. One hundred and two adults indicated their preferences in a series of choices for two hypothetical outcome types: immediate versus delayed food and immediate versus delayed money. Participants made choices involving either relatively small maximum amounts of food (10 dollars worth) and money (10 dollars) or for relatively large maximum amounts of food (100 dollars worth) and money (100 dollars ). In the within-subject comparisons, food was discounted more steeply by delay than money for both groups. In the between-subject comparisons, different amounts of the commodities were affected similarly by delay. Overall, these results suggest that steeper discounting of consumable outcomes than money is a fairly robust phenomenon, occurring with relatively small amounts of outcomes as well as with larger amounts.     

Delay discounting and probability discounting as related to cigarette smoking status in adults

This study examined relations between adult smokers and non-smokers and the devaluation of monetary rewards as a function of delay (delay discounting, DD) or probability (probability discounting, PD). The extent to which individuals discount value, either as a function of a reward being delayed or probabilistic, has been taken to reflect individual differences in impulsivity. Those who discount most are considered most impulsive. Previous research has shown that adult smokers discount the value of delayed rewards more than adult non-smokers. However, in the one published study that examined probability discounting in adult smokers and non-smokers, the smokers did not discount the value of probabilistic rewards more than the non-smoker controls. From this past research, it was hypothesized that measures of delay discounting would differentiate between smokers and non-smokers but that probability discounting would not. Participants were 54 (25 female) adult smokers (n = 25) and non-smokers (n = 29). The smokers all reported smoking at least 20 cigarettes per day, and the non-smokers reported having never smoked. The results indicated that the smokers discounted significantly more than the non-smokers by both delay and probability. Unlike past findings, these results suggest that both delay and probability discounting are related to adult cigarette smoking; however, it also was determined that DD was a significantly stronger predictor of smoking than PD.     

Delay and probability discounting as related to different stages of adolescent smoking and non-smoking

This study examined relations between different patterns of adolescent cigarette smoking and discounting of monetary rewards due to delay (delay discounting) and probabilistic uncertainty (probability discounting). The study also examined the relation between smoking and the number of peer friends who smoke and level of parent education. Participants were 55 adolescents (28 females) between 14 and 16 years of age who were categorized according to the following patterns of smoking behavior: "never smokers" (n=19; 10 females) who had not tried even one cigarette; "triers" (n=17; 9 females) who had recently tried cigarettes for the first time; and "current smokers" (n=19; 9 females) who smoked a minimum of one cigarette every week for at least 6 months prior to data collection. It was hypothesized that current smokers would discount more than those who had never smoked. No specific hypotheses were made for participants only trying cigarettes. Unexpectedly, results indicated no differences in discounting between the current smokers and never smokers. However, the trier group discounted probabilistic rewards significantly more than the never- and current-smoker groups. Also, triers and current smokers both reported having more friends who smoked than never smokers, and fathers of never smokers had significantly more education than fathers of either triers or current smokers. These results suggest that impulsive discounting may be more related to adolescents trying cigarettes than to their becoming regular smokers, whereas number of peer friends who smoke and parent level of education seem to differentiate between those who have smoked to some extent (triers and current smokers) and those who have not even tried cigarettes (never smokers).     

Percent body fat is related to delay and probability discounting for food in humans

This study describes delay and probability discounting patterns for hypothetical food and money in relation to percent body fat (PBF). Sixty university students completed four computerized discounting tasks in which they were asked to make a series of hypothetical decisions between (a) 10 dollars after one of several different delays (1, 2, 30, 180, and 365 days) or a smaller amount of money available immediately; (b) 10 bites of food after one of several delays (1, 2, 5, 10, and 20 h) or a smaller number of bites available immediately; (c) $10 at one of several probabilities (0.9, 0.75, 0.5, 0.25, 0.1) or a smaller amount of money to be received for sure; and (d) 10 bites of food at one of several probabilities (0.9, 0.75, 0.5, 0.25, 0.1) or a smaller number of bites to be received for sure. Median indifference points for all participants across each task were well described using the hyperbolic discounting function. Results suggest that percent body fat predicted discounting for hypothetical food, but not money, using regression analyses with the entire sample and when comparing individuals in the high and low quartiles for PBF. None of the other dietary variables (body mass index, subjective hunger, and time since last meal or snack) were related to discounting patterns. This suggests that individuals with high PBF may exhibit heightened sensitivities to delay and probability when making decisions about food.     

Discounting of delayed hypothetical money, alcohol, and food

For drug-dependent individuals, drugs of abuse that are delayed in time are discounted more steeply than money delayed in time in a hypothetical choice task. The reasons for this finding are not clear. This study examined whether steep discounting of drugs relative to money might be related to the function of drugs as primary/consumable reinforcers and money as a conditioned/non-consumable reinforcer. Twenty adults with no self-reported problems with money, alcohol, or food participated. They indicated their preferences for three hypothetical outcome types: delayed versus immediate money, delayed versus immediate food, and delayed versus immediate alcohol. Both the hyperbolic decay model and area under the curve analysis showed that money was discounted less steeply than alcohol or food, but that alcohol and food were discounted similarly. This finding replicates previous results showing that people without drug abuse problems show steep discounting of alcohol. Furthermore, this finding suggests that alcohol may be steeply discounted as part of a general process involving primary/consumable reinforcers, not necessarily because it is a drug.     

Domain independence and stability in young and older adults' discounting of delayed rewards

Individual discounting rates for different types of delayed reward are typically assumed to reflect a single, underlying trait of impulsivity. Recently, we showed that discounting rates are orders of magnitude steeper for directly consumable liquid rewards than for monetary rewards (Jimura et al., 2009), raising the question of whether discounting rates for different types of reward covary at the individual level. Accordingly, the present study examined the relation between discounting of hypothetical money and real liquid rewards in young adults (Experiment 1) and older adults (Experiment 2). At the group level, young adults discounted monetary rewards more steeply than the older adults, but there was no significant age difference with respect to liquid rewards. At the individual level, the rates at which young and older participants discounted each reward type were stable over a two- to fifteen-week interval (rs > 70), but there was no significant correlation between the rates at which they discounted the two reward types. These results suggest that although similar decision-making processes may underlie the discounting of different types of rewards, the rates at which individuals discount money and directly consumable rewards may reflect separate, stable traits, rather than a single trait of impulsivity.     

Probability and delay discounting of hypothetical sexual outcomes

The present study used the discounting procedure to characterize choice behaviors regarding hypothetical sexual outcomes. Eighty-six adult undergraduate students completed computerized delay and probability discounting tasks concerning hypothetical money and hypothetical sexual activity. Consistent with other discounting findings, hyperbolic and hyperbola-like decay models described individual and group median indifference point data well. These findings contribute to a growing literature on the relevance of the discounting procedure to decision-making processes and suggest that the discounting procedure may be useful for understanding the processes that underlie social problem behaviors associated with impulsive sexual decisions.     

Delay discounting of saccharin in rhesus monkeys

The value of a reinforcer decreases as the time until its receipt increases, a phenomenon referred to as delay discounting. Although delay discounting of non-drug reinforcers has been studied extensively in a number of species, our knowledge of discounting in non-human primates is limited. In the present study, rhesus monkeys were allowed to choose in discrete trials between 0.05% saccharin delivered in different amounts and with different delays. Indifference points were calculated and discounting functions were established. Discounting functions for saccharin were well described by a hyperbolic function. Moreover, the discounting rates for saccharin in all six monkeys were comparable to those of other non-human animals responding for non-drug reinforcers. Also consistent with other studies of non-human animals, changing the amount of a saccharin reinforcer available after a 10-s delay did not affect its relative subjective value. Discounting functions for saccharin were steeper than we found in a previous study with cocaine, raising the possibility that drugs such as cocaine may be discounted less steeply than non-drug reinforcers.     

The subjective value of delayed and probabilistic outcomes: Outcome size matters for gains but not for losses

The subjective value of a reward (gain) is related to factors such as its size, the delay to its receipt and the probability of its receipt. We examined whether the subjective value of losses was similarly affected by these factors in 128 adults. Participants chose between immediate/certain gains or losses and larger delayed/probabilistic gains or losses. Rewards of $100 were devalued as a function of their delay (“discounted”) relatively less than $10 gains while probabilistic $100 rewards were discounted relatively more than $10 rewards. However, there was no effect of outcome size on discounting of delayed or probabilistic losses. For delayed outcomes of each size, the degree to which gains were discounted was positively correlated with the degree to which losses were discounted, whereas for probabilistic outcomes, no such correlation was observed. These results suggest that the processes underlying the subjective valuation of losses are different from those underlying the subjective valuation of gains.     

Dopaminergic Lesions of the Dorsolateral Striatum in Rats Increase Delay Discounting in an Impulsive Choice Task

Dysregulated dopamine transmission in striatal circuitry is associated with impulsivity. The current study evaluated the influence of dopaminergic inputs to the dorsolateral striatum on impulsive choice, one aspect of impulsive behavior. We implemented an operant task that measures impulsive choice in rats via delay discounting wherein intracranial self-stimulation (ICSS) was used as the positive reinforcer. To do so, rats were anesthetized to allow implanting of a stimulating electrode within the lateral hypothalamus of one hemisphere and bilateral dorsal striatal injections of the dopaminergic toxin, 6-OHDA (lesioned) or its vehicle (sham). Following recovery, rats were trained in a delay discounting task wherein they selected between a small ICSS current presented immediately after lever pressing, and a large ICSS current presented following a 0 to 15s delay upon pressing the alternate lever. Task acquisition and reinforcer discrimination were similar for lesioned and sham rats. All rats exhibited an initial preference for the large reinforcer, and as the delay was increased, preference for the large reinforcer was decreased indicating that the subjective value of the large reinforcer was discounted as a function of delay time. However, this discounting effect was significantly enhanced in lesioned rats for the longer delays. These data reveal a contribution of dopaminergic inputs to the dorsolateral striatum on impulsive choice behavior, and provide new insights into neural substrates underlying discounting behaviors.     

Pathological gambling severity is associated with impulsivity in a delay discounting procedure

Research and clinical expertise indicates that impulsivity is an underlying feature of pathological gambling. This study examined the extent to which impulsive behavior, defined by the rate of discounting delayed monetary rewards, varies with pathological gambling severity, assessed by the South Oaks Gambling Screen (SOGS). Sixty-two pathological gamblers completed a delay discounting task, the SOGS, the Eysenck impulsivity scale, the Addiction Severity Index (ASI), and questions about gambling and substance use at intake to outpatient treatment for pathological gambling. In the delay discounting task, participants chose between a large delayed reward (US $1000) and smaller more immediate rewards (US $1-$999) across a range of delays (6h to 25 years). The rate at which the delayed reward was discounted (k value) was derived for each participant and linear regression was used to identify the variables that predicted k values. Age, gender, years of education, substance abuse treatment history, and cigarette smoking history failed to significantly predict k values. Scores on the Eysenck impulsivity scale and the SOGS both accounted for a significant proportion of the variance in k values. The predictive value of the SOGS was 1.4 times that of the Eysenck scale. These results indicate that of the measures tested, gambling severity was the best single predictor of impulsive behavior in a delay discounting task in this sample of pathological gamblers.     

The evolution of social discounting in hierarchically clustered populations

The expression of a social behaviour may affect the fitness of actors and recipients living in the present and in the future of the population. When there is a risk that a future reward will not be experienced in such a context, the value of that reward should be discounted; but by how much? Here, we evaluate social discount rates for delayed fitness rewards to group of recipients living at different positions in both space and time than the actor in a hierarchically clustered population. This is a population where individuals are grouped into families, families into villages, villages into clans, and so on, possibly ad infinitum. The group-wide fitness effects are assumed to either increase or decrease the fecundity or the survival of recipients and can be arbitrarily extended in space and time. We find that actions changing the survival of individuals living in the future are generally more strongly discounted than fecundity-changing actions for all future times and that the value of future rewards increases as individuals live longer. We also find that delayed fitness effects may not only be discounted by a constant factor per unit delay (exponential discounting), but that, as soon as there is localized dispersal in a population, discounting per unit delay is likely to fall rapidly for small delays and then slowly for longer delays (hyperbolic discounting). As dispersal tends to be localized in natural populations, our results suggest that evolution is likely to favour individuals that express present-biased behaviours and that may be time-inconsistent with respect to their group-wide effects.     

Temporal discounting and heart rate reactivity to stress

Temporal discounting is the reduction of the value of a reinforcer as a function of increasing delay to its presentation. Impulsive individuals discount delayed consequences more rapidly than self-controlled individuals, and impulsivity has been related to substance abuse, gambling, and other problem behaviors. A growing body of literature has identified biological correlates of impulsivity, though little research to date has examined relations between delay discounting and markers of poor health (e.g., cardiovascular reactivity to stress). We evaluated the relation between one aspect of impulsivity, measured using a computerized temporal discounting task, and heart rate reactivity, measured as a change in heart rate from rest during a serial subtraction task. A linear regression showed that individuals who were more reactive to stress responded more impulsively (i.e., discounted delayed reinforcers more rapidly). When results were stratified by gender, the effect was observed for females, but not for males. This finding supports previous research on gender differences in cardiovascular reactivity and suggests that this type of reactivity may be an important correlate of impulsive behavior.     

Rats bred for high alcohol drinking are more sensitive to delayed and probabilistic outcomes

Alcoholics and heavy drinkers score higher on measures of impulsivity than nonalcoholics and light drinkers. This may be because of factors that predate drug exposure (e.g. genetics). This study examined the role of genetics by comparing impulsivity measures in ethanol-naive rats selectively bred based on their high [high alcohol drinking (HAD)] or low [low alcohol drinking (LAD)] consumption of ethanol. Replicates 1 and 2 of the HAD and LAD rats, developed by the University of Indiana Alcohol Research Center, completed two different discounting tasks. Delay discounting examines sensitivity to rewards that are delayed in time and is commonly used to assess 'choice' impulsivity. Probability discounting examines sensitivity to the uncertain delivery of rewards and has been used to assess risk taking and risk assessment. High alcohol drinking rats discounted delayed and probabilistic rewards more steeply than LAD rats. Discount rates associated with probabilistic and delayed rewards were weakly correlated, while bias was strongly correlated with discount rate in both delay and probability discounting. The results suggest that selective breeding for high alcohol consumption selects for animals that are more sensitive to delayed and probabilistic outcomes. Sensitivity to delayed or probabilistic outcomes may be predictive of future drinking in genetically predisposed individuals.     

Making Time for Nature: Visual Exposure to Natural Environments Lengthens Subjective Time Perception and Reduces Impulsivity

Impulsivity in delay discounting is associated with maladaptive behaviors such as overeating and drug and alcohol abuse. Researchers have recently noted that delay discounting, even when measured by a brief laboratory task, may be the best predictor of human health related behaviors (e.g., exercise) currently available. Identifying techniques to decrease impulsivity in delay discounting, therefore, could help improve decision-making on a global scale. Visual exposure to natural environments is one recent approach shown to decrease impulsive decision-making in a delay discounting task, although the mechanism driving this result is currently unknown. The present experiment was thus designed to evaluate not only whether visual exposure to natural (mountains, lakes) relative to built (buildings, cities) environments resulted in less impulsivity, but also whether this exposure influenced time perception. Participants were randomly assigned to either a natural environment condition or a built environment condition. Participants viewed photographs of either natural scenes or built scenes before and during a delay discounting task in which they made choices about receiving immediate or delayed hypothetical monetary outcomes. Participants also completed an interval bisection task in which natural or built stimuli were judged as relatively longer or shorter presentation durations. Following the delay discounting and interval bisection tasks, additional measures of time perception were administered, including how many minutes participants thought had passed during the session and a scale measurement of whether time "flew" or "dragged" during the session. Participants exposed to natural as opposed to built scenes were less impulsive and also reported longer subjective session times, although no differences across groups were revealed with the interval bisection task. These results are the first to suggest that decreased impulsivity from exposure to natural as opposed to built environments may be related to lengthened time perception.     

Effects of reinforcer magnitude on an animal model of impulsive behavior

The effects of altering sucrose solution concentration on discounting of delayed rewards in rats were examined. Five different delays were used (0, 1, 2, 4, and 8s) and three different sucrose solution concentrations (3, 10, and 30%). It was hypothesized that high value sucrose solution concentrations would be discounted less than low value sucrose solution concentrations. The results indicated that the rats discounted the 30% sucrose solution concentration at a higher rate than the 3 or 10% sucrose solution concentration, a finding that apparently contradicted the hypothesis that higher value sucrose solution concentrations would be discounted less than lower value sucrose solution concentrations. However, a follow up experiment indicated that the 3 and 10% sucrose solution concentrations were preferred over the 30% concentration. Thus the results of Experiment 1 can be interpreted as supporting the hypothesis that high valued sucrose solution concentrations are discounted less than lower valued sucrose solution concentrations.     

The combined effects of delay and probability in discounting

Human discounting studies have frequently observed hyperbolic discounting of rewards that are delayed or probabilistic. However, no studies have systematically combined delay and probability in a single discounting procedure. Indifference points of hypothetical money rewards that are both delayed and probabilistic were determined. Probabilities were converted into comparable delays according to the h/k constant of proportionality determined by , and discounting rates were calculated. These data provided a very good fit to the hyperbolic model of discounting, suggesting that delay and probability can be combined into a single metric in studies of discounting. The inclusion of a magnitude condition found the Magnitude Effect commonly found in studies of temporal discounting. A temporal resolution of uncertainty condition found no effect. The present paper offers a novel statistical method, within an established framework, for the analysis of data from studies of discounting that combine delay and probability.     

Using crowdsourcing to examine relations between delay and probability discounting

Although the extensive lines of research on delay and/or probability discounting have greatly expanded our understanding of human decision-making processes, the relation between these two phenomena remains unclear. For example, some studies have reported robust associations between delay and probability discounting, whereas others have failed to demonstrate a consistent relation between the two. The current study sought to clarify this relation by examining the relation between delay and probability discounting in a large sample of internet users (n = 904) using the Amazon Mechanical Turk (AMT) crowdsourcing service. Because AMT is a novel data collection platform, the findings were validated through the replication of a number of previously established relations (e.g., relations between delay discounting and cigarette smoking status). A small but highly significant positive correlation between delay and probability discounting rates was obtained, and principal component analysis suggested that two (rather than one) components were preferable to account for the variance in both delay and probability discounting. Taken together, these findings suggest that delay and probability discounting may be related, but are not manifestations of a single construct (e.g., impulsivity).