Insulin,Central Dopamine D2 Receptors,and Monetary Reward Discounting in Obesity

Animal research finds that insulin regulates dopamine signaling and reward behavior, but similar research in humans is lacking. We investigated whether individual differences in body mass index, percent body fat, pancreatic β-cell function, and dopamine D2 receptor binding were related to reward discounting in obese and non-obese adult men and women. Obese (n = 27; body mass index>30) and non-obese (n = 20; body mass index<30) adults were assessed for percent body fat with dual-energy X-ray absorptiometry and for β-cell function using disposition index. Choice of larger, but delayed or less certain, monetary rewards relative to immediate, certain smaller monetary rewards was measured using delayed and probabilistic reward discounting tasks. Positron emission tomography using a non-displaceable D2-specific radioligand, [¹¹C](N-methyl)benperidol quantified striatal D2 receptor binding. Groups differed in body mass index, percent body fat, and disposition index, but not in striatal D2 receptor specific binding or reward discounting. Higher percent body fat in non-obese women related to preference for a smaller, certain reward over a larger, less likely one (greater probabilistic discounting). Lower β-cell function in the total sample and lower insulin sensitivity in obese related to stronger preference for an immediate and smaller monetary reward over delayed receipt of a larger one (greater delay discounting). In obese adults, higher striatal D2 receptor binding related to greater delay discounting. Interestingly, striatal D2 receptor binding was not significantly related to body mass index, percent body fat, or β-cell function in either group. Our findings indicate that individual differences in percent body fat, β-cell function, and striatal D2 receptor binding may each contribute to altered reward discounting behavior in non-obese and obese individuals. These results raise interesting questions about whether and how striatal D2 receptor binding and metabolic factors, including β-cell function, interact to affect reward discounting in humans.     

Domain independence and stability in young and older adults' discounting of delayed rewards

Individual discounting rates for different types of delayed reward are typically assumed to reflect a single, underlying trait of impulsivity. Recently, we showed that discounting rates are orders of magnitude steeper for directly consumable liquid rewards than for monetary rewards (Jimura et al., 2009), raising the question of whether discounting rates for different types of reward covary at the individual level. Accordingly, the present study examined the relation between discounting of hypothetical money and real liquid rewards in young adults (Experiment 1) and older adults (Experiment 2). At the group level, young adults discounted monetary rewards more steeply than the older adults, but there was no significant age difference with respect to liquid rewards. At the individual level, the rates at which young and older participants discounted each reward type were stable over a two- to fifteen-week interval (rs > 70), but there was no significant correlation between the rates at which they discounted the two reward types. These results suggest that although similar decision-making processes may underlie the discounting of different types of rewards, the rates at which individuals discount money and directly consumable rewards may reflect separate, stable traits, rather than a single trait of impulsivity.     

Pathological gambling severity is associated with impulsivity in a delay discounting procedure

Research and clinical expertise indicates that impulsivity is an underlying feature of pathological gambling. This study examined the extent to which impulsive behavior, defined by the rate of discounting delayed monetary rewards, varies with pathological gambling severity, assessed by the South Oaks Gambling Screen (SOGS). Sixty-two pathological gamblers completed a delay discounting task, the SOGS, the Eysenck impulsivity scale, the Addiction Severity Index (ASI), and questions about gambling and substance use at intake to outpatient treatment for pathological gambling. In the delay discounting task, participants chose between a large delayed reward (US $1000) and smaller more immediate rewards (US $1-$999) across a range of delays (6h to 25 years). The rate at which the delayed reward was discounted (k value) was derived for each participant and linear regression was used to identify the variables that predicted k values. Age, gender, years of education, substance abuse treatment history, and cigarette smoking history failed to significantly predict k values. Scores on the Eysenck impulsivity scale and the SOGS both accounted for a significant proportion of the variance in k values. The predictive value of the SOGS was 1.4 times that of the Eysenck scale. These results indicate that of the measures tested, gambling severity was the best single predictor of impulsive behavior in a delay discounting task in this sample of pathological gamblers.     

Neural Sensitivity to Absolute and Relative Anticipated Reward in Adolescents

Adolescence is associated with a dramatic increase in risky and impulsive behaviors that have been attributed to developmental differences in neural processing of rewards. In the present study, we sought to identify age differences in anticipation of absolute and relative rewards. To do so, we modified a commonly used monetary incentive delay (MID) task in order to examine brain activity to relative anticipated reward value (neural sensitivity to the value of a reward as a function of other available rewards). This design also made it possible to examine developmental differences in brain activation to absolute anticipated reward magnitude (the degree to which neural activity increases with increasing reward magnitude). While undergoing fMRI, 18 adolescents and 18 adult participants were presented with cues associated with different reward magnitudes. After the cue, participants responded to a target to win money on that trial. Presentation of cues was blocked such that two reward cues associated with $.20, $1.00, or $5.00 were in play on a given block. Thus, the relative value of the $1.00 reward varied depending on whether it was paired with a smaller or larger reward. Reflecting age differences in neural responses to relative anticipated reward (i.e., reference dependent processing), adults, but not adolescents, demonstrated greater activity to a $1 reward when it was the larger of the two available rewards. Adults also demonstrated a more linear increase in ventral striatal activity as a function of increasing absolute reward magnitude compared to adolescents. Additionally, reduced ventral striatal sensitivity to absolute anticipated reward (i.e., the difference in activity to medium versus small rewards) correlated with higher levels of trait Impulsivity. Thus, ventral striatal activity in anticipation of absolute and relative rewards develops with age. Absolute reward processing is also linked to individual differences in Impulsivity.     

Dopaminergic Lesions of the Dorsolateral Striatum in Rats Increase Delay Discounting in an Impulsive Choice Task

Dysregulated dopamine transmission in striatal circuitry is associated with impulsivity. The current study evaluated the influence of dopaminergic inputs to the dorsolateral striatum on impulsive choice, one aspect of impulsive behavior. We implemented an operant task that measures impulsive choice in rats via delay discounting wherein intracranial self-stimulation (ICSS) was used as the positive reinforcer. To do so, rats were anesthetized to allow implanting of a stimulating electrode within the lateral hypothalamus of one hemisphere and bilateral dorsal striatal injections of the dopaminergic toxin, 6-OHDA (lesioned) or its vehicle (sham). Following recovery, rats were trained in a delay discounting task wherein they selected between a small ICSS current presented immediately after lever pressing, and a large ICSS current presented following a 0 to 15s delay upon pressing the alternate lever. Task acquisition and reinforcer discrimination were similar for lesioned and sham rats. All rats exhibited an initial preference for the large reinforcer, and as the delay was increased, preference for the large reinforcer was decreased indicating that the subjective value of the large reinforcer was discounted as a function of delay time. However, this discounting effect was significantly enhanced in lesioned rats for the longer delays. These data reveal a contribution of dopaminergic inputs to the dorsolateral striatum on impulsive choice behavior, and provide new insights into neural substrates underlying discounting behaviors.     

The Nature of Impulsivity: Visual Exposure to Natural Environments Decreases Impulsive Decision-Making in a Delay Discounting Task

The benefits of visual exposure to natural environments for human well-being in areas of stress reduction, mood improvement, and attention restoration are well documented, but the effects of natural environments on impulsive decision-making remain unknown. Impulsive decision-making in delay discounting offers generality, predictive validity, and insight into decision-making related to unhealthy behaviors. The present experiment evaluated differences in such decision-making in humans experiencing visual exposure to one of the following conditions: natural (e.g., mountains), built (e.g., buildings), or control (e.g., triangles) using a delay discounting task that required participants to choose between immediate and delayed hypothetical monetary outcomes. Participants viewed the images before and during the delay discounting task. Participants were less impulsive in the condition providing visual exposure to natural scenes compared to built and geometric scenes. Results suggest that exposure to natural environments results in decreased impulsive decision-making relative to built environments.     

Regional white matter volumes correlate with delay discounting

A preference for immediate gratification is a central feature in addictive processes. However, the neural structures underlying reward delay tolerance are still unclear. Healthy participants (n = 121) completed a delay discounting questionnaire assessing the extent to which they prefer smaller immediate rewards to larger delayed reward after undergoing magnetic resonance imaging (MRI) scanning. Whole brain voxel-based morphometric analysis shows that delay discounting severity was negatively correlated with right prefrontal subgyral white matter volume and positively correlated with white matter volume in parahippocampus/hippocampus, after whole brain correction. This study might better our understanding of the neural basis of impulsivity and addiction.     

Single units in the pigeon brain integrate reward amount and time-to-reward in an impulsive choice task

BACKGROUND: Animals prefer small over large rewards when the delays preceding large rewards exceed an individual tolerance limit. Such impulsive choice behavior occurs even in situations in which alternative strategies would yield more optimal outcomes. Behavioral research has shown that an animal's choice is guided by the alternative rewards' subjective values, which are a function of reward amount and time-to-reward. Despite increasing knowledge about the pharmacology and anatomy underlying impulsivity, it is still unknown how the brain combines reward amount and time-to-reward information to represent subjective reward value. RESULTS: We trained pigeons to choose between small, immediate rewards and large rewards delivered after gradually increasing delays. Single-cell recordings in the avian Nidopallium caudolaterale, the presumed functional analog of the mammalian prefrontal cortex, revealed that neural delay activation decreased with increasing delay length but also covaried with the expected reward amount. This integrated neural response was modulated by reward amount and delay, as predicted by a hyperbolical equation, of subjective reward value derived from behavioral studies. Furthermore, the neural activation pattern reflected the current reward preference and the time point of the shift from large to small rewards. CONCLUSIONS: The reported activity was modulated by the temporal devaluation of the anticipated reward in addition to reward amount. Our findings contribute to the understanding of neuropathologies such as drug addiction, pathological gambling, frontal lobe syndrome, and attention-deficit disorders, which are characterized by inappropriate temporal discounting and increased impulsiveness.     

Will travel for food: spatial discounting in two new world monkeys

Nonhuman animals steeply discount the future, showing a preference for small, immediate over large, delayed rewards. Currently unclear is whether discounting functions depend on context. Here, we examine the effects of spatial context on discounting in cotton-top tamarins (Saguinus oedipus) and common marmosets (Callithrix jacchus), species known to differ in temporal discounting. We presented subjects with a choice between small, nearby rewards and large, distant rewards. Tamarins traveled farther for the large reward than marmosets, attending to the ratio of reward differences rather than their absolute values. This species difference contrasts with performance on a temporal task in which marmosets waited longer than tamarins for the large reward. These comparative data indicate that context influences choice behavior, with the strongest effect seen in marmosets who discounted more steeply over space than over time. These findings parallel details of each species' feeding ecology. Tamarins range over large distances and feed primarily on insects, which requires using quick, impulsive action. Marmosets range over shorter distances than tamarins and feed primarily on tree exudates, a clumped resource that requires patience to wait for sap to exude. These results show that discounting functions are context specific, shaped by a history of ecological pressures.     

Delay discounting and probability discounting as related to cigarette smoking status in adults

This study examined relations between adult smokers and non-smokers and the devaluation of monetary rewards as a function of delay (delay discounting, DD) or probability (probability discounting, PD). The extent to which individuals discount value, either as a function of a reward being delayed or probabilistic, has been taken to reflect individual differences in impulsivity. Those who discount most are considered most impulsive. Previous research has shown that adult smokers discount the value of delayed rewards more than adult non-smokers. However, in the one published study that examined probability discounting in adult smokers and non-smokers, the smokers did not discount the value of probabilistic rewards more than the non-smoker controls. From this past research, it was hypothesized that measures of delay discounting would differentiate between smokers and non-smokers but that probability discounting would not. Participants were 54 (25 female) adult smokers (n = 25) and non-smokers (n = 29). The smokers all reported smoking at least 20 cigarettes per day, and the non-smokers reported having never smoked. The results indicated that the smokers discounted significantly more than the non-smokers by both delay and probability. Unlike past findings, these results suggest that both delay and probability discounting are related to adult cigarette smoking; however, it also was determined that DD was a significantly stronger predictor of smoking than PD.     

Discounting of sequences of delayed rewards of different amounts

The main purpose of this study was to determine whether the magnitude effect is present in cases where delayed sequences of rewards are discounted. The magnitude effect refers to the inverse relationship between the amount of a reward and the steepness of temporal discounting. This study was conducted with a computer program to estimate the indifference points, which served as indicators of the present subjective value of delayed sequences of small and large rewards. In the indifference point the subjective value of a single, immediate reward was equal to the subjective value of the delayed sequence (or to the value of a single delayed reward). As a control condition, we added an experimental task involving choices between single immediate and single delayed rewards. The experiment showed that the sequences of large rewards are discounted less steeply than are the sequences of small rewards. This finding suggests that the magnitude effect is present within the delayed sequences of rewards. In addition, when outcomes are relatively large, the results suggest that a single reward is discounted less steeply than the sequence of a total nominal value equal to this single reward. However, for relatively small rewards, the difference is not statistically significant. The less steep discounting of sequences of large rewards may explain the reward-bundling effect, which refers to less steep discounting of longer sequences than of shorter ones: longer sequences usually have greater overall nominal value. The present study was conducted on hypothetical rewards, and the results should be validated using real rewards.     

Heterogeneous coding of temporally discounted values in the dorsal and ventral striatum during intertemporal choice

In choosing between different rewards expected after unequal delays, humans and animals often prefer the smaller but more immediate reward, indicating that the subjective value or utility of reward is depreciated according to its delay. Here, we show that neurons in the primate caudate nucleus and ventral striatum modulate their activity according to temporally discounted values of rewards with a similar time course. However, neurons in the caudate nucleus encoded the difference in the temporally discounted values of the two alternative targets more reliably than neurons in the ventral striatum. In contrast, neurons in the ventral striatum largely encoded the sum of the temporally discounted values, and therefore, the overall goodness of available options. These results suggest a more pivotal role for the dorsal striatum in action selection during intertemporal choice.     

The subjective value of delayed and probabilistic outcomes: Outcome size matters for gains but not for losses

The subjective value of a reward (gain) is related to factors such as its size, the delay to its receipt and the probability of its receipt. We examined whether the subjective value of losses was similarly affected by these factors in 128 adults. Participants chose between immediate/certain gains or losses and larger delayed/probabilistic gains or losses. Rewards of $100 were devalued as a function of their delay (“discounted”) relatively less than $10 gains while probabilistic $100 rewards were discounted relatively more than $10 rewards. However, there was no effect of outcome size on discounting of delayed or probabilistic losses. For delayed outcomes of each size, the degree to which gains were discounted was positively correlated with the degree to which losses were discounted, whereas for probabilistic outcomes, no such correlation was observed. These results suggest that the processes underlying the subjective valuation of losses are different from those underlying the subjective valuation of gains.     

Humans can adopt optimal discounting strategy under real-time constraints

Critical to our many daily choices between larger delayed rewards, and smaller more immediate rewards, are the shape and the steepness of the function that discounts rewards with time. Although research in artificial intelligence favors exponential discounting in uncertain environments, studies with humans and animals have consistently shown hyperbolic discounting. We investigated how humans perform in a reward decision task with temporal constraints, in which each choice affects the time remaining for later trials, and in which the delays vary at each trial. We demonstrated that most of our subjects adopted exponential discounting in this experiment. Further, we confirmed analytically that exponential discounting, with a decay rate comparable to that used by our subjects, maximized the total reward gain in our task. Our results suggest that the particular shape and steepness of temporal discounting is determined by the task that the subject is facing, and question the notion of hyperbolic reward discounting as a universal principle.     

The neural basis of cultural differences in delay discounting

People generally prefer to receive rewarding outcomes sooner rather than later. Such preferences result from delay discounting, or the process by which outcomes are devalued for the expected delay until their receipt. We investigated cultural differences in delay discounting by contrasting behaviour and brain activity in separate cohorts of Western (American) and Eastern (Korean) subjects. Consistent with previous reports, we find a dramatic difference in discounting behaviour, with Americans displaying much greater present bias and elevated discount rates. Recent neuroimaging findings suggest that differences in discounting may arise from differential involvement of either brain reward areas or regions in the prefrontal and parietal cortices associated with cognitive control. We find that the ventral striatum is more greatly recruited in Americans relative to Koreans when discounting future rewards, but there is no difference in prefrontal or parietal activity. This suggests that a cultural difference in emotional responsivity underlies the observed behavioural effect. We discuss the implications of this research for strategic interrelations between Easterners and Westerners.     

Making Time for Nature: Visual Exposure to Natural Environments Lengthens Subjective Time Perception and Reduces Impulsivity

Impulsivity in delay discounting is associated with maladaptive behaviors such as overeating and drug and alcohol abuse. Researchers have recently noted that delay discounting, even when measured by a brief laboratory task, may be the best predictor of human health related behaviors (e.g., exercise) currently available. Identifying techniques to decrease impulsivity in delay discounting, therefore, could help improve decision-making on a global scale. Visual exposure to natural environments is one recent approach shown to decrease impulsive decision-making in a delay discounting task, although the mechanism driving this result is currently unknown. The present experiment was thus designed to evaluate not only whether visual exposure to natural (mountains, lakes) relative to built (buildings, cities) environments resulted in less impulsivity, but also whether this exposure influenced time perception. Participants were randomly assigned to either a natural environment condition or a built environment condition. Participants viewed photographs of either natural scenes or built scenes before and during a delay discounting task in which they made choices about receiving immediate or delayed hypothetical monetary outcomes. Participants also completed an interval bisection task in which natural or built stimuli were judged as relatively longer or shorter presentation durations. Following the delay discounting and interval bisection tasks, additional measures of time perception were administered, including how many minutes participants thought had passed during the session and a scale measurement of whether time "flew" or "dragged" during the session. Participants exposed to natural as opposed to built scenes were less impulsive and also reported longer subjective session times, although no differences across groups were revealed with the interval bisection task. These results are the first to suggest that decreased impulsivity from exposure to natural as opposed to built environments may be related to lengthened time perception.     

The discounting-by-interruptions hypothesis: model and experiment

Experimental animals often prefer small but immediate rewardseven when larger-delayed rewards provide a higher rate of intake.This impulsivity has important implications for models of foragingand cooperation. Behavioral ecologists have hypothesized thatanimals discount delayed rewards because delay imposes a collectionrisk. According to this long-standing hypothesis, delay reducesvalue because an interruption that occurs while an animal iswaiting may prevent it from collecting the delayed reward. Althoughthere have been many experimental demonstrations of animal preferencesfor immediacy, none have included any interruptions. This paperdevelops a simple model of discounting by interruptions andthen tests this model experimentally. The model considers theeffects of interruption rate and duration on choice behavior.The experiment tests the effects of interruptions on the choicebehavior of captive blue jays (Cyanocitta cristata) using afactorial design that manipulates the rate and duration of interruptions.The results do not support the discounting-by-interruptionshypothesis. This represents one of several lines of evidencesuggesting that investigators should seek alternative explanationsof the animal impulsivity.     

The Value of Emotion: How Does Episodic Prospection Modulate Delay Discounting?

Background

Humans often show impatience when making intertemporal choice for monetary rewards, preferring small rewards delivered immediately to larger rewards delivered after a delay, which reflects a fundamental psychological principle: delay discounting. However, we propose that episodic prospection humans can vividly envisage exerts a strong and broad influence on individuals'' delay discounting. Specifically, episodic prospection may affect individuals'' intertemporal choice by the negative or positive emotion of prospection.

Methodology/Principal Findings

The present study explored how episodic prospection modulated delay discounting by emotion. Study 1 showed that participants were more inclined to choose the delayed but larger rewards when they imaged positive future events than when they did not image events; Study 2 showed that participants were more inclined to choose the immediate but smaller rewards when they imaged negative future events than when they did not image events; In contrast, study 3 showed that choice preferences of participants when they imaged neutral future events were the same as when they did not image events.

Conclusions/Significance

By manipulating the emotion valence of episodic prospection, our findings suggested that positive emotion made individuals tend to choose delayed rewards, while negative emotion made individuals tend to choose immediate rewards. Only imaging events with neutral emotion did not affect individuals'' choice preference. Thus, the valence of imaged future events'' emotion might play an important role in individuals'' intertemporal choice. It is possible that the valence of emotion may affect the changed direction (promote or inhibit) of individuals'' delay discounting, while the ability to image future events affects the changed degree of individuals'' delay discounting.     

Strain differences in delay discounting using inbred rats

A heightened aversion to delayed rewards is associated with substance abuse and numerous other neuropsychiatric disorders. Many of these disorders are heritable, raising the possibility that delay aversion may also have a significant genetic or heritable component. To examine this possibility, we compared delay discounting in six inbred strains of rats (Brown Norway, Copenhagen, Lewis, Fischer, Noble and Wistar Furth) using the adjusting amount procedure, which provides a measure of the subjective value of delayed rewards. The subjective value of rewards decreased as the delay to receipt increased for all strains. However, a main effect of strain and a strain × delay interaction indicated that some strains were more sensitive to the imposition of delays than others. Fitting a hyperbolic discount equation showed significant strain differences in sensitivity to delay ( k ). These data indicate that there are significant strain differences in delay discounting. All strains strongly preferred the 10% sucrose solution (the reinforcer in the delay discounting task) over water and the amount of sucrose consumed was correlated with sensitivity to delay. Locomotor activity was not correlated with delay discounting behavior. Additional research will be required to disentangle genetic influences from maternal effects and to determine how these factors influence the underlying association between heightened delay discounting and neuropsychiatric disorders.