The ecology and evolution of patience in two New World monkeys

Decision making often involves choosing between small, short-term rewards and large, long-term rewards. All animals, humans included, discount future rewards--the present value of delayed rewards is viewed as less than the value of immediate rewards. Despite its ubiquity, there exists considerable but unexplained variation between species in their capacity to wait for rewards--that is, to exert patience or self-control. Using two closely related primates--common marmosets (Callithrix jacchus) and cotton-top tamarins (Saguinus oedipus)--we uncover a variable that may explain differences in how species discount future rewards. Both species faced a self-control paradigm in which individuals chose between taking an immediate small reward and waiting a variable amount of time for a large reward. Under these conditions, marmosets waited significantly longer for food than tamarins. This difference cannot be explained by life history, social behaviour or brain size. It can, however, be explained by feeding ecology: marmosets rely on gum, a food product acquired by waiting for exudate to flow from trees, whereas tamarins feed on insects, a food product requiring impulsive action. Foraging ecology, therefore, may provide a selective pressure for the evolution of self-control.     

Discounting of sequences of delayed rewards of different amounts

The main purpose of this study was to determine whether the magnitude effect is present in cases where delayed sequences of rewards are discounted. The magnitude effect refers to the inverse relationship between the amount of a reward and the steepness of temporal discounting. This study was conducted with a computer program to estimate the indifference points, which served as indicators of the present subjective value of delayed sequences of small and large rewards. In the indifference point the subjective value of a single, immediate reward was equal to the subjective value of the delayed sequence (or to the value of a single delayed reward). As a control condition, we added an experimental task involving choices between single immediate and single delayed rewards. The experiment showed that the sequences of large rewards are discounted less steeply than are the sequences of small rewards. This finding suggests that the magnitude effect is present within the delayed sequences of rewards. In addition, when outcomes are relatively large, the results suggest that a single reward is discounted less steeply than the sequence of a total nominal value equal to this single reward. However, for relatively small rewards, the difference is not statistically significant. The less steep discounting of sequences of large rewards may explain the reward-bundling effect, which refers to less steep discounting of longer sequences than of shorter ones: longer sequences usually have greater overall nominal value. The present study was conducted on hypothetical rewards, and the results should be validated using real rewards.     

Domain independence and stability in young and older adults' discounting of delayed rewards

Individual discounting rates for different types of delayed reward are typically assumed to reflect a single, underlying trait of impulsivity. Recently, we showed that discounting rates are orders of magnitude steeper for directly consumable liquid rewards than for monetary rewards (Jimura et al., 2009), raising the question of whether discounting rates for different types of reward covary at the individual level. Accordingly, the present study examined the relation between discounting of hypothetical money and real liquid rewards in young adults (Experiment 1) and older adults (Experiment 2). At the group level, young adults discounted monetary rewards more steeply than the older adults, but there was no significant age difference with respect to liquid rewards. At the individual level, the rates at which young and older participants discounted each reward type were stable over a two- to fifteen-week interval (rs > 70), but there was no significant correlation between the rates at which they discounted the two reward types. These results suggest that although similar decision-making processes may underlie the discounting of different types of rewards, the rates at which individuals discount money and directly consumable rewards may reflect separate, stable traits, rather than a single trait of impulsivity.     

Gum feeder as environmental enrichment for zoo marmosets and tamarins

Tamarins and marmosets are small-bodied social callitrichines. Wild callitrichines feed on exudates, such as sap and gum; particularly, marmosets are mainly gummivores, while tamarins consume gums only occasionally and opportunistically. Zoo marmosets and tamarins are usually provided with gum arabic as an alternative to the exudates normally found in the wild. The aim of this study was to evaluate the effects of a gum feeder on the behavior and well-being of four zoo-managed callitrichines. We studied four cotton-top tamarins (Saguinus oedipus), four red-handed tamarins (S. midas), two pygmy marmosets (Cebuella pygmaea), and three Geoffroy's marmosets (Callithrix geoffroyi) housed at Parco Natura Viva (Italy). We conducted the study over two different periods, a baseline (control, without the gum feeder) and then a gum feeder (when the gum feeder was provided) period. We used continuous focal animal sampling to collect behavioral data, including durations of social and individual behaviors. We collected 240 min of observations per period per study subject, with a total of 3,120 min for all the subjects in the same period and of 6,240 min in both periods. We analyzed data by using nonparametric statistical tests. First, we found that the gum feeder promoted species-specific behaviors, such as exploration, and diminished self-directed behaviors, suggesting an enriching effect on tamarin and marmoset behavior. Moreover, in red-handed tamarins, the provision of the gum feeder reduced the performance of self-directed and abnormal behavior, specifically coprophagy. These results confirm that gum feeders are effective foraging enrichment tools for zoo marmosets and tamarins.     

Single units in the pigeon brain integrate reward amount and time-to-reward in an impulsive choice task

BACKGROUND: Animals prefer small over large rewards when the delays preceding large rewards exceed an individual tolerance limit. Such impulsive choice behavior occurs even in situations in which alternative strategies would yield more optimal outcomes. Behavioral research has shown that an animal's choice is guided by the alternative rewards' subjective values, which are a function of reward amount and time-to-reward. Despite increasing knowledge about the pharmacology and anatomy underlying impulsivity, it is still unknown how the brain combines reward amount and time-to-reward information to represent subjective reward value. RESULTS: We trained pigeons to choose between small, immediate rewards and large rewards delivered after gradually increasing delays. Single-cell recordings in the avian Nidopallium caudolaterale, the presumed functional analog of the mammalian prefrontal cortex, revealed that neural delay activation decreased with increasing delay length but also covaried with the expected reward amount. This integrated neural response was modulated by reward amount and delay, as predicted by a hyperbolical equation, of subjective reward value derived from behavioral studies. Furthermore, the neural activation pattern reflected the current reward preference and the time point of the shift from large to small rewards. CONCLUSIONS: The reported activity was modulated by the temporal devaluation of the anticipated reward in addition to reward amount. Our findings contribute to the understanding of neuropathologies such as drug addiction, pathological gambling, frontal lobe syndrome, and attention-deficit disorders, which are characterized by inappropriate temporal discounting and increased impulsiveness.     

Humans can adopt optimal discounting strategy under real-time constraints

Critical to our many daily choices between larger delayed rewards, and smaller more immediate rewards, are the shape and the steepness of the function that discounts rewards with time. Although research in artificial intelligence favors exponential discounting in uncertain environments, studies with humans and animals have consistently shown hyperbolic discounting. We investigated how humans perform in a reward decision task with temporal constraints, in which each choice affects the time remaining for later trials, and in which the delays vary at each trial. We demonstrated that most of our subjects adopted exponential discounting in this experiment. Further, we confirmed analytically that exponential discounting, with a decay rate comparable to that used by our subjects, maximized the total reward gain in our task. Our results suggest that the particular shape and steepness of temporal discounting is determined by the task that the subject is facing, and question the notion of hyperbolic reward discounting as a universal principle.     

Future altruism: Social discounting of delayed rewards

Social discounting assesses an individual's willingness to forgo an outcome for the self in lieu of a larger outcome for someone else. The purpose of the present research was to examine the effect of adding a common delay to outcomes in a binary choice, social discounting procedure. Based on the premise that both social and temporal distances are dimensions of psychological distance, we hypothesized that social discounting should decrease as a function of delay to the outcomes. Across two within-subject experiments, participants indicated preference between a hypothetical money reward for the self or for someone else. The outcomes were associated with no, short, and long delays. Both studies confirmed our hypothesis that adding any delay to the receipt of outcomes decreases social discounting, though no significant differences were observed between short and long delays. These results are discussed in the context of some existing literature on altruism.     

The role of social context and individual experience in novel task acquisition in cottontop tamarins, Saguinus oedipus

In socially tolerant settings, na?ve individuals may have opportunities to interact jointly with knowledgeable demonstrators and novel tasks. This process is expected to facilitate social learning. Individual experience may also be important for reinforcing and honing socially acquired behaviours. We examined the role of joint interaction and individual experience in the acquisition of a novel foraging task in captive cottontop tamarins. The task involved learning how to locate and access two hidden food rewards from among 10 differently cued forage sites. Tamarins were tested in three different conditions: (1) individually, (2) while interacting with a na?ve mate, and (3) while interacting with a mate trained as a knowledgeable demonstrator. For tamarins tested with mates present, we interspersed social input test days with exposure to the task while alone. Tamarins were tested again 17 months after their last exposure to the task, to assess long-term memory. All tamarins tested with knowledgeable demonstrators solved the task. In contrast, tamarins tested alone or with na?ve mates had similarly high levels of neophobia and low levels of task acquisition. We conclude that joint interaction occurs in mated pairs of cottontop tamarins and facilitates the spread of novel behaviour. Interspersing test days with a knowledgeable demonstrator present and test days alone with the task helped tamarins to achieve the ultimate goal of the task: obtaining food rewards. Tamarins performed similarly when tested 17 months later, regardless of their initial learning environment. Tamarins had memory deficits for the location of hidden food rewards, but retained memory of the necessary motor actions and solved the task.     

Measurement of delay discounting using trial-by-trial consequences

DELAY DISCOUNTING IN HUMANS WAS INVESTIGATED USING THREE DIFFERENT PROCEDURES: a frequently used discounting procedure with hypothetical rewards and delays; a procedure with hypothetical rewards and delays compressed down to much smaller values; and a contingent procedure in which each choice had a direct consequence. In the contingent procedure, on every trial, participants actually experienced the delay and obtained the reward amount associated with their choice. Each participant was exposed to all three procedures. Orderly temporal discounting patterns were obtained in all three procedures and described well by a hyperbolic model. Comparisons of the data revealed patterns unique to each procedure. The distributions of the discounting measures differed across the three procedures. In the contingent procedure, several subjects showed no discounting, e.g. complete self-control. Procedural factors in studies of impulsivity are discussed, and suggestions are offered for experiments in which the contingent-discounting procedure may prove useful.     

Formal Comparison of Dual-Parameter Temporal Discounting Models in Controls and Pathological Gamblers

Temporal or delay discounting refers to the phenomenon that the value of a reward is discounted as a function of time to delivery. A range of models have been proposed that approximate the shape of the discount curve describing the relationship between subjective value and time. Recent evidence suggests that more than one free parameter may be required to accurately model human temporal discounting data. Nonetheless, many temporal discounting studies in psychiatry, psychology and neuroeconomics still apply single-parameter models, despite their oftentimes poor fit to single-subject data. Previous comparisons of temporal discounting models have either not taken model complexity into account, or have overlooked particular models. Here we apply model comparison techniques in a large sample of temporal discounting datasets using several discounting models employed in the past. Among the models examined, an exponential-power model from behavioural economics (CS model, Ebert & Prelec 2007) provided the best fit to human laboratory discounting data. Inter-parameter correlations for the winning model were moderate, whereas they were substantial for other dual-parameter models examined. Analyses of previous group and context effects on temporal discounting with the winning model provided additional theoretical insights. The CS model may be a useful tool in future psychiatry, psychology and neuroscience work on inter-temporal choice.     

The date-delay framing effect in temporal discounting depends on substance abuse

In the present study, individuals with substance use disorders (n=30) and non-addicted controls (n=30) were presented with a delay-discounting task with time being described either as dates or as temporal intervals. Three main results were obtained. First, in both groups reward size had a large impact on discounting future rewards, with discount rates becoming larger with smaller reward sizes. Second, participants discounted future rewards less strongly when their time of delivery was presented as a date instead of a temporal distance. Third, whereas discount rates of individuals with substance use disorders varied substantially with regard to the presentation of time in the task, the controls changed their choices depending on time presentation only slightly.     

Reduced sensitivity to immediate reward during decision-making in older than younger adults

We examined whether older adults differ from younger adults in the degree to which they favor immediate over delayed rewards during decision-making. To examine the neural correlates of age-related differences in delay discounting we acquired functional MR images while participants made decisions between smaller but sooner and larger but later monetary rewards. The behavioral results show age-related reductions in delay discounting. Less impulsive decision-making in older adults was associated with lower ventral striatal activations to immediate reward. Furthermore, older adults showed an overall higher percentage of delayed choices and reduced activity in the dorsal striatum than younger adults. This points to a reduced reward sensitivity of the dorsal striatum in older adults. Taken together, our findings indicate that less impulsive decision-making in older adults is due to a reduced sensitivity of striatal areas to reward. These age-related changes in reward sensitivity may result from transformations in dopaminergic neuromodulation with age.     

Led into Temptation? Rewarding Brand Logos Bias the Neural Encoding of Incidental Economic Decisions

Human decision-making is driven by subjective values assigned to alternative choice options. These valuations are based on reward cues. It is unknown, however, whether complex reward cues, such as brand logos, may bias the neural encoding of subjective value in unrelated decisions. In this functional magnetic resonance imaging (fMRI) study, we subliminally presented brand logos preceding intertemporal choices. We demonstrated that priming biased participants' preferences towards more immediate rewards in the subsequent temporal discounting task. This was associated with modulations of the neural encoding of subjective values of choice options in a network of brain regions, including but not restricted to medial prefrontal cortex. Our findings demonstrate the general susceptibility of the human decision making system to apparently incidental contextual information. We conclude that the brain incorporates seemingly unrelated value information that modifies decision making outside the decision-maker's awareness.     

Differences among captive callitrichids in the digestive responses to dietary gum

Although many members of the Callitrichidae, a monophyletic family of small, New World monkeys, have been observed to feed on plant exudates, available field data support the generalization that pygmy and common marmosets (Cebuella pygmaea and Callithrix jacchus) feed on gums to a greater extent than most other callitrichids. Because microbial fermentation is required for vertebrates to digest gums, gum-feeding primates may react differently to dietary gum from their relatives that eat little gum. To test this hypothesis, digestion trials were conducted on animals from the two marmoset species, two tamarin species (Saguinus fuscicollis and S. oedipus), and a species of lion tamarin (Leontopithecus rosalia). These species span the range of body sizes within the Callitrichidae. All animals were fed two variations of a homogeneous diet, which differed only in that gum arabic was added to one. Transit time of digesta (TFA) and digestive efficiency (as measured by the coefficients of apparent digestibility of dry matter and energy [ADDM and ADE, respectively]) were compared between diets for each individual. As predicted, the digestive responses of marmosets differed from the responses of the other study species. In marmosets, TFA tended to be longer when gum was added to the diet, while TFA did not change in the other three species. Digestive efficiency decreased in tamarins and lion tamarins with the addition of gum to the diet; marmoset digestive efficiency was unaffected by diet. The results of this research are consistent with the hypothesis that marmosets have digestive adaptations that aid in the digestion of gum that other callitrichids lack. © 1996 Wiley-Liss, Inc.     

The ecological role of the callitrichidae: a review

The marmosets and tamarins fill a unique ecological role among the anthropoid primates, one that has not been fully recognized. Many misconceptions--that they are primitive, monogamous, territorial, and squirrellike--pervade the literature. These misconceptions are largely the result of misinterpreting laboratory studies which have not been confirmed with identified animals in natural habitats. Recent field studies, reviewed here, indicate that marmosets and tamarins have a highly derived ecological role, are not monogamous, feed largely on insects and plant exudates, and have uniquely specialized positional behavior involving clinging to vertical tree trunks in order to feed on exudates. Accompanying these behavioral traits are a number clawlike nails on all digits except the hallux, and a three-cusped upper molar morphology. These form a suite of characteristics unique among the living primates, many of which are related to their ecological role. We believe that the marmosets and tamarins are members of a guild of exudate feeders in which plant exudates are an important component of the diet. It is within this framework of a primate foraging guild that we can best understand many of their morphological and behavioral adaptations.     

Timing in reward and decision processes

Sensitivity to time, including the time of reward, guides the behaviour of all organisms. Recent research suggests that all major reward structures of the brain process the time of reward occurrence, including midbrain dopamine neurons, striatum, frontal cortex and amygdala. Neuronal reward responses in dopamine neurons, striatum and frontal cortex show temporal discounting of reward value. The prediction error signal of dopamine neurons includes the predicted time of rewards. Neurons in the striatum, frontal cortex and amygdala show responses to reward delivery and activities anticipating rewards that are sensitive to the predicted time of reward and the instantaneous reward probability. Together these data suggest that internal timing processes have several well characterized effects on neuronal reward processing.     

Insulin,Central Dopamine D2 Receptors,and Monetary Reward Discounting in Obesity

Animal research finds that insulin regulates dopamine signaling and reward behavior, but similar research in humans is lacking. We investigated whether individual differences in body mass index, percent body fat, pancreatic β-cell function, and dopamine D2 receptor binding were related to reward discounting in obese and non-obese adult men and women. Obese (n = 27; body mass index>30) and non-obese (n = 20; body mass index<30) adults were assessed for percent body fat with dual-energy X-ray absorptiometry and for β-cell function using disposition index. Choice of larger, but delayed or less certain, monetary rewards relative to immediate, certain smaller monetary rewards was measured using delayed and probabilistic reward discounting tasks. Positron emission tomography using a non-displaceable D2-specific radioligand, [¹¹C](N-methyl)benperidol quantified striatal D2 receptor binding. Groups differed in body mass index, percent body fat, and disposition index, but not in striatal D2 receptor specific binding or reward discounting. Higher percent body fat in non-obese women related to preference for a smaller, certain reward over a larger, less likely one (greater probabilistic discounting). Lower β-cell function in the total sample and lower insulin sensitivity in obese related to stronger preference for an immediate and smaller monetary reward over delayed receipt of a larger one (greater delay discounting). In obese adults, higher striatal D2 receptor binding related to greater delay discounting. Interestingly, striatal D2 receptor binding was not significantly related to body mass index, percent body fat, or β-cell function in either group. Our findings indicate that individual differences in percent body fat, β-cell function, and striatal D2 receptor binding may each contribute to altered reward discounting behavior in non-obese and obese individuals. These results raise interesting questions about whether and how striatal D2 receptor binding and metabolic factors, including β-cell function, interact to affect reward discounting in humans.     

Amount-dependent temporal discounting?

Amount-dependent temporal discounting has been demonstrated for human choice between outcomes differing in amount and delay. In the only study to date with non-humans, Grace reported no evidence for amount-dependent temporal discounting with pigeons in a concurrent-chains procedure. The present experiments repeated Grace's procedure but with modifications to enhance the discrimination between small and large magnitude outcomes. In Experiment 1, sensitivity of pigeons' initial-link choice to the terminal link delay ratio was greater with large reinforcer durations in the terminal links than with small reinforcer durations. This result is consistent with a greater rate of temporal discounting for larger reinforcers (the reverse of the result for humans), but can also be explained as enhanced discrimination of delay ratios with larger reinforcer durations. The results of a second experiment supported Grace's conclusion that amount-dependent temporal discounting does not characterize pigeons' choice in concurrent chains. Because reinforcer amount was held constant between choice alternatives in the present experiments and that of Grace, but varied in the human studies, our results question whether prior demonstrations of amount-dependent discounting reflect the effects of reinforcer delay or of reinforcer amount. Differences in the procedures used to study discounting in humans (titration procedures) and non-humans (concurrent chains) may contribute to the divergent results across species.