What Do I Want and When Do I Want It: Brain Correlates of Decisions Made for Self and Other

A number of recent functional Magnetic Resonance Imaging (fMRI) studies on intertemporal choice behavior have demonstrated that so-called emotion- and reward-related brain areas are preferentially activated by decisions involving immediately available (but smaller) rewards as compared to (larger) delayed rewards. This pattern of activation was not seen, however, when intertemporal choices were made for another (unknown) individual, which speaks to that activation having been triggered by self-relatedness. In the present fMRI study, we investigated the brain correlates of individuals who passively observed intertemporal choices being made either for themselves or for an unknown person. We found higher activation within the ventral striatum, medial prefrontal and orbitofrontal cortex, pregenual anterior cingulate cortex, and posterior cingulate cortex when an immediate reward was possible for the observer herself, which is in line with findings from studies in which individuals actively chose immediately available rewards. Additionally, activation in the dorsal anterior cingulate cortex, posterior cingulate cortex, and precuneus was higher for choices that included immediate options than for choices that offered only delayed options, irrespective of who was to be the beneficiary. These results indicate that (1) the activations found in active intertemporal decision making are also present when the same decisions are merely observed, thus supporting the assumption that a robust brain network is engaged in immediate gratification; and (2) with immediate rewards, certain brain areas are activated irrespective of whether the observer or another person is the beneficiary of a decision, suggesting that immediacy plays a more general role for neural activation. An explorative analysis of participants’ brain activation corresponding to chosen rewards, further indicates that activation in the aforementioned brain areas depends on the mere presence, availability, or actual reception of immediate rewards.     

内侧前额叶与社会认知

早期的研究表明杏仁核、前额叶、颞上沟、前扣带回等与人类的社会认知活动有关;随着多种新技术的应用。越来越多的研究发现其它一些脑区结构(如岛叶、基底节、白质等)也与社会认知和行为有关。本文综述了内侧前额叶在社会认知中的作用,重点介绍了内侧前额叶在心灵理论、情绪认知、社会推理与决策、道德判断、自我认知等社会认知活动中的作用。未来研究希望能从整体和动态上认识内侧前额叶在社会认知活动中的作用。     

Explicit neural signals reflecting reward uncertainty

The acknowledged importance of uncertainty in economic decision making has stimulated the search for neural signals that could influence learning and inform decision mechanisms. Current views distinguish two forms of uncertainty, namely risk and ambiguity, depending on whether the probability distributions of outcomes are known or unknown. Behavioural neurophysiological studies on dopamine neurons revealed a risk signal, which covaried with the standard deviation or variance of the magnitude of juice rewards and occurred separately from reward value coding. Human imaging studies identified similarly distinct risk signals for monetary rewards in the striatum and orbitofrontal cortex (OFC), thus fulfilling a requirement for the mean variance approach of economic decision theory. The orbitofrontal risk signal covaried with individual risk attitudes, possibly explaining individual differences in risk perception and risky decision making. Ambiguous gambles with incomplete probabilistic information induced stronger brain signals than risky gambles in OFC and amygdala, suggesting that the brain's reward system signals the partial lack of information. The brain can use the uncertainty signals to assess the uncertainty of rewards, influence learning, modulate the value of uncertain rewards and make appropriate behavioural choices between only partly known options.     

Neural mechanisms of social learning and decision-making

One of the hallmarks of human society is the ubiquitous interactions among individuals. Indeed, a significant portion of human daily routine decision making is socially related. Normative economic theory, namely game theory, has prescribed the canonical decision strategy when "rational" social agents have full information about the decision environment. In reality, however, social decision is often influenced by the trait and state parameters of selves and others. Therefore, understanding the cognitive and neural processes of inferring the decision parameters is pivotal for social decision making. Recently, both correlational and causal non-invasive neuroimaging studies have started to reveal the critical neural computations underlying social learning and decision-making, and highlighted the unique roles of "social" brain structures such as temporal-parietal junction(TPJ) and dorsomedial prefrontal cortex(dmPFC). Here we review recent advances in social decision neuroscience and maintain the focus on how the inference about others is dynamically acquired during social learning, as well as how the prosocial(altruistic)behavior results from orchestrated interactions of different brain regions specified under the social utility framework. We conclude by emphasizing the importance of combining computational decision theory with the identification of neural mechanisms that represent, evaluate and integrate value related social information and generate decision variables guiding behavioral output in the complex social environment.     

The evolutionary origins of human patience: temporal preferences in chimpanzees, bonobos, and human adults

To make adaptive choices, individuals must sometimes exhibit patience, forgoing immediate benefits to acquire more valuable future rewards [1-3]. Although humans account for future consequences when making temporal decisions [4], many animal species wait only a few seconds for delayed benefits [5-10]. Current research thus suggests a phylogenetic gap between patient humans and impulsive, present-oriented animals [9, 11], a distinction with implications for our understanding of economic decision making [12] and the origins of human cooperation [13]. On the basis of a series of experimental results, we reject this conclusion. First, bonobos (Pan paniscus) and chimpanzees (Pan troglodytes) exhibit a degree of patience not seen in other animals tested thus far. Second, humans are less willing to wait for food rewards than are chimpanzees. Third, humans are more willing to wait for monetary rewards than for food, and show the highest degree of patience only in response to decisions about money involving low opportunity costs. These findings suggest that core components of the capacity for future-oriented decisions evolved before the human lineage diverged from apes. Moreover, the different levels of patience that humans exhibit might be driven by fundamental differences in the mechanisms representing biological versus abstract rewards.     

The second wave of evolutionary economics in biology

Several core issues in economics and biology overlap substantially. At the theoretical level, these include analogies and differences among rational choice, learning, genetic evolution and cultural evolution. At the empirical level, they include the structure of decision making, its neural basis and, more generally, human nature. We illustrate here the increasingly important collaboration between economics and biology with several characteristic examples, including signaling, markets, statistical reasoning, cooperation, punishment, reputation and social norms. In contrast to the mutual borrowing of ideas during the 1970s and 1980s, we now see the joint exploration of empirical and theoretical issues by biologists and economists that constitutes a second wave of interactions between the two disciplines.     

Led into Temptation? Rewarding Brand Logos Bias the Neural Encoding of Incidental Economic Decisions

Human decision-making is driven by subjective values assigned to alternative choice options. These valuations are based on reward cues. It is unknown, however, whether complex reward cues, such as brand logos, may bias the neural encoding of subjective value in unrelated decisions. In this functional magnetic resonance imaging (fMRI) study, we subliminally presented brand logos preceding intertemporal choices. We demonstrated that priming biased participants' preferences towards more immediate rewards in the subsequent temporal discounting task. This was associated with modulations of the neural encoding of subjective values of choice options in a network of brain regions, including but not restricted to medial prefrontal cortex. Our findings demonstrate the general susceptibility of the human decision making system to apparently incidental contextual information. We conclude that the brain incorporates seemingly unrelated value information that modifies decision making outside the decision-maker's awareness.     

Human neuroimaging of oxytocin and vasopressin in social cognition

The neuropeptides oxytocin and vasopressin have increasingly been identified as modulators of human social behaviors and associated with neuropsychiatric disorders characterized by social dysfunction, such as autism. Identifying the human brain regions that are impacted by oxytocin and vasopressin in a social context is essential to fully characterize the role of oxytocin and vasopressin in complex human social cognition. Advances in human non-invasive neuroimaging techniques and genetics have enabled scientists to begin to elucidate the neurobiological basis of the influence of oxytocin and vasopressin on human social behaviors. Here we review the findings to-date from investigations of the acute and chronic effects of oxytocin and vasopressin on neural activity underlying social cognitive processes using "pharmacological fMRI" and "imaging genetics", respectively. This article is part of a Special Issue entitled Oxytocin, Vasopressin, and Social Behavior.     

Decision‐Making Deficits and Overeating: A Risk Model for Obesity

Objective: To demonstrate that human overeating is not just a passive response to salient environmental triggers and powerful physiological drives; it is also about making choices. The ventromedial prefrontal cortex has been strongly implicated in the neural circuitry necessary for making advantageous decisions when various options for action are available. Decision‐making deficits have been found in patients with ventromedial prefrontal cortex lesions and in those with substance dependence—impairments that reflect an inability to advantageously assess future consequences. That is, they choose immediate rewards in the face of future long‐term negative consequences. Research Methods and Procedures: We extended this research to the study of overeating and overweight, testing a regression model that predicted that poor decision making (as assessed by a validated computerized gambling task) and a tendency to overeat under stress would correlate with higher BMI in a group of healthy adult women (N = 41) representing a broad range of body weights. Results: We found statistically significant main effects for both independent variables in the predicted direction (p < 0.05; R² = 0.35). Indeed, the decision‐making impairments across the 100 trials of the computer task were greater in those with high BMI than in previous studies with drug addicts. Discussion: Findings suggested that cortical and subcortical processes, which regulate one's ability to inhibit short‐term rewards when the long‐term consequences are deleterious, may also influence eating behaviors in a culture dominated by so many, and such varied, sources of palatable and calorically dense sources of energy.     

Discounting the freedom to choose: implications for the paradox of choice

Organisms prefer to make their own choices. However, emerging research from behavioral decision making sciences has demonstrated that there are boundaries to the preference for choice. Specifically, many decision makers find an extensive array of choice options to be aversive, often leading to negative emotional states and poor behavioral outcomes. This study examined the degree to which human participants discounted hypothetical rewards that were (a) delayed, (b) probabilistic, and (c) chosen from a large array of options. The present results suggest that the "paradox of choice" effect may be explained within a discounting model for individual patterns of decision making.     

Economic principles motivating social attention in humans

We know little about the processes by which we evaluate the opportunity to look at another person. We propose that behavioural economics provides a powerful approach to understanding this basic aspect of social attention. We hypothesized that the decision process culminating in attention to another person follows the same economic principles that govern choices about rewards such as food, drinks and money. Specifically, such rewards are discounted as a function of time, are tradable for other rewards, and reinforce work. Behavioural and neurobiological evidence suggests that looking at other people can also be described as rewarding, but to what extent these economic principles apply to social orienting remains unknown. Here, we show that the opportunity to view pictures of the opposite sex is discounted by delay to viewing, substitutes for money and reinforces work. The reward value of photos of the opposite sex varied with physical attractiveness and was greater in men, suggesting differential utility of acquiring visual information about the opposite sex in men and women. Together, these results demonstrate that choosing whom to look at follows a general set of economic principles, implicating shared neural mechanisms in both social and non-social decision making.     

Social observation increases deontological judgments in moral dilemmas

A concern for positive reputation is one of the core motivations underlying various social behaviors in humans. The present study investigated how experimentally induced reputation concern modulates judgments in moral dilemmas. In a mixed-design experiment, participants were randomly assigned to the observed vs. the control group and responded to a series of trolley-type moral dilemmas either in the presence or absence of observers, respectively. While no significant baseline difference in personality traits and moral decision tendency were found across two groups of participants, our analyses revealed that social observation promoted deontological judgments especially for moral dilemmas involving direct bodily harm (i.e., personal moral dilemmas), yet with an overall decrease in decision confidence and significant prolongation of reaction time. Moreover, participants in the observed group, but not in the control group, showed the increased sensitivities towards warmth vs. competence traits words in the lexical decision task performed after the moral dilemma task. Our findings suggest that reputation concern, once triggered by the presence of potentially judgmental others, could activate a culturally dominant norm of warmth in various social contexts. This could, in turn, induce a series of goal-directed processes for self-presentation of warmth, leading to increased deontological judgments in moral dilemmas. The results of the present study provide insights into the reputational consequences of moral decisions that merit further exploration.     

Fast and automatic activation of an abstract representation of money in the human ventral visual pathway

Money, when used as an incentive, activates the same neural circuits as rewards associated with physiological needs. However, unlike physiological rewards, monetary stimuli are cultural artifacts: how are monetary stimuli identified in the first place? How and when does the brain identify a valid coin, i.e. a disc of metal that is, by social agreement, endowed with monetary properties? We took advantage of the changes in the Euro area in 2002 to compare neural responses to valid coins (Euros, Australian Dollars) with neural responses to invalid coins that have lost all monetary properties (French Francs, Finnish Marks). We show in magneto-encephalographic recordings, that the ventral visual pathway automatically distinguishes between valid and invalid coins, within only ∼150 ms. This automatic categorization operates as well on coins subjects were familiar with as on unfamiliar coins. No difference between neural responses to scrambled controls could be detected. These results could suggest the existence of a generic, all-purpose neural representation of money that is independent of experience. This finding is reminiscent of a central assumption in economics, money fungibility, or the fact that a unit of money is substitutable to another. From a neural point of view, our findings may indicate that the ventral visual pathway, a system previously thought to analyze visual features such as shape or color and to be influenced by daily experience, could also able to use conceptual attributes such as monetary validity to categorize familiar as well as unfamiliar visual objects. The symbolic abilities of the posterior fusiform region suggested here could constitute an efficient neural substrate to deal with culturally defined symbols, independently of experience, which probably fostered money''s cultural emergence and success.     

The Neural Basis of Responsibility Attribution in Decision-Making

Social responsibility links personal behavior with societal expectations and plays a key role in affecting an agent’s emotional state following a decision. However, the neural basis of responsibility attribution remains unclear. In two previous event-related brain potential (ERP) studies we found that personal responsibility modulated outcome evaluation in gambling tasks. Here we conducted a functional magnetic resonance imaging (fMRI) study to identify particular brain regions that mediate responsibility attribution. In a context involving team cooperation, participants completed a task with their teammates and on each trial received feedback about team success and individual success sequentially. We found that brain activity differed between conditions involving team success vs. team failure. Further, different brain regions were associated with reinforcement of behavior by social praise vs. monetary reward. Specifically, right temporoparietal junction (RTPJ) was associated with social pride whereas dorsal striatum and dorsal anterior cingulate cortex (ACC) were related to reinforcement of behaviors leading to personal gain. The present study provides evidence that the RTPJ is an important region for determining whether self-generated behaviors are deserving of praise in a social context.     

Regulating Prefrontal Cortex Activation: An Emerging Role for the 5-HT2A Serotonin Receptor in the Modulation of Emotion-Based Actions?

The prefrontal cortex (PFC) is involved in mediating important higher-order cognitive processes such as decision making, prompting thereby our actions. At the same time, PFC activation is strongly influenced by emotional reactions through its functional interaction with the amygdala and the striatal circuitry, areas involved in emotion and reward processing. The PFC, however, is able to modulate amygdala reactivity via a feedback loop to this area. A role for serotonin in adjusting for this circuitry of cognitive regulation of emotion has long been suggested based primarily on the positive pharmacological effect of elevating serotonin levels in anxiety regulation. Recent animal and human functional magnetic resonance studies have pointed to a specific involvement of the 5-hydroxytryptamine (5-HT)_2A serotonin receptor in the PFC feedback regulatory projection onto the amygdala. This receptor is highly expressed in the prefrontal cortex areas, playing an important role in modulating cortical activity and neural oscillations (brain waves). This makes it an interesting potential pharmacological target for the treatment of neuropsychiatric modes characterized by lack of inhibitory control of emotion-based actions, such as addiction and other impulse-related behaviors. In this review, we give an overview of the 5-HT_2A receptor distribution (neuronal, intracellular, and anatomical) along with its functional and physiological effect on PFC activation, and how that relates to more recent findings of a regulatory effect of the PFC on the emotional control of our actions.     

Reduced sensitivity to immediate reward during decision-making in older than younger adults

We examined whether older adults differ from younger adults in the degree to which they favor immediate over delayed rewards during decision-making. To examine the neural correlates of age-related differences in delay discounting we acquired functional MR images while participants made decisions between smaller but sooner and larger but later monetary rewards. The behavioral results show age-related reductions in delay discounting. Less impulsive decision-making in older adults was associated with lower ventral striatal activations to immediate reward. Furthermore, older adults showed an overall higher percentage of delayed choices and reduced activity in the dorsal striatum than younger adults. This points to a reduced reward sensitivity of the dorsal striatum in older adults. Taken together, our findings indicate that less impulsive decision-making in older adults is due to a reduced sensitivity of striatal areas to reward. These age-related changes in reward sensitivity may result from transformations in dopaminergic neuromodulation with age.     

The Decision to Engage Cognitive Control Is Driven by Expected Reward-Value: Neural and Behavioral Evidence

Cognitive control is a fundamental skill reflecting the active use of task-rules to guide behavior and suppress inappropriate automatic responses. Prior work has traditionally used paradigms in which subjects are told when to engage cognitive control. Thus, surprisingly little is known about the factors that influence individuals'' initial decision of whether or not to act in a reflective, rule-based manner. To examine this, we took three classic cognitive control tasks (Stroop, Wisconsin Card Sorting Task, Go/No-Go task) and created novel ‘free-choice’ versions in which human subjects were free to select an automatic, pre-potent action, or an action requiring rule-based cognitive control, and earned varying amounts of money based on their choices. Our findings demonstrated that subjects'' decision to engage cognitive control was driven by an explicit representation of monetary rewards expected to be obtained from rule-use. Subjects rarely engaged cognitive control when the expected outcome was of equal or lesser value as compared to the value of the automatic response, but frequently engaged cognitive control when it was expected to yield a larger monetary outcome. Additionally, we exploited fMRI-adaptation to show that the lateral prefrontal cortex (LPFC) represents associations between rules and expected reward outcomes. Together, these findings suggest that individuals are more likely to act in a reflective, rule-based manner when they expect that it will result in a desired outcome. Thus, choosing to exert cognitive control is not simply a matter of reason and willpower, but rather, conforms to standard mechanisms of value-based decision making. Finally, in contrast to current models of LPFC function, our results suggest that the LPFC plays a direct role in representing motivational incentives.     

Electromyographic activity of hand muscles in a motor coordination game: effect of incentive scheme and its relation with social capital

Background

A vast body of social and cognitive psychology studies in humans reports evidence that external rewards, typically monetary ones, undermine intrinsic motivation. These findings challenge the standard selfish-rationality assumption at the core of economic reasoning. In the present work we aimed at investigating whether the different modulation of a given monetary reward automatically and unconsciously affects effort and performance of participants involved in a game devoid of visual and verbal interaction and without any perspective-taking activity.

Methodology/Principal Findings

Twelve pairs of participants were submitted to a simple motor coordination game while recording the electromyographic activity of First Dorsal Interosseus (FDI), the muscle mainly involved in the task. EMG data show a clear effect of alternative rewards strategies on subjects'' motor behavior. Moreover, participants'' stock of relevant past social experiences, measured by a specifically designed questionnaire, was significantly correlated with EMG activity, showing that only low social capital subjects responded to monetary incentives consistently with a standard rationality prediction.

Conclusions/Significance

Our findings show that the effect of extrinsic motivations on performance may arise outside social contexts involving complex cognitive processes due to conscious perspective-taking activity. More importantly, the peculiar performance of low social capital individuals, in agreement with standard economic reasoning, adds to the knowledge of the circumstances that makes the crowding out/in of intrinsic motivation likely to occur. This may help in improving the prediction and accuracy of economic models and reconcile this puzzling effect of external incentives with economic theory.     

The neural basis of following advice

Learning by following explicit advice is fundamental for human cultural evolution, yet the neurobiology of adaptive social learning is largely unknown. Here, we used simulations to analyze the adaptive value of social learning mechanisms, computational modeling of behavioral data to describe cognitive mechanisms involved in social learning, and model-based functional magnetic resonance imaging (fMRI) to identify the neurobiological basis of following advice. One-time advice received before learning had a sustained influence on people's learning processes. This was best explained by social learning mechanisms implementing a more positive evaluation of the outcomes from recommended options. Computer simulations showed that this "outcome-bonus" accumulates more rewards than an alternative mechanism implementing higher initial reward expectation for recommended options. fMRI results revealed a neural outcome-bonus signal in the septal area and the left caudate. This neural signal coded rewards in the absence of advice, and crucially, it signaled greater positive rewards for positive and negative feedback after recommended rather than after non-recommended choices. Hence, our results indicate that following advice is intrinsically rewarding. A positive correlation between the model's outcome-bonus parameter and amygdala activity after positive feedback directly relates the computational model to brain activity. These results advance the understanding of social learning by providing a neurobiological account for adaptive learning from advice.     

Regional brain responses in nulliparous women to emotional infant stimuli

Infant cries and facial expressions influence social interactions and elicit caretaking behaviors from adults. Recent neuroimaging studies suggest that neural responses to infant stimuli involve brain regions that process rewards. However, these studies have yet to investigate individual differences in tendencies to engage or withdraw from motivationally relevant stimuli. To investigate this, we used event-related fMRI to scan 17 nulliparous women. Participants were presented with novel infant cries of two distress levels (low and high) and unknown infant faces of varying affect (happy, sad, and neutral) in a randomized, counter-balanced order. Brain activation was subsequently correlated with scores on the Behavioral Inhibition System/Behavioral Activation System scale. Infant cries activated bilateral superior and middle temporal gyri (STG and MTG) and precentral and postcentral gyri. Activation was greater in bilateral temporal cortices for low- relative to high-distress cries. Happy relative to neutral faces activated the ventral striatum, caudate, ventromedial prefrontal, and orbitofrontal cortices. Sad versus neutral faces activated the precuneus, cuneus, and posterior cingulate cortex, and behavioral activation drive correlated with occipital cortical activations in this contrast. Behavioral inhibition correlated with activation in the right STG for high- and low-distress cries relative to pink noise. Behavioral drive correlated inversely with putamen, caudate, and thalamic activations for the comparison of high-distress cries to pink noise. Reward-responsiveness correlated with activation in the left precentral gyrus during the perception of low-distress cries relative to pink noise. Our findings indicate that infant cry stimuli elicit activations in areas implicated in auditory processing and social cognition. Happy infant faces may be encoded as rewarding, whereas sad faces activate regions associated with empathic processing. Differences in motivational tendencies may modulate neural responses to infant cues.