Prefrontal coding of temporally discounted values during intertemporal choice

Reward from a particular action is seldom immediate, and the influence of such delayed outcome on choice decreases with delay. It has been postulated that when faced with immediate and delayed rewards, decision makers choose the option with maximum temporally discounted value. We examined the preference of monkeys for delayed reward in an intertemporal choice task and the neural basis for real-time computation of temporally discounted values in the dorsolateral prefrontal cortex. During this task, the locations of the targets associated with small or large rewards and their corresponding delays were randomly varied. We found that prefrontal neurons often encoded the temporally discounted value of reward expected from a particular option. Furthermore, activity tended to increase with [corrected] discounted values for targets [corrected] presented in the neuron's preferred direction, suggesting that activity related to temporally discounted values in the prefrontal cortex might determine the animal's behavior during intertemporal choice.     

Get It While It’s Hot: A Peak-First Bias in Self-Generated Choice Order in Rhesus Macaques

Animals typically must make a number of successive choices to achieve a goal: e.g., eating multiple food items before becoming satiated. However, it is unclear whether choosing the best first or saving the best for last represents the best choice strategy to maximize overall reward. Specifically, since outcomes can be evaluated prospectively (with future rewards discounted and more immediate rewards preferred) or retrospectively (with prior rewards discounted and more recent rewards preferred), the conditions under which each are used remains unclear. On the one hand, humans and non-human animals clearly discount future reward, preferring immediate rewards to delayed ones, suggesting prospective evaluation; on the other hand, it has also been shown that a sequence that ends well, i.e., with the best event or item last, is often preferred, suggesting retrospective evaluation. Here we hypothesized that when individuals are allowed to build the sequence themselves they are more likely to evaluate each item individually and therefore build a sequence using prospective evaluation. We examined the relationship between self-generated choice order and preference in rhesus monkeys in two experiments in which the distinctiveness of options were relatively high and low, respectively. We observed a positive linear relationship between choice order and preference among highly distinct options, indicating that the rhesus monkeys chose their preferred food first: i.e., a peak-first order preference. Overall, choice order depended on the degree of relative preference among alternatives and a peak-first bias, providing evidence for prospective evaluation when choice order is self-generated.     

Discounting of delayed hypothetical money, alcohol, and food

For drug-dependent individuals, drugs of abuse that are delayed in time are discounted more steeply than money delayed in time in a hypothetical choice task. The reasons for this finding are not clear. This study examined whether steep discounting of drugs relative to money might be related to the function of drugs as primary/consumable reinforcers and money as a conditioned/non-consumable reinforcer. Twenty adults with no self-reported problems with money, alcohol, or food participated. They indicated their preferences for three hypothetical outcome types: delayed versus immediate money, delayed versus immediate food, and delayed versus immediate alcohol. Both the hyperbolic decay model and area under the curve analysis showed that money was discounted less steeply than alcohol or food, but that alcohol and food were discounted similarly. This finding replicates previous results showing that people without drug abuse problems show steep discounting of alcohol. Furthermore, this finding suggests that alcohol may be steeply discounted as part of a general process involving primary/consumable reinforcers, not necessarily because it is a drug.     

Emoticon-Based Ambivalent Expression: A Hidden Indicator for Unusual Behaviors in Weibo

Recent decades have witnessed online social media being a big-data window for testifying conventional social theories quantitatively and exploring much detailed human behavioral patterns. In this paper, by tracing the emoticon use in Weibo, a group of hidden “ambivalent users” are disclosed for frequently posting ambivalent tweets containing both positive and negative emotions. Further investigation reveals that this ambivalent expression could be a novel indicator of many unusual social behaviors. For instance, ambivalent users with the female as the majority like to make a sound in midnights and at weekends. They mention their close friends frequently in ambivalent tweets, which attract more replies and serve as a more private communication way. Ambivalent users also respond differently to public affairs from others and demonstrate more interests in entertainment and sports events. Moreover, the sentiment shift in ambivalent tweets is more evident than usual and exhibits a clear “negative to positive” pattern. The above observations, though being promiscuous seemingly, actually point to the self-regulation of negative mood in Weibo, which could find its basis from the traditional emotion management theories in sociology but makes an important extension to the online environment in this study. Finally, as an interesting corollary, ambivalent users are found connected with compulsive buyers and turn out to be perfect targets for online marketing.     

The Weight of a Guilty Conscience: Subjective Body Weight as an Embodiment of Guilt

Guilt is an important social and moral emotion. In addition to feeling unpleasant, guilt is metaphorically described as a “weight on one''s conscience.” Evidence from the field of embodied cognition suggests that abstract metaphors may be grounded in bodily experiences, but no prior research has examined the embodiment of guilt. Across four studies we examine whether i) unethical acts increase subjective experiences of weight, ii) feelings of guilt explain this effect, and iii) whether there are consequences of the weight of guilt. Studies 1–3 demonstrated that unethical acts led to more subjective body weight compared to control conditions. Studies 2 and 3 indicated that heightened feelings of guilt mediated the effect, whereas other negative emotions did not. Study 4 demonstrated a perceptual consequence. Specifically, an induction of guilt affected the perceived effort necessary to complete tasks that were physical in nature, compared to minimally physical tasks.     

The subjective value of delayed and probabilistic outcomes: Outcome size matters for gains but not for losses

The subjective value of a reward (gain) is related to factors such as its size, the delay to its receipt and the probability of its receipt. We examined whether the subjective value of losses was similarly affected by these factors in 128 adults. Participants chose between immediate/certain gains or losses and larger delayed/probabilistic gains or losses. Rewards of $100 were devalued as a function of their delay (“discounted”) relatively less than $10 gains while probabilistic $100 rewards were discounted relatively more than $10 rewards. However, there was no effect of outcome size on discounting of delayed or probabilistic losses. For delayed outcomes of each size, the degree to which gains were discounted was positively correlated with the degree to which losses were discounted, whereas for probabilistic outcomes, no such correlation was observed. These results suggest that the processes underlying the subjective valuation of losses are different from those underlying the subjective valuation of gains.     

Dread and the Disvalue of Future Pain

Standard theories of decision-making involving delayed outcomes predict that people should defer a punishment, whilst advancing a reward. In some cases, such as pain, people seem to prefer to expedite punishment, implying that its anticipation carries a cost, often conceptualized as ‘dread’. Despite empirical support for the existence of dread, whether and how it depends on prospective delay is unknown. Furthermore, it is unclear whether dread represents a stable component of value, or is modulated by biases such as framing effects. Here, we examine choices made between different numbers of painful shocks to be delivered faithfully at different time points up to 15 minutes in the future, as well as choices between hypothetical painful dental appointments at time points of up to approximately eight months in the future, to test alternative models for how future pain is disvalued. We show that future pain initially becomes increasingly aversive with increasing delay, but does so at a decreasing rate. This is consistent with a value model in which moment-by-moment dread increases up to the time of expected pain, such that dread becomes equivalent to the discounted expectation of pain. For a minority of individuals pain has maximum negative value at intermediate delay, suggesting that the dread function may itself be prospectively discounted in time. Framing an outcome as relief reduces the overall preference to expedite pain, which can be parameterized by reducing the rate of the dread-discounting function. Our data support an account of disvaluation for primary punishments such as pain, which differs fundamentally from existing models applied to financial punishments, in which dread exerts a powerful but time-dependent influence over choice.     

The Value of Emotion: How Does Episodic Prospection Modulate Delay Discounting?

Background

Humans often show impatience when making intertemporal choice for monetary rewards, preferring small rewards delivered immediately to larger rewards delivered after a delay, which reflects a fundamental psychological principle: delay discounting. However, we propose that episodic prospection humans can vividly envisage exerts a strong and broad influence on individuals'' delay discounting. Specifically, episodic prospection may affect individuals'' intertemporal choice by the negative or positive emotion of prospection.

Methodology/Principal Findings

The present study explored how episodic prospection modulated delay discounting by emotion. Study 1 showed that participants were more inclined to choose the delayed but larger rewards when they imaged positive future events than when they did not image events; Study 2 showed that participants were more inclined to choose the immediate but smaller rewards when they imaged negative future events than when they did not image events; In contrast, study 3 showed that choice preferences of participants when they imaged neutral future events were the same as when they did not image events.

Conclusions/Significance

By manipulating the emotion valence of episodic prospection, our findings suggested that positive emotion made individuals tend to choose delayed rewards, while negative emotion made individuals tend to choose immediate rewards. Only imaging events with neutral emotion did not affect individuals'' choice preference. Thus, the valence of imaged future events'' emotion might play an important role in individuals'' intertemporal choice. It is possible that the valence of emotion may affect the changed direction (promote or inhibit) of individuals'' delay discounting, while the ability to image future events affects the changed degree of individuals'' delay discounting.     

I Choose,Therefore I Like: Preference for Faces Induced by Arbitrary Choice

Behavioral choice alters one’s preference rather than simply reflecting it. This effect to fit preferences with past choice, is known as “choice-induced preference change.” After making a choice between two equally attractive options, one tends to rate the chosen option better than they initially did and/or the unchosen option worse. The present study examined how behavioral choice changes subsequent preference, using facial images for the choice options as well as blind choice techniques. Participants rated their facial preference for each face, and chose between two equally preferred faces and subsequently rated their facial preference. Results from four experiments demonstrated that randomly chosen faces were more preferred only after participants were required to choose “a preferred face,” (in Experiment 1) but not “an unpreferred face,” (in Experiment 2) or “a rounder face” (in Experiment 3). Further, preference change was still observed after participants were informed that choices were actually random (in Experiment 4). Our findings provide new and important implications characterizing the conditions under which random choice changes preference, and show that people are tempted to make a biased evaluation even after they know that they did not make the choice for themselves.     

Discounting of delayed hypothetical money and food: effects of amount

Delay discounting research determines how the value of an outcome is affected by delay to its receipt. Research so far shows that consumable outcomes are discounted more steeply by delay than money. Prior studies, however, have used large amounts of the outcomes (e.g. 100 dollars worth) that would not typically be consumed in one bout, unlike the corresponding amount of money (e.g. 100 dollars ). This experiment examined whether small amounts of food would be discounted more steeply than money, as occurs with larger amounts. One hundred and two adults indicated their preferences in a series of choices for two hypothetical outcome types: immediate versus delayed food and immediate versus delayed money. Participants made choices involving either relatively small maximum amounts of food (10 dollars worth) and money (10 dollars) or for relatively large maximum amounts of food (100 dollars worth) and money (100 dollars ). In the within-subject comparisons, food was discounted more steeply by delay than money for both groups. In the between-subject comparisons, different amounts of the commodities were affected similarly by delay. Overall, these results suggest that steeper discounting of consumable outcomes than money is a fairly robust phenomenon, occurring with relatively small amounts of outcomes as well as with larger amounts.     

PDYN rs2281285 Variant Association with Drinking to Avoid Emotional or Somatic Discomfort

Introduction

One of the proposed psychobiological pathways of craving attributes the desire for drinking in the context of tension, discomfort or unpleasant emotions, to “negative” (or “relief”) craving. The aim of this study was to replicate a previously reported association of the PDYN rs2281285 variant with negative craving using a different phenotyping approach.

Methods

The TaqMan® Genotyping Assay was used to genotype the rs2281285 variant in 417 German alcohol-dependent subjects. The presence of negative/relief craving was assessed by asking if participants ever ingested alcohol to avoid unwanted emotional or somatic discomfort.

Results

The minor allele of rs2281285 was associated with an increased risk of drinking to avoid/escape unwanted emotional or somatic events (OR = 2.29, 95% CI = 1.08–4.85, p = 0.0298).

Discussion

Despite the use of a different phenotyping approach to the measurement of negative craving, our results confirm the association between negative craving and PDYN rs2281285. Genetic markers of negative craving may help to identify subgroups of alcohol-dependent individuals vulnerable to relapse in the context of negative emotions or somatic discomfort, leading to the development of specifically tailored treatment strategies.     

The Effects of Twitter Sentiment on Stock Price Returns

Social media are increasingly reflecting and influencing behavior of other complex systems. In this paper we investigate the relations between a well-known micro-blogging platform Twitter and financial markets. In particular, we consider, in a period of 15 months, the Twitter volume and sentiment about the 30 stock companies that form the Dow Jones Industrial Average (DJIA) index. We find a relatively low Pearson correlation and Granger causality between the corresponding time series over the entire time period. However, we find a significant dependence between the Twitter sentiment and abnormal returns during the peaks of Twitter volume. This is valid not only for the expected Twitter volume peaks (e.g., quarterly announcements), but also for peaks corresponding to less obvious events. We formalize the procedure by adapting the well-known “event study” from economics and finance to the analysis of Twitter data. The procedure allows to automatically identify events as Twitter volume peaks, to compute the prevailing sentiment (positive or negative) expressed in tweets at these peaks, and finally to apply the “event study” methodology to relate them to stock returns. We show that sentiment polarity of Twitter peaks implies the direction of cumulative abnormal returns. The amount of cumulative abnormal returns is relatively low (about 1–2%), but the dependence is statistically significant for several days after the events.     

Negative Emotional Events that People Ruminate about Feel Closer in Time

Rumination is intrusive, perseverative cognition. We suggest that one psychological consequence of ruminating about negative emotional events is that the events feel as though they happened metaphorically “just yesterday”. Results from three studies showed that ruminating about real world anger provocations, guilt-inducing events, and sad times in the last year made these past events feel as though they happened more recently. The relationship between rumination and reduced temporal psychological distance persisted even when controlling for when the event occurred and the emotional intensity of the event. Moreover, angry rumination was correlated with enhanced approach motivation, which mediated the rumination-distance relationship. The relationship between guilty rumination and distance was mediated by enhanced vividness. Construal level and taking a 3^rd person perspective contributed to the sense of distance when participants were prompted to think about less emotionally charged situations. A meta-analysis of the data showed that the relationship between rumination and reduced distance was significant and twice as large as the same relationship for neutral events. These findings have implications for understanding the role of emotional rumination on memory processes in clinical populations and people prone to rumination. This research suggests that rumination may be a critical mechanism that keeps negative events close in the heart, mind, and time.     

The Role of Informative and Ambiguous Feedback in Avoidance Behavior: Empirical and Computational Findings

Avoidance behavior is a critical component of many psychiatric disorders, and as such, it is important to understand how avoidance behavior arises, and whether it can be modified. In this study, we used empirical and computational methods to assess the role of informational feedback and ambiguous outcome in avoidance behavior. We adapted a computer-based probabilistic classification learning task, which includes positive, negative and no-feedback outcomes; the latter outcome is ambiguous as it might signal either a successful outcome (missed punishment) or a failure (missed reward). Prior work with this task suggested that most healthy subjects viewed the no-feedback outcome as strongly positive. Interestingly, in a later version of the classification task, when healthy subjects were allowed to opt out of (i.e. avoid) responding, some subjects (“avoiders”) reliably avoided trials where there was a risk of punishment, but other subjects (“non-avoiders”) never made any avoidance responses at all. One possible interpretation is that the “non-avoiders” valued the no-feedback outcome so positively on punishment-based trials that they had little incentive to avoid. Another possible interpretation is that the outcome of an avoided trial is unspecified and that lack of information is aversive, decreasing subjects’ tendency to avoid. To examine these ideas, we here tested healthy young adults on versions of the task where avoidance responses either did or did not generate informational feedback about the optimal response. Results showed that provision of informational feedback decreased avoidance responses and also decreased categorization performance, without significantly affecting the percentage of subjects classified as “avoiders.” To better understand these results, we used a modified Q-learning model to fit individual subject data. Simulation results suggest that subjects in the feedback condition adjusted their behavior faster following better-than-expected outcomes, compared to subjects in the no-feedback condition. Additionally, in both task conditions, “avoiders” adjusted their behavior faster following worse-than-expected outcomes, and treated the ambiguous no-feedback outcome as less rewarding, compared to non-avoiders. Together, results shed light on the important role of ambiguous and informative feedback in avoidance behavior.     

When is it adaptive to be patient? A general framework for evaluating delayed rewards

The tendency of animals to seek instant gratification instead of waiting for greater long-term benefits has been described as impatient, impulsive or lacking in self-control. How can we explain the evolution of such seemingly irrational behaviour? Here we analyse optimal behaviour in a variety of simple choice situations involving delayed rewards. We show that preferences for more immediate rewards should depend on a variety of factors, including whether the choice is a one-off or is likely to be repeated, the information the animal has about the continuing availability of the rewards and the opportunity to gain rewards through alternative activities. In contrast to the common assertion that rational animals should devalue delayed rewards exponentially, we find that this pattern of discounting is optimal only under restricted circumstances. We predict preference reversal whenever waiting for delayed rewards entails loss of opportunities elsewhere, but the direction of this reversal depends on whether the animal will face the same choice repeatedly. Finally, we question the ecological relevance of standard laboratory tests for impulsive behaviour, arguing that animals rarely face situations analogous to the self-control paradigm in their natural environment. To understand the evolution of impulsiveness, a more promising strategy would be to identify decision rules that are adaptive in a realistic ecological setting, and examine how these rules determine patterns of behaviour in simultaneous choice tests.     

The Development of Infants’ Sensitivity to Behavioral Intentions when Inferring Others’ Social Preferences

The present study investigated whether infants reason about others’ social preferences based on the intentions of others’ interactive actions. In Experiment 1, 12-month-old infants were familiarized with an event in which an agent either successfully helped a circle to climb up a hill (successful-helping condition) or failed to help the circle to achieve its goal (failed-helping condition). During the test, the infants saw the circle approach either the helper (approach-helper event) or the hinderer (approach-hinderer event). In the successful-helping condition, the 12-month-old infants looked for longer at the approach-hinderer event than at the approach-helper event, but in the failed-helping condition, looking times were about equal for the two test events. These results suggest that 12-month-old infants could not infer the circle’s preference when the helper’s action did not lead to its intended outcome. In Experiment 2, 16-month-olds were tested in the failed-helping condition; they looked longer at the approach-hinderer event than at the approach-helper event, which suggests that they could reason about the third party’s social preferences based on the exhibited intentions. In Experiment 3, 12-month-olds were familiarized with events in which the final outcomes of helping and hindering actions were ambiguous. The results revealed that 12-month-old infants are also sensitive to intentions when inferring other’s social preferences. The results suggest that by 12-months of age, infants expect an agent to prefer and approach another who intends to help the circle to achieve its goal, regardless of the outcome. The current research has implications for moral reasoning and social evaluation in infancy.     

Genome-Wide Reconstruction of Rediploidization Following Autopolyploidization across One Hundred Million Years of Salmonid Evolution

The long-term evolutionary impacts of whole-genome duplication (WGD) are strongly influenced by the ensuing rediploidization process. Following autopolyploidization, rediploidization involves a transition from tetraploid to diploid meiotic pairing, allowing duplicated genes (ohnologs) to diverge genetically and functionally. Our understanding of autopolyploid rediploidization has been informed by a WGD event ancestral to salmonid fishes, where large genomic regions are characterized by temporally delayed rediploidization, allowing lineage-specific ohnolog sequence divergence in the major salmonid clades. Here, we investigate the long-term outcomes of autopolyploid rediploidization at genome-wide resolution, exploiting a recent “explosion” of salmonid genome assemblies, including a new genome sequence for the huchen (Hucho hucho). We developed a genome alignment approach to capture duplicated regions across multiple species, allowing us to create 121,864 phylogenetic trees describing genome-wide ohnolog divergence across salmonid evolution. Using molecular clock analysis, we show that 61% of the ancestral salmonid genome experienced an initial “wave” of rediploidization in the late Cretaceous (85–106 Ma). This was followed by a period of relative genomic stasis lasting 17–39 My, where much of the genome remained tetraploid. A second rediploidization wave began in the early Eocene and proceeded alongside species diversification, generating predictable patterns of lineage-specific ohnolog divergence, scaling in complexity with the number of speciation events. Using gene set enrichment, gene expression, and codon-based selection analyses, we provide insights into potential functional outcomes of delayed rediploidization. This study enhances our understanding of delayed autopolyploid rediploidization and has broad implications for future studies of WGD events.     

The Role of Trait and State Absorption in the Enjoyment of Music

Little is known about the role of state versus trait characteristics on our enjoyment of music. The aim of this study was to investigate the influence of state and trait absorption upon preference for music, particularly preference for music that evokes negative emotions. The sample consisted of 128 participants who were asked to listen to two pieces of self-selected music and rate the music on variables including preference and felt and expressed emotions. Participants completed a brief measure of state absorption after listening to each piece, and a trait absorption inventory. State absorption was strongly positively correlated with music preference, whereas trait absorption was not. Trait absorption was related to preference for negative emotions in music, with chi-square analyses demonstrating greater enjoyment of negative emotions in music among individuals with high trait absorption. This is the first study to show that state and trait absorption have separable and distinct effects on a listener’s music experience, with state characteristics impacting music enjoyment in the moment, and trait characteristics influencing music preference based on its emotional content.     

The Long Term Economic Impact of Severe Obstetric Complications for Women and Their Children in Burkina Faso

This study investigates the long term economic impact of severe obstetric complications for women and their children in Burkina Faso, focusing on measures of food security, expenditures and related quality of life measures. It uses a hospital based cohort, first visited in 2004/2005 and followed up four years later. This cohort of 1014 women consisted of two main groups of comparison: 677 women who had an uncomplicated delivery and 337 women who experienced a severe obstetric complication which would have almost certainly caused death had they not received hospital care (labelled a “near miss” event). To analyze the impact of such near miss events as well as the possible interaction with the pregnancy outcome, we compared household and individual level indicators between women without a near miss event and women with a near miss event who either had a live birth, a perinatal death or an early pregnancy loss. We used propensity score matching to remove initial selection bias. Although we found limited effects for the whole group of near miss women, the results indicated negative impacts: a) for near miss women with a live birth, on child development and education, on relatively expensive food consumption and on women’s quality of life; b) for near miss women with perinatal death, on relatively expensive foods consumption and children’s education and c) for near miss women who had an early pregnancy loss, on overall food security. Our results showed that severe obstetric complications have long lasting consequences for different groups of women and their children and highlighted the need for carefully targeted interventions.