The Effect of Positive and Negative Feedback on Risk-Taking across Different Contexts

Preferences for risky choices have often been shown to be unstable and context-dependent. Though people generally avoid gambles with mixed outcomes, a phenomenon often attributed to loss aversion, contextual factors can impact this dramatically. For example, people typically prefer risky options after a financial loss, while generally choosing safer options after a monetary gain. However, it is unclear what exactly contributes to these preference shifts as a function of prior outcomes, as these gain/loss outcomes are usually confounded with participant performance, and therefore it is unclear whether these effects are driven purely by the monetary gains or losses, or rather by success or failure at the actual task. Here, we experimentally separated the effects of monetary gains/losses from performance success/failure prior to a standard risky choice. Participants performed a task in which they experienced contextual effects: 1) monetary gain or loss based directly on performance, 2) monetary gain or loss that was randomly awarded and was, crucially, independent from performance, and 3) success or failure feedback based on performance, but without any monetary incentive. Immediately following these positive/negative contexts, participants were presented with a gain-loss gamble that they had to decide to either play or pass. We found that risk preferences for identical sets of gambles were biased by positive and negative contexts containing monetary gains and losses, but not by contexts containing performance feedback. This data suggests that the observed framing effects are driven by aversion for monetary losses and not simply by the positive or negative valence of the context, or by potential moods resulting from positive or negative contexts. These results highlight the specific context dependence of risk preferences.     

Posttraumatic Stress Disorder Increases Sensitivity to Long Term Losses among Patients with Major Depressive Disorder

Background

Decisions under risk and with outcomes that are delayed in time are ubiquitous in real life and can have a significant impact on the health and wealth of the decision-maker. Despite its potential relevance for real-world choices, the degree of aberrant risky and intertemporal decision-making in patients suffering from major depressive disorder (MDD) and posttraumatic stress disorder (PTSD) has received little attention to date.

Method

We used a case-control design to compare decision-making in healthy control subjects (N=16) versus untreated depressed subjects in a current major depressive episode (N=20). In order to examine how major depressive disorder (MDD) may impact decision-making, subjects made decisions over (1) risky outcomes and (2) delayed outcomes in the domain of gains and losses using choice paradigms from neuroeconomics. In a pre-planned analysis, depressed subjects were subdivided into those with primary PTSD along with comorbid MDD (MDD+PTSD) versus those with primary MDD without PTSD (MDD-only). Choice behavior was modeled via a standard econometric model of intertemporal choice, a quasi-hyperbolic temporal discounting function, which was estimated for each subject group separately.

Results

Under conditions of potential gain, depressed subjects demonstrated greater discounting for gains across all time frames compared to controls. In the realm of losses, both subgroups of depressed subjects discounted more steeply than controls for short time frames. However, for delayed losses ranging from >1-10 years, MDD+PTSD subjects showed shallower discounting rates relative to MDD-only subjects, who continued to discount future losses steeply. Risk attitudes did not contribute to differences in intertemporal choice.

Conclusions

Depressed patients make choices that minimize current pain and maximize current reward, despite severe later consequences or lost opportunities. Anxiety associated with PTSD may serve as a partially protective factor in decision-making about long-term potential losses compared to MDD patients without PTSD.     

Interdependent utilities: how social ranking affects choice behavior

Organization in hierarchical dominance structures is prevalent in animal societies, so a strong preference for higher positions in social ranking is likely to be an important motivation of human social and economic behavior. This preference is also likely to influence the way in which we evaluate our outcome and the outcome of others, and finally the way we choose. In our experiment participants choose among lotteries with different levels of risk, and can observe the choice that others have made. Results show that the relative weight of gains and losses is the opposite in the private and social domain. For private outcomes, experience and anticipation of losses loom larger than gains, whereas in the social domain, gains loom larger than losses, as indexed by subjective emotional evaluations and physiological responses. We propose a theoretical model (interdependent utilities), predicting the implication of this effect for choice behavior. The relatively larger weight assigned to social gains strongly affects choices, inducing complementary behavior: faced with a weaker competitor, participants adopt a more risky and dominant behavior.     

Risky Decisions and Their Consequences: Neural Processing by Boys with Antisocial Substance Disorder

Background

Adolescents with conduct and substance problems (“Antisocial Substance Disorder” (ASD)) repeatedly engage in risky antisocial and drug-using behaviors. We hypothesized that, during processing of risky decisions and resulting rewards and punishments, brain activation would differ between abstinent ASD boys and comparison boys.

Methodology/Principal Findings

We compared 20 abstinent adolescent male patients in treatment for ASD with 20 community controls, examining rapid event-related blood-oxygen-level-dependent (BOLD) responses during functional magnetic resonance imaging. In 90 decision trials participants chose to make either a cautious response that earned one cent, or a risky response that would either gain 5 cents or lose 10 cents; odds of losing increased as the game progressed. We also examined those times when subjects experienced wins, or separately losses, from their risky choices. We contrasted decision trials against very similar comparison trials requiring no decisions, using whole-brain BOLD-response analyses of group differences, corrected for multiple comparisons. During decision-making ASD boys showed hypoactivation in numerous brain regions robustly activated by controls, including orbitofrontal and dorsolateral prefrontal cortices, anterior cingulate, basal ganglia, insula, amygdala, hippocampus, and cerebellum. While experiencing wins, ASD boys had significantly less activity than controls in anterior cingulate, temporal regions, and cerebellum, with more activity nowhere. During losses ASD boys had significantly more activity than controls in orbitofrontal cortex, dorsolateral prefrontal cortex, brain stem, and cerebellum, with less activity nowhere.

Conclusions/Significance

Adolescent boys with ASD had extensive neural hypoactivity during risky decision-making, coupled with decreased activity during reward and increased activity during loss. These neural patterns may underlie the dangerous, excessive, sustained risk-taking of such boys. The findings suggest that the dysphoria, reward insensitivity, and suppressed neural activity observed among older addicted persons also characterize youths early in the development of substance use disorders.     

The Commonality of Loss Aversion across Procedures and Stimuli

Individuals tend to give losses approximately 2-fold the weight that they give gains. Such approximations of loss aversion (LA) are almost always measured in the stimulus domain of money, rather than objects or pictures. Recent work on preference-based decision-making with a schedule-less keypress task (relative preference theory, RPT) has provided a mathematical formulation for LA similar to that in prospect theory (PT), but makes no parametric assumptions in the computation of LA, uses a variable tied to communication theory (i.e., the Shannon entropy or information), and works readily with non-monetary stimuli. We evaluated if these distinct frameworks described similar LA in healthy subjects, and found that LA during the anticipation phase of the PT-based task correlated significantly with LA related to the RPT-based task. Given the ease with which non-monetary stimuli can be used on the Internet, or in animal studies, these findings open an extensive range of applications for the study of loss aversion. Furthermore, the emergence of methodology that can be used to measure preference for both social stimuli and money brings a common framework to the evaluation of preference in both social psychology and behavioral economics.     

Relative Gains,Losses, and Reference Points in Probabilistic Choice in Rats

Theoretical reference points have been proposed to differentiate probabilistic gains from probabilistic losses in humans, but such a phenomenon in non-human animals has yet to be thoroughly elucidated. Three experiments evaluated the effect of reward magnitude on probabilistic choice in rats, seeking to determine reference point use by examining the effect of previous outcome magnitude(s) on subsequent choice behavior. Rats were trained to choose between an outcome that always delivered reward (low-uncertainty choice) and one that probabilistically delivered reward (high-uncertainty). The probability of high-uncertainty outcome receipt and the magnitudes of low-uncertainty and high-uncertainty outcomes were manipulated within and between experiments. Both the low- and high-uncertainty outcomes involved variable reward magnitudes, so that either a smaller or larger magnitude was probabilistically delivered, as well as reward omission following high-uncertainty choices. In Experiments 1 and 2, the between groups factor was the magnitude of the high-uncertainty-smaller (H-S) and high-uncertainty-larger (H-L) outcome, respectively. The H-S magnitude manipulation differentiated the groups, while the H-L magnitude manipulation did not. Experiment 3 showed that manipulating the probability of differential losses as well as the expected value of the low-uncertainty choice produced systematic effects on choice behavior. The results suggest that the reference point for probabilistic gains and losses was the expected value of the low-uncertainty choice. Current theories of probabilistic choice behavior have difficulty accounting for the present results, so an integrated theoretical framework is proposed. Overall, the present results have implications for understanding individual differences and corresponding underlying mechanisms of probabilistic choice behavior.     

The subjective value of delayed and probabilistic outcomes: Outcome size matters for gains but not for losses

The subjective value of a reward (gain) is related to factors such as its size, the delay to its receipt and the probability of its receipt. We examined whether the subjective value of losses was similarly affected by these factors in 128 adults. Participants chose between immediate/certain gains or losses and larger delayed/probabilistic gains or losses. Rewards of $100 were devalued as a function of their delay (“discounted”) relatively less than $10 gains while probabilistic $100 rewards were discounted relatively more than $10 rewards. However, there was no effect of outcome size on discounting of delayed or probabilistic losses. For delayed outcomes of each size, the degree to which gains were discounted was positively correlated with the degree to which losses were discounted, whereas for probabilistic outcomes, no such correlation was observed. These results suggest that the processes underlying the subjective valuation of losses are different from those underlying the subjective valuation of gains.     

Motor Preparatory Activity in Posterior Parietal Cortex is Modulated by Subjective Absolute Value

For optimal response selection, the consequences associated with behavioral success or failure must be appraised. To determine how monetary consequences influence the neural representations of motor preparation, human brain activity was scanned with fMRI while subjects performed a complex spatial visuomotor task. At the beginning of each trial, reward context cues indicated the potential gain and loss imposed for correct or incorrect trial completion. FMRI-activity in canonical reward structures reflected the expected value related to the context. In contrast, motor preparatory activity in posterior parietal and premotor cortex peaked in high “absolute value” (high gain or loss) conditions: being highest for large gains in subjects who believed they performed well while being highest for large losses in those who believed they performed poorly. These results suggest that the neural activity preceding goal-directed actions incorporates the absolute value of that action, predicated upon subjective, rather than objective, estimates of one''s performance.     

网络游戏成瘾的奖赏加工缺陷及其神经机制

奖赏加工异常是网络游戏成瘾（internet gaming disorder，IGD）核心特征之一，近期研究结合认知神经科学技术对IGD的神经机制进行探讨发现，IGD与药物成瘾存在相似的神经基础，但仍然存在较多争议。本文从奖赏类型、奖赏加工阶段梳理了IGD人群奖赏加工的研究进展。IGD人群在游戏相关线索下，奖赏预期（reward anticipation）阶段的奖赏系统激活可能与注意偏向、情绪体验和渴求感增加有关。同时，IGD人群对自然奖赏表现出较为一致的低敏感性，该特征主要出现在结果评估（outcome evaluation）阶段。未来研究可以排除共病因素、结合生动的游戏奖赏刺激，进一步探究奖赏预期和结果评估异常如何推动IGD的发展。     

A neurochemical approach to valuation sensitivity over gains and losses

Prospect theory proposes the hypothesis that people have diminishing sensitivity in valuing increases in the size of monetary outcomes, for both gains and losses. For decision-making under risk, this implies a tendency to be risk-tolerant over losses while being generally risk averse over gains. We offer a neurochemistry-based model of the diminishing valuation sensitivity hypothesis. Specifically, we propose that dopamine tone modulates the sensitivity towards valuation of gains while serotonin tone modulates the sensitivity towards valuation of losses. Consequently, higher dopamine tone would yield a more concave valuation function over gains while higher serotonin tone would yield a more convex valuation function over losses. Using a neurogenetics strategy to test our neurochemical model, we find that subjects with the 9-repeat allele of DAT1 (lower DA tone) are more risk-tolerant over gains than subjects with the 10-repeat allele, and that subjects with the 10-repeat allele of STin2 (higher 5HT tone) are more risk-tolerant over losses than subjects with the 12-repeat allele. Overall, our results support the implications of our model and provide the first neurogenetics evidence that risk attitudes are partially hard-wired in differentiating between gain- and loss-oriented risks.     

Gain and loss learning differentially contribute to life financial outcomes

Emerging findings imply that distinct neurobehavioral systems process gains and losses. This study investigated whether individual differences in gain learning and loss learning might contribute to different life financial outcomes (i.e., assets versus debt). In a community sample of healthy adults (n = 75), rapid learners had smaller debt-to-asset ratios overall. More specific analyses, however, revealed that those who learned rapidly about gains had more assets, while those who learned rapidly about losses had less debt. These distinct associations remained strong even after controlling for potential cognitive (e.g., intelligence, memory, and risk preferences) and socioeconomic (e.g., age, sex, ethnicity, income, education) confounds. Self-reported measures of assets and debt were additionally validated with credit report data in a subset of subjects. These findings support the notion that different gain and loss learning systems may exert a cumulative influence on distinct life financial outcomes.     

Spillover Effects of Loss of Control on Risky Decision-Making

Decision making in risky situations is frequently required in our everyday lives and has been shown to be influenced by various factors, some of which are independent of the risk context. Based on previous findings and theories about the central role of perceptions of control and their impact on subsequent settings, spillover effects of subjective loss of control on risky decision-making are assumed. After developing an innovative experimental paradigm for inducing loss of control, its hypothesized effects on risky decision-making are investigated. Partially supporting the hypotheses, results demonstrated no increased levels of risk perceptions but decreased risk-taking behavior following experiences of loss of control. Thus, this study makes a methodological contribution by proposing a newly developed experimental paradigm facilitating further research on the effects of subjective loss of control, and additionally provides partial evidence for the spillover effects of loss of control experiences on risky decision-making.     

Global Patterns of Protein Domain Gain and Loss in Superkingdoms

Domains are modules within proteins that can fold and function independently and are evolutionarily conserved. Here we compared the usage and distribution of protein domain families in the free-living proteomes of Archaea, Bacteria and Eukarya and reconstructed species phylogenies while tracing the history of domain emergence and loss in proteomes. We show that both gains and losses of domains occurred frequently during proteome evolution. The rate of domain discovery increased approximately linearly in evolutionary time. Remarkably, gains generally outnumbered losses and the gain-to-loss ratios were much higher in akaryotes compared to eukaryotes. Functional annotations of domain families revealed that both Archaea and Bacteria gained and lost metabolic capabilities during the course of evolution while Eukarya acquired a number of diverse molecular functions including those involved in extracellular processes, immunological mechanisms, and cell regulation. Results also highlighted significant contemporary sharing of informational enzymes between Archaea and Eukarya and metabolic enzymes between Bacteria and Eukarya. Finally, the analysis provided useful insights into the evolution of species. The archaeal superkingdom appeared first in evolution by gradual loss of ancestral domains, bacterial lineages were the first to gain superkingdom-specific domains, and eukaryotes (likely) originated when an expanding proto-eukaryotic stem lineage gained organelles through endosymbiosis of already diversified bacterial lineages. The evolutionary dynamics of domain families in proteomes and the increasing number of domain gains is predicted to redefine the persistence strategies of organisms in superkingdoms, influence the make up of molecular functions, and enhance organismal complexity by the generation of new domain architectures. This dynamics highlights ongoing secondary evolutionary adaptations in akaryotic microbes, especially Archaea.     

Individual Differences and Decision Making: When the Lure Effect of Gain Is a Matter of Size

The Iowa Gambling Task (IGT) is widely used in investigations of decision making. A growing number of studies have linked performance on this task to personality differences, with the aim of explaining the large degree of variability in healthy individuals'' performance of the task. However, this line of research has yielded inconsistent results. In the present study, we tested whether increasing the conflict between short-term and long-term gains in the IGT can clarify personality-related modulations of decision making. We assessed performance on the original IGT as a function of the personality traits typically involved in risky decision making (i.e., impulsivity, sensation seeking, sensitivity to reward and punishment). The impact of these same personality traits was also evaluated on a modified version of the task in which the difference in immediate reward magnitude between disadvantageous and advantageous decks was increased, while keeping the net gain fixed. The results showed that only in this latter IGT variant were highly impulsive individuals and high sensation seekers lured into making disadvantageous choices. The opposite seems to be the case for participants who were highly sensitive to punishment, although further data are needed to corroborate this finding. The present preliminary results suggest that the IGT variant used in this study could be more effective than the original task at identifying personality effects in decision making. Implications for dispositional and situational effects on decision making are discussed.     

Forest biomass stocks and dynamics across the subtropical Andes

Forest biomass plays an important role in the global carbon cycle. Therefore, understanding the factors that control forest biomass stocks and dynamics is a key challenge in the context of global change. We analyzed data from 60 forest plots in the subtropical Andes (22–27.5° S and 300–2300 m asl) to describe patterns and identify drivers of aboveground biomass (AGB) stocks and dynamics. We found that AGB stocks remained roughly constant with elevation due to compensating changes in basal area (which increased with elevation) and plot‐mean wood specific gravity (which decreased with elevation). AGB gain and loss rates both decreased with elevation and were explained mainly by temperature and rainfall (positive effects on both AGB gains and losses). AGB gain was also correlated with forest‐use history and weakly correlated with forest structure. Mean annual temperature and rainfall showed minor effects on AGB stocks and AGB change (gains minus losses) over recent decades. Although AGB change was only weakly correlated with climate variables, increases in AGB gains and losses with increasing rainfall—together with observed increases in rainfall in the subtropical Andes—suggest that these forests may become increasingly dynamic in the future. Abstract in Spanish is available with online material     

Offsets for land clearing: No net loss or the tail wagging the dog?

Summary   Offsets (also known as mitigation banks, compensatory habitat, set-asides) is a policy instrument recently introduced in several States in Australia to permit some land clearing while striving for no net loss in the extent and condition of native vegetation overall. Offsetting is criticized with respect to the amount of gain required to compensate for losses from clearing, the equivalence of losses and gains, the time lag between losses and gains and a poor record of compliance. Despite these criticisms, we conclude that offsetting is a useful policy instrument while governments continue to permit some clearing of native vegetation. However, offsets will only contribute to no net loss if (i) clearing is restricted to vegetation that is simplified enough so that its functions can be restored elsewhere with confidence or clearing is restricted to vegetation that is unlikely to persist and is not practicable to restore irrespective of clearing; (ii) any temporary loss in habitat between clearing and the maturation of an offset, or differences between the habitat lost from clearing and gained through an offset, does not represent significant risk to a species, population or ecosystem process; (iii) there will be gains of sufficient magnitude on the offset site to compensate for losses from clearing; (iv) best practice adaptive management is applied to offsets; (v) offsets are in place for at least the same duration as the impacts from clearing; and (vi) there is adequate compliance. Land clearing with offsets outside these parameters is inconsistent with 'no net loss'.     

EXACT INDICES, CRITERIA TO SELECT FROM MINIMUM LENGTH TREES

Abstract— Modifications of the consistency, retention and rescaled consistency indices are introduced. These apply to particular transformations of a character state rather than all of the transformations of a character. For example, if one observes relatively many losses in a character state over a suite of minimum length trees, a low weight is applied to the transformation to a loss; however, these observations infer nothing on the probability of the character state being gained independently. If the same character state shows few or no convergent gains on the suite of minimum length cladograms, then gains receive a relatively high weight. Conversely, if for a particular character state, convergent gains are common and losses rare, the transformation to a loss is given a higher weight than the transformation to a gain. For multistate characters, each possible transformation is weighted independently. Three indices are proposed, i.e. the exact consistently index, the exact retention index and the exact rescaled consistency index. The consistency index is modified to deal with characters with unknown entries.
The methods outlined not only select (or generate) preferred tree topologies but they also choose character optimizations, even for trees of identical topology.     

Dynamic Excitatory and Inhibitory Gain Modulation Can Produce Flexible,Robust and Optimal Decision-making

Behavioural and neurophysiological studies in primates have increasingly shown the involvement of urgency signals during the temporal integration of sensory evidence in perceptual decision-making. Neuronal correlates of such signals have been found in the parietal cortex, and in separate studies, demonstrated attention-induced gain modulation of both excitatory and inhibitory neurons. Although previous computational models of decision-making have incorporated gain modulation, their abstract forms do not permit an understanding of the contribution of inhibitory gain modulation. Thus, the effects of co-modulating both excitatory and inhibitory neuronal gains on decision-making dynamics and behavioural performance remain unclear. In this work, we incorporate time-dependent co-modulation of the gains of both excitatory and inhibitory neurons into our previous biologically based decision circuit model. We base our computational study in the context of two classic motion-discrimination tasks performed in animals. Our model shows that by simultaneously increasing the gains of both excitatory and inhibitory neurons, a variety of the observed dynamic neuronal firing activities can be replicated. In particular, the model can exhibit winner-take-all decision-making behaviour with higher firing rates and within a significantly more robust model parameter range. It also exhibits short-tailed reaction time distributions even when operating near a dynamical bifurcation point. The model further shows that neuronal gain modulation can compensate for weaker recurrent excitation in a decision neural circuit, and support decision formation and storage. Higher neuronal gain is also suggested in the more cognitively demanding reaction time than in the fixed delay version of the task. Using the exact temporal delays from the animal experiments, fast recruitment of gain co-modulation is shown to maximize reward rate, with a timescale that is surprisingly near the experimentally fitted value. Our work provides insights into the simultaneous and rapid modulation of excitatory and inhibitory neuronal gains, which enables flexible, robust, and optimal decision-making.     

Widespread intron loss suggests retrotransposon activity in ancient apicomplexans

Several facets of spliceosomal intron in apicomplexans remain mysterious. First, intron numbers vary across species by 2 orders of magnitude, indicating massive intron loss and/or gain. Second, previous studies have shown very different evolutionary patterns over different timescales, with 100-fold higher rates of intron loss/gain between genera than within genera. Third, the timing and dynamics of nearly complete intron loss in Cryptosporidium species, as well as reasons for retention of the few remaining introns, remain unknown. We compared intron positions in 785 orthologous genes between 3 moderate to intron-rich apicomplexan species. We estimate that the Theileria-Plasmodium ancestor had 4.5 times as many introns as modern Plasmodium species and 38% more than modern Theileria species, and that subsequent intron losses have outnumbered intron gains by 5.8 to 1 in Theileria and by some 56 to 1 in Plasmodium. Several patterns suggest that these intron losses occurred by recombination with reverse-transcribed mRNAs. Intriguingly, this finding suggests significant retrotransposon activity in the lineages leading to both Theileria and Plasmodium, in contrast to the dearth of known retrotransposons and intron loss within modern species from both genera. We also compared genomes from Cryptosporidium parvum and C. hominis and found no evidence of ongoing intron loss, nor of intron gain. By contrast, Cryptosporidium introns are less evolutionary conserved with Toxoplasma than are introns from other apicomplexans; thus the few remaining introns are not simply indispensable ancestral introns.