Intrinsic Valuation of Information in Decision Making under Uncertainty

In a dynamic world, an accurate model of the environment is vital for survival, and agents ought regularly to seek out new information with which to update their world models. This aspect of behaviour is not captured well by classical theories of decision making, and the cognitive mechanisms of information seeking are poorly understood. In particular, it is not known whether information is valued only for its instrumental use, or whether humans also assign it a non-instrumental intrinsic value. To address this question, the present study assessed preference for non-instrumental information among 80 healthy participants in two experiments. Participants performed a novel information preference task in which they could choose to pay a monetary cost to receive advance information about the outcome of a monetary lottery. Importantly, acquiring information did not alter lottery outcome probabilities. We found that participants were willing to incur considerable monetary costs to acquire payoff-irrelevant information about the lottery outcome. This behaviour was well explained by a computational cognitive model in which information preference resulted from aversion to temporally prolonged uncertainty. These results strongly suggest that humans assign an intrinsic value to information in a manner inconsistent with normative accounts of decision making under uncertainty. This intrinsic value may be associated with adaptive behaviour in real-world environments by producing a bias towards exploratory and information-seeking behaviour.     

Role of anticipated reward in cognitive behavioral control

The lateral prefrontal cortex (LPFC), which is important for higher cognitive activity, is also concerned with motivational operations; this is exemplified by its activity in relation to expectancy of rewards. In the LPFC, motivational information is integrated with cognitive information, as demonstrated by the enhancement of working-memory-related activity by reward expectancy. Such activity would be expected to induce changes in attention and, subsequently, to modify behavioral performance. Recently, the effects of motivation and emotion on neural activities have been examined in several areas of the brain in relation to cognitive-task performance. Of these areas, the LPFC seems to have the most important role in adaptive goal-directed behavior, by sending top-down attention-control signals to other areas of the brain.     

Expectation Suppression in Early Visual Cortex Depends on Task Set

Stimulus expectation can modulate neural responses in early sensory cortical regions, with expected stimuli often leading to a reduced neural response. However, it is unclear whether this expectation suppression is an automatic phenomenon or is instead dependent on the type of task a subject is engaged in. To investigate this, human subjects were presented with visual grating stimuli in the periphery that were either predictable or non-predictable while they performed three tasks that differently engaged cognitive resources. In two of the tasks, the predictable stimulus was task-irrelevant and spatial attention was engaged at fixation, with a high load on either perceptual or working memory resources. In the third task, the predictable stimulus was task-relevant, and therefore spatially attended. We observed that expectation suppression is dependent on the cognitive resources engaged by a subjects’ current task. When the grating was task-irrelevant, expectation suppression for predictable items was visible in retinotopically specific areas of early visual cortex (V1-V3) during the perceptual task, but it was abolished when working memory was loaded. When the grating was task-relevant and spatially attended, there was no significant effect of expectation in early visual cortex. These results suggest that expectation suppression is not an automatic phenomenon, but dependent on attentional state and type of available cognitive resources.     

When Breathing Interferes with Cognition: Experimental Inspiratory Loading Alters Timed Up-and-Go Test in Normal Humans

Human breathing stems from automatic brainstem neural processes. It can also be operated by cortico-subcortical networks, especially when breathing becomes uncomfortable because of external or internal inspiratory loads. How the “irruption of breathing into consciousness” interacts with cognition remains unclear, but a case report in a patient with defective automatic breathing (Ondine''s curse syndrome) has shown that there was a cognitive cost of breathing when the respiratory cortical networks were engaged. In a pilot study of putative breathing-cognition interactions, the present study relied on a randomized design to test the hypothesis that experimentally loaded breathing in 28 young healthy subjects would have a negative impact on cognition as tested by “timed up-and-go” test (TUG) and its imagery version (iTUG). Progressive inspiratory threshold loading resulted in slower TUG and iTUG performance. Participants consistently imagined themselves faster than they actually were. However, progressive inspiratory loading slowed iTUG more than TUG, a finding that is unexpected with regard to the known effects of dual tasking on TUG and iTUG (slower TUG but stable iTUG). Insofar as the cortical networks engaged in response to inspiratory loading are also activated during complex locomotor tasks requiring cognitive inputs, we infer that competition for cortical resources may account for the breathing-cognition interference that is evidenced here.     

Origin of Emotion Effects on ERP Correlates of Emotional Word Processing: The Emotion Duality Approach

We distinguish two evaluative systems which evoke automatic and reflective emotions. Automatic emotions are direct reactions to stimuli whereas reflective emotions are always based on verbalized (and often abstract) criteria of evaluation. We conducted an electroencephalography (EEG) study in which 25 women were required to read and respond to emotional words which engaged either the automatic or reflective system. Stimulus words were emotional (positive or negative) and neutral. We found an effect of valence on an early response with dipolar fronto-occipital topography; positive words evoked a higher amplitude response than negative words. We also found that topographically specific differences in the amplitude of the late positive complex were related to the system involved in processing. Emotional stimuli engaging the automatic system were associated with significantly higher amplitudes in the left-parietal region; the response to neutral words was similar regardless of the system engaged. A different pattern of effects was observed in the central region, neutral stimuli engaging the reflective system evoked a higher amplitudes response whereas there was no system effect for emotional stimuli. These differences could not be reduced to effects of differences between the arousing properties and concreteness of the words used as stimuli.     

Specific contributions of ventromedial, anterior cingulate, and lateral prefrontal cortex for attentional selection and stimulus valuation

Attentional control ensures that neuronal processes prioritize the most relevant stimulus in a given environment. Controlling which stimulus is attended thus originates from neurons encoding the relevance of stimuli, i.e. their expected value, in hand with neurons encoding contextual information about stimulus locations, features, and rules that guide the conditional allocation of attention. Here, we examined how these distinct processes are encoded and integrated in macaque prefrontal cortex (PFC) by mapping their functional topographies at the time of attentional stimulus selection. We find confined clusters of neurons in ventromedial PFC (vmPFC) that predominantly convey stimulus valuation information during attention shifts. These valuation signals were topographically largely separated from neurons predicting the stimulus location to which attention covertly shifted, and which were evident across the complete medial-to-lateral extent of the PFC, encompassing anterior cingulate cortex (ACC), and lateral PFC (LPFC). LPFC responses showed particularly early-onset selectivity and primarily facilitated attention shifts to contralateral targets. Spatial selectivity within ACC was delayed and heterogeneous, with similar proportions of facilitated and suppressed responses during contralateral attention shifts. The integration of spatial and valuation signals about attentional target stimuli was observed in a confined cluster of neurons at the intersection of vmPFC, ACC, and LPFC. These results suggest that valuation processes reflecting stimulus-specific outcome predictions are recruited during covert attentional control. Value predictions and the spatial identification of attentional targets were conveyed by largely separate neuronal populations, but were integrated locally at the intersection of three major prefrontal areas, which may constitute a functional hub within the larger attentional control network.     

Need for Cognitive Closure Modulates How Perceptual Decisions Are Affected by Task Difficulty and Outcome Relevance

The aim of this study was to assess the extent to which Need for Cognitive Closure (NCC), an individual-level epistemic motivation, can explain inter-individual variability in the cognitive effort invested on a perceptual decision making task (the random motion task). High levels of NCC are manifested in a preference for clarity, order and structure and a desire for firm and stable knowledge. The study evaluated how NCC moderates the impact of two variables known to increase the amount of cognitive effort invested on a task, namely task ambiguity (i.e., the difficulty of the perceptual discrimination) and outcome relevance (i.e., the monetary gain associated with a correct discrimination). Based on previous work and current design, we assumed that reaction times (RTs) on our motion discrimination task represent a valid index of effort investment. Task ambiguity was associated with increased cognitive effort in participants with low or medium NCC but, interestingly, it did not affect the RTs of participants with high NCC. A different pattern of association was observed for outcome relevance; high outcome relevance increased cognitive effort in participants with moderate or high NCC, but did not affect the performance of low NCC participants. In summary, the performance of individuals with low NCC was affected by task difficulty but not by outcome relevance, whereas individuals with high NCC were influenced by outcome relevance but not by task difficulty; only participants with medium NCC were affected by both task difficulty and outcome relevance. These results suggest that perceptual decision making is influenced by the interaction between context and NCC.     

Viewing Time Measures of Sexual Orientation in Samoan Cisgender Men Who Engage in Sexual Interactions with Fa’afafine

Androphilia refers to attraction to adult males, whereas gynephilia refers to attraction to adult females. The current study employed self-report and viewing time (response time latency) measures of sexual attraction to determine the sexual orientation of Samoan cisgender men (i.e., males whose gender presentation and identity is concordant with their biological sex) who engage in sexual interactions with transgender male androphiles (known locally as fa’afafine) compared to: (1) Samoan cisgender men who only engage in sexual interactions with women, and (2) fa’afafine. As expected, both measures indicated that cisgender men who only engaged in sexual interactions with women exhibited a gynephilic pattern of sexual attraction, whereas fa’afafine exhibited an androphilic one. In contrast, both measures indicated that cisgender men who engaged in sexual interactions with fa’afafine demonstrated a bisexual pattern of sexual attraction. Most of the cisgender men who exhibited bisexual viewing times did not engage in sexual activity with both men and women indicating that the manner in which bisexual patterns of sexual attraction manifest behaviorally vary from one culture to the next.     

Incipient cognition solves the spatial reciprocity conundrum of cooperation

Background

From the simplest living organisms to human societies, cooperation among individuals emerges as a paradox difficult to explain and describe mathematically, although very often observed in reality. Evolutionary game theory offers an excellent toolbar to investigate this issue. Spatial structure has been one of the first mechanisms promoting cooperation; however, alone it only opens a narrow window of viability.

Methodology/Principal Findings

Here we equip individuals with incipient cognitive abilities, and investigate the evolution of cooperation in a spatial world where retaliation, forgiveness, treason and mutualism may coexist, as individuals engage in Prisoner''s Dilemma games. In the model, individuals are able to distinguish their partners and act towards them based on previous interactions. We show how the simplest level of cognition, alone, can lead to the emergence of cooperation.

Conclusions/Significance

Despite the incipient nature of the individuals'' cognitive abilities, cooperation emerges for unprecedented values of the temptation to cheat, being also robust to invasion by cheaters, errors in decision making and inaccuracy of imitation, features akin to many species, including humans.     

When Does Reward Maximization Lead to Matching Law?

What kind of strategies subjects follow in various behavioral circumstances has been a central issue in decision making. In particular, which behavioral strategy, maximizing or matching, is more fundamental to animal''s decision behavior has been a matter of debate. Here, we prove that any algorithm to achieve the stationary condition for maximizing the average reward should lead to matching when it ignores the dependence of the expected outcome on subject''s past choices. We may term this strategy of partial reward maximization “matching strategy”. Then, this strategy is applied to the case where the subject''s decision system updates the information for making a decision. Such information includes subject''s past actions or sensory stimuli, and the internal storage of this information is often called “state variables”. We demonstrate that the matching strategy provides an easy way to maximize reward when combined with the exploration of the state variables that correctly represent the crucial information for reward maximization. Our results reveal for the first time how a strategy to achieve matching behavior is beneficial to reward maximization, achieving a novel insight into the relationship between maximizing and matching.     

Cost-Effectiveness Analysis of Chemical Testing for Decision-Support: How to Include Animal Welfare?

Toxicity testing for regulatory purposes raises the question of test selection for a particular endpoint. Given the public's concern for animal welfare, test selection is a multi-objective decision problem that requires balancing information outcome, animal welfare loss, and monetary testing costs. This paper demonstrates the applicability of cost-effectiveness analysis as a decision-support tool for test selection in a regulatory context such as, for example, the new European chemicals legislation (REACH). We distinguish different decision-making perspectives, in particular the regulator's and chemical industry's perspectives, and we discuss how cost-effectiveness analysis can be applied to test selection from both perspectives. Furthermore, we show how animal welfare goals can be included in cost-effectiveness analyses, and we provide a three-dimensional extension to the standard cost-effectiveness analysis if animal welfare loss cannot be valued in monetary terms. To illustrate how cost-effectiveness analysis works in different settings, we apply our model to a simple case of selecting short-term tests for mutagenicity. We demonstrate that including sufficiently high values for animal welfare induces cost-effective replacements of animal testing. Furthermore, we show that the regulator and chemical companies face different tradeoffs when selecting tests. This may lead to different choices of tests or testing systems.     

Differential Contributions of Dorso-Ventral and Rostro-Caudal Prefrontal White Matter Tracts to Cognitive Control in Healthy Older Adults

Prefrontal cortex mediates cognitive control by means of circuitry organized along dorso-ventral and rostro-caudal axes. Along the dorso-ventral axis, ventrolateral PFC controls semantic information, whereas dorsolateral PFC encodes task rules. Along the rostro-caudal axis, anterior prefrontal cortex encodes complex rules and relationships between stimuli, whereas posterior prefrontal cortex encodes simple relationships between stimuli and behavior. Evidence of these gradients of prefrontal cortex organization has been well documented in fMRI studies, but their functional correlates have not been examined with regard to integrity of underlying white matter tracts. We hypothesized that (a) the integrity of specific white matter tracts is related to cognitive functioning in a manner consistent with the dorso-ventral and rostro-caudal organization of the prefrontal cortex, and (b) this would be particularly evident in healthy older adults. We assessed three cognitive processes that recruit the prefrontal cortex and can distinguish white matter tracts along the dorso-ventral and rostro-caudal dimensions –episodic memory, working memory, and reasoning. Correlations between cognition and fractional anisotropy as well as fiber tractography revealed: (a) Episodic memory was related to ventral prefrontal cortex-thalamo-hippocampal fiber integrity; (b) Working memory was related to integrity of corpus callosum body fibers subserving dorsolateral prefrontal cortex; and (c) Reasoning was related to integrity of corpus callosum body fibers subserving rostral and caudal dorsolateral prefrontal cortex. These findings confirm the ventrolateral prefrontal cortex''s role in semantic control and the dorsolateral prefrontal cortex''s role in rule-based processing, in accordance with the dorso-ventral prefrontal cortex gradient. Reasoning-related rostral and caudal superior frontal white matter may facilitate different levels of task rule complexity. This study is the first to demonstrate dorso-ventral and rostro-caudal prefrontal cortex processing gradients in white matter integrity.     

Teasing,Taunting, and the Politics of Politeness: High Sociometric Status Is Associated with Expectation-Consistent Behavior

Research examining face-to-face status hierarchies suggests that individuals attain respect and admiration by engaging in behavior that influences others'' judgments of their value to the group. Building on this research, we expected that high-status individuals would be less likely to engage in behaviors that violate group norms and expectations, relative to low-status individuals. Adolescent participants took part in an interaction in which they teased an opposite-gender friend (Study 1) or an experiment in which taunting or cheering expectations were manipulated (Study 2). Consistent with the hypothesis, high-status boys and girls engaged in teasing behaviors consistent with their gender roles, relative to their low status counterparts (Study 1). In Study 2, high-status boys engaged in more direct provocation and off-record commentary while taunting, and more affiliative behavior while cheering on their partner, relative to low-status boys. Discussion focused on how expectation-consistent actions help individuals maintain elevated status.     

The Cerebellum Predicts the Temporal Consequences of Observed Motor Acts

It is increasingly clear that we extract patterns of temporal regularity between events to optimize information processing. The ability to extract temporal patterns and regularity of events is referred as temporal expectation. Temporal expectation activates the same cerebral network usually engaged in action selection, comprising cerebellum. However, it is unclear whether the cerebellum is directly involved in temporal expectation, when timing information is processed to make predictions on the outcome of a motor act. Healthy volunteers received one session of either active (inhibitory, 1Hz) or sham repetitive transcranial magnetic stimulation covering the right lateral cerebellum prior the execution of a temporal expectation task. Subjects were asked to predict the end of a visually perceived human body motion (right hand handwriting) and of an inanimate object motion (a moving circle reaching a target). Videos representing movements were shown in full; the actual tasks consisted of watching the same videos, but interrupted after a variable interval from its onset by a dark interval of variable duration. During the ‘dark’ interval, subjects were asked to indicate when the movement represented in the video reached its end by clicking on the spacebar of the keyboard. Performance on the timing task was analyzed measuring the absolute value of timing error, the coefficient of variability and the percentage of anticipation responses. The active group exhibited greater absolute timing error compared with the sham group only in the human body motion task. Our findings suggest that the cerebellum is engaged in cognitive and perceptual domains that are strictly connected to motor control.     

Accidental Outcomes Guide Punishment in a “Trembling Hand” Game

How do people respond to others'' accidental behaviors? Reward and punishment for an accident might depend on the actor''s intentions, or instead on the unintended outcomes she brings about. Yet, existing paradigms in experimental economics do not include the possibility of accidental monetary allocations. We explore the balance of outcomes and intentions in a two-player economic game where monetary allocations are made with a “trembling hand”: that is, intentions and outcomes are sometimes mismatched. Player 1 allocates $10 between herself and Player 2 by rolling one of three dice. One die has a high probability of a selfish outcome, another has a high probability of a fair outcome, and the third has a high probability of a generous outcome. Based on Player 1''s choice of die, Player 2 can infer her intentions. However, any of the three die can yield any of the three possible outcomes. Player 2 is given the opportunity to respond to Player 1''s allocation by adding to or subtracting from Player 1''s payoff. We find that Player 2''s responses are influenced substantially by the accidental outcome of Player 1''s roll of the die. Comparison to control conditions suggests that in contexts where the allocation is at least partially under the control of Player 1, Player 2 will punish Player 1 accountable for unintentional negative outcomes. In addition, Player 2''s responses are influenced by Player 1''s intention. However, Player 2 tends to modulate his responses substantially more for selfish intentions than for generous intentions. This novel economic game provides new insight into the psychological mechanisms underlying social preferences for fairness and retribution.     

Cortical and Hippocampal Correlates of Deliberation during Model-Based Decisions for Rewards in Humans

How do we use our memories of the past to guide decisions we''ve never had to make before? Although extensive work describes how the brain learns to repeat rewarded actions, decisions can also be influenced by associations between stimuli or events not directly involving reward — such as when planning routes using a cognitive map or chess moves using predicted countermoves — and these sorts of associations are critical when deciding among novel options. This process is known as model-based decision making. While the learning of environmental relations that might support model-based decisions is well studied, and separately this sort of information has been inferred to impact decisions, there is little evidence concerning the full cycle by which such associations are acquired and drive choices. Of particular interest is whether decisions are directly supported by the same mnemonic systems characterized for relational learning more generally, or instead rely on other, specialized representations. Here, building on our previous work, which isolated dual representations underlying sequential predictive learning, we directly demonstrate that one such representation, encoded by the hippocampal memory system and adjacent cortical structures, supports goal-directed decisions. Using interleaved learning and decision tasks, we monitor predictive learning directly and also trace its influence on decisions for reward. We quantitatively compare the learning processes underlying multiple behavioral and fMRI observables using computational model fits. Across both tasks, a quantitatively consistent learning process explains reaction times, choices, and both expectation- and surprise-related neural activity. The same hippocampal and ventral stream regions engaged in anticipating stimuli during learning are also engaged in proportion to the difficulty of decisions. These results support a role for predictive associations learned by the hippocampal memory system to be recalled during choice formation.     

Raising grateful children one day at a time

ABSTRACT

We examined micro developmental processes related to the socialization of children's gratitude by testing whether parents who engage in more frequent daily socialization practices targeting children's gratitude reported more frequent gratitude displays by their children after controlling for potential confounds. 101 parent-child dyads completed a baseline lab visit followed by a seven-day diary study. Using multi-level modeling, we found that parents who engaged in more frequent gratitude socialization acts reported more frequent displays of gratitude by their children across the seven-days (between-dyad effect) and that on days when a parent engaged in more socialization acts than usual parents reported relative increases in gratitude displays by their children (within-dyad effect). These findings show that parent socialization acts are associated with children’s displayed gratitude and point to the need for future work to explore reactive and proactive parent-child interactions that may underlie these associations as well as associations between micro-developmental and macro-developmental processes.     

Cognitive capacities for cooking in chimpanzees

The transition to a cooked diet represents an important shift in human ecology and evolution. Cooking requires a set of sophisticated cognitive abilities, including causal reasoning, self-control and anticipatory planning. Do humans uniquely possess the cognitive capacities needed to cook food? We address whether one of humans'' closest relatives, chimpanzees (Pan troglodytes), possess the domain-general cognitive skills needed to cook. Across nine studies, we show that chimpanzees: (i) prefer cooked foods; (ii) comprehend the transformation of raw food that occurs when cooking, and generalize this causal understanding to new contexts; (iii) will pay temporal costs to acquire cooked foods; (iv) are willing to actively give up possession of raw foods in order to transform them; and (v) can transport raw food as well as save their raw food in anticipation of future opportunities to cook. Together, our results indicate that several of the fundamental psychological abilities necessary to engage in cooking may have been shared with the last common ancestor of apes and humans, predating the control of fire.     

Noncentrosomal microtubules and type II myosins potentiate epidermal cell adhesion and barrier formation

During differentiation, many cells reorganize their microtubule cytoskeleton into noncentrosomal arrays. Although these microtubules are likely organized to meet the physiological roles of their tissues, their functions in most cell types remain unexplored. In the epidermis, differentiation induces the reorganization of microtubules to cell–cell junctions in a desmosome-dependent manner. Here, we recapitulate the reorganization of microtubules in cultured epidermal cells. Using this reorganization assay, we show that cortical microtubules recruit myosin II to the cell cortex in order to engage adherens junctions, resulting in an increase in mechanical integrity of the cell sheets. Cortical microtubules and engaged adherens junctions, in turn, increase tight junction function. In vivo, disruption of microtubules or loss of myosin IIA and B resulted in loss of tight junction–mediated barrier activity. We propose that noncentrosomal microtubules act through myosin II recruitment to potentiate cell adhesion in the differentiating epidermis, thus forming a robust mechanical and chemical barrier against the external environment.