A Diffusion Model Analysis of Decision Biases Affecting Delayed Recognition of Emotional Stimuli

Previous empirical work suggests that emotion can influence accuracy and cognitive biases underlying recognition memory, depending on the experimental conditions. The current study examines the effects of arousal and valence on delayed recognition memory using the diffusion model, which allows the separation of two decision biases thought to underlie memory: response bias and memory bias. Memory bias has not been given much attention in the literature but can provide insight into the retrieval dynamics of emotion modulated memory. Participants viewed emotional pictorial stimuli; half were given a recognition test 1-day later and the other half 7-days later. Analyses revealed that emotional valence generally evokes liberal responding, whereas high arousal evokes liberal responding only at a short retention interval. The memory bias analyses indicated that participants experienced greater familiarity with high-arousal compared to low-arousal items and this pattern became more pronounced as study-test lag increased; positive items evoke greater familiarity compared to negative and this pattern remained stable across retention interval. The findings provide insight into the separate contributions of valence and arousal to the cognitive mechanisms underlying delayed emotion modulated memory.     

Recognition of Intensive Valence and Arousal Affective States via Facial Electromyographic Activity in Young and Senior Adults

Background

Research suggests that interaction between humans and digital environments characterizes a form of companionship in addition to technical convenience. To this effect, humans have attempted to design computer systems able to demonstrably empathize with the human affective experience. Facial electromyography (EMG) is one such technique enabling machines to access to human affective states. Numerous studies have investigated the effects of valence emotions on facial EMG activity captured over the corrugator supercilii (frowning muscle) and zygomaticus major (smiling muscle). The arousal emotion, specifically, has not received much research attention, however. In the present study, we sought to identify intensive valence and arousal affective states via facial EMG activity.

Methods

Ten blocks of affective pictures were separated into five categories: neutral valence/low arousal (0VLA), positive valence/high arousal (PVHA), negative valence/high arousal (NVHA), positive valence/low arousal (PVLA), and negative valence/low arousal (NVLA), and the ability of each to elicit corresponding valence and arousal affective states was investigated at length. One hundred and thirteen participants were subjected to these stimuli and provided facial EMG. A set of 16 features based on the amplitude, frequency, predictability, and variability of signals was defined and classified using a support vector machine (SVM).

Results

We observed highly accurate classification rates based on the combined corrugator and zygomaticus EMG, ranging from 75.69% to 100.00% for the baseline and five affective states (0VLA, PVHA, PVLA, NVHA, and NVLA) in all individuals. There were significant differences in classification rate accuracy between senior and young adults, but there was no significant difference between female and male participants.

Conclusion

Our research provides robust evidences for recognition of intensive valence and arousal affective states in young and senior adults. These findings contribute to the successful future application of facial EMG for identifying user affective states in human machine interaction (HMI) or companion robotic systems (CRS).     

Negative Mood Increases Selective Attention to Negatively Valenced Body Parts in Female Adolescents with Anorexia Nervosa

ObjectivePrevious research has yielded evidence of increased attentional processing of negatively valenced body parts in women with anorexia nervosa (AN), especially for those with high depressive symptomatology. The present study extended previous research by implementing an experimental mood manipulation.MethodIn a within-subjects design, female adolescents with AN (n = 12) and an age matched female control group (CG; n = 12) were given a negative and a positive mood induction at a one-week interval. After each mood induction, participants underwent a 3-min mirror exposure, while their eye movements were recorded.ResultsAfter the positive mood induction, both AN and CG participants displayed longer and more frequent gazes towards their self-defined most ugly relative to their self-defined most beautiful body part. However, after the negative mood induction, only females with AN were characterized by increased attention to their most ugly compared to their most beautiful body part, while CG participants’ attention distribution was balanced. Furthermore, in the negative (but not in the positive) mood induction condition gaze frequency and duration towards the most ugly body part was significantly stronger in the AN group relative to the CG.DiscussionThe results emphasize the role of negative mood in the maintenance of pathological information processing of the self-body. This increased body-related negativity-bias during negative mood may lead to the persistence and aggravation of AN patients’ body image disturbance.     

Dissociable modulation of overt visual attention in valence and arousal revealed by topology of scan path

Emotional stimuli have evolutionary significance for the survival of organisms; therefore, they are attention-grabbing and are processed preferentially. The neural underpinnings of two principle emotional dimensions in affective space, valence (degree of pleasantness) and arousal (intensity of evoked emotion), have been shown to be dissociable in the olfactory, gustatory and memory systems. However, the separable roles of valence and arousal in scene perception are poorly understood. In this study, we asked how these two emotional dimensions modulate overt visual attention. Twenty-two healthy volunteers freely viewed images from the International Affective Picture System (IAPS) that were graded for affective levels of valence and arousal (high, medium, and low). Subjects' heads were immobilized and eye movements were recorded by camera to track overt shifts of visual attention. Algebraic graph-based approaches were introduced to model scan paths as weighted undirected path graphs, generating global topology metrics that characterize the algebraic connectivity of scan paths. Our data suggest that human subjects show different scanning patterns to stimuli with different affective ratings. Valence salient stimuli (with neutral arousal) elicited faster and larger shifts of attention, while arousal salient stimuli (with neutral valence) elicited local scanning, dense attention allocation and deep processing. Furthermore, our model revealed that the modulatory effect of valence was linearly related to the valence level, whereas the relation between the modulatory effect and the level of arousal was nonlinear. Hence, visual attention seems to be modulated by mechanisms that are separate for valence and arousal.     

The impact of coping style on gaze duration

The understanding of individual differences in response to threat (e.g., attentional bias) is important to better understand the development of anxiety disorders. Previous studies revealed only a small attentional bias in high-anxious (HA) subjects. One explanation for this finding may be the assumption that all HA-subjects show a constant attentional bias. Current models distinguish HA-subjects depending on their level of tolerance for uncertainty and for arousal. These models assume that only HA-subjects with intolerance for uncertainty but tolerance for arousal ("sensitizers") show an attentional bias, compared to HA-subjects with intolerance for uncertainty and intolerance for arousal ("fluctuating subjects"). Further, it is assumed that repressors (defined as intolerance for arousal but tolerance for uncertainty) would react with avoidance behavior when confronted with threatening stimuli. The present study investigated the influence of coping styles on attentional bias. After an extensive recruiting phase, 36 subjects were classified into three groups (sensitizers, fluctuating, and repressors). All subjects were exposed to presentations of happy and threatening faces, while recording gaze durations with an eye-tracker. The results showed that only sensitizer showed an attentional bias: they gazed longer at the threatening face rather than at the happy face during the first 500 ms. The results support the findings of the relationship between anxiety and attention and extend these by showing variations according to coping styles. The differentiation of subjects according to a multifaceted coping style allows a better prediction of the attentional bias and contributes to an insight into the complex interplay of personality, coping, and behavior.     

Restricted attentional capacity within but not between sensory modalities: an individual differences approach

Background

Most people show a remarkable deficit to report the second of two targets when presented in close temporal succession, reflecting an attentional blink (AB). An aspect of the AB that is often ignored is that there are large individual differences in the magnitude of the effect. Here we exploit these individual differences to address a long-standing question: does attention to a visual target come at a cost for attention to an auditory target (and vice versa)? More specifically, the goal of the current study was to investigate a) whether individuals with a large within-modality AB also show a large cross-modal AB, and b) whether individual differences in AB magnitude within different modalities correlate or are completely separate.

Methodology/Principal Findings

While minimizing differential task difficulty and chances for a task-switch to occur, a significant AB was observed when targets were both presented within the auditory or visual modality, and a positive correlation was found between individual within-modality AB magnitudes. However, neither a cross-modal AB nor a correlation between cross-modal and within-modality AB magnitudes was found.

Conclusion/Significance

The results provide strong evidence that a major source of attentional restriction must lie in modality-specific sensory systems rather than a central amodal system, effectively settling a long-standing debate. Individuals with a large within-modality AB may be especially committed or focused in their processing of the first target, and to some extent that tendency to focus could cross modalities, reflected in the within-modality correlation. However, what they are focusing (resource allocation, blocking of processing) is strictly within-modality as it only affects the second target on within-modality trials. The findings show that individual differences in AB magnitude can provide important information about the modular structure of human cognition.     

Feedback Valence Affects Auditory Perceptual Learning Independently of Feedback Probability

Previous studies have suggested that negative feedback is more effective in driving learning than positive feedback. We investigated the effect on learning of providing varying amounts of negative and positive feedback while listeners attempted to discriminate between three identical tones; an impossible task that nevertheless produces robust learning. Four feedback conditions were compared during training: 90% positive feedback or 10% negative feedback informed the participants that they were doing equally well, while 10% positive or 90% negative feedback informed them they were doing equally badly. In all conditions the feedback was random in relation to the listeners’ responses (because the task was to discriminate three identical tones), yet both the valence (negative vs. positive) and the probability of feedback (10% vs. 90%) affected learning. Feedback that informed listeners they were doing badly resulted in better post-training performance than feedback that informed them they were doing well, independent of valence. In addition, positive feedback during training resulted in better post-training performance than negative feedback, but only positive feedback indicating listeners were doing badly on the task resulted in learning. As we have previously speculated, feedback that better reflected the difficulty of the task was more effective in driving learning than feedback that suggested performance was better than it should have been given perceived task difficulty. But contrary to expectations, positive feedback was more effective than negative feedback in driving learning. Feedback thus had two separable effects on learning: feedback valence affected motivation on a subjectively difficult task, and learning occurred only when feedback probability reflected the subjective difficulty. To optimize learning, training programs need to take into consideration both feedback valence and probability.     

Distractor Suppression When Attention Fails: Behavioral Evidence for a Flexible Selective Attention Mechanism

Despite consistent evidence showing that attention is a multifaceted mechanism that can operate at multiple levels of processing depending on the structure and demands of the task, investigations of the attentional blink phenomenon have consistently shown that the impairment in reporting the second of two targets typically occurs at a late, or post-perceptual, stage of processing. This suggests that the attentional blink phenomenon may represent the operation of a unique attentional mechanism that is not as flexible as other attentional mechanisms. To test whether the attentional blink is a fixed or flexible phenomenon, we manipulated first target task demands (i.e., difficulty) and measured the influence this had on processing a subsequently presented distractor and the second target. If the attentional blink represents a mechanism that is fixed and consistently fails at a single stage of processing, then manipulations of task difficulty should not affect distractor processing. However, if the attentional blink represents a more multifaceted and flexible mechanism, then task difficulty should modulate distractor processing. The results revealed that distractor processing during the AB was attenuated under high task difficulty. In addition, unlike previous studies, we failed to find a correlation between distractor processing and the severity of the attentional blink. Using a simulation, we demonstrate that the previously reported correlations may have been spurious and due to using variables that were not independent. Overall, the present results support the conclusion that the selectivity of attention during the AB is flexible and depends on the structure and demands of the task.     

Musical Minds: Attentional Blink Reveals Modality-Specific Restrictions

BackgroundFormal musical training is known to have positive effects on attentional and executive functioning, processing speed, and working memory. Consequently, one may expect to find differences in the dynamics of temporal attention between musicians and non-musicians. Here we address the question whether that is indeed the case, and whether any beneficial effects of musical training on temporal attention are modality specific or generalize across sensory modalities.Conclusion/SignificanceAB magnitude within one modality can generalize to another modality, but this turns out not to be the case for every individual. Formal musical training seems to have a domain-general, but modality-specific beneficial effect on selective attention. The results fit with the idea that a major source of attentional restriction as reflected in the AB lies in modality-specific, independent sensory systems rather than a central amodal system. The findings demonstrate that individual differences in AB magnitude can provide important information about the modular structure of human cognition.     

The time course of the influence of valence and arousal on the implicit processing of affective pictures

In the current study, we investigated the time course of the implicit processing of affective pictures with an orthogonal design of valence (negative vs. positive) by arousal (low vs. high). Previous studies with explicit tasks suggested that valence mainly modulates early event-related potential (ERP) components, whereas arousal mainly modulates late components. However, in this study with an implicit task, we observed significant interactions between valence and arousal at both early and late stages over both parietal and frontal sites, which were reflected by three different ERP components: P2a (100-200 ms), N2 (200-300 ms), and P3 (300-400 ms). Furthermore, there was also a significant main effect of arousal on P2b (200-300 ms) over parieto-occipital sites. Our results suggest that valence and arousal effects on implicit affective processing are more complicated than previous ERP studies with explicit tasks have revealed.     

Emotional Modulation of Attention: Fear Increases but Disgust Reduces the Attentional Blink

Background

It is well known that facial expressions represent important social cues. In humans expressing facial emotion, fear may be configured to maximize sensory exposure (e.g., increases visual input) whereas disgust can reduce sensory exposure (e.g., decreases visual input). To investigate whether such effects also extend to the attentional system, we used the “attentional blink” (AB) paradigm. Many studies have documented that the second target (T2) of a pair is typically missed when presented within a time window of about 200–500 ms from the first to-be-detected target (T1; i.e., the AB effect). It has recently been proposed that the AB effect depends on the efficiency of a gating system which facilitates the entrance of relevant input into working memory, while inhibiting irrelevant input. Following the inhibitory response on post T1 distractors, prolonged inhibition of the subsequent T2 is observed. In the present study, we hypothesized that processing facial expressions of emotion would influence this attentional gating. Fearful faces would increase but disgust faces would decrease inhibition of the second target.

Methodology/Principal Findings

We showed that processing fearful versus disgust faces has different effects on these attentional processes. We found that processing fear faces impaired the detection of T2 to a greater extent than did the processing disgust faces. This finding implies emotion-specific modulation of attention.

Conclusions/Significance

Based on the recent literature on attention, our finding suggests that processing fear-related stimuli exerts greater inhibitory responses on distractors relative to processing disgust-related stimuli. This finding is of particular interest for researchers examining the influence of emotional processing on attention and memory in both clinical and normal populations. For example, future research could extend upon the current study to examine whether inhibitory processes invoked by fear-related stimuli may be the mechanism underlying the enhanced learning of fear-related stimuli.     

Are Age Effects in Positivity Influenced by the Valence of Distractors?

An age-related ‘positivity’ effect has been identified, in which older adults show an information-processing bias towards positive emotional items in attention and memory. In the present study, we examined this positivity bias by using a novel paradigm in which emotional and neutral distractors were presented along with emotionally valenced targets. Thirty-five older and 37 younger adults were asked during encoding to attend to emotional targets paired with distractors that were either neutral or opposite in valence to the target. Pupillary responses were recorded during initial encoding as well as a later incidental recognition task. Memory and pupillary responses for negative items were not affected by the valence of distractors, suggesting that positive distractors did not automatically attract older adults’ attention while they were encoding negative targets. Additionally, the pupil dilation to negative items mediated the relation between age and positivity in memory. Overall, memory and pupillary responses provide converging support for a cognitive control account of positivity effects in late adulthood and suggest a link between attentional processes and the memory positivity effect.     

Attentional capture in rapid serial visual presentation

We examined whether attentional capture can occur during an attentional blink (AB). If attention were 'locked up' during an AB, capture should not occur. To test for capture, we varied the salience of the two targets (T1 and T2) or of a distractor. Salience was controlled by adjusting chromaticity at equiluminance to equate simple reaction times. Experiment 1 demonstrated that the extent of AB varied almost entirely with T2 salience, not with T1 salience. In Experiment 2, a salient distractor between T1 and T2 reduced the AB without affecting its temporal profile; a salient distractor after T2 had no effect on AB. We conclude that attentional capture can occur during the AB, and stimulus salience modulates, rather than overriding, the AB. Independent of the post-attentional (consolidation) mechanism primarily responsible for the AB, stimulus salience affects how an attention gate is triggered (Shih, 2000).     

Dissociable effects of valence and arousal in adaptive executive control

Background

Based on introspectionist, semantic, and psychophysiological experimental frameworks, it has long been assumed that all affective states derive from two independent basic dimensions, valence and arousal. However, until now, no study has investigated whether valence and arousal are also dissociable at the level of affect-related changes in cognitive processing.

Methodology/Principal Findings

We examined how changes in both valence (negative vs. positive) and arousal (low vs. high) influence performance in tasks requiring executive control because recent research indicates that two dissociable cognitive components are involved in the regulation of task performance: amount of current control (i.e., strength of filtering goal-irrelevant signals) and control adaptation (i.e., strength of maintaining current goals over time). Using a visual pop-out distractor task, we found that control is exclusively modulated by arousal because interference by goal-irrelevant signals was largest in high arousal states, independently of valence. By contrast, control adaptation is exclusively modulated by valence because the increase in control after trials in which goal-irrelevant signals were present was largest in negative states, independent of arousal. A Monte Carlo simulation revealed that differential effects of two experimental factors on control and control adaptation can be dissociated if there is no correlation between empirical interference and conflict-driven modulation of interference, which was the case in the present data. Consequently, the observed effects of valence and arousal on adaptive executive control are indeed dissociable.

Conclusions/Significance

These findings indicate that affective influences on cognitive processes can be driven by independent effects of variations in valence and arousal, which may resolve several heterogeneous findings observed in previous studies on affect-cognition interactions.     

The Effects of Valence and Arousal on Associative Working Memory and Long-Term Memory

Background

Emotion can either facilitate or impair memory, depending on what, when and how memory is tested and whether the paradigm at hand is administered as a working memory (WM) or a long-term memory (LTM) task. Whereas emotionally arousing single stimuli are more likely to be remembered, memory for the relationship between two or more component parts (i.e., relational memory) appears to be worse in the presence of emotional stimuli, at least in some relational memory tasks. The current study investigated the effects of both valence (neutral vs. positive vs. negative) and arousal (low vs. high) in an inter-item WM binding and LTM task.

Methodology/Principal Findings

A five-pair delayed-match-to-sample (WM) task was administered. In each trial, study pairs consisted of one neutral picture and a second picture of which the emotional qualities (valence and arousal levels) were manipulated. These pairs had to be remembered across a delay interval of 10 seconds. This was followed by a probe phase in which five pairs were tested. After completion of this task, an unexpected single item LTM task as well as an LTM task for the pairs was assessed. As expected, emotional arousal impaired WM processing. This was reflected in lower accuracy for pairs consisting of high-arousal pictures compared to pairs with low-arousal pictures. A similar effect was found for the associative LTM task. However, the arousal effect was modulated by affective valence for the WM but not the LTM task; pairs with low-arousal negative pictures were not processed as well in the WM task. No significant differences were found for the single-item LTM task.

Conclusions/Significance

The present study provides additional evidence that processes during initial perception/encoding and post-encoding processes, the time interval between study and test and the interaction between valence and arousal might modulate the effects of “emotion” on associative memory.     

Brain activity elicited by positive and negative feedback in preschool-aged children

To investigate the processing of positive vs. negative feedback in children aged 4-5 years, we devised a prize-guessing game that is analogous to gambling tasks used to measure feedback-related brain responses in adult studies. Unlike adult studies, the feedback-related negativity (FRN) elicited by positive feedback was as large as that elicited by negative feedback, suggesting that the neural system underlying the FRN may not process feedback valence in early childhood. In addition, positive feedback, compared with negative feedback, evoked a larger P1 over the occipital scalp area and a larger positive slow wave (PSW) over the right central-parietal scalp area. We believe that the PSW is related to emotional arousal and the intensive focus on positive feedback that is present in the preschool and early school years has adaptive significance for both cognitive and emotional development during this period.     

Temporal-Spatial Neural Activation Patterns Linked to Perceptual Encoding of Emotional Salience

It is well known that we continuously filter incoming sensory information, selectively allocating attention to what is important while suppressing distracting or irrelevant information. Yet questions remain about spatiotemporal patterns of neural processes underlying attentional biases toward emotionally significant aspects of the world. One index of affectively biased attention is an emotional variant of an attentional blink (AB) paradigm, which reveals enhanced perceptual encoding for emotionally salient over neutral stimuli under conditions of limited executive attention. The present study took advantage of the high spatial and temporal resolution of magnetoencephalography (MEG) to investigate neural activation related to emotional and neutral targets in an AB task. MEG data were collected while participants performed a rapid stimulus visual presentation task in which two target stimuli were embedded in a stream of distractor words. The first target (T1) was a number and the second (T2) either an emotionally salient or neutral word. Behavioural results replicated previous findings of greater accuracy for emotionally salient than neutral T2 words. MEG source analyses showed that activation in orbitofrontal cortex, characterized by greater power in the theta and alpha bands, and dorsolateral prefrontal activation were associated with successful perceptual encoding of emotionally salient relative to neutral words. These effects were observed between 250 and 550 ms, latencies associated with discrimination of perceived from unperceived stimuli. These data suggest that important nodes of both emotional salience and frontoparietal executive systems are associated with the emotional modulation of the attentional blink.     

Effects of Emotional Context on Memory for Details: The Role of Attention

It was repeatedly demonstrated that a negative emotional context enhances memory for central details while impairing memory for peripheral information. This trade-off effect is assumed to result from attentional processes: a negative context seems to narrow attention to central information at the expense of more peripheral details, thus causing the differential effects in memory. However, this explanation has rarely been tested and previous findings were partly inconclusive. For the present experiment 13 negative and 13 neutral naturalistic, thematically driven picture stories were constructed to test the trade-off effect in an ecologically more valid setting as compared to previous studies. During an incidental encoding phase, eye movements were recorded as an index of overt attention. In a subsequent recognition phase, memory for central and peripheral details occurring in the picture stories was tested. Explicit affective ratings and autonomic responses validated the induction of emotion during encoding. Consistent with the emotional trade-off effect on memory, encoding context differentially affected recognition of central and peripheral details. However, contrary to the common assumption, the emotional trade-off effect on memory was not mediated by attentional processes. By contrast, results suggest that the relevance of attentional processing for later recognition memory depends on the centrality of information and the emotional context but not their interaction. Thus, central information was remembered well even when fixated very briefly whereas memory for peripheral information depended more on overt attention at encoding. Moreover, the influence of overt attention on memory for central and peripheral details seems to be much lower for an arousing as compared to a neutral context.     

Trait and state positive emotional experience in schizophrenia: a meta-analysis

Background

Prior meta-analyses indicated that people with schizophrenia show impairment in trait hedonic capacity but retain their state hedonic experience (valence) in laboratory-based assessments. Little is known about what is the extent of differences for state positive emotional experience (especially arousal) between people with schizophrenia and healthy controls. It is also not clear whether negative symptoms and gender effect contribute to the variance of positive affect.

Methods and Findings

The current meta-analysis examined 21 studies assessing state arousal experience, 40 studies measuring state valence experience, and 47studies assessing trait hedonic capacity in schizophrenia. Patients with schizophrenia demonstrated significant impairment in trait hedonic capacity (Cohen’s d = 0.81). However, patients and controls did not statistically differ in state hedonic (valence) as well as exciting (arousal) experience to positive stimuli (Cohen’s d = −0.24 to 0.06). They also reported experiencing relatively robust state aversion and calmness to positive stimuli compared with controls (Cohen’s d = 0.75, 0.56, respectively). Negative symptoms and gender contributed to the variance of findings in positive affect, especially trait hedonic capacity in schizophrenia.

Conclusions

Our findings suggest that schizophrenia patients have no deficit in state positive emotional experience but impairment in “noncurrent” hedonic capacity, which may be mediated by negative symptoms and gender effect.