Relationships among Facial Mimicry,Emotional Experience,and Emotion Recognition

Background

The relationships between facial mimicry and subsequent psychological processes remain unclear. We hypothesized that the congruent facial muscle activity would elicit emotional experiences and that the experienced emotion would induce emotion recognition.

Methodology/Principal Findings

To test this hypothesis, we re-analyzed data collected in two previous studies. We recorded facial electromyography (EMG) from the corrugator supercilii and zygomatic major and obtained ratings on scales of valence and arousal for experienced emotions (Study 1) and for experienced and recognized emotions (Study 2) while participants viewed dynamic and static facial expressions of negative and positive emotions. Path analyses showed that the facial EMG activity consistently predicted the valence ratings for the emotions experienced in response to dynamic facial expressions. The experienced valence ratings in turn predicted the recognized valence ratings in Study 2.

Conclusion

These results suggest that facial mimicry influences the sharing and recognition of emotional valence in response to others'' dynamic facial expressions.     

Differential Brain Activation to Angry Faces by Elite Warfighters: Neural Processing Evidence for Enhanced Threat Detection

Background

Little is known about the neural basis of elite performers and their optimal performance in extreme environments. The purpose of this study was to examine brain processing differences between elite warfighters and comparison subjects in brain structures that are important for emotion processing and interoception.

Methodology/Principal Findings

Navy Sea, Air, and Land Forces (SEALs) while off duty (n = 11) were compared with n = 23 healthy male volunteers while performing a simple emotion face-processing task during functional magnetic resonance imaging. Irrespective of the target emotion, elite warfighters relative to comparison subjects showed relatively greater right-sided insula, but attenuated left-sided insula, activation. Navy SEALs showed selectively greater activation to angry target faces relative to fearful or happy target faces bilaterally in the insula. This was not accounted for by contrasting positive versus negative emotions. Finally, these individuals also showed slower response latencies to fearful and happy target faces than did comparison subjects.

Conclusions/Significance

These findings support the hypothesis that elite warfighters deploy greater processing resources toward potential threat-related facial expressions and reduced processing resources to non-threat-related facial expressions. Moreover, rather than expending more effort in general, elite warfighters show more focused neural and performance tuning. In other words, greater neural processing resources are directed toward threat stimuli and processing resources are conserved when facing a nonthreat stimulus situation.     

Context modulation of facial emotion perception differed by individual difference

Background

Certain facial configurations are believed to be associated with distinct affective meanings (i.e. basic facial expressions), and such associations are common across cultures (i.e. universality of facial expressions). However, recently, many studies suggest that various types of contextual information, rather than facial configuration itself, are important factor for facial emotion perception.

Methodology/Principal Findings

To examine systematically how contextual information influences individuals’ facial emotion perception, the present study estimated direct observers’ perceptual thresholds for detecting negative facial expressions via a forced-choice psychophysical procedure using faces embedded in various emotional contexts. We additionally measured the individual differences in affective information-processing tendency (BIS/BAS) as a possible factor that may determine the extent to which contextual information on facial emotion perception is used. It was found that contextual information influenced observers'' perceptual thresholds for facial emotion. Importantly, individuals’ affective-information tendencies modulated the extent to which they incorporated context information into their facial emotion perceptions.

Conclusions/Significance

The findings of this study suggest that facial emotion perception not only depends on facial configuration, but the context in which the face appears as well. This contextual influence appeared differently with individual’s characteristics of information processing. In summary, we conclude that individual character traits, as well as facial configuration and the context in which a face appears, need to be taken into consideration regarding facial emotional perception.     

Recognition profile of emotions in natural and virtual faces

Background

Computer-generated virtual faces become increasingly realistic including the simulation of emotional expressions. These faces can be used as well-controlled, realistic and dynamic stimuli in emotion research. However, the validity of virtual facial expressions in comparison to natural emotion displays still needs to be shown for the different emotions and different age groups.

Methodology/Principal Findings

Thirty-two healthy volunteers between the age of 20 and 60 rated pictures of natural human faces and faces of virtual characters (avatars) with respect to the expressed emotions: happiness, sadness, anger, fear, disgust, and neutral. Results indicate that virtual emotions were recognized comparable to natural ones. Recognition differences in virtual and natural faces depended on specific emotions: whereas disgust was difficult to convey with the current avatar technology, virtual sadness and fear achieved better recognition results than natural faces. Furthermore, emotion recognition rates decreased for virtual but not natural faces in participants over the age of 40. This specific age effect suggests that media exposure has an influence on emotion recognition.

Conclusions/Significance

Virtual and natural facial displays of emotion may be equally effective. Improved technology (e.g. better modelling of the naso-labial area) may lead to even better results as compared to trained actors. Due to the ease with which virtual human faces can be animated and manipulated, validated artificial emotional expressions will be of major relevance in future research and therapeutic applications.     

Altered negative unconscious processing in major depressive disorder: an exploratory neuropsychological study

Objective

Major depressive disorder (MDD) has been characterized by abnormalities in emotional processing. However, what remains unclear is whether MDD also shows deficits in the unconscious processing of either positive or negative emotions. We conducted a psychological study in healthy and MDD subjects to investigate unconscious emotion processing and its valence-specific alterations in MDD patients.

Methods

We combined a well established paradigm for unconscious visual processing, the continuous flash suppression, with positive and negative emotional valences to detect the attentional preference evoked by the invisible emotional facial expressions.

Results

Healthy subjects showed an attentional bias for negative emotions in the unconscious condition while this valence bias remained absent in MDD patients. In contrast, this attentional bias diminished in the conscious condition for both healthy subjects and MDD.

Conclusion

Our findings demonstrate for the first time valence-specific deficits specifically in the unconscious processing of emotions in MDD; this may have major implications for subsequent neurobiological investigations as well as for clinical diagnosis and therapy.     

Negative Emotion Regulation in Patients with Posttraumatic Stress Disorder

Objective

To explore the neural mechanisms of negative emotion regulation in patients with post-traumatic stress disorder (PTSD).

Methods

Twenty PTSD patients and 20 healthy subjects were recruited. Event-related functional magnetic resonance imaging (fMRI) was used to investigate the modification of emotional responses to negative stimuli. Participants were required to regulate their emotional reactions according to the auditory regulation instructions via headphones, to maintain, enhance or diminish responses to negative stimuli during fMRI scans.

Results

The PTSD group showed poorer modification performance than the control group when diminishing responses to negative stimuli. On fMRI, the PTSD group showed decreased activation in the inferior frontal cortex, inferior parietal lobule, insula and putamen, and increased activation in posterior cingulate cortex and amygdala during up-regulation of negative emotion. Similar decreased activation regions were found during down-regulation of negative emotion, but no increased activation was found.

Conclusion

Trauma exposure might impair the ability to down-regulate negative emotion. The present findings will improve our understanding of the neural mechanisms of emotion regulation underlying PTSD.     

Facial Emotion Recognition in Parkinson's Disease: An fMRI Investigation

Background

Findings of behavioral studies on facial emotion recognition in Parkinson’s disease (PD) are very heterogeneous. Therefore, the present investigation additionally used functional magnetic resonance imaging (fMRI) in order to compare brain activation during emotion perception between PD patients and healthy controls.

Methods and Findings

We included 17 nonmedicated, nondemented PD patients suffering from mild to moderate symptoms and 22 healthy controls. The participants were shown pictures of facial expressions depicting disgust, fear, sadness, and anger and they answered scales for the assessment of affective traits. The patients did not report lowered intensities for the displayed target emotions, and showed a comparable rating accuracy as the control participants. The questionnaire scores did not differ between patients and controls. The fMRI data showed similar activation in both groups except for a generally stronger recruitment of somatosensory regions in the patients.

Conclusions

Since somatosensory cortices are involved in the simulation of an observed emotion, which constitutes an important mechanism for emotion recognition, future studies should focus on activation changes within this region during the course of disease.     

Influence of Repressive Coping Style on Cortical Activation during Encoding of Angry Faces

Background

Coping plays an important role for emotion regulation in threatening situations. The model of coping modes designates repression and sensitization as two independent coping styles. Repression consists of strategies that shield the individual from arousal. Sensitization indicates increased analysis of the environment in order to reduce uncertainty. According to the discontinuity hypothesis, repressors are sensitive to threat in the early stages of information processing. While repressors do not exhibit memory disturbances early on, they manifest weak memory for these stimuli later. This study investigates the discontinuity hypothesis using functional magnetic resonance imaging (fMRI).

Methods

Healthy volunteers (20 repressors and 20 sensitizers) were selected from a sample of 150 students on the basis of the Mainz Coping Inventory. During the fMRI experiment, subjects evaluated and memorized emotional and neutral faces. Subjects performed two sessions of face recognition: immediately after the fMRI session and three days later.

Results

Repressors exhibited greater activation of frontal, parietal and temporal areas during encoding of angry faces compared to sensitizers. There were no differences in recognition of facial emotions between groups neither immediately after exposure nor after three days.

Conclusions

The fMRI findings suggest that repressors manifest an enhanced neural processing of directly threatening facial expression which confirms the assumption of hyper-responsivity to threatening information in repression in an early processing stage. A discrepancy was observed between high neural activation in encoding-relevant brain areas in response to angry faces in repressors and no advantage in subsequent memory for these faces compared to sensitizers.     

Dissociation of Neural Substrates of Response Inhibition to Negative Information between Implicit and Explicit Facial Go/Nogo Tasks: Evidence from an Electrophysiological Study

Background

Although ample evidence suggests that emotion and response inhibition are interrelated at the behavioral and neural levels, neural substrates of response inhibition to negative facial information remain unclear. Thus we used event-related potential (ERP) methods to explore the effects of explicit and implicit facial expression processing in response inhibition.

Methods

We used implicit (gender categorization) and explicit emotional Go/Nogo tasks (emotion categorization) in which neutral and sad faces were presented. Electrophysiological markers at the scalp and the voxel level were analyzed during the two tasks.

Results

We detected a task, emotion and trial type interaction effect in the Nogo-P3 stage. Larger Nogo-P3 amplitudes during sad conditions versus neutral conditions were detected with explicit tasks. However, the amplitude differences between the two conditions were not significant for implicit tasks. Source analyses on P3 component revealed that right inferior frontal junction (rIFJ) was involved during this stage. The current source density (CSD) of rIFJ was higher with sad conditions compared to neutral conditions for explicit tasks, rather than for implicit tasks.

Conclusions

The findings indicated that response inhibition was modulated by sad facial information at the action inhibition stage when facial expressions were processed explicitly rather than implicitly. The rIFJ may be a key brain region in emotion regulation.     

Impaired attribution of emotion to facial expressions in anxiety and major depression

Background

Recognition of others'' emotions is an important aspect of interpersonal communication. In major depression, a significant emotion recognition impairment has been reported. It remains unclear whether the ability to recognize emotion from facial expressions is also impaired in anxiety disorders. There is a need to review and integrate the published literature on emotional expression recognition in anxiety disorders and major depression.

Methodology/Principal Findings

A detailed literature search was used to identify studies on explicit emotion recognition in patients with anxiety disorders and major depression compared to healthy participants. Eighteen studies provided sufficient information to be included. The differences on emotion recognition impairment between patients and controls (Cohen''s d) with corresponding confidence intervals were computed for each study. Over all studies, adults with anxiety disorders had a significant impairment in emotion recognition (d = −0.35). In children with anxiety disorders no significant impairment of emotion recognition was found (d = −0.03). Major depression was associated with an even larger impairment in recognition of facial expressions of emotion (d = −0.58).

Conclusions/Significance

Results from the current analysis support the hypothesis that adults with anxiety disorders or major depression both have a deficit in recognizing facial expression of emotions, and that this deficit is more pronounced in major depression than in anxiety.     

Emotional facial expression detection in the peripheral visual field

Background

In everyday life, signals of danger, such as aversive facial expressions, usually appear in the peripheral visual field. Although facial expression processing in central vision has been extensively studied, this processing in peripheral vision has been poorly studied.

Methodology/Principal Findings

Using behavioral measures, we explored the human ability to detect fear and disgust vs. neutral expressions and compared it to the ability to discriminate between genders at eccentricities up to 40°. Responses were faster for the detection of emotion compared to gender. Emotion was detected from fearful faces up to 40° of eccentricity.

Conclusions

Our results demonstrate the human ability to detect facial expressions presented in the far periphery up to 40° of eccentricity. The increasing advantage of emotion compared to gender processing with increasing eccentricity might reflect a major implication of the magnocellular visual pathway in facial expression processing. This advantage may suggest that emotion detection, relative to gender identification, is less impacted by visual acuity and within-face crowding in the periphery. These results are consistent with specific and automatic processing of danger-related information, which may drive attention to those messages and allow for a fast behavioral reaction.     

MET and AKT genetic influence on facial emotion perception

Background

Facial emotion perception is a major social skill, but its molecular signal pathway remains unclear. The MET/AKT cascade affects neurodevelopment in general populations and face recognition in patients with autism. This study explores the possible role of MET/AKT cascade in facial emotion perception.

Methods

One hundred and eighty two unrelated healthy volunteers (82 men and 100 women) were recruited. Four single nucleotide polymorphisms (SNP) of MET (rs2237717, rs41735, rs42336, and rs1858830) and AKT rs1130233 were genotyped and tested for their effects on facial emotion perception. Facial emotion perception was assessed by the face task of Mayer-Salovey-Caruso Emotional Intelligence Test (MSCEIT). Thorough neurocognitive functions were also assessed.

Results

Regarding MET rs2237717, individuals with the CT genotype performed better in facial emotion perception than those with TT (p = 0.016 by ANOVA, 0.018 by general linear regression model [GLM] to control for age, gender, and education duration), and showed no difference with those with CC. Carriers with the most common MET CGA haplotype (frequency = 50.5%) performed better than non-carriers of CGA in facial emotion perception (p = 0.018, df = 1, F = 5.69, p = 0.009 by GLM). In MET rs2237717/AKT rs1130233 interaction, the C carrier/G carrier group showed better facial emotion perception than those with the TT/AA genotype (p = 0.035 by ANOVA, 0.015 by GLM), even when neurocognitive functions were controlled (p = 0.046 by GLM).

Conclusions

To our knowledge, this is the first study to suggest that genetic factors can affect performance of facial emotion perception. The findings indicate that MET variances and MET/AKT interaction may affect facial emotion perception, implicating that the MET/AKT cascade plays a significant role in facial emotion perception. Further replication studies are needed.     

Changes in health perceptions after exposure to human suffering: using discrete emotions to understand underlying processes

Background

The aim of this study was to examine whether exposure to human suffering is associated with negative changes in perceptions about personal health. We further examined the relation of possible health perception changes, to changes in five discrete emotions (i.e., fear, guilt, hostility/anger, and joviality), as a guide to understand the processes underlying health perception changes, provided that each emotion conveys information regarding triggering conditions.

Methodology/Findings

An experimental group (N = 47) was exposed to images of human affliction, whereas a control group (N = 47) was exposed to relaxing images. Participants in the experimental group reported more health anxiety and health value, as well as lower health-related optimism and internal health locus of control, in comparison to participants exposed to relaxing images. They also reported more fear, guilt, hostility and sadness, as well as less joviality. Changes in each health perception were related to changes in particular emotions.

Conclusion

These findings imply that health perceptions are shaped in a constant dialogue with the representations about the broader world. Furthermore, it seems that the core of health perception changes lies in the acceptance that personal well-being is subject to several potential threats, as well as that people cannot fully control many of the factors the determine their own well-being.     

Sex Differences in the Rapid Detection of Emotional Facial Expressions

Background

Previous studies have shown that females and males differ in the processing of emotional facial expressions including the recognition of emotion, and that emotional facial expressions are detected more rapidly than are neutral expressions. However, whether the sexes differ in the rapid detection of emotional facial expressions remains unclear.

Methodology/Principal Findings

We measured reaction times (RTs) during a visual search task in which 44 females and 46 males detected normal facial expressions of anger and happiness or their anti-expressions within crowds of neutral expressions. Anti-expressions expressed neutral emotions with visual changes quantitatively comparable to normal expressions. We also obtained subjective emotional ratings in response to the facial expression stimuli. RT results showed that both females and males detected normal expressions more rapidly than anti-expressions and normal-angry expressions more rapidly than normal-happy expressions. However, females and males showed different patterns in their subjective ratings in response to the facial expressions. Furthermore, sex differences were found in the relationships between subjective ratings and RTs. High arousal was more strongly associated with rapid detection of facial expressions in females, whereas negatively valenced feelings were more clearly associated with the rapid detection of facial expressions in males.

Conclusion

Our data suggest that females and males differ in their subjective emotional reactions to facial expressions and in the emotional processes that modulate the detection of facial expressions.     

Effects of Emotion Regulation Difficulties on the Tonic and Phasic Cardiac Autonomic Response

Background

Emotion regulation theory aims to explain the interactions between individuals and the environment. In this context, Emotion Regulation Difficulties (ERD) disrupt the physiological component of emotions through the autonomic nervous system and are involved in several psychopathological states.

Objective

We were interested in comparing the influence of a film-elicited emotion procedure on the autonomic nervous system activity of two groups with different levels of emotion regulation difficulties.

Methods

A total of 63 women (undergraduate students) ranging from 18 to 27 (20.7±1.99) years old were included. Using the upper and lower quartile of a questionnaire assessing the daily difficulties in regulating emotions, two groups, one with low (LERD) and one with high (HERD) levels of emotion regulation difficulties, were constituted and studied during a film-elicited emotion procedure. Cardiac vagal activity (HF-HRV) was analyzed during three periods: baseline, film-elicited emotion, and recovery.

Results

The cardiovascular results showed a decrease in HF-HRV from baseline to elicitation for both groups. Then, from elicitation to recovery, HF-HRV increased for the LERD group, whereas a low HF-HRV level persisted for the HERD group.

Conclusions

The HERD group exhibited inappropriate cardiac vagal recovery after a negative emotion elicitation had ended. Cardiac vagal tone took longer to return to its initial state in the HERD group than in the LERD group. Prolonged cardiac vagal suppression might constitute an early marker of emotion regulation difficulties leading to lower cardiac vagal tone.     

Cross-cultural patterns in dynamic ratings of positive and negative natural emotional behaviour

Background

Studies of cross-cultural variations in the perception of emotion have typically compared rates of recognition of static posed stimulus photographs. That research has provided evidence for universality in the recognition of a range of emotions but also for some systematic cross-cultural variation in the interpretation of emotional expression. However, questions remain about how widely such findings can be generalised to real life emotional situations. The present study provides the first evidence that the previously reported interplay between universal and cultural influences extends to ratings of natural, dynamic emotional stimuli.

Methodology/Principal Findings

Participants from Northern Ireland, Serbia, Guatemala and Peru used a computer based tool to continuously rate the strength of positive and negative emotion being displayed in twelve short video sequences by people from the United Kingdom engaged in emotional conversations. Generalized additive mixed models were developed to assess the differences in perception of emotion between countries and sexes. Our results indicate that the temporal pattern of ratings is similar across cultures for a range of emotions and social contexts. However, there are systematic differences in intensity ratings between the countries, with participants from Northern Ireland making the most extreme ratings in the majority of the clips.

Conclusions/Significance

The results indicate that there is strong agreement across cultures in the valence and patterns of ratings of natural emotional situations but that participants from different cultures show systematic variation in the intensity with which they rate emotion. Results are discussed in terms of both ‘in-group advantage’ and ‘display rules’ approaches. This study indicates that examples of natural spontaneous emotional behaviour can be used to study cross-cultural variations in the perception of emotion.     

The neural correlates of emotional prosody comprehension: disentangling simple from complex emotion

Background

Emotional prosody comprehension (EPC), the ability to interpret another person''s feelings by listening to their tone of voice, is crucial for effective social communication. Previous studies assessing the neural correlates of EPC have found inconsistent results, particularly regarding the involvement of the medial prefrontal cortex (mPFC). It remained unclear whether the involvement of the mPFC is linked to an increased demand in socio-cognitive components of EPC such as mental state attribution and if basic perceptual processing of EPC can be performed without the contribution of this region.

Methods

fMRI was used to delineate neural activity during the perception of prosodic stimuli conveying simple and complex emotion. Emotional trials in general, as compared to neutral ones, activated a network comprising temporal and lateral frontal brain regions, while complex emotion trials specifically showed an additional involvement of the mPFC, premotor cortex, frontal operculum and left insula.

Conclusion

These results indicate that the mPFC and premotor areas might be associated, but are not crucial to EPC. However, the mPFC supports socio-cognitive skills necessary to interpret complex emotion such as inferring mental states. Additionally, the premotor cortex involvement may reflect the participation of the mirror neuron system for prosody processing particularly of complex emotion.     

The temporal dynamics of voluntary emotion regulation

Background

Neuroimaging has demonstrated that voluntary emotion regulation is effective in reducing amygdala activation to aversive stimuli during regulation. However, to date little is known about the sustainability of these neural effects once active emotion regulation has been terminated.

Methodology/Principal Findings

We addressed this issue by means of functional magnetic resonance imaging (fMRI) in healthy female subjects. We performed an active emotion regulation task using aversive visual scenes (task 1) and a subsequent passive viewing task using the same stimuli (task 2). Here we demonstrate not only a significantly reduced amygdala activation during active regulation but also a sustained regulation effect on the amygdala in the subsequent passive viewing task. This effect was related to an immediate increase of amygdala signal in task 1 once active emotion regulation has been terminated: The larger this peak postregulation signal in the amygdala in task 1, the smaller the sustained regulation effect in task 2.

Conclusions/Significance

In summary, we found clear evidence that effects of voluntary emotion regulation extend beyond the period of active regulation. These findings are of importance for the understanding of emotion regulation in general, for disorders of emotion regulation and for psychotherapeutic interventions.     

Dealing with Feelings: Characterization of Trait Alexithymia on Emotion Regulation Strategies and Cognitive-Emotional Processing

Background

Alexithymia, or “no words for feelings”, is a personality trait which is associated with difficulties in emotion recognition and regulation. It is unknown whether this deficit is due primarily to regulation, perception, or mentalizing of emotions. In order to shed light on the core deficit, we tested our subjects on a wide range of emotional tasks. We expected the high alexithymics to underperform on all tasks.

Method

Two groups of healthy individuals, high and low scoring on the cognitive component of the Bermond-Vorst Alexithymia Questionnaire, completed questionnaires of emotion regulation and performed several emotion processing tasks including a micro expression recognition task, recognition of emotional prosody and semantics in spoken sentences, an emotional and identity learning task and a conflicting beliefs and emotions task (emotional mentalizing).

Results

The two groups differed on the Emotion Regulation Questionnaire, Berkeley Expressivity Questionnaire and Empathy Quotient. Specifically, the Emotion Regulation Quotient showed that alexithymic individuals used more suppressive and less reappraisal strategies. On the behavioral tasks, as expected, alexithymics performed worse on recognition of micro expressions and emotional mentalizing. Surprisingly, groups did not differ on tasks of emotional semantics and prosody and associative emotional-learning.

Conclusion

Individuals scoring high on the cognitive component of alexithymia are more prone to suppressive emotion regulation strategies rather than reappraisal strategies. Regarding emotional information processing, alexithymia is associated with reduced performance on measures of early processing as well as higher order mentalizing. However, difficulties in the processing of emotional language were not a core deficit in our alexithymic group.     

Neural circuitry of emotional and cognitive conflict revealed through facial expressions

Background

Neural systems underlying conflict processing have been well studied in the cognitive realm, but the extent to which these overlap with those underlying emotional conflict processing remains unclear. A novel adaptation of the AX Continuous Performance Task (AX-CPT), a stimulus-response incompatibility paradigm, was examined that permits close comparison of emotional and cognitive conflict conditions, through the use of affectively-valenced facial expressions as the response modality.

Methodology/Principal Findings

Brain activity was monitored with functional magnetic resonance imaging (fMRI) during performance of the emotional AX-CPT. Emotional conflict was manipulated on a trial-by-trial basis, by requiring contextually pre-cued facial expressions to emotional probe stimuli (IAPS images) that were either affectively compatible (low-conflict) or incompatible (high-conflict). The emotion condition was contrasted against a matched cognitive condition that was identical in all respects, except that probe stimuli were emotionally neutral. Components of the brain cognitive control network, including dorsal anterior cingulate cortex (ACC) and lateral prefrontal cortex (PFC), showed conflict-related activation increases in both conditions, but with higher activity during emotion conditions. In contrast, emotion conflict effects were not found in regions associated with affective processing, such as rostral ACC.

Conclusions/Significance

These activation patterns provide evidence for a domain-general neural system that is active for both emotional and cognitive conflict processing. In line with previous behavioural evidence, greatest activity in these brain regions occurred when both emotional and cognitive influences additively combined to produce increased interference.