Asymmetrical activation in the human brain during processing of fearful faces

Traditional split-field studies and patient research indicate a privileged role for the right hemisphere in emotional processing [1-7], but there has been little direct fMRI evidence for this, despite many studies on emotional-face processing [8-10](see Supplemental Background). With fMRI, we addressed differential hemispheric processing of fearful versus neutral faces by presenting subjects with faces bilaterally [11-13]and orthogonally manipulating whether each hemifield showed a fearful or neutral expression prior to presentation of a checkerboard target. Target discrimination in the left visual field was more accurate after a fearful face was presented there. Event-related fMRI showed right-lateralized brain activations for fearful minus neutral left-hemifield faces in right visual areas, as well as more activity in the right than in the left amygdala. These activations occurred regardless of the type of right-hemifield face shown concurrently, concordant with the behavioral effect. No analogous behavioral or fMRI effects were observed for fearful faces in the right visual field (left hemisphere). The amygdala showed enhanced functional coupling with right-middle and anterior-fusiform areas in the context of a left-hemifield fearful face. These data provide behavioral and fMRI evidence for right-lateralized emotional processing during bilateral stimulation involving enhanced coupling of the amygdala and right-hemispheric extrastriate cortex.     

Emotion Separation Is Completed Early and It Depends on Visual Field Presentation

It is now apparent that the visual system reacts to stimuli very fast, with many brain areas activated within 100 ms. It is, however, unclear how much detail is extracted about stimulus properties in the early stages of visual processing. Here, using magnetoencephalography we show that the visual system separates different facial expressions of emotion well within 100 ms after image onset, and that this separation is processed differently depending on where in the visual field the stimulus is presented. Seven right-handed males participated in a face affect recognition experiment in which they viewed happy, fearful and neutral faces. Blocks of images were shown either at the center or in one of the four quadrants of the visual field. For centrally presented faces, the emotions were separated fast, first in the right superior temporal sulcus (STS; 35–48 ms), followed by the right amygdala (57–64 ms) and medial pre-frontal cortex (83–96 ms). For faces presented in the periphery, the emotions were separated first in the ipsilateral amygdala and contralateral STS. We conclude that amygdala and STS likely play a different role in early visual processing, recruiting distinct neural networks for action: the amygdala alerts sub-cortical centers for appropriate autonomic system response for fight or flight decisions, while the STS facilitates more cognitive appraisal of situations and links appropriate cortical sites together. It is then likely that different problems may arise when either network fails to initiate or function properly.     

Effects of attention and emotion on face processing in the human brain: an event-related fMRI study.

We used event-related fMRI to assess whether brain responses to fearful versus neutral faces are modulated by spatial attention. Subjects performed a demanding matching task for pairs of stimuli at prespecified locations, in the presence of task-irrelevant stimuli at other locations. Faces or houses unpredictably appeared at the relevant or irrelevant locations, while the faces had either fearful or neutral expressions. Activation of fusiform gyri by faces was strongly affected by attentional condition, but the left amygdala response to fearful faces was not. Right fusiform activity was greater for fearful than neutral faces, independently of the attention effect on this region. These results reveal differential influences on face processing from attention and emotion, with the amygdala response to threat-related expressions unaffected by a manipulation of attention that strongly modulates the fusiform response to faces.     

Emotional expectations influence neural sensitivity to fearful faces in humans: An event-related potential study

The present study tested whether neural sensitivity to salient emotional facial expressions was influenced by emotional expectations induced by a cue that validly predicted the expression of a subsequently presented target face. Event-related potentials (ERPs) elicited by fearful and neutral faces were recorded while participants performed a gender discrimination task under cued (‘expected’) and uncued (‘unexpected’) conditions. The behavioral results revealed that accuracy was lower for fearful compared with neutral faces in the unexpected condition, while accuracy was similar for fearful and neutral faces in the expected condition. ERP data revealed increased amplitudes in the P2 component and 200–250 ms interval for unexpected fearful versus neutral faces. By contrast, ERP responses were similar for fearful and neutral faces in the expected condition. These findings indicate that human neural sensitivity to fearful faces is modulated by emotional expectations. Although the neural system is sensitive to unpredictable emotionally salient stimuli, sensitivity to salient stimuli is reduced when these stimuli are predictable.     

Genetic variation in the serotonin transporter modulates neural system-wide response to fearful faces

A distributed, serotonergically innervated neural system comprising extrastriate cortex, amygdala and ventral prefrontal cortex is critical for identification of socially relevant emotive stimuli. The extent to which a genetic variation of serotonin transporter gene 5-HTTLPR impacts functional connectivity between the amygdala and the other components of this neural system remains little examined. In our study, neural activity was measured using event-related functional magnetic resonance imaging in 29 right-handed, white Caucasian healthy subjects as they viewed mild or prototypical fearful and neutral facial expressions. 5-HTTLPR genotype was classified as homozygous for the short allele ( S/S ), homozygous for the long allele ( L/L ) or heterozygous ( S/L ). S/S showed greater activity than L/L within right fusiform gyrus (FG) to prototypically fearful faces. To these fearful faces, S/S more than other genotype subgroups showed significantly greater positive functional connectivity between right amygdala and FG and between right FG and right ventrolateral prefrontal cortex (VLPFC). There was a positive association between measure of psychoticism and degree of functional connectivity between right FG and right VLPFC in response to prototypically fearful faces. Our data are the first to show that genotypic variation in 5-HTTLPR modulates both the amplitude within and the functional connectivity between different components of the visual object-processing neural system to emotionally salient stimuli. These effects may underlie the vulnerability to mood and anxiety disorders potentially triggered by socially salient, emotional cues in individuals with the S allele of 5-HTTLPR.     

To what extent are emotional visual stimuli processed without attention and awareness?

In the past few years, important contributions have been made to the study of emotional visual perception. Researchers have reported responses to emotional stimuli in the human amygdala under some unattended conditions (i.e. conditions in which the focus of attention was diverted away from the stimuli due to task instructions), during visual masking and during binocular suppression. Taken together, these results reveal the relative degree of autonomy of emotional processing. At the same time, however, important limitations to the notion of complete automaticity have been revealed. Effects of task context and attention have been shown, as well as large inter-subject differences in sensitivity to the detection of masked fearful faces (whereby briefly presented, target fearful faces are immediately followed by a neutral face that 'masks' the initial face). A better understanding of the neural basis of emotional perception and how it relates to visual attention and awareness is likely to require further refinement of the concepts of automaticity and awareness.     

Brain responses to the acquired moral status of faces

We examined whether neural responses associated with judgments of socially relevant aspects of the human face extend to stimuli that acquire their significance through learning in a meaningful interactive context, specifically reciprocal cooperation. During fMRI, subjects made gender judgments on faces of people who had been introduced as fair (cooperators) or unfair (defector) players through repeated play of a sequential Prisoner's Dilemma game. To manipulate moral responsibility, players were introduced as either intentional or nonintentional agents. Our behavioral (likebility ratings and memory performance) as well as our imaging data confirm the saliency of social fairness for human interactions. Relative to neutral faces, faces of intentional cooperators engendered increased activity in left amygdala, bilateral insula, fusiform gyrus, STS, and reward-related areas. Our data indicate that rapid learning regarding the moral status of others is expressed in altered neural activity within a system associated with social cognition.     

Individual differences in trait anxiety predict the response of the basolateral amygdala to unconsciously processed fearful faces

Responses to threat-related stimuli are influenced by conscious and unconscious processes, but the neural systems underlying these processes and their relationship to anxiety have not been clearly delineated. Using fMRI, we investigated the neural responses associated with the conscious and unconscious (backwardly masked) perception of fearful faces in healthy volunteers who varied in threat sensitivity (Spielberger trait anxiety scale). Unconscious processing modulated activity only in the basolateral subregion of the amygdala, while conscious processing modulated activity only in the dorsal amygdala (containing the central nucleus). Whereas activation of the dorsal amygdala by conscious stimuli was consistent across subjects and independent of trait anxiety, activity in the basolateral amygdala to unconscious stimuli, and subjects' reaction times, were predicted by individual differences in trait anxiety. These findings provide a biological basis for the unconscious emotional vigilance characteristic of anxiety and a means for investigating the mechanisms and efficacy of treatments for anxiety.     

Facial-expression and gaze-selective responses in the monkey amygdala

The social behavior of both human and nonhuman primates relies on specializations for the recognition of individuals, their facial expressions, and their direction of gaze. A broad network of cortical and subcortical structures has been implicated in face processing, yet it is unclear whether co-occurring dimensions of face stimuli, such as expression and direction of gaze, are processed jointly or independently by anatomically and functionally segregated neural structures. Awake macaques were presented with a set of monkey faces displaying aggressive, neutral, and appeasing expressions with head and eyes either averted or directed. BOLD responses to these faces as compared to Fourier-phase-scrambled images revealed widespread activation of the superior temporal sulcus and inferotemporal cortex and included activity in the amygdala. The different dimensions of the face stimuli elicited distinct activation patterns among the amygdaloid nuclei. The basolateral amygdala, including the lateral, basal, and accessory basal nuclei, produced a stronger response for threatening than appeasing expressions. The central nucleus and bed nucleus of the stria terminalis responded more to averted than directed-gaze faces. Independent behavioral measures confirmed that faces with averted gaze were more arousing, suggesting the activity in the central nucleus may be related to attention and arousal.     

Spatial Attention Effects of Disgusted and Fearful Faces

Effective processing of threat-related stimuli is of significant evolutionary advantage. Given the intricate relationship between attention and the neural processing of threat-related emotions, this study manipulated attention allocation and emotional categories of threat-related stimuli as independent factors and investigated the time course of spatial-attention-modulated processing of disgusting and fearful stimuli. The participants were instructed to direct their attention either to the two vertical or to the two horizontal locations, where two faces and two houses would be presented. The task was to respond regarding the physical identity of the two stimuli at cued locations. Event-related potentials (ERP) evidences were found to support a two-stage model of attention-modulated processing of threat-related emotions. In the early processing stage, disgusted faces evoked larger P1 component at right occipital region despite the attention allocation while larger N170 component was elicited by fearful faces at right occipito-temporal region only when participants attended to houses. In the late processing stage, the amplitudes of the parietal P3 component enhanced for both disgusted and fearful facial expressions only when the attention was focused on faces. According to the results, we propose that the temporal dynamics of the emotion-by-attention interaction consist of two stages. The early stage is characterized by quick and specialized neural encoding of disgusting and fearful stimuli irrespective of voluntary attention allocation, indicating an automatic detection and perception of threat-related emotions. The late stage is represented by attention-gated separation between threat-related stimuli and neutral stimuli; the similar ERP pattern evoked by disgusted and fearful faces suggests a more generalized processing of threat-related emotions via top-down attentional modulation, based on which the defensive behavior in response to threat events is largely facilitated.     

Effects of unconscious processing on implicit memory for fearful faces

Emotional stimuli can be processed even when participants perceive them without conscious awareness, but the extent to which unconsciously processed emotional stimuli influence implicit memory after short and long delays is not fully understood. We addressed this issue by measuring a subliminal affective priming effect in Experiment 1 and a long-term priming effect in Experiment 2. In Experiment 1, a flashed fearful or neutral face masked by a scrambled face was presented three times, then a target face (either fearful or neutral) was presented and participants were asked to make a fearful/neutral judgment. We found that, relative to a neutral prime face (neutral-fear face), a fearful prime face speeded up participants' reaction to a fearful target (fear-fear face), when they were not aware of the masked prime face. But this response pattern did not apply to the neutral target. In Experiment 2, participants were first presented with a masked faces six times during encoding. Three minutes later, they were asked to make a fearful/neutral judgment for the same face with congruent expression, the same face with incongruent expression or a new face. Participants showed a significant priming effect for the fearful faces but not for the neutral faces, regardless of their awareness of the masked faces during encoding. These results provided evidence that unconsciously processed stimuli could enhance emotional memory after both short and long delays. It indicates that emotion can enhance memory processing whether the stimuli are encoded consciously or unconsciously.     

Abnormal FMRI adaptation to unfamiliar faces in a case of developmental prosopamnesia

In rare cases, damage to the temporal lobe causes a selective impairment in the ability to learn new faces, a condition known as prosopamnesia [1]. Here we present the case of an individual with prosopamnesia in the absence of any acquired structural lesion. "C" shows intact processing of simple and complex nonface objects, but her ability to learn new faces is severely impaired. We used a neural marker of perceptual learning known as repetition suppression to examine functioning within C's fusiform face area (FFA), a region of cortex involved in face perception [2]. For comparison, we examined repetition suppression in the scene-selective parahippocampal place area (PPA) [3]. As expected, normal controls showed significant region-specific attenuation of neural activity across repetitions of each stimulus class. C also showed normal attenuation within the PPA to familiar and unfamiliar scenes, and within the FFA to familiar faces. Critically, however, she failed to show any adaptive change within the FFA for repeated unfamiliar faces, despite a face-specific blood-oxygen-dependent response (BOLD) response in her FFA during viewing of face stimuli. Our findings suggest that in developmental prosopamnesia, the FFA cannot maintain stable representations of new faces for subsequent recall or recognition.     

Regional Neural Response Differences in the Determination of Faces or Houses Positioned in a Wide Visual Field

In human visual cortex, the primary visual cortex (V1) is considered to be essential for visual information processing; the fusiform face area (FFA) and parahippocampal place area (PPA) are considered as face-selective region and places-selective region, respectively. Recently, a functional magnetic resonance imaging (fMRI) study showed that the neural activity ratios between V1 and FFA were constant as eccentricities increasing in central visual field. However, in wide visual field, the neural activity relationships between V1 and FFA or V1 and PPA are still unclear. In this work, using fMRI and wide-view present system, we tried to address this issue by measuring neural activities in V1, FFA and PPA for the images of faces and houses aligning in 4 eccentricities and 4 meridians. Then, we further calculated ratio relative to V1 (RRV1) as comparing the neural responses amplitudes in FFA or PPA with those in V1. We found V1, FFA, and PPA showed significant different neural activities to faces and houses in 3 dimensions of eccentricity, meridian, and region. Most importantly, the RRV1s in FFA and PPA also exhibited significant differences in 3 dimensions. In the dimension of eccentricity, both FFA and PPA showed smaller RRV1s at central position than those at peripheral positions. In meridian dimension, both FFA and PPA showed larger RRV1s at upper vertical positions than those at lower vertical positions. In the dimension of region, FFA had larger RRV1s than PPA. We proposed that these differential RRV1s indicated FFA and PPA might have different processing strategies for encoding the wide field visual information from V1. These different processing strategies might depend on the retinal position at which faces or houses are typically observed in daily life. We posited a role of experience in shaping the information processing strategies in the ventral visual cortex.     

Passive and motivated perception of emotional faces: qualitative and quantitative changes in the face processing network

Emotionally expressive faces are processed by a distributed network of interacting sub-cortical and cortical brain regions. The components of this network have been identified and described in large part by the stimulus properties to which they are sensitive, but as face processing research matures interest has broadened to also probe dynamic interactions between these regions and top-down influences such as task demand and context. While some research has tested the robustness of affective face processing by restricting available attentional resources, it is not known whether face network processing can be augmented by increased motivation to attend to affective face stimuli. Short videos of people expressing emotions were presented to healthy participants during functional magnetic resonance imaging. Motivation to attend to the videos was manipulated by providing an incentive for improved recall performance. During the motivated condition, there was greater coherence among nodes of the face processing network, more widespread correlation between signal intensity and performance, and selective signal increases in a task-relevant subset of face processing regions, including the posterior superior temporal sulcus and right amygdala. In addition, an unexpected task-related laterality effect was seen in the amygdala. These findings provide strong evidence that motivation augments co-activity among nodes of the face processing network and the impact of neural activity on performance. These within-subject effects highlight the necessity to consider motivation when interpreting neural function in special populations, and to further explore the effect of task demands on face processing in healthy brains.     

Asymmetric Engagement of Amygdala and Its Gamma Connectivity in Early Emotional Face Processing

The amygdala has been regarded as a key substrate for emotion processing. However, the engagement of the left and right amygdala during the early perceptual processing of different emotional faces remains unclear. We investigated the temporal profiles of oscillatory gamma activity in the amygdala and effective connectivity of the amygdala with the thalamus and cortical areas during implicit emotion-perceptual tasks using event-related magnetoencephalography (MEG). We found that within 100 ms after stimulus onset the right amygdala habituated to emotional faces rapidly (with duration around 20–30 ms), whereas activity in the left amygdala (with duration around 50–60 ms) sustained longer than that in the right. Our data suggest that the right amygdala could be linked to autonomic arousal generated by facial emotions and the left amygdala might be involved in decoding or evaluating expressive faces in the early perceptual emotion processing. The results of effective connectivity provide evidence that only negative emotional processing engages both cortical and subcortical pathways connected to the right amygdala, representing its evolutional significance (survival). These findings demonstrate the asymmetric engagement of bilateral amygdala in emotional face processing as well as the capability of MEG for assessing thalamo-cortico-limbic circuitry.     

The effect of negative and positive emotionality on associative memory: an FMRI study

In general, emotion is known to enhance memory processes. However, the effect of emotion on associative memory and the underling neural mechanisms remains largely unexplored. In this study, we explored brain activation during an associative memory task that involved the encoding and retrieval of word and face pairs. The word and face pairs consisted of either negative or positive words with neutral faces. Significant hippocampal activation was observed during both encoding and retrieval, regardless of whether the word was negative or positive. Negative and positive emotionality differentially affected the hemodynamic responses to encoding and retrieval in the amygdala, with increased responses during encoding negative word and face pairs. Furthermore, activation of the amygdala during encoding of negative word and neutral face pairs was inversely correlated with subsequent memory retrieval. These findings suggest that activation of the amygdala induced by negative emotion during encoding may disrupt associative memory performance.     

Positive Facial Affect – An fMRI Study on the Involvement of Insula and Amygdala

Imitation of facial expressions engages the putative human mirror neuron system as well as the insula and the amygdala as part of the limbic system. The specific function of the latter two regions during emotional actions is still under debate. The current study investigated brain responses during imitation of positive in comparison to non-emotional facial expressions. Differences in brain activation of the amygdala and insula were additionally examined during observation and execution of facial expressions. Participants imitated, executed and observed happy and non-emotional facial expressions, as well as neutral faces. During imitation, higher right hemispheric activation emerged in the happy compared to the non-emotional condition in the right anterior insula and the right amygdala, in addition to the pre-supplementary motor area, middle temporal gyrus and the inferior frontal gyrus. Region-of-interest analyses revealed that the right insula was more strongly recruited by (i) imitation and execution than by observation of facial expressions, that (ii) the insula was significantly stronger activated by happy than by non-emotional facial expressions during observation and imitation and that (iii) the activation differences in the right amygdala between happy and non-emotional facial expressions were increased during imitation and execution, in comparison to sole observation. We suggest that the insula and the amygdala contribute specifically to the happy emotional connotation of the facial expressions depending on the task. The pattern of the insula activity might reflect increased bodily awareness during active execution compared to passive observation and during visual processing of the happy compared to non-emotional facial expressions. The activation specific for the happy facial expression of the amygdala during motor tasks, but not in the observation condition, might reflect increased autonomic activity or feedback from facial muscles to the amygdala.     

A specific and rapid neural signature for parental instinct

Darwin originally pointed out that there is something about infants which prompts adults to respond to and care for them, in order to increase individual fitness, i.e. reproductive success, via increased survivorship of one's own offspring. Lorenz proposed that it is the specific structure of the infant face that serves to elicit these parental responses, but the biological basis for this remains elusive. Here, we investigated whether adults show specific brain responses to unfamiliar infant faces compared to adult faces, where the infant and adult faces had been carefully matched across the two groups for emotional valence and arousal, as well as size and luminosity. The faces also matched closely in terms of attractiveness. Using magnetoencephalography (MEG) in adults, we found that highly specific brain activity occurred within a seventh of a second in response to unfamiliar infant faces but not to adult faces. This activity occurred in the medial orbitofrontal cortex (mOFC), an area implicated in reward behaviour, suggesting for the first time a neural basis for this vital evolutionary process. We found a peak in activity first in mOFC and then in the right fusiform face area (FFA). In mOFC the first significant peak (p<0.001) in differences in power between infant and adult faces was found at around 130 ms in the 10-15 Hz band. These early differences were not found in the FFA. In contrast, differences in power were found later, at around 165 ms, in a different band (20-25 Hz) in the right FFA, suggesting a feedback effect from mOFC. These findings provide evidence in humans of a potential brain basis for the "innate releasing mechanisms" described by Lorenz for affection and nurturing of young infants. This has potentially important clinical applications in relation to postnatal depression, and could provide opportunities for early identification of families at risk.     

The neuropsychology of face perception: beyond simple dissociations and functional selectivity

Face processing relies on a distributed, patchy network of cortical regions in the temporal and frontal lobes that respond disproportionately to face stimuli, other cortical regions that are not even primarily visual (such as somatosensory cortex), and subcortical structures such as the amygdala. Higher-level face perception abilities, such as judging identity, emotion and trustworthiness, appear to rely on an intact face-processing network that includes the occipital face area (OFA), whereas lower-level face categorization abilities, such as discriminating faces from objects, can be achieved without OFA, perhaps via the direct connections to the fusiform face area (FFA) from several extrastriate cortical areas. Some lesion, transcranial magnetic stimulation (TMS) and functional magnetic resonance imaging (fMRI) findings argue against a strict feed-forward hierarchical model of face perception, in which the OFA is the principal and common source of input for other visual and non-visual cortical regions involved in face perception, including the FFA, face-selective superior temporal sulcus and somatosensory cortex. Instead, these findings point to a more interactive model in which higher-level face perception abilities depend on the interplay between several functionally and anatomically distinct neural regions. Furthermore, the nature of these interactions may depend on the particular demands of the task. We review the lesion and TMS literature on this topic and highlight the dynamic and distributed nature of face processing.     

Frontal EEG Activation Asymmetry Reflects Cognitive Biases in Anxiety: Evidence from an Emotional Face Stroop Task

Electroencephalography (EEG) has been extensively used in studies of the frontal asymmetry of emotion and motivation. This study investigated the midfrontal EEG activation, heart rate and skin conductance during an emotional face analog of the Stroop task, in anxious and non-anxious participants. In this task, the participants were asked to identify the expression of calm, fearful and happy faces that had either a congruent or incongruent emotion name written across them. Anxious participants displayed a cognitive bias characterized by facilitated attentional engagement with fearful faces. Fearful face trials induced greater relative right frontal activation, whereas happy face trials induced greater relative left frontal activation. Moreover, anxiety specifically modulated the magnitude of the right frontal activation to fearful faces, which also correlated with the cognitive bias. Therefore, these results show that frontal EEG activation asymmetry reflects the bias toward facilitated processing of fearful faces in anxiety.