The neural correlates of emotional prosody comprehension: disentangling simple from complex emotion

Background

Emotional prosody comprehension (EPC), the ability to interpret another person''s feelings by listening to their tone of voice, is crucial for effective social communication. Previous studies assessing the neural correlates of EPC have found inconsistent results, particularly regarding the involvement of the medial prefrontal cortex (mPFC). It remained unclear whether the involvement of the mPFC is linked to an increased demand in socio-cognitive components of EPC such as mental state attribution and if basic perceptual processing of EPC can be performed without the contribution of this region.

Methods

fMRI was used to delineate neural activity during the perception of prosodic stimuli conveying simple and complex emotion. Emotional trials in general, as compared to neutral ones, activated a network comprising temporal and lateral frontal brain regions, while complex emotion trials specifically showed an additional involvement of the mPFC, premotor cortex, frontal operculum and left insula.

Conclusion

These results indicate that the mPFC and premotor areas might be associated, but are not crucial to EPC. However, the mPFC supports socio-cognitive skills necessary to interpret complex emotion such as inferring mental states. Additionally, the premotor cortex involvement may reflect the participation of the mirror neuron system for prosody processing particularly of complex emotion.     

Adaptive allocation of attention: effects of sex and sociosexuality on visual attention to attractive opposite-sex faces

We tested the hypothesis that, compared with sociosexually restricted individuals, those with an unrestricted approach to mating would selectively allocate visual attention to attractive opposite-sex others. We also tested for sex differences in this effect. Seventy-four participants completed the Sociosexual Orientation Inventory and performed a computer-based task that assessed the speed with which they detected changes in attractive and unattractive male and female faces. Differences in reaction times served as indicators of selective attention. Results revealed a Sex×Sociosexuality interaction: Compared with sociosexually restricted men, unrestricted men selectively allocated attention to attractive opposite-sex others; no such effect emerged among women. This finding was specific to opposite-sex targets and did not occur in attention to same-sex others. These results contribute to a growing literature on the adaptive allocation of attention in social environments.     

Post-determined emotion: motor action retrospectively modulates emotional valence of visual images

Upward and downward motor actions influence subsequent and ongoing emotional processing in accordance with a space–valence metaphor: positive is up/negative is down. In this study, we examined whether upward and downward motor actions could also affect previous emotional processing. Participants were shown an emotional image on a touch screen. After the image disappeared, they were required to drag a centrally located dot towards a cued area, which was either in the upper or lower portion of the screen. They were then asked to rate the emotional valence of the image using a 7-point scale. We found that the emotional valence of the image was more positive when the cued area was located in the upper portion of the screen. However, this was the case only when the dragging action was required immediately after the image had disappeared. Our findings suggest that when somatic information that is metaphorically associated with an emotion is linked temporally with a visual event, retrospective emotional integration between the visual and somatic events occurs.     

Reward guides vision when it's your thing: trait reward-seeking in reward-mediated visual priming

Reward-related mesolimbic dopamine is thought to play an important role in guiding animal behaviour, biasing approach towards potentially beneficial environmental stimuli and away from objects unlikely to garner positive outcome. This is considered to result in part from an impact on perceptual and attentional processes: dopamine initiates a series of cognitive events that result in the priming of reward-associated perceptual features. We have provided behavioural and electrophysiological evidence that this mechanism guides human vision in search, an effect we refer to as reward priming. We have also demonstrated that there is substantial individual variability in this effect. Here we show that behavioural differences in reward priming are predicted remarkably well by a personality index that captures the degree to which a person's behaviour is driven by reward outcome. Participants with reward-seeking personalities are found to be those who allocate visual resources to objects characterized by reward-associated visual features. These results add to a rapidly developing literature demonstrating the crucial role reward plays in attentional control. They additionally illustrate the striking impact personality traits can have on low-level cognitive processes like perception and selective attention.     

Modulation of visual processing by attention and emotion: windows on causal interactions between human brain regions

Visual processing is not determined solely by retinal inputs. Attentional modulation can arise when the internal attentional state (current task) of the observer alters visual processing of the same stimuli. This can influence visual cortex, boosting neural responses to an attended stimulus. Emotional modulation can also arise, when affective properties (emotional significance) of stimuli, rather than their strictly visual properties, influence processing. This too can boost responses in visual cortex, as for fear-associated stimuli. Both attentional and emotional modulation of visual processing may reflect distant influences upon visual cortex, exerted by brain structures outside the visual system per se. Hence, these modulations may provide windows onto causal interactions between distant but interconnected brain regions. We review recent evidence, noting both similarities and differences between attentional and emotional modulation. Both can affect visual cortex, but can reflect influences from different regions, such as fronto-parietal circuits versus the amygdala. Recent work on this has developed new approaches for studying causal influences between human brain regions that may be useful in other cognitive domains. The new methods include application of functional magnetic resonance imaging (fMRI) and electroencephalography (EEG) measures in brain-damaged patients to study distant functional impacts of their focal lesions, and use of transcranial magnetic stimulation concurrently with fMRI or EEG in the normal brain. Cognitive neuroscience is now moving beyond considering the putative functions of particular brain regions, as if each operated in isolation, to consider, instead, how distinct brain regions (such as visual cortex, parietal or frontal regions, or amygdala) may mutually influence each other in a causal manner.     

Emotional sensitivity for motherhood: Late pregnancy is associated with enhanced accuracy to encode emotional faces

Previous research suggests that female sex hormones can increase the sensitivity of women's emotion processing systems. The largest rises in sex hormone levels in a woman's life are from early to late pregnancy. The current study, therefore, investigated whether changes in emotion processing are seen across pregnancy. Hypervigilant emotion processing has been implicated in the aetiology of anxiety. Therefore enhanced emotion processing across pregnancy has implications for women's vulnerability to anxiety. Ability to encode facial expressions of emotion was assessed in 101 women during early pregnancy and again in 76 of these women during late pregnancy. Symptoms of anxiety were measured using a clinical interview (The CIS-R). Consistent with previous research, the presence of anxiety symptoms was associated with greater accuracy to encode faces signalling threat (fearful and angry faces). We found that women had higher accuracy scores to encode emotional expressions signalling threat or harm (fearful, angry and disgusted faces) but also a more general negative emotion (sadness) during late, compared with early, pregnancy. Enhanced ability to encode emotional faces during late pregnancy may be an evolutionary adaption to prepare women for the protective and nurturing demands of motherhood by increasing their general emotional sensitivity and their vigilance towards emotional signals of threat, aggression and contagion. However, the results also suggest that, during late pregnancy, women's emotion processing style is similar to that seen in anxiety. The results have implications for our understanding of normal pregnant women's processing of emotional cues and their vulnerability to symptoms of anxiety.     

From optics to attention: visual perception in barn owls

Barn owls are nocturnal predators which have evolved specific sensory and morphological adaptations to a life in dim light. Here, some of the most fundamental properties of spatial vision in barn owls are reviewed. The eye with its tubular shape is rigidly integrated in the skull so that eye movements are very much restricted. The eyes are oriented frontally, allowing for a large binocular overlap. Accommodation, but not pupil dilation, is coupled between the two eyes. The retina is rod dominated and lacks a visible fovea. Retinal ganglion cells form a marked region of highest density that extends to a horizontally oriented visual streak. Behavioural visual acuity and contrast sensitivity are poor, although the optical quality of the ocular media is excellent. A low f-number allows high image quality at low light levels. Vernier acuity was found to be a hyperacute percept. Owls have global stereopsis with hyperacute stereo acuity thresholds. Neurons of the visual Wulst are sensitive to binocular disparities. Orientation based saliency was demonstrated in a visual-search experiment, and higher cognitive abilities were shown when the owl’s were able to use illusory contours for object discrimination.     

Seeing is believing: information content and behavioural response to visual and chemical cues

Predator avoidance and foraging often pose conflicting demands. Animals can decrease mortality risk searching for predators, but searching decreases foraging time and hence intake. We used this principle to investigate how prey should use information to detect, assess and respond to predation risk from an optimal foraging perspective. A mathematical model showed that solitary bees should increase flower examination time in response to predator cues and that the rate of false alarms should be negatively correlated with the relative value of the flower explored. The predatory ant, Oecophylla smaragdina, and the harmless ant, Polyrhachis dives, differ in the profile of volatiles they emit and in their visual appearance. As predicted, the solitary bee Nomia strigata spent more time examining virgin flowers in presence of predator cues than in their absence. Furthermore, the proportion of flowers rejected decreased from morning to noon, as the relative value of virgin flowers increased. In addition, bees responded differently to visual and chemical cues. While chemical cues induced bees to search around flowers, bees detecting visual cues hovered in front of them. These strategies may allow prey to identify the nature of visual cues and to locate the source of chemical cues.     

The music of your emotions: neural substrates involved in detection of emotional correspondence between auditory and visual music actions

In humans, emotions from music serve important communicative roles. Despite a growing interest in the neural basis of music perception, action and emotion, the majority of previous studies in this area have focused on the auditory aspects of music performances. Here we investigate how the brain processes the emotions elicited by audiovisual music performances. We used event-related functional magnetic resonance imaging, and in Experiment 1 we defined the areas responding to audiovisual (musician's movements with music), visual (musician's movements only), and auditory emotional (music only) displays. Subsequently a region of interest analysis was performed to examine if any of the areas detected in Experiment 1 showed greater activation for emotionally mismatching performances (combining the musician's movements with mismatching emotional sound) than for emotionally matching music performances (combining the musician's movements with matching emotional sound) as presented in Experiment 2 to the same participants. The insula and the left thalamus were found to respond consistently to visual, auditory and audiovisual emotional information and to have increased activation for emotionally mismatching displays in comparison with emotionally matching displays. In contrast, the right thalamus was found to respond to audiovisual emotional displays and to have similar activation for emotionally matching and mismatching displays. These results suggest that the insula and left thalamus have an active role in detecting emotional correspondence between auditory and visual information during music performances, whereas the right thalamus has a different role.     

Effect of empathy trait on attention to faces: an event-related potential (ERP) study

Background

Empathy is deeply linked with the ability to adapt to human social environments. The present study investigated the relationship between the empathy trait and attention elicited by discriminating facial expressions.

Methods

Event-related potentials were measured while 32 participants (17 men and 15 women) discriminated facial expressions (happy or angry) and colors of flowers (yellow or purple) under an oddball paradigm. The empathy trait of participants was measured using the Interpersonal Reactivity Index (Davis, 1980).

Results

The empathy trait correlated positively with both the early portion (300 to 600 ms after stimulus onset) and late portion (600 to 800 ms after stimulus onset) of late positive potential (LPP) amplitude elicited by faces, but not with LPP elicited by flowers.

Conclusions

This result suggests that, compared to people with low empathy, people with high empathy pay more attention when discriminating facial expressions. The present study suggests that differences exist in methods of adapting to social environments between people with high and low empathy.     

Color coding in the cortex: a modified approach to bottom-up visual attention

Itti and Koch’s (Vision Research 40:1489–1506, 2000) saliency-based visual attention model is a broadly accepted model that describes how attention processes are deployed in the visual cortex in a pure bottom-up strategy. This work complements their model by modifying the color feature calculation. Evidence suggests that S-cone responses are elicited in the same spatial distribution and have the same sign as responses to M-cone stimuli; these cells are tentatively referred to as red-cyan. For other cells, the S-cone input seems to be aligned with the L-cone input; these cells might be green-magenta cells. To model red-cyan and green-magenta double-opponent cells, we implement a center-surround difference approach of the aforementioned model. The resulting color maps elicited enhanced responses to color salient stimuli when compared to the classic ones at high statistical significance levels. We also show that the modified model improves the prediction of locations attended by human viewers.     

Feeling or features: different sensitivity to emotion in high-order visual cortex and amygdala.

Emotionally loaded visual stimuli have shown increased activation in visual and cortex limbic areas. However, differences in visual features of such images could confound these findings. In order to manipulate valence of stimuli while keeping visual features largely unchanged, we took advantage of an "expressional transfiguration" (ET) effect of faces. In addition, we used repetition effects, which enabled us to test more incisively the impact of the ET effect. Using the ET manipulation, we have shown that the activation in lateral occipital complex (LOC) was unaffected by valence attributes, but produced significant modulation of fMR adaptation. Contrary to LOC, amygdala activation was increased by ET manipulation unrelated to the adaptation. A correlation between amygdala and LOC adaptation points to a possible modulatory role of the amygdala upon visual cortex short-term plasticity.     

Understanding deficient emotional self-regulation in adults with attention deficit hyperactivity disorder: a controlled study

While symptoms of deficient emotional self-regulation (DESR) such as low frustration tolerance, temper outbursts, emotional impulsivity, and mood lability are commonly associated with attention deficit hyperactivity disorder (ADHD), little is known about their nature. The main aim of this post hoc study was to examine the correlates of DESR in a large sample of adults with and without ADHD. Subjects were 206 adults with ADHD and 123 adults without ADHD from a family study of ADHD. Emotional impulsivity was operationalized using items from the Barkley Current Behavior Scale. Subjects were comprehensively assessed for psychiatric comorbidity using structured diagnostic interview methodology. We used the Quality of Life, Enjoyment, and Satisfaction Questionnaire-Short Form (QLES-Q-SF) and Social Adjustment Scale-Self-report (SAS-SR) to assess quality of life and psychosocial functioning. DESR was more common among ADHD compared with non-ADHD adults, and 55 % of adults with ADHD reported extreme DESR of greater severity than 95 % of control subjects. The association of ADHD and DESR was not entirely accounted for by either current or lifetime comorbid disorders. DESR was also associated with significant functional impairment as evaluated by the QLES-Q-SF and SAS-SR, and with reduced marital status, as well as higher risk for traffic accidents and arrests. DESR adversely impacts quality of life in adults with ADHD. More work is needed to further evaluate DESR in clinical and investigational studies of subjects with ADHD.     

Omega-3 fatty acids are related to abnormal emotion processing in adolescent boys with attention deficit hyperactivity disorder

BackgroundIn addition to the core symptoms, attention deficit hyperactivity disorder (ADHD) is associated with poor emotion regulation. There is some evidence that children and young adults with ADHD have lower omega-3 levels and that supplementation with omega-3 can improve both ADHD and affective symptoms. We therefore investigated differences between ADHD and non-ADHD children in omega-3/6 fatty acid plasma levels and the relationship between those indices and emotion-elicited event-related potentials (ERPs).MethodsChildren/adolescents with (n=31) and without ADHD (n=32) were compared in their plasma omega-3/6 indices and corresponding ERPs during an emotion processing task.ResultsChildren with ADHD had lower mean omega-3/6 and ERP abnormalities in emotion processing, independent of emotional valence relative to control children. ERP abnormalities were significantly associated with lower omega-3 levels in the ADHD group.ConclusionsThe findings reveal for the first time that lower omega-3 fatty acids are associated with impaired emotion processing in ADHD children.     

Selective attention to task-irrelevant emotional distractors is unaffected by the perceptual load associated with a foreground task

A number of studies have shown that emotionally arousing stimuli are preferentially processed in the human brain. Whether or not this preference persists under increased perceptual load associated with a task at hand remains an open question. Here we manipulated two possible determinants of the attentional selection process, perceptual load associated with a foreground task and the emotional valence of concurrently presented task-irrelevant distractors. As a direct measure of sustained attentional resource allocation in early visual cortex we used steady-state visual evoked potentials (SSVEPs) elicited by distinct flicker frequencies of task and distractor stimuli. Subjects either performed a detection (low load) or discrimination (high load) task at a centrally presented symbol stream that flickered at 8.6 Hz while task-irrelevant neutral or unpleasant pictures from the International Affective Picture System (IAPS) flickered at a frequency of 12 Hz in the background of the stream. As reflected in target detection rates and SSVEP amplitudes to both task and distractor stimuli, unpleasant relative to neutral background pictures more strongly withdrew processing resources from the foreground task. Importantly, this finding was unaffected by the factor 'load' which turned out to be a weak modulator of attentional processing in human visual cortex.     

The Goldilocks effect: human infants allocate attention to visual sequences that are neither too simple nor too complex

Human infants, like immature members of any species, must be highly selective in sampling information from their environment to learn efficiently. Failure to be selective would waste precious computational resources on material that is already known (too simple) or unknowable (too complex). In two experiments with 7- and 8-month-olds, we measure infants' visual attention to sequences of events varying in complexity, as determined by an ideal learner model. Infants' probability of looking away was greatest on stimulus items whose complexity (negative log probability) according to the model was either very low or very high. These results suggest a principle of infant attention that may have broad applicability: infants implicitly seek to maintain intermediate rates of information absorption and avoid wasting cognitive resources on overly simple or overly complex events.     

Interval timing in children: effects of auditory and visual pacing stimuli and relationships with reading and attention variables

Motor timing tasks have been employed in studies of neurodevelopmental disorders such as developmental dyslexia and ADHD, where they provide an index of temporal processing ability. Investigations of these disorders have used different stimulus parameters within the motor timing tasks that are likely to affect performance measures. Here we assessed the effect of auditory and visual pacing stimuli on synchronised motor timing performance and its relationship with cognitive and behavioural predictors that are commonly used in the diagnosis of these highly prevalent developmental disorders. Twenty-one children (mean age 9.6 years) completed a finger tapping task in two stimulus conditions, together with additional psychometric measures. As anticipated, synchronisation to the beat (ISI 329 ms) was less accurate in the visually paced condition. Decomposition of timing variance indicated that this effect resulted from differences in the way that visual and auditory paced tasks are processed by central timekeeping and associated peripheral implementation systems. The ability to utilise an efficient processing strategy on the visual task correlated with both reading and sustained attention skills. Dissociations between these patterns of relationship across task modality suggest that not all timing tasks are equivalent.     

Decoding unattended fearful faces with whole-brain correlations: an approach to identify condition-dependent large-scale functional connectivity

Processing of unattended threat-related stimuli, such as fearful faces, has been previously examined using group functional magnetic resonance (fMRI) approaches. However, the identification of features of brain activity containing sufficient information to decode, or "brain-read", unattended (implicit) fear perception remains an active research goal. Here we test the hypothesis that patterns of large-scale functional connectivity (FC) decode the emotional expression of implicitly perceived faces within single individuals using training data from separate subjects. fMRI and a blocked design were used to acquire BOLD signals during implicit (task-unrelated) presentation of fearful and neutral faces. A pattern classifier (linear kernel Support Vector Machine, or SVM) with linear filter feature selection used pair-wise FC as features to predict the emotional expression of implicitly presented faces. We plotted classification accuracy vs. number of top N selected features and observed that significantly higher than chance accuracies (between 90-100%) were achieved with 15-40 features. During fearful face presentation, the most informative and positively modulated FC was between angular gyrus and hippocampus, while the greatest overall contributing region was the thalamus, with positively modulated connections to bilateral middle temporal gyrus and insula. Other FCs that predicted fear included superior-occipital and parietal regions, cerebellum and prefrontal cortex. By comparison, patterns of spatial activity (as opposed to interactivity) were relatively uninformative in decoding implicit fear. These findings indicate that whole-brain patterns of interactivity are a sensitive and informative signature of unattended fearful emotion processing. At the same time, we demonstrate and propose a sensitive and exploratory approach for the identification of large-scale, condition-dependent FC. In contrast to model-based, group approaches, the current approach does not discount the multivariate, joint responses of multiple functional connections and is not hampered by signal loss and the need for multiple comparisons correction.     

Anger and fearful expressions influence perceptions of physical strength: Testing the signalling functions of emotional facial expressions with a visual aftereffects paradigm

Facial expressions are important social communicators. In addition to communicating social information, the specific muscular movements of expressions may serve additional functional roles. For example, recalibration theory hypothesizes that the anger expression exaggerates facial cues of strength, an indicator of human fighting ability, to increase bargaining power in conflicts. Supporting this theory is evidence that faces displaying one element of an angry expression (e.g. lowered eyebrows) are perceived to be stronger than faces with opposite expression features (e.g. raised eyebrows for fear). The present study sought stronger evidence that more natural manipulations of facial anger also enhance perceived strength. We used expression aftereffects to bias perception of a neutral face towards anger and observed the effects on perceptions of strength. In addition, we tested the specificity of the strength-cue enhancing effect by examining whether two other expressions, fear and happy, also affected perceptions of strength. We found that, as predicted, a face biased to be perceived as angrier was rated as stronger compared to a baseline rating, whereas a face biased to be more fearful was rated as weaker, consistent with the purported function of fear as an act of submission. Interestingly, faces biased towards a happy expression were also perceived as stronger, though the effect was smaller than that for anger. Overall, the results supported the recalibration theory hypothesis that the anger expression enhances cues of strength to increase bargaining power in conflicts, but with some limitations regarding the specificity of the function to anger.     

Revision of Stenotaphrum (Gramineae: Paniceae) with attention to its historical geography

Seven species are recognized, of whichStenotaphrum helferi, native to forested streambanks in southeastern Asia, is considered the most primitive. Four species are restricted to tropical islands and coasts of the western Indian Ocean ; one of these, 5.dimidiatum, may have had its range within the region expanded by planting as a pasture grass during the early colonial period.Stenotaphrum micranthum is a naturally wide-ranging beach pioneer in both the tropical Pacific and Indian Oceans, particularly on small, remote islands. The last species,S. secundatum, includes fertile diploids and sterile polyploids. The common diploid race has been found since the early days of botanical exploration as a seashore pioneer on both sides of the Atlantic; in West Africa it is strictly tropical, but in the New World it ranges from the Carolinas and Bermuda to Argentina; early Pacific expeditions also found it in Hawaii and the Australian region ; this race has been taken inland as a lawn grass and spread locally as a weed. A triploid clone of this species, originally confined to the Cape of Good Hope region, has recently been planted and naturalized in Australia, various Pacific islands, and North America; another aberrant Southern Hemisphere race has become naturalized in the Mediterranean region.