Integration of consonant and pitch processing as revealed by the absence of additivity in mismatch negativity

Consonants, unlike vowels, are thought to be speech specific and therefore no interactions would be expected between consonants and pitch, a basic element for musical tones. The present study used an electrophysiological approach to investigate whether, contrary to this view, there is integrative processing of consonants and pitch by measuring additivity of changes in the mismatch negativity (MMN) of evoked potentials. The MMN is elicited by discriminable variations occurring in a sequence of repetitive, homogeneous sounds. In the experiment, event-related potentials (ERPs) were recorded while participants heard frequently sung consonant-vowel syllables and rare stimuli deviating in either consonant identity only, pitch only, or in both dimensions. Every type of deviation elicited a reliable MMN. As expected, the two single-deviant MMNs had similar amplitudes, but that of the double-deviant MMN was also not significantly different from them. This absence of additivity in the double-deviant MMN suggests that consonant and pitch variations are processed, at least at a pre-attentive level, in an integrated rather than independent way. Domain-specificity of consonants may depend on higher-level processes in the hierarchy of speech perception.     

Early specialization for voice and emotion processing in the infant brain

Human voices play a fundamental role in social communication, and areas of the adult "social brain" show specialization for processing voices and their emotional content (superior temporal sulcus, inferior prefrontal cortex, premotor cortical regions, amygdala, and insula). However, it is unclear when this specialization develops. Functional magnetic resonance (fMRI) studies suggest that the infant temporal cortex does not differentiate speech from music or backward speech, but a prior study with functional near-infrared spectroscopy revealed preferential activation for human voices in 7-month-olds, in a more posterior location of the temporal cortex than in adults. However, the brain networks involved in processing nonspeech human vocalizations in early development are still unknown. To address this issue, in the present fMRI study, 3- to 7-month-olds were presented with adult nonspeech vocalizations (emotionally neutral, emotionally positive, and emotionally negative) and nonvocal environmental sounds. Infants displayed significant differential activation in the anterior portion of the temporal cortex, similarly to adults. Moreover, sad vocalizations modulated the activity of brain regions involved in processing affective stimuli such as the orbitofrontal cortex and insula. These results suggest remarkably early functional specialization for processing human voice and negative emotions.     

Neural Processing of Emotional Facial and Semantic Expressions in Euthymic Bipolar Disorder (BD) and Its Association with Theory of Mind (ToM)

Background

Adults with bipolar disorder (BD) have cognitive impairments that affect face processing and social cognition. However, it remains unknown whether these deficits in euthymic BD have impaired brain markers of emotional processing.

Methodology/Principal Findings

We recruited twenty six participants, 13 controls subjects with an equal number of euthymic BD participants. We used an event-related potential (ERP) assessment of a dual valence task (DVT), in which faces (angry and happy), words (pleasant and unpleasant), and face-word simultaneous combinations are presented to test the effects of the stimulus type (face vs word) and valence (positive vs. negative). All participants received clinical, neuropsychological and social cognition evaluations. ERP analysis revealed that both groups showed N170 modulation of stimulus type effects (face > word). BD patients exhibited reduced and enhanced N170 to facial and semantic valence, respectively. The neural source estimation of N170 was a posterior section of the fusiform gyrus (FG), including the face fusiform area (FFA). Neural generators of N170 for faces (FG and FFA) were reduced in BD. In these patients, N170 modulation was associated with social cognition (theory of mind).

Conclusions/Significance

This is the first report of euthymic BD exhibiting abnormal N170 emotional discrimination associated with theory of mind impairments.     

Emotion-Related Visual Mismatch Responses in Schizophrenia: Impairments and Correlations with Emotion Recognition

Background and Objectives

Mismatch negativity (MMN) is an event-related potential (ERP) measure of preattentional sensory processing. While deficits in the auditory MMN are robust electrophysiological findings in schizophrenia, little is known about visual mismatch response and its association with social cognitive functions such as emotion recognition in schizophrenia. Our aim was to study the potential deficit in the visual mismatch response to unexpected facial emotions in schizophrenia and its association with emotion recognition impairments, and to localize the sources of the mismatch signals.

Experimental Design

The sample comprised 24 patients with schizophrenia and 24 healthy control subjects. Controls were matched individually to patients by gender, age, and education. ERPs were recorded using a high-density 128-channel BioSemi amplifier. Mismatch responses to happy and fearful faces were determined in 2 time windows over six regions of interest (ROIs). Emotion recognition performance and its association with the mismatch response were also investigated.

Principal Observations

Mismatch signals to both emotional conditions were significantly attenuated in patients compared to controls in central and temporal ROIs. Controls recognized emotions significantly better than patients. The association between overall emotion recognition performance and mismatch response to the happy condition was significant in the 250–360 ms time window in the central ROI. The estimated sources of the mismatch responses for both emotional conditions were localized in frontal regions, where patients showed significantly lower activity.

Conclusions

Impaired generation of mismatch signals indicate insufficient automatic processing of emotions in patients with schizophrenia, which correlates strongly with decreased emotion recognition.     

Emotional Voice Processing: Investigating the Role of Genetic Variation in the Serotonin Transporter across Development

The ability to effectively respond to emotional information carried in the human voice plays a pivotal role for social interactions. We examined how genetic factors, especially the serotonin transporter genetic variation (5-HTTLPR), affect the neurodynamics of emotional voice processing in infants and adults by measuring event-related brain potentials (ERPs). The results revealed that infants distinguish between emotions during an early perceptual processing stage, whereas adults recognize and evaluate the meaning of emotions during later semantic processing stages. While infants do discriminate between emotions, only in adults was genetic variation associated with neurophysiological differences in how positive and negative emotions are processed in the brain. This suggests that genetic association with neurocognitive functions emerges during development, emphasizing the role that variation in serotonin plays in the maturation of brain systems involved in emotion recognition.     

Emotional cues during simultaneous face and voice processing: electrophysiological insights

Both facial expression and tone of voice represent key signals of emotional communication but their brain processing correlates remain unclear. Accordingly, we constructed a novel implicit emotion recognition task consisting of simultaneously presented human faces and voices with neutral, happy, and angry valence, within the context of recognizing monkey faces and voices task. To investigate the temporal unfolding of the processing of affective information from human face-voice pairings, we recorded event-related potentials (ERPs) to these audiovisual test stimuli in 18 normal healthy subjects; N100, P200, N250, P300 components were observed at electrodes in the frontal-central region, while P100, N170, P270 were observed at electrodes in the parietal-occipital region. Results indicated a significant audiovisual stimulus effect on the amplitudes and latencies of components in frontal-central (P200, P300, and N250) but not the parietal occipital region (P100, N170 and P270). Specifically, P200 and P300 amplitudes were more positive for emotional relative to neutral audiovisual stimuli, irrespective of valence, whereas N250 amplitude was more negative for neutral relative to emotional stimuli. No differentiation was observed between angry and happy conditions. The results suggest that the general effect of emotion on audiovisual processing can emerge as early as 200 msec (P200 peak latency) post stimulus onset, in spite of implicit affective processing task demands, and that such effect is mainly distributed in the frontal-central region.     

It’s All in the Eyes: Subcortical and Cortical Activation during Grotesqueness Perception in Autism

Atypical face processing plays a key role in social interaction difficulties encountered by individuals with autism. In the current fMRI study, the Thatcher illusion was used to investigate several aspects of face processing in 20 young adults with high-functioning autism spectrum disorder (ASD) and 20 matched neurotypical controls. “Thatcherized” stimuli were modified at either the eyes or the mouth and participants discriminated between pairs of faces while cued to attend to either of these features in upright and inverted orientation. Behavioral data confirmed sensitivity to the illusion and intact configural processing in ASD. Directing attention towards the eyes vs. the mouth in upright faces in ASD led to (1) improved discrimination accuracy; (2) increased activation in areas involved in social and emotional processing; (3) increased activation in subcortical face-processing areas. Our findings show that when explicitly cued to attend to the eyes, activation of cortical areas involved in face processing, including its social and emotional aspects, can be enhanced in autism. This suggests that impairments in face processing in autism may be caused by a deficit in social attention, and that giving specific cues to attend to the eye-region when performing behavioral therapies aimed at improving social skills may result in a better outcome.     

Emotion Based Attentional Priority for Storage in Visual Short-Term Memory

A plethora of research demonstrates that the processing of emotional faces is prioritised over non-emotive stimuli when cognitive resources are limited (this is known as ‘emotional superiority’). However, there is debate as to whether competition for processing resources results in emotional superiority per se, or more specifically, threat superiority. Therefore, to investigate prioritisation of emotional stimuli for storage in visual short-term memory (VSTM), we devised an original VSTM report procedure using schematic (angry, happy, neutral) faces in which processing competition was manipulated. In Experiment 1, display exposure time was manipulated to create competition between stimuli. Participants (n = 20) had to recall a probed stimulus from a set size of four under high (150 ms array exposure duration) and low (400 ms array exposure duration) perceptual processing competition. For the high competition condition (i.e. 150 ms exposure), results revealed an emotional superiority effect per se. In Experiment 2 (n = 20), we increased competition by manipulating set size (three versus five stimuli), whilst maintaining a constrained array exposure duration of 150 ms. Here, for the five-stimulus set size (i.e. maximal competition) only threat superiority emerged. These findings demonstrate attentional prioritisation for storage in VSTM for emotional faces. We argue that task demands modulated the availability of processing resources and consequently the relative magnitude of the emotional/threat superiority effect, with only threatening stimuli prioritised for storage in VSTM under more demanding processing conditions. Our results are discussed in light of models and theories of visual selection, and not only combine the two strands of research (i.e. visual selection and emotion), but highlight a critical factor in the processing of emotional stimuli is availability of processing resources, which is further constrained by task demands.     

Effect of Aripiprazole on Mismatch Negativity (MMN) in Schizophrenia

Background

Cognitive deficits are considered core symptoms of the schizophrenia. Cognitive function has been found to be a better predictor of functional outcome than symptom levels. Changed mismatch negativity (MMN) reflects abnormalities of early auditory processing in schizophrenia. Up to now, no studies for the effects of aripiprazole on MMN in schizophrenia have been reported.

Methodology/Principal Findings

Subjects included 26 patients with schizophrenia, and 26 controls. Psychopathology was rated in patients with the Positive and Negative Syndrome Scale (PANSS) at baseline, after 4- and 8-week treatments with aripiprazole. Auditory stimuli for ERP consisted of 100 millisecond/1000 Hz standards, intermixed with 100 millisecond/1500 Hz frequency deviants and 250 millisecond/1000 Hz duration deviants. EEG was recorded at Fz. BESA 5.1.8 was used to perform data analysis. MMN waveforms were obtained by subtracting waveforms elicited by standards from waveforms elicited by frequency- or duration-deviant stimuli. Aripiprazole decreased all PANSS. Patients showed smaller mean amplitudes of frequency and duration MMN at baseline than did controls. A repeated measure ANOVA with sessions (i.e., baseline, 4- and 8-week treatments) and MMN type (frequency vs. duration) as within-subject factors revealed no significant MMN type or MMN type × session main effect for MMN amplitudes. Session main effect was significant. LSD tests demonstrated significant differences between MMN amplitudes at 8 weeks and those at both baseline and 4 weeks. There was significant negative correlation between changes in amplitudes of frequency and duration MMN and changes in PANSS total scores at baseline and follow-up periods.

Conclusions

Aripiprazole improved the amplitudes of MMN. MMN offers objective evidence that treatment with the aripiprazole may ameliorate preattentive deficits in schizophrenia.     

The mismatch negativity as an index of the perception of speech sounds by the human brain

The present article outlines the contribution of the mismatch negativity (MMN), and its magnetic equivalent MMNm, to our understanding of the perception of speech sounds in the human brain. MMN data indicate that each sound, both speech and non-speech, develops its neural representation corresponding to the percept of this sound in the neurophysiological substrate of auditory sensory memory. The accuracy of this representation, determining the accuracy of the discrimination between different sounds, can be probed with MMN separately for any auditory feature or stimulus type such as phonemes. Furthermore, MMN data show that the perception of phonemes, and probably also of larger linguistic units (syllables and words), is based on language-specific phonetic traces developed in the posterior part of the left-hemisphere auditory cortex. These traces serve as recognition models for the corresponding speech sounds in listening to speech.     

Speech Sound Processing Deficits and Training-Induced Neural Plasticity in Rats with Dyslexia Gene Knockdown

In utero RNAi of the dyslexia-associated gene Kiaa0319 in rats (KIA-) degrades cortical responses to speech sounds and increases trial-by-trial variability in onset latency. We tested the hypothesis that KIA- rats would be impaired at speech sound discrimination. KIA- rats needed twice as much training in quiet conditions to perform at control levels and remained impaired at several speech tasks. Focused training using truncated speech sounds was able to normalize speech discrimination in quiet and background noise conditions. Training also normalized trial-by-trial neural variability and temporal phase locking. Cortical activity from speech trained KIA- rats was sufficient to accurately discriminate between similar consonant sounds. These results provide the first direct evidence that assumed reduced expression of the dyslexia-associated gene KIAA0319 can cause phoneme processing impairments similar to those seen in dyslexia and that intensive behavioral therapy can eliminate these impairments.     

Auditory selective attention in middle-aged and elderly subjects: an event-related brain potential study

Reaction times (RTs) and event-related brain potentials (ERPs) were recorded in middle-aged (MA) and elderly (ELD) subjects performing an auditory selective attention task. Subjets attended to tone bursts of a specified pitch and ear of delivery and responded to occasional longer duration target tones (75 vs. 25 msec). Infrequent novel stimuli (computer synthesized sounds and digitized environmental noises) were also included in the stimulus sequence.No significant age-related differences were found in the speed or accuracy of target detection. However, in both groups, RTs were delayed (by more than 300 msec) to targets that followed novel sounds. The prolongation was greater following novel sounds in the attended ear, particularly in the ELD group.The effects of selective attention on ERPs to standard tones were isolated as negative difference waves (Nds) by subtracting ERPs to non-attended stimuli from ERPs to the same signals when attended. Nds had similar amplitudes, latencies of onset (60 msec), and distributions in ELD and MA groups. In both groups, Nd waves were more prominent following right ear stimulation, reflecting possible hemispheric asymmetries of generators in posterior temporal regions.The mismatch negativity (MMN) was isolated by subtracting ERPs to standard tones from ERPs to deviant stimuli. MMN amplitudes were reduced in the ELD group. There was also a significant change in MMN distribution with age: the MMN was larger over the right hemisphere for MA subjects but larger over the left for ELD subjects. Elderly subjects showed a trend toward smaller P3 amplitudes and delayed P3 latencies, but group differences did not reach statistical significance. ERPs to novel sounds were characterized by centrally distributed N2 and P3a components. Although the novel P3a was enhanced with attention, no novel Nd waves could be isolated. This suggests that novel sounds fell outside the focus of attention.     

Unaffected perceptual thresholds for biological and non-biological form-from-motion perception in autism spectrum conditions

Background

Perception of biological motion is linked to the action perception system in the human brain, abnormalities within which have been suggested to underlie impairments in social domains observed in autism spectrum conditions (ASC). However, the literature on biological motion perception in ASC is heterogeneous and it is unclear whether deficits are specific to biological motion, or might generalize to form-from-motion perception.

Methodology and Principal Findings

We compared psychophysical thresholds for both biological and non-biological form-from-motion perception in adults with ASC and controls. Participants viewed point-light displays depicting a walking person (Biological Motion), a translating rectangle (Structured Object) or a translating unfamiliar shape (Unstructured Object). The figures were embedded in noise dots that moved similarly and the task was to determine direction of movement. The number of noise dots varied on each trial and perceptual thresholds were estimated adaptively. We found no evidence for an impairment in biological or non-biological object motion perception in individuals with ASC. Perceptual thresholds in the three conditions were almost identical between the ASC and control groups.

Discussion and Conclusions

Impairments in biological motion and non-biological form-from-motion perception are not across the board in ASC, and are only found for some stimuli and tasks. We discuss our results in relation to other findings in the literature, the heterogeneity of which likely relates to the different tasks performed. It appears that individuals with ASC are unaffected in perceptual processing of form-from-motion, but may exhibit impairments in higher order judgments such as emotion processing. It is important to identify more specifically which processes of motion perception are impacted in ASC before a link can be made between perceptual deficits and the higher-level features of the disorder.     

Oscillatory Underpinnings of Mismatch Negativity and Their Relationship with Cognitive Function in Patients with Schizophrenia

Background

Impairments in mismatch negativity (MMN) generation have been consistently reported in patients with schizophrenia. However, underlying oscillatory activity of MMN deficits in schizophrenia and the relationship with cognitive impairments have not been investigated in detail. Time-frequency power and phase analyses can provide more detailed measures of brain dynamics of MMN deficits in schizophrenia.

Method

21 patients with schizophrenia and 21 healthy controls were tested with a roving frequency paradigm to generate MMN. Time-frequency domain power and phase-locking (PL) analysis was performed on all trials using short-time Fourier transforms with Hanning window tapering. A comprehensive battery (CANTAB) was used to assess neurocognitive functioning.

Results

Mean MMN amplitude was significantly lower in patients with schizophrenia (95% CI 0.18 - 0.77). Patients showed significantly lower EEG power (95% CI -1.02 - -0.014) in the ~4-7 Hz frequency range (theta band) between 170 and 210 ms. Patients with schizophrenia showed cognitive impairment in multiple domains of CANTAB. However, MMN impairments in amplitude and power were not correlated with clinical measures, medication dose, social functioning or neurocognitive performance.

Conclusion

The findings from this study suggested that while MMN may be a useful marker to probe NMDA receptor mediated mechanisms and associated impairments in gain control and perceptual changes, it may not be a useful marker in association with clinical or cognitive changes. Trial-by-trial EEG power analysis can be used as a measure of brain dynamics underlying MMN deficits which also can have implications for the use of MMN as a biomarker for drug discovery.     

Social and vocal behavior in adult greater tube-nosed bats (Murina leucogaster)

Many studies have revealed the significant influence of the social nature and ecological niche of a species on the design and complexity of their communication sounds. The knowledge of communication sounds and particularly of the flexibility in their use among mammals, however, remains patchy. Being highly vocal and social, bats are well suited for investigating vocal plasticity as well as vocal diversity. Thus, the overall aim of this study was to test the presence of structural overlap between calls used in social communication and echolocation pulses emitted during foraging in greater tube-nosed bats (Murina leucogaster). Acoustic analysis and spectrotemporal decomposition of calls revealed a rich communication repertoire comprising 12 simple syllables and 5 composites with harmonics in the ultrasonic range. Simultaneous recording of vocal and social behavior in the same species yielded a strong correspondence between distinct behaviors and specific call types in support of Morton's motivation-structure hypothesis. Spectrographic analysis of call types also revealed the presence of modified components of echolocation pulses embedded within social calls. Altogether, the data suggest that bats can parse complex sounds into structurally simpler components that are recombined within behaviorally meaningful and multifunctional contexts.     

Mismatch Negativity/P3a Complex in Young People with Psychiatric Disorders: A Cluster Analysis

Background

We have recently shown that the event-related potential biomarkers, mismatch negativity (MMN) and P3a, are similarly impaired in young patients with schizophrenia- and affective-spectrum psychoses as well as those with bipolar disorder. A data driven approach may help to further elucidate novel patterns of MMN/P3a amplitudes that characterise distinct subgroups in patients with emerging psychiatric disorders.

Methods

Eighty seven outpatients (16 to 30 years) were assessed: 19 diagnosed with a depressive disorder; 26 with a bipolar disorder; and 42 with a psychotic disorder. The MMN/P3a complex was elicited using a two-tone passive auditory oddball paradigm with duration deviant tones. Hierarchical cluster analysis utilising frontal, central and temporal neurophysiological variables was conducted.

Results

Three clusters were determined: the ‘globally impaired’ cluster (n = 53) displayed reduced frontal and temporal MMN as well as reduced central P3a amplitudes; the ‘largest frontal MMN’ cluster (n = 17) were distinguished by increased frontal MMN amplitudes and the ‘largest temporal MMN’ cluster (n = 17) was characterised by increases in temporal MMN only. Notably, 55% of those in the globally impaired cluster were diagnosed with schizophrenia-spectrum disorder, whereas the three patient subgroups were equally represented in the remaining two clusters. The three cluster-groups did not differ in their current symptomatology; however, the globally impaired cluster was the most neuropsychologically impaired, compared with controls.

Conclusions

These findings suggest that in emerging psychiatric disorders there are distinct MMN/P3a profiles of patient subgroups independent of current symptomatology. Schizophrenia-spectrum patients tended to show the most global impairments in this neurophysiological complex. Two other subgroups of patients were found to have neurophysiological profiles suggestive of quite different neurobiological (and hence, treatment) implications.     

A new method for estimating voice sounds transmitted to the chest wall in children and adolescents

A new method for estimating voice sound transmission to the chest wall is proposed. The spectral characteristics of voice-transmitted sounds have been estimated in children and adolescents. A total of 37 subjects aged 7–17 yers were examined. The frequency of the first spectral peak of the voice-transmitted sounds “tree, tree” (M ± SD) is 263.7 ± 7.82 and 253 ± 4.29 Hz at ages of 7–11 and 12–14 years, respectively. In male adolescents aged 15–17 years, this frequency is decreased to 100–150 Hz. The slope of the descending segment of the spectrum on the high-frequency side of the peak steadily increases on moving from the upper to the lower zones of the lungs, which may be related to the increase in the air content of the lung tissue. The difference between the amplitudes of the first and second spectral peaks of voice-transmitted sounds over symmetric regions of the chest on the right and left sides (Me(Q75-Q25)) is ?0.1(11.0) dB and does not depend on age or sex, which can be interpreted as an average statistical symmetry of sound transmission.     

Facial Trustworthiness Judgments in Children with ASD Are Modulated by Happy and Angry Emotional Cues

Appearance-based trustworthiness inferences may reflect the misinterpretation of emotional expression cues. Children and adults typically perceive faces that look happy to be relatively trustworthy and those that look angry to be relatively untrustworthy. Given reports of atypical expression perception in children with Autism Spectrum Disorder (ASD), the current study aimed to determine whether the modulation of trustworthiness judgments by emotional expression cues in children with ASD is also atypical. Cognitively-able children with and without ASD, aged 6–12 years, rated the trustworthiness of faces showing happy, angry and neutral expressions. Trust judgments in children with ASD were significantly modulated by overt happy and angry expressions, like those of typically-developing children. Furthermore, subtle emotion cues in neutral faces also influenced trust ratings of the children in both groups. These findings support a powerful influence of emotion cues on perceived trustworthiness, which even extends to children with social cognitive impairments.     

Self-Relevance Appraisal Influences Facial Reactions to Emotional Body Expressions

People display facial reactions when exposed to others'' emotional expressions, but exactly what mechanism mediates these facial reactions remains a debated issue. In this study, we manipulated two critical perceptual features that contribute to determining the significance of others'' emotional expressions: the direction of attention (toward or away from the observer) and the intensity of the emotional display. Electromyographic activity over the corrugator muscle was recorded while participants observed videos of neutral to angry body expressions. Self-directed bodies induced greater corrugator activity than other-directed bodies; additionally corrugator activity was only influenced by the intensity of anger expresssed by self-directed bodies. These data support the hypothesis that rapid facial reactions are the outcome of self-relevant emotional processing.     

白腹管鼻蝠成体交流声波多样性

小蝙蝠亚目即通常所说的蝙蝠,是哺乳动物中群居程度最高的类群之一,主要依靠声学信号在黑暗环境中进行交流并维持社群结构,很多蝙蝠种类的交流声波具有极高的多样性,但是目前关于特定种类蝙蝠交流声波的研究还比较缺乏。我们通过录制白腹管鼻蝠(Murina leucogaster)成体的声波,深入研究其交流声波声谱特征,根据交流声波在声谱图上的形状对声波类型进行初步划分,并利用主成分分析(PCA)和判别分析(DFAs)进行验证。结果表明,其交流声波在声谱结构上具有较高多样性,分为16种不同的音节类型,其中包括13种简单音节和3种组合音节,大多数音节都具有多谐波结构。简单音节可分为9种调频音节、2种准恒频音节和2种噪音,组合音节由简单音节无间隔地组合而成。第一谐波最大频率、第一谐波带宽、持续时间为与调频音节类型相关的主要参数。本研究结果为今后进一步开展研究蝙蝠发声行为的行为学意义和声波交流的神经生理学机制方面的研究奠定了基础。