Dissociated Roles of the Inferior Frontal Gyrus and Superior Temporal Sulcus in Audiovisual Processing: Top-Down and Bottom-Up Mismatch Detection

Visual inputs can distort auditory perception, and accurate auditory processing requires the ability to detect and ignore visual input that is simultaneous and incongruent with auditory information. However, the neural basis of this auditory selection from audiovisual information is unknown, whereas integration process of audiovisual inputs is intensively researched. Here, we tested the hypothesis that the inferior frontal gyrus (IFG) and superior temporal sulcus (STS) are involved in top-down and bottom-up processing, respectively, of target auditory information from audiovisual inputs. We recorded high gamma activity (HGA), which is associated with neuronal firing in local brain regions, using electrocorticography while patients with epilepsy judged the syllable spoken by a voice while looking at a voice-congruent or -incongruent lip movement from the speaker. The STS exhibited stronger HGA if the patient was presented with information of large audiovisual incongruence than of small incongruence, especially if the auditory information was correctly identified. On the other hand, the IFG exhibited stronger HGA in trials with small audiovisual incongruence when patients correctly perceived the auditory information than when patients incorrectly perceived the auditory information due to the mismatched visual information. These results indicate that the IFG and STS have dissociated roles in selective auditory processing, and suggest that the neural basis of selective auditory processing changes dynamically in accordance with the degree of incongruity between auditory and visual information.     

Functional organization of the human auditory cortex

We investigated the functional organization of the human auditory cortex using a novel electrophysiological recording technique combined with an advanced brain magnetic resonance imaging (MRI) technique. Tonotopic mapping data were obtained during single unit recording along the Heschl’s gyrus. Most of the units studied (73%) demonstrated sharply tuned excitatory responses. A tonotopic pattern was observed with the best frequencies systematically increasing as more medial-caudal recording sites were sampled. Additionally, a new auditory field along the posterior aspect of the superior temporal gyrus has been identified using a high spatial resolution direct recording technique. Results obtained during electrical stimulation demonstrate functional connectivity between the primary auditory cortex and the auditory field in the posterior superior temporal gyrus.     

Evoked potentials recorded from the auditory cortex in man: evaluation and topography of the middle latency components

The goal of this study is to determine and localize the generators of different components of middle latency auditory evoked potentials (MLAEPs) through intracerebral recording in auditory cortex in man (Heschl's gyrus and planum temporale).The present results show that the generators of components at 30, 50, 60 and 75 msec latency are distributed medio-laterally along Heschl's gyrus. The 30 msec component is generated in the dorso-postero-medial part of Heschl's gyrus (primary area) and the 50 msec component is generated laterally in the primary area. The generators of the later components (60–75 msec) are localized in the lateral part of Heschl's gyrus that forms the secondary areas.The localization of N100 generators is discussed.     

The Structural Correlates of Statistical Information Processing during Speech Perception

The processing of continuous and complex auditory signals such as speech relies on the ability to use statistical cues (e.g. transitional probabilities). In this study, participants heard short auditory sequences composed either of Italian syllables or bird songs and completed a regularity-rating task. Behaviorally, participants were better at differentiating between levels of regularity in the syllable sequences than in the bird song sequences. Inter-individual differences in sensitivity to regularity for speech stimuli were correlated with variations in surface-based cortical thickness (CT). These correlations were found in several cortical areas including regions previously associated with statistical structure processing (e.g. bilateral superior temporal sulcus, left precentral sulcus and inferior frontal gyrus), as well other regions (e.g. left insula, bilateral superior frontal gyrus/sulcus and supramarginal gyrus). In all regions, this correlation was positive suggesting that thicker cortex is related to higher sensitivity to variations in the statistical structure of auditory sequences. Overall, these results suggest that inter-individual differences in CT within a distributed network of cortical regions involved in statistical structure processing, attention and memory is predictive of the ability to detect structural structure in auditory speech sequences.     

The neuromagnetic dynamics of time perception

Examining real-time cortical dynamics is crucial for understanding time perception. Using magnetoencephalography we studied auditory duration discrimination of short (<.5 s) versus long tones (>.5 s) versus a pitch control. Time-frequency analysis of event-related fields showed widespread beta-band (13-30 Hz) desynchronization during all tone presentations. Synthetic aperture magnetometry indicated automatic primarily sensorimotor responses in short and pitch conditions, with activation specific to timing in bilateral inferior frontal gyrus. In the long condition, a right lateralized network was active, including lateral prefrontal cortices, inferior frontal gyrus, supramarginal gyrus and secondary auditory areas. Activation in this network peaked just after attention to tone duration was no longer necessary, suggesting a role in sustaining representation of the interval. These data expand our understanding of time perception by revealing its complex cortical spatiotemporal signature.     

Alterations of Regional Cerebral Blood Flow in Tinnitus Patients as Assessed Using Single-Photon Emission Computed Tomography

Tinnitus is the perception of phantom sound without an external auditory stimulus. Using neuroimaging techniques, such as positron emission tomography, electroencephalography, magnetoencephalography, and functional magnetic resonance imaging (fMRI), many studies have demonstrated that abnormal functions of the central nervous system are closely associated with tinnitus. In our previous research, we reported using resting-state fMRI that several brain regions, including the rectus gyrus, cingulate gyrus, thalamus, hippocampus, caudate, inferior temporal gyrus, cerebellar hemisphere, and medial superior frontal gyrus, were associated with tinnitus distress and loudness. To reconfirm these results and probe target regions for repetitive transcranial magnetic stimulation (rTMS), we investigated the regional cerebral blood flow (rCBF) between younger tinnitus patients (<60 years old) and the age-matched controls using single-photon emission computed tomography and easy Z-score imaging system. Compared with that of controls, the rCBF of tinnitus patients was significantly lower in the bilateral medial superior frontal gyri, left middle occipital gyrus and significantly higher in the bilateral cerebellar hemispheres and vermis, bilateral middle temporal gyri, right fusiform gyrus. No clear differences were observed between tinnitus patients with normal and impaired hearing. Regardless of the assessment modality, similar brain regions were identified as characteristic in tinnitus patients. These regions are potentially involved in the pathophysiology of chronic subjective tinnitus.     

Activation of Heschl's gyrus during auditory hallucinations

Apart from being a common feature of mental illness, auditory hallucinations provide an intriguing model for the study of internally generated sensory perceptions that are attributed to external sources. Until now, the knowledge about the cortical network that supports such hallucinations has been restricted by methodological limitations. Here, we describe an experiment with paranoid schizophrenic patients whose on- and offset of auditory hallucinations could be monitored within one functional magnetic resonance imaging (fMRI) session. We demonstrate an increase of the blood oxygen level-dependent (BOLD) signal in Heschl's gyrus during the patients' hallucinations. Our results provide direct evidence of the involvement of primary auditory areas in auditory verbal hallucinations and establish novel constraints for psychopathological models.     

Cortical dynamics of acoustic and phonological processing in speech perception

In speech perception, a functional hierarchy has been proposed by recent functional neuroimaging studies: core auditory areas on the dorsal plane of superior temporal gyrus (STG) are sensitive to basic acoustic characteristics, whereas downstream regions, specifically the left superior temporal sulcus (STS) and middle temporal gyrus (MTG) ventral to Heschl's gyrus (HG) are responsive to abstract phonological features. What is unclear so far is the relationship between the dorsal and ventral processes, especially with regard to whether low-level acoustic processing is modulated by high-level phonological processing. To address the issue, we assessed sensitivity of core auditory and downstream regions to acoustic and phonological variations by using within- and across-category lexical tonal continua with equal physical intervals. We found that relative to within-category variation, across-category variation elicited stronger activation in the left middle MTG (mMTG), apparently reflecting the abstract phonological representations. At the same time, activation in the core auditory region decreased, resulting from the top-down influences of phonological processing. These results support a hierarchical organization of the ventral acoustic-phonological processing stream, which originates in the right HG/STG and projects to the left mMTG. Furthermore, our study provides direct evidence that low-level acoustic analysis is modulated by high-level phonological representations, revealing the cortical dynamics of acoustic and phonological processing in speech perception. Our findings confirm the existence of reciprocal progression projections in the auditory pathways and the roles of both feed-forward and feedback mechanisms in speech perception.     

Neural Effects of Auditory Distraction on Visual Attention in Schizophrenia

Sensory flooding, particularly during auditory stimulation, is a common problem for patients with schizophrenia. The functional consequences of this impairment during cross-modal attention tasks, however, are unclear. The purpose of this study was to examine how auditory distraction differentially affects task-associated response during visual attention in patients and healthy controls. To that end, 21 outpatients with schizophrenia and 23 healthy comparison subjects performed a visual attention task in the presence or absence of distracting, environmentally relevant “urban” noise while undergoing functional magnetic resonance imaging at 3T. The task had two conditions (difficult and easy); task-related neural activity was defined as difficult – easy. During task performance, a significant distraction (noise or silence) by group (patient or control) interaction was observed in the left dorsolateral prefrontal cortex, right hippocampus, left temporoparietal junction, and right fusiform gyrus, with patients showing relative hypoactivation during noise compared to controls. In patients, the ability to recruit the dorsolateral prefrontal cortex during the task in noise was negatively correlated with the effect of noise on reaction time. Clinically, the ability to recruit the fusiform gyrus during the task in noise was negatively correlated with SANS affective flattening score, and hippocampal recruitment during the task in noise was positively correlated with global functioning. In conclusion, schizophrenia may be associated with abnormalities in neural response during visual attention tasks in the presence of cross-modal noise distraction. These response differences may predict global functioning in the illness, and may serve as a biomarker for therapeutic development.     

High binaural coherence determines successful sound localization and increased activity in posterior auditory areas

Our brain continuously receives complex combinations of sounds originating from different sources and relating to different events in the external world. Timing differences between the two ears can be used to localize sounds in space, but only when the inputs to the two ears have similar spectrotemporal profiles (high binaural coherence). We used fMRI to investigate any modulation of auditory responses by binaural coherence. We assessed how processing of these cues depends on whether spatial information is task relevant and whether brain activity correlates with subjects' localization performance. We found that activity in Heschl's gyrus increased with increasing coherence, irrespective of whether localization was task relevant. Posterior auditory regions also showed increased activity for high coherence, primarily when sound localization was required and subjects successfully localized sounds. We conclude that binaural coherence cues are processed throughout the auditory cortex and that these cues are used in posterior regions for successful auditory localization.     

The role of superior temporal cortex in auditory timing

Recently, there has been upsurge of interest in the neural mechanisms of time perception. A central question is whether the representation of time is distributed over brain regions as a function of stimulus modality, task and length of the duration used or whether it is centralized in a single specific and supramodal network. The answers seem to be converging on the former, and many areas not primarily considered as temporal processing areas remain to be investigated in the temporal domain. Here we asked whether the superior temporal gyrus, an auditory modality specific area, is involved in processing of auditory timing. Repetitive transcranial magnetic stimulation was applied over left and right superior temporal gyri while participants performed either a temporal or a frequency discrimination task of single tones. A significant decrease in performance accuracy was observed after stimulation of the right superior temporal gyrus, in addition to an increase in response uncertainty as measured by the Just Noticeable Difference. The results are specific to auditory temporal processing and performance on the frequency task was not affected. Our results further support the idea of distributed temporal processing and speak in favor of the existence of modality specific temporal regions in the human brain.     

The processing of temporal pitch and melody information in auditory cortex

An fMRI experiment was performed to identify the main stages of melody processing in the auditory pathway. Spectrally matched sounds that produce no pitch, fixed pitch, or melody were all found to activate Heschl's gyrus (HG) and planum temporale (PT). Within this region, sounds with pitch produced more activation than those without pitch only in the lateral half of HG. When the pitch was varied to produce a melody, there was activation in regions beyond HG and PT, specifically in the superior temporal gyrus (STG) and planum polare (PP). The results support the view that there is hierarchy of pitch processing in which the center of activity moves anterolaterally away from primary auditory cortex as the processing of melodic sounds proceeds.     

Integration of auditory and visual information about objects in superior temporal sulcus

Two categories of objects in the environment-animals and man-made manipulable objects (tools)-are easily recognized by either their auditory or visual features. Although these features differ across modalities, the brain integrates them into a coherent percept. In three separate fMRI experiments, posterior superior temporal sulcus and middle temporal gyrus (pSTS/MTG) fulfilled objective criteria for an integration site. pSTS/MTG showed signal increases in response to either auditory or visual stimuli and responded more to auditory or visual objects than to meaningless (but complex) control stimuli. pSTS/MTG showed an enhanced response when auditory and visual object features were presented together, relative to presentation in a single modality. Finally, pSTS/MTG responded more to object identification than to other components of the behavioral task. We suggest that pSTS/MTG is specialized for integrating different types of information both within modalities (e.g., visual form, visual motion) and across modalities (auditory and visual).     

Human dorsal and ventral auditory streams subserve rehearsal-based and echoic processes during verbal working memory

To hear a sequence of words and repeat them requires sensory-motor processing and something more-temporary storage. We investigated neural mechanisms of verbal memory by using fMRI and a task designed to tease apart perceptually based ("echoic") memory from phonological-articulatory memory. Sets of two- or three-word pairs were presented bimodally, followed by a cue indicating from which modality (auditory or visual) items were to be retrieved and rehearsed over a delay. Although delay-period activation in the planum temporale (PT) was insensible to the source modality and showed sustained delay-period activity, the superior temporal gyrus (STG) activated more vigorously when the retrieved items had arrived to the auditory modality and showed transient delay-period activity. Functional connectivity analysis revealed two topographically distinct fronto-temporal circuits, with STG co-activating more strongly with ventrolateral prefrontal cortex and PT co-activating more strongly with dorsolateral prefrontal cortex. These argue for separate contributions of ventral and dorsal auditory streams in verbal working memory.     

Sparse Spectro-Temporal Receptive Fields Based on Multi-Unit and High-Gamma Responses in Human Auditory Cortex

Spectro-Temporal Receptive Fields (STRFs) were estimated from both multi-unit sorted clusters and high-gamma power responses in human auditory cortex. Intracranial electrophysiological recordings were used to measure responses to a random chord sequence of Gammatone stimuli. Traditional methods for estimating STRFs from single-unit recordings, such as spike-triggered-averages, tend to be noisy and are less robust to other response signals such as local field potentials. We present an extension to recently advanced methods for estimating STRFs from generalized linear models (GLM). A new variant of regression using regularization that penalizes non-zero coefficients is described, which results in a sparse solution. The frequency-time structure of the STRF tends toward grouping in different areas of frequency-time and we demonstrate that group sparsity-inducing penalties applied to GLM estimates of STRFs reduces the background noise while preserving the complex internal structure. The contribution of local spiking activity to the high-gamma power signal was factored out of the STRF using the GLM method, and this contribution was significant in 85 percent of the cases. Although the GLM methods have been used to estimate STRFs in animals, this study examines the detailed structure directly from auditory cortex in the awake human brain. We used this approach to identify an abrupt change in the best frequency of estimated STRFs along posteromedial-to-anterolateral recording locations along the long axis of Heschl’s gyrus. This change correlates well with a proposed transition from core to non-core auditory fields previously identified using the temporal response properties of Heschl’s gyrus recordings elicited by click-train stimuli.     

Cortical motion deafness

The extent to which the auditory system, like the visual system, processes spatial stimulus characteristics such as location and motion in separate specialized neuronal modules or in one homogeneously distributed network is unresolved. Here we present a patient with a selective deficit for the perception and discrimination of auditory motion following resection of the right anterior temporal lobe and the right posterior superior temporal gyrus (STG). Analysis of stimulus identity and location within the auditory scene remained intact. In addition, intracranial auditory evoked potentials, recorded preoperatively, revealed motion-specific responses selectively over the resected right posterior STG, and electrical cortical stimulation of this region was experienced by the patient as incoming moving sounds. Collectively, these data present a patient with cortical motion deafness, providing evidence that cortical processing of auditory motion is performed in a specialized module within the posterior STG.     

Dissociation of temporal and frontal components in the human auditory N1 wave: a scalp current density and dipole model analysis

This study reports a combined scalp current density (SCD) and dipole model analysis of the N1 wave of the auditory event-related potentials evoked by 1 kHz tone bursts delivered every second. The SCD distributions revealed: (i) a sink and a source of current reversing in polarity at the inferotemporal level of each hemiscalp, compatible with neural generators in and around the supratemporal plane of the auditory cortex, as previously reported; and (ii) bilateral current sinks over frontal areas. Consistently, dynamic dipole model analysis showed that generators in and outside the auditory cortex are necessary to account for the observed current fields between 65 and 140 msec post stimulus. The frontal currents could originate from the motor cortex, the supplementary motor area and/or the cingulate gyrus. The dissociation of an exogenous, obligatory frontal component from the sensory-specific response in the auditory N1 suggests that parallel processes served by distinct neural systems are activated during acoustic stimulation. Implications for recent models of auditory processing are discussed.     

Default Mode,Dorsal Attention and Auditory Resting State Networks Exhibit Differential Functional Connectivity in Tinnitus and Hearing Loss

We investigated auditory, dorsal attention, and default mode networks in adults with tinnitus and hearing loss in a resting state functional connectivity study. Data were obtained using continuous functional magnetic resonance imaging (fMRI) while the participants were at “rest” and were not performing any task. Participants belonged to one of three groups: middle-aged adults with tinnitus and mild-to-moderate high frequency hearing loss (TIN), age-matched controls with normal hearing and no tinnitus (NH), and a second control group with mild-to-moderate high frequency hearing loss without tinnitus (HL). After standard preprocessing, (a) a group independent component analysis (ICA) using 30 components and (b) a seeding-based connectivity analysis were conducted. In the group ICA, the default mode network was the only network to display visual differences between subject groups. In the seeding analysis, we found increased connectivity between the left parahippocampus and the auditory resting state network in the TIN group when compared to NH controls. Similarly, there was also an increased correlation between the right parahippocampus and the dorsal attention network when compared to HL controls. Other group differences in this attention network included decreased correlations between the seed regions and the right supramarginal gyrus in TIN patients when compared to HL controls. In the default mode network, there was a strong decrease in correlation between the seed regions and the precuneus when compared to both control groups. The findings of this study identify specific alterations in the connectivity of the default mode, dorsal attention, and auditory resting state networks due to tinnitus. The results suggest that therapies for tinnitus that mitigate the increased connectivity of limbic regions with auditory and attention resting state networks and the decreased coherence of the default mode network could be effective at reducing tinnitus-related distress.     

Auditory resting-state network connectivity in tinnitus: a functional MRI study

The underlying functional neuroanatomy of tinnitus remains poorly understood. Few studies have focused on functional cerebral connectivity changes in tinnitus patients. The aim of this study was to test if functional MRI "resting-state" connectivity patterns in auditory network differ between tinnitus patients and normal controls. Thirteen chronic tinnitus subjects and fifteen age-matched healthy controls were studied on a 3 tesla MRI. Connectivity was investigated using independent component analysis and an automated component selection approach taking into account the spatial and temporal properties of each component. Connectivity in extra-auditory regions such as brainstem, basal ganglia/NAc, cerebellum, parahippocampal, right prefrontal, parietal, and sensorimotor areas was found to be increased in tinnitus subjects. The right primary auditory cortex, left prefrontal, left fusiform gyrus, and bilateral occipital regions showed a decreased connectivity in tinnitus. These results show that there is a modification of cortical and subcortical functional connectivity in tinnitus encompassing attentional, mnemonic, and emotional networks. Our data corroborate the hypothesized implication of non-auditory regions in tinnitus physiopathology and suggest that various regions of the brain seem involved in the persistent awareness of the phenomenon as well as in the development of the associated distress leading to disabling chronic tinnitus.     

A cortical network processes auditory error signals during human speech production to maintain fluency

Hearing one’s own voice is critical for fluent speech production as it allows for the detection and correction of vocalization errors in real time. This behavior known as the auditory feedback control of speech is impaired in various neurological disorders ranging from stuttering to aphasia; however, the underlying neural mechanisms are still poorly understood. Computational models of speech motor control suggest that, during speech production, the brain uses an efference copy of the motor command to generate an internal estimate of the speech output. When actual feedback differs from this internal estimate, an error signal is generated to correct the internal estimate and update necessary motor commands to produce intended speech. We were able to localize the auditory error signal using electrocorticographic recordings from neurosurgical participants during a delayed auditory feedback (DAF) paradigm. In this task, participants hear their voice with a time delay as they produced words and sentences (similar to an echo on a conference call), which is well known to disrupt fluency by causing slow and stutter-like speech in humans. We observed a significant response enhancement in auditory cortex that scaled with the duration of feedback delay, indicating an auditory speech error signal. Immediately following auditory cortex, dorsal precentral gyrus (dPreCG), a region that has not been implicated in auditory feedback processing before, exhibited a markedly similar response enhancement, suggesting a tight coupling between the 2 regions. Critically, response enhancement in dPreCG occurred only during articulation of long utterances due to a continuous mismatch between produced speech and reafferent feedback. These results suggest that dPreCG plays an essential role in processing auditory error signals during speech production to maintain fluency.

Hearing one’s own voice is critical for fluent speech production, allowing detection and correction of vocalization errors in real-time. This study shows that the dorsal precentral gyrus is a critical component of a cortical network that monitors auditory feedback to produce fluent speech; this region is engaged specifically when speech production is effortful during articulation of long utterances.