Visual Cross-Modal Re-Organization in Children with Cochlear Implants

Background

Visual cross-modal re-organization is a neurophysiological process that occurs in deafness. The intact sensory modality of vision recruits cortical areas from the deprived sensory modality of audition. Such compensatory plasticity is documented in deaf adults and animals, and is related to deficits in speech perception performance in cochlear-implanted adults. However, it is unclear whether visual cross-modal re-organization takes place in cochlear-implanted children and whether it may be a source of variability contributing to speech and language outcomes. Thus, the aim of this study was to determine if visual cross-modal re-organization occurs in cochlear-implanted children, and whether it is related to deficits in speech perception performance.

Methods

Visual evoked potentials (VEPs) were recorded via high-density EEG in 41 normal hearing children and 14 cochlear-implanted children, aged 5–15 years, in response to apparent motion and form change. Comparisons of VEP amplitude and latency, as well as source localization results, were conducted between the groups in order to view evidence of visual cross-modal re-organization. Finally, speech perception in background noise performance was correlated to the visual response in the implanted children.

Results

Distinct VEP morphological patterns were observed in both the normal hearing and cochlear-implanted children. However, the cochlear-implanted children demonstrated larger VEP amplitudes and earlier latency, concurrent with activation of right temporal cortex including auditory regions, suggestive of visual cross-modal re-organization. The VEP N1 latency was negatively related to speech perception in background noise for children with cochlear implants.

Conclusion

Our results are among the first to describe cross modal re-organization of auditory cortex by the visual modality in deaf children fitted with cochlear implants. Our findings suggest that, as a group, children with cochlear implants show evidence of visual cross-modal recruitment, which may be a contributing source of variability in speech perception outcomes with their implant.     

Status of the development of cochlear prostheses relying on electric stimulation

Inner ear prostheses, or cochlear implants, are neuroprostheses providing profoundly deaf people with sound sensations through electrical stimulation of the auditory nerve. Approximately 2,000 of these devices are currently in use worldwide. Five models are each being used by more than 50 patients. Among other features they differ from one another mainly in the design and placement of electrodes and in the particular speech coding strategy used, periodicity and tonotopy priciple being made use of to a highly varying degree. Nevertheless, 4 of the 5 devices lead to quite comparable degrees of speech understanding without additional lipreading.     

Cochlear implants: the view from the brain

The cochlear implant arguably is the most successful neural prosthesis. Studies of the responses of the central auditory system to prosthetic electrical stimulation of the cochlea are revealing the success with which electrical stimulation of a deaf ear can mimic acoustic stimulation of a normal-hearing ear. Understanding of the physiology of central auditory structures can lead to improved restoration of hearing with cochlear implants. In turn, the cochlear implant can be exploited as an experimental tool for examining central hearing mechanisms isolated from the effects of cochlear mechanics and transduction.     

Design and Evaluation of a Cochlear Implant Strategy Based on a “Phantom” Channel

Unbalanced bipolar stimulation, delivered using charge balanced pulses, was used to produce “Phantom stimulation”, stimulation beyond the most apical contact of a cochlear implant’s electrode array. The Phantom channel was allocated audio frequencies below 300Hz in a speech coding strategy, conveying energy some two octaves lower than the clinical strategy and hence delivering the fundamental frequency of speech and of many musical tones. A group of 12 Advanced Bionics cochlear implant recipients took part in a chronic study investigating the fitting of the Phantom strategy and speech and music perception when using Phantom. The evaluation of speech in noise was performed immediately after fitting Phantom for the first time (Session 1) and after one month of take-home experience (Session 2). A repeated measures of analysis of variance (ANOVA) within factors strategy (Clinical, Phantom) and interaction time (Session 1, Session 2) revealed a significant effect for the interaction time and strategy. Phantom obtained a significant improvement in speech intelligibility after one month of use. Furthermore, a trend towards a better performance with Phantom (48%) with respect to F120 (37%) after 1 month of use failed to reach significance after type 1 error correction. Questionnaire results show a preference for Phantom when listening to music, likely driven by an improved balance between high and low frequencies.     

Perception of Binaural Cues Develops in Children Who Are Deaf through Bilateral Cochlear Implantation

There are significant challenges to restoring binaural hearing to children who have been deaf from an early age. The uncoordinated and poor temporal information available from cochlear implants distorts perception of interaural timing differences normally important for sound localization and listening in noise. Moreover, binaural development can be compromised by bilateral and unilateral auditory deprivation. Here, we studied perception of both interaural level and timing differences in 79 children/adolescents using bilateral cochlear implants and 16 peers with normal hearing. They were asked on which side of their head they heard unilaterally or bilaterally presented click- or electrical pulse- trains. Interaural level cues were identified by most participants including adolescents with long periods of unilateral cochlear implant use and little bilateral implant experience. Interaural timing cues were not detected by new bilateral adolescent users, consistent with previous evidence. Evidence of binaural timing detection was, for the first time, found in children who had much longer implant experience but it was marked by poorer than normal sensitivity and abnormally strong dependence on current level differences between implants. In addition, children with prior unilateral implant use showed a higher proportion of responses to their first implanted sides than children implanted simultaneously. These data indicate that there are functional repercussions of developing binaural hearing through bilateral cochlear implants, particularly when provided sequentially; nonetheless, children have an opportunity to use these devices to hear better in noise and gain spatial hearing.     

在电子耳蜗CIS方案中语音增强算法的实现

目的：电子耳蜗是一个帮助聋人恢复听觉的装置。它根据人耳的仿生学原理,用有限个电极刺激神经以恢复聋人听觉。目前实际应用的电子耳蜗技术已经能够在安静环境下帮助聋人恢复一定的听觉。本文在使用GIS方案的基础上,采取了频谱增强的方法,以提高电子耳蜗的在噪声环境下的性能。另外采用计算机仿真及声音合成的方法,以评估耳蜗植入者听到的声音。本实验获得了比较好的试听效果。其中提出的方法对耳子耳蜗的研究和工程现实具有一定的意义。     

Neural Adaptation and Behavioral Measures of Temporal Processing and Speech Perception in Cochlear Implant Recipients

The objective was to determine if one of the neural temporal features, neural adaptation, can account for the across-subject variability in behavioral measures of temporal processing and speech perception performance in cochlear implant (CI) recipients. Neural adaptation is the phenomenon in which neural responses are the strongest at the beginning of the stimulus and decline following stimulus repetition (e.g., stimulus trains). It is unclear how this temporal property of neural responses relates to psychophysical measures of temporal processing (e.g., gap detection) or speech perception. The adaptation of the electrical compound action potential (ECAP) was obtained using 1000 pulses per second (pps) biphasic pulse trains presented directly to the electrode. The adaptation of the late auditory evoked potential (LAEP) was obtained using a sequence of 1-kHz tone bursts presented acoustically, through the cochlear implant. Behavioral temporal processing was measured using the Random Gap Detection Test at the most comfortable listening level. Consonant nucleus consonant (CNC) word and AzBio sentences were also tested. The results showed that both ECAP and LAEP display adaptive patterns, with a substantial across-subject variability in the amount of adaptation. No correlations between the amount of neural adaptation and gap detection thresholds (GDTs) or speech perception scores were found. The correlations between the degree of neural adaptation and demographic factors showed that CI users having more LAEP adaptation were likely to be those implanted at a younger age than CI users with less LAEP adaptation. The results suggested that neural adaptation, at least this feature alone, cannot account for the across-subject variability in temporal processing ability in the CI users. However, the finding that the LAEP adaptive pattern was less prominent in the CI group compared to the normal hearing group may suggest the important role of normal adaptation pattern at the cortical level in speech perception.     

Speech Perception and Localisation with SCORE Bimodal: A Loudness Normalisation Strategy for Combined Cochlear Implant and Hearing Aid Stimulation

A significant fraction of newly implanted cochlear implant recipients use a hearing aid in their non-implanted ear. SCORE bimodal is a sound processing strategy developed for this configuration, aimed at normalising loudness perception and improving binaural loudness balance. Speech perception performance in quiet and noise and sound localisation ability of six bimodal listeners were measured with and without application of SCORE. Speech perception in quiet was measured either with only acoustic, only electric, or bimodal stimulation, at soft and normal conversational levels. For speech in quiet there was a significant improvement with application of SCORE. Speech perception in noise was measured for either steady-state noise, fluctuating noise, or a competing talker, at conversational levels with bimodal stimulation. For speech in noise there was no significant effect of application of SCORE. Modelling of interaural loudness differences in a long-term-average-speech-spectrum-weighted click train indicated that left-right discrimination of sound sources can improve with application of SCORE. As SCORE was found to leave speech perception unaffected or to improve it, it seems suitable for implementation in clinical devices.     

Cross-Modal and Intra-Modal Characteristics of Visual Function and Speech Perception Performance in Postlingually Deafened,Cochlear Implant Users

Evidence of visual-auditory cross-modal plasticity in deaf individuals has been widely reported. Superior visual abilities of deaf individuals have been shown to result in enhanced reactivity to visual events and/or enhanced peripheral spatial attention. The goal of this study was to investigate the association between visual-auditory cross-modal plasticity and speech perception in post-lingually deafened, adult cochlear implant (CI) users. Post-lingually deafened adults with CIs (N = 14) and a group of normal hearing, adult controls (N = 12) participated in this study. The CI participants were divided into a good performer group (good CI, N = 7) and a poor performer group (poor CI, N = 7) based on word recognition scores. Visual evoked potentials (VEP) were recorded from the temporal and occipital cortex to assess reactivity. Visual field (VF) testing was used to assess spatial attention and Goldmann perimetry measures were analyzed to identify differences across groups in the VF. The association of the amplitude of the P1 VEP response over the right temporal or occipital cortex among three groups (control, good CI, poor CI) was analyzed. In addition, the association between VF by different stimuli and word perception score was evaluated. The P1 VEP amplitude recorded from the right temporal cortex was larger in the group of poorly performing CI users than the group of good performers. The P1 amplitude recorded from electrodes near the occipital cortex was smaller for the poor performing group. P1 VEP amplitude in right temporal lobe was negatively correlated with speech perception outcomes for the CI participants (r = -0.736, P = 0.003). However, P1 VEP amplitude measures recorded from near the occipital cortex had a positive correlation with speech perception outcome in the CI participants (r = 0.775, P = 0.001). In VF analysis, CI users showed narrowed central VF (VF to low intensity stimuli). However, their far peripheral VF (VF to high intensity stimuli) was not different from the controls. In addition, the extent of their central VF was positively correlated with speech perception outcome (r = 0.669, P = 0.009). Persistent visual activation in right temporal cortex even after CI causes negative effect on outcome in post-lingual deaf adults. We interpret these results to suggest that insufficient intra-modal (visual) compensation by the occipital cortex may cause negative effects on outcome. Based on our results, it appears that a narrowed central VF could help identify CI users with poor outcomes with their device.     

Enhanced auditory neuron survival following cell-based BDNF treatment in the deaf guinea pig

Exogenous neurotrophin delivery to the deaf cochlea can prevent deafness-induced auditory neuron degeneration, however, we have previously reported that these survival effects are rapidly lost if the treatment stops. In addition, there are concerns that current experimental techniques are not safe enough to be used clinically. Therefore, for such treatments to be clinically transferable, methods of neurotrophin treatment that are safe, biocompatible and can support long-term auditory neuron survival are necessary. Cell transplantation and gene transfer, combined with encapsulation technologies, have the potential to address these issues. This study investigated the survival-promoting effects of encapsulated BDNF over-expressing Schwann cells on auditory neurons in the deaf guinea pig. In comparison to control (empty) capsules, there was significantly greater auditory neuron survival following the cell-based BDNF treatment. Concurrent use of a cochlear implant is expected to result in even greater auditory neuron survival, and provide a clinically relevant method to support auditory neuron survival that may lead to improved speech perception and language outcomes for cochlear implant patients.     

Encoding and decoding amplitude-modulated cochlear implant stimuli—a point process analysis

Cochlear implant speech processors stimulate the auditory nerve by delivering amplitude-modulated electrical pulse trains to intracochlear electrodes. Studying how auditory nerve cells encode modulation information is of fundamental importance, therefore, to understanding cochlear implant function and improving speech perception in cochlear implant users. In this paper, we analyze simulated responses of the auditory nerve to amplitude-modulated cochlear implant stimuli using a point process model. First, we quantify the information encoded in the spike trains by testing an ideal observer’s ability to detect amplitude modulation in a two-alternative forced-choice task. We vary the amount of information available to the observer to probe how spike timing and averaged firing rate encode modulation. Second, we construct a neural decoding method that predicts several qualitative trends observed in psychophysical tests of amplitude modulation detection in cochlear implant listeners. We find that modulation information is primarily available in the sequence of spike times. The performance of an ideal observer, however, is inconsistent with observed trends in psychophysical data. Using a neural decoding method that jitters spike times to degrade its temporal resolution and then computes a common measure of phase locking from spike trains of a heterogeneous population of model nerve cells, we predict the correct qualitative dependence of modulation detection thresholds on modulation frequency and stimulus level. The decoder does not predict the observed loss of modulation sensitivity at high carrier pulse rates, but this framework can be applied to future models that better represent auditory nerve responses to high carrier pulse rate stimuli. The supplemental material of this article contains the article’s data in an active, re-usable format.     

A new stimulation strategy for recording electrical auditory evoked potentials in cochlear implant patients

Recording electrical auditory brainstem responses (EABR) provides clinical insight about responses of the residual post-cochlear neural system to electrical stimulation in profoundly deaf patients. A new strategy is presented for stimulating patients already implanted with a 15-electrode cochlear implant. Since the device is fully re-programmable via a RS-232 PC interface, it was possible to load a specific stimulating strategy designed to improve the spatial locus and the temporal structure of the impulse stimulation. Waves III to V emerge more clearly when this method is applied.     

Envelope Enhancement Increases Cortical Sensitivity to Interaural Envelope Delays with Acoustic and Electric Hearing

Evidence from human psychophysical and animal electrophysiological studies suggests that sensitivity to interaural time delay (ITD) in the modulating envelope of a high-frequency carrier can be enhanced using half-wave rectified stimuli. Recent evidence has shown potential benefits of equivalent electrical stimuli to deaf individuals with bilateral cochlear implants (CIs). In the current study we assessed the effects of envelope shape on ITD sensitivity in the primary auditory cortex of normal-hearing ferrets, and profoundly-deaf animals with bilateral CIs. In normal-hearing animals, cortical sensitivity to ITDs (±1 ms in 0.1-ms steps) was assessed in response to dichotically-presented i) sinusoidal amplitude-modulated (SAM) and ii) half-wave rectified (HWR) tones (100-ms duration; 70 dB SPL) presented at the best-frequency of the unit over a range of modulation frequencies. In separate experiments, adult ferrets were deafened with neomycin administration and bilaterally-implanted with intra-cochlear electrode arrays. Electrically-evoked auditory brainstem responses (EABRs) were recorded in response to bipolar electrical stimulation of the apical pair of electrodes with singe biphasic current pulses (40 µs per phase) over a range of current levels to measure hearing thresholds. Subsequently, we recorded cortical sensitivity to ITDs (±800 µs in 80-µs steps) within the envelope of SAM and HWR biphasic-pulse trains (40 µs per phase; 6000 pulses per second, 100-ms duration) over a range of modulation frequencies. In normal-hearing animals, nearly a third of cortical neurons were sensitive to envelope-ITDs in response to SAM tones. In deaf animals with bilateral CI, the proportion of ITD-sensitive cortical neurons was approximately a fifth in response to SAM pulse trains. In normal-hearing and deaf animals with bilateral CI the proportion of ITD sensitive units and neural sensitivity to ITDs increased in response to HWR, compared with SAM stimuli. Consequently, novel stimulation strategies based on envelope enhancement may prove beneficial to individuals with bilateral cochlear implants.     

Positron Emission Tomography Imaging Reveals Auditory and Frontal Cortical Regions Involved with Speech Perception and Loudness Adaptation

Considerable progress has been made in the treatment of hearing loss with auditory implants. However, there are still many implanted patients that experience hearing deficiencies, such as limited speech understanding or vanishing perception with continuous stimulation (i.e., abnormal loudness adaptation). The present study aims to identify specific patterns of cerebral cortex activity involved with such deficiencies. We performed O-15-water positron emission tomography (PET) in patients implanted with electrodes within the cochlea, brainstem, or midbrain to investigate the pattern of cortical activation in response to speech or continuous multi-tone stimuli directly inputted into the implant processor that then delivered electrical patterns through those electrodes. Statistical parametric mapping was performed on a single subject basis. Better speech understanding was correlated with a larger extent of bilateral auditory cortex activation. In contrast to speech, the continuous multi-tone stimulus elicited mainly unilateral auditory cortical activity in which greater loudness adaptation corresponded to weaker activation and even deactivation. Interestingly, greater loudness adaptation was correlated with stronger activity within the ventral prefrontal cortex, which could be up-regulated to suppress the irrelevant or aberrant signals into the auditory cortex. The ability to detect these specific cortical patterns and differences across patients and stimuli demonstrates the potential for using PET to diagnose auditory function or dysfunction in implant patients, which in turn could guide the development of appropriate stimulation strategies for improving hearing rehabilitation. Beyond hearing restoration, our study also reveals a potential role of the frontal cortex in suppressing irrelevant or aberrant activity within the auditory cortex, and thus may be relevant for understanding and treating tinnitus.     

Long-term functional outcomes after 10 years of bilateral cochlear implantat use

The aims were to determine the benefit of bilateral cochlear implantation in a 20 years old patient implanted in Croatia on hearing and speech development. The male patient, after 10 years of deafness, got cochlear implants Med-EL Combi 40+ on both sides in one-stage surgery. The etiology of his deafness was posttraumatic meningitis. Auditory capacity and speech recognition tests were performed for both ears separately and together Average hearing level on the right ear with right cochlear implant switched on started at 62 dB 1 month after the cochlear implantation and was on 55 dB after 10 years. Average hearing level on the left ear with left cochlear implant switched on started at 55 dB 1 month after the cochlear implantation and was on 32 dB after 10 years. Average hearing level on the both ears with 2 cochlear implants switched on started at 35 dB 1 month after the cochlear implantation and was on 27 dB after 10 years. Long-term functional outcomes with bilateral cochlear implantation provides advantages over unilateral implantation including improved hearing level, speech perception in noise and improved sound localization.     

Binaural Fusion and Listening Effort in Children Who Use Bilateral Cochlear Implants: A Psychoacoustic and Pupillometric Study

Bilateral cochlear implants aim to provide hearing to both ears for children who are deaf and promote binaural/spatial hearing. Benefits are limited by mismatched devices and unilaterally-driven development which could compromise the normal integration of left and right ear input. We thus asked whether children hear a fused image (ie. 1 vs 2 sounds) from their bilateral implants and if this “binaural fusion” reduces listening effort. Binaural fusion was assessed by asking 25 deaf children with cochlear implants and 24 peers with normal hearing whether they heard one or two sounds when listening to bilaterally presented acoustic click-trains/electric pulses (250 Hz trains of 36 ms presented at 1 Hz). Reaction times and pupillary changes were recorded simultaneously to measure listening effort. Bilaterally implanted children heard one image of bilateral input less frequently than normal hearing peers, particularly when intensity levels on each side were balanced. Binaural fusion declined as brainstem asymmetries increased and age at implantation decreased. Children implanted later had access to acoustic input prior to implantation due to progressive deterioration of hearing. Increases in both pupil diameter and reaction time occurred as perception of binaural fusion decreased. Results indicate that, without binaural level cues, children have difficulty fusing input from their bilateral implants to perceive one sound which costs them increased listening effort. Brainstem asymmetries exacerbate this issue. By contrast, later implantation, reflecting longer access to bilateral acoustic hearing, may have supported development of auditory pathways underlying binaural fusion. Improved integration of bilateral cochlear implant signals for children is required to improve their binaural hearing.     

Computed tomography in the evaluation of cochlear structural features in cochlear implantation

Temporal bone computed tomographic scans were studied in 136 deaf patients of different age and sex, including 56 patients (39 children and 17 adults) rehabilitated with cochlear implantation (CI). The mean values of the cochlear parameters that are important for the results of a surgical CI stage, namely: the diameter of the cochlear base (DCB), the diameter of the basal helix, the height of the cochlea, the angle between the cochlear base and the promontorial wall, were calculated. These parameters were compared in different age groups. A correlation was determined for each of the studied parameters and for the depth of intracochlear insertion of electrodes. There was a significant correlation between DCB and the depth of insertion of the electrodes of CI22M and CI24M cochlear implants. DBC at which the active part of the electrode chain of an implant could be significantly more frequently placed in the tympanic scala of the cochlea was estimated.     

Optogenetic Stimulation of the Auditory Nerve

Direct electrical stimulation of spiral ganglion neurons (SGNs) by cochlear implants (CIs) enables open speech comprehension in the majority of implanted deaf subjects^1-6. Nonetheless, sound coding with current CIs has poor frequency and intensity resolution due to broad current spread from each electrode contact activating a large number of SGNs along the tonotopic axis of the cochlea^7-9. Optical stimulation is proposed as an alternative to electrical stimulation that promises spatially more confined activation of SGNs and, hence, higher frequency resolution of coding. In recent years, direct infrared illumination of the cochlea has been used to evoke responses in the auditory nerve¹⁰. Nevertheless it requires higher energies than electrical stimulation^10,11 and uncertainty remains as to the underlying mechanism¹². Here we describe a method based on optogenetics to stimulate SGNs with low intensity blue light, using transgenic mice with neuronal expression of channelrhodopsin 2 (ChR2)¹³ or virus-mediated expression of the ChR2-variant CatCh¹⁴. We used micro-light emitting diodes (µLEDs) and fiber-coupled lasers to stimulate ChR2-expressing SGNs through a small artificial opening (cochleostomy) or the round window. We assayed the responses by scalp recordings of light-evoked potentials (optogenetic auditory brainstem response: oABR) or by microelectrode recordings from the auditory pathway and compared them with acoustic and electrical stimulation.     

Neural Correlates of Speech Processing in Prelingually Deafened Children and Adolescents with Cochlear Implants

Prelingually deafened children with cochlear implants stand a good chance of developing satisfactory speech performance. Nevertheless, their eventual language performance is highly variable and not fully explainable by the duration of deafness and hearing experience. In this study, two groups of cochlear implant users (CI groups) with very good basic hearing abilities but non-overlapping speech performance (very good or very bad speech performance) were matched according to hearing age and age at implantation. We assessed whether these CI groups differed with regard to their phoneme discrimination ability and auditory sensory memory capacity, as suggested by earlier studies. These functions were measured behaviorally and with the Mismatch Negativity (MMN). Phoneme discrimination ability was comparable in the CI group of good performers and matched healthy controls, which were both better than the bad performers. Source analyses revealed larger MMN activity (155–225 ms) in good than in bad performers, which was generated in the frontal cortex and positively correlated with measures of working memory. For the bad performers, this was followed by an increased activation of left temporal regions from 225 to 250 ms with a focus on the auditory cortex. These results indicate that the two CI groups developed different auditory speech processing strategies and stress the role of phonological functions of auditory sensory memory and the prefrontal cortex in positively developing speech perception and production.     

Artificial implementation of auditory neurons: A comparison of biologically motivated models and a new transfer function oriented model

Auditory perception neurons, also called inner hair cells (IHCs) because of their physical shape, transform the mechanical movements of the basilar membrane into electrical impulses. The impulse coding of the IHC is the main information carrier in the auditory process and is the basis for improvements in cochlear implants as well as for low-rate, high-quality speech processing and compression. This paper compares biologically motivated models (Meddis, Cooke, Payton) with a newly developed model which is transfer function oriented. The new model has only three reservoirs and the parameters can be controlled through five small ROM tables. This model is compared with the often used Meddis model in terms of accuracy, system parameter flexibility, and hardware effort in an FPGA implementation. Received: 26 March 1997 / Accepted in revised version: 27 May 1997