Sensory experience and the formation of a computational map of auditory space in the brain.

The basic wiring of the brain is first established before birth by using a variety of molecular guidance cues. These connections are then refined by patterns of neural activity, which are initially generated spontaneously and subsequently driven by sensory experience. In the superior colliculus, a midbrain nucleus involved in the control of orienting behaviour, visual, auditory, and tactile inputs converge to form superimposed maps of sensory space. Maps of visual space and of the body surface arise from spatially ordered projections from the retina and skin, respectively. In contrast, the map of auditory space is computed within the brain by tuning the neurons to different localization cues that result from the acoustical properties of the head and ears. Establishing and maintaining the registration of the maps in the face of individual differences in the size and relative positions of different sense organs is an activity-dependent process in which the synaptic circuits underlying the auditory representation are modified and calibrated under the influence of both auditory and visual experience. BioEssays 1999;21:900-911.     

大鼠初级听皮层神经元对声音空间信息的编码

尽管大脑听皮层神经元对声音空间信息的编码已有不少的研究报道,但其编码机制并不十分清楚,相关研究在大鼠的初级听皮层也未见详细的研究报道．用神经电生理学方法在大鼠初级听皮层考察了151个听神经元的听空间反应域,分析了神经元对来自不同空间方位声刺激反应的放电数和平均首次发放潜伏期的关系．结果表明,多数(52.32%)神经元对来自对侧听空间的声刺激反应较强,表现为对侧偏好型特征,其他神经元分别归类为同侧偏好型(18.54%)、中间偏好型(18.54%)、全向型(3.31%)和复杂型(7.28%)．多数神经元偏好的听空间区域的几何中心位于记录部位对侧听空间的中部和上部．绝大多数初级听皮层神经元对来自偏好听空间的声刺激反应的放电数较多、反应潜伏期较短,对来自非偏好听空间的声刺激反应的放电数较少、反应潜伏期较长,放电数与平均首次发放潜伏期呈显著负相关．在对声音空间信息的编码中,大脑初级听皮层可能综合放电数和潜伏期的信息以实现对声源方位的编码．     

Sparse codes for speech predict spectrotemporal receptive fields in the inferior colliculus

We have developed a sparse mathematical representation of speech that minimizes the number of active model neurons needed to represent typical speech sounds. The model learns several well-known acoustic features of speech such as harmonic stacks, formants, onsets and terminations, but we also find more exotic structures in the spectrogram representation of sound such as localized checkerboard patterns and frequency-modulated excitatory subregions flanked by suppressive sidebands. Moreover, several of these novel features resemble neuronal receptive fields reported in the Inferior Colliculus (IC), as well as auditory thalamus and cortex, and our model neurons exhibit the same tradeoff in spectrotemporal resolution as has been observed in IC. To our knowledge, this is the first demonstration that receptive fields of neurons in the ascending mammalian auditory pathway beyond the auditory nerve can be predicted based on coding principles and the statistical properties of recorded sounds.     

Eye position affects activity in primary auditory cortex of primates

BACKGROUND: Neurons in primary auditory cortex are known to be sensitive to the locations of sounds in space, but the reference frame for this spatial sensitivity has not been investigated. Conventional wisdom holds that the auditory and visual pathways employ different reference frames, with the auditory pathway using a head-centered reference frame and the visual pathway using an eye-centered reference frame. Reconciling these discrepant reference frames is therefore a critical component of multisensory integration. RESULTS: We tested the reference frame of neurons in the auditory cortex of primates trained to fixate visual stimuli at different orbital positions. We found that eye position altered the activity of about one third of the neurons in this region (35 of 113, or 31%). Eye position affected not only the responses to sounds (26 of 113, or 23%), but also the spontaneous activity (14 of 113, or 12%). Such effects were also evident when monkeys moved their eyes freely in the dark. Eye position and sound location interacted to produce a representation for auditory space that was neither head- nor eye-centered in reference frame. CONCLUSIONS: Taken together with emerging results in both visual and other auditory areas, these findings suggest that neurons whose responses reflect complex interactions between stimulus position and eye position set the stage for the eventual convergence of auditory and visual information.     

Auditory cortex mapmaking: principles, projections, and plasticity

Maps of sensory receptor epithelia and computed features of the sensory environment are common elements of auditory, visual, and somatic sensory representations from the periphery to the cerebral cortex. Maps enhance the understanding of normal neural organization and its modification by pathology and experience. They underlie the derivation of the computational principles that govern sensory processing and the generation of perception. Despite their intuitive explanatory power, the functions of and rules for organizing maps and their plasticity are not well understood. Some puzzles of auditory cortical map organization are that few complete receptor maps are available and that even fewer computational maps are known beyond primary cortical areas. Neuroanatomical evidence suggests equally organized connectional patterns throughout the cortical hierarchy that might underlie map stability. Here, we consider the implications of auditory cortical map organization and its plasticity and evaluate the complementary role of maps in representation and computation from an auditory perspective.     

Spatiotopic transfer of visual-form adaptation across saccadic eye movements

Although conscious perception is smooth and continuous, the input to the visual system is a series of short, discrete fixations interleaved with rapid shifts of the eye. One possible explanation for visual stability is that internal maps of objects and their visual properties are remapped around the time of saccades, but numerous studies have demonstrated that visual patterns are not combined across saccades. Here, we report that visual-form aftereffects transfer across separate fixations when adaptor and test are presented in the same spatial position. The magnitude of the transsaccadic adaptation increased with stimulus complexity, suggesting a progressive construction of spatiotopic receptive fields along the visual-form pathway. These results demonstrate that basic shape information is combined across saccades, allowing for predictive and consistent information from the past to be incorporated into each new fixation.     

Distribution of auditory motion-direction sensitive neurons in the barn owl's midbrain

Barn owls have neurons sensitive to acoustic motion-direction in the midbrain. We report here that acoustic motion-direction sensitive neurons with receptive-field centres in frontal auditory space are not randomly distributed. In the inferior colliculus and optic tectum in the left (right) brain, the responses of about two-thirds of the motion-direction sensitive neurons were sensitive to clockwise (counter-clockwise) motion. The midbrain contains maps of auditory space that represent about 15 degrees of ipsilateral and all of contralateral space. Since a similar bias in motion-direction sensitivity was observed for neurons with receptive-field centres in ipsilateral as well as for neurons with receptive fields centres in contralateral auditory space, the brain side at which a motion-direction sensitive neuron was recorded was a more important predictor for the preferred direction of a cell than the spatial direction of the centre of the receptive field. Within one dorso-ventral electrode pass motion-direction sensitivity typically stayed constant suggesting a clustered or even a columnar-like organization. We hypothesize from these distributions that the right brain is important for orientating movements to the left hemisphere and vice versa.     

Nonlinear visuoauditory integration in the mouse superior colliculus

Sensory information from different modalities is processed in parallel, and then integrated in associative brain areas to improve object identification and the interpretation of sensory experiences. The Superior Colliculus (SC) is a midbrain structure that plays a critical role in integrating visual, auditory, and somatosensory input to assess saliency and promote action. Although the response properties of the individual SC neurons to visuoauditory stimuli have been characterized, little is known about the spatial and temporal dynamics of the integration at the population level. Here we recorded the response properties of SC neurons to spatially restricted visual and auditory stimuli using large-scale electrophysiology. We then created a general, population-level model that explains the spatial, temporal, and intensity requirements of stimuli needed for sensory integration. We found that the mouse SC contains topographically organized visual and auditory neurons that exhibit nonlinear multisensory integration. We show that nonlinear integration depends on properties of auditory but not visual stimuli. We also find that a heuristically derived nonlinear modulation function reveals conditions required for sensory integration that are consistent with previously proposed models of sensory integration such as spatial matching and the principle of inverse effectiveness.     

Perisaccadic Remapping and Rescaling of Visual Responses in Macaque Superior Colliculus

Visual neurons have spatial receptive fields that encode the positions of objects relative to the fovea. Because foveate animals execute frequent saccadic eye movements, this position information is constantly changing, even though the visual world is generally stationary. Interestingly, visual receptive fields in many brain regions have been found to exhibit changes in strength, size, or position around the time of each saccade, and these changes have often been suggested to be involved in the maintenance of perceptual stability. Crucial to the circuitry underlying perisaccadic changes in visual receptive fields is the superior colliculus (SC), a brainstem structure responsible for integrating visual and oculomotor signals. In this work we have studied the time-course of receptive field changes in the SC. We find that the distribution of the latencies of SC responses to stimuli placed outside the fixation receptive field is bimodal: The first mode is comprised of early responses that are temporally locked to the onset of the visual probe stimulus and stronger for probes placed closer to the classical receptive field. We suggest that such responses are therefore consistent with a perisaccadic rescaling, or enhancement, of weak visual responses within a fixed spatial receptive field. The second mode is more similar to the remapping that has been reported in the cortex, as responses are time-locked to saccade onset and stronger for stimuli placed in the postsaccadic receptive field location. We suggest that these two temporal phases of spatial updating may represent different sources of input to the SC.     

A neural network model of ventriloquism effect and aftereffect

Presenting simultaneous but spatially discrepant visual and auditory stimuli induces a perceptual translocation of the sound towards the visual input, the ventriloquism effect. General explanation is that vision tends to dominate over audition because of its higher spatial reliability. The underlying neural mechanisms remain unclear. We address this question via a biologically inspired neural network. The model contains two layers of unimodal visual and auditory neurons, with visual neurons having higher spatial resolution than auditory ones. Neurons within each layer communicate via lateral intra-layer synapses; neurons across layers are connected via inter-layer connections. The network accounts for the ventriloquism effect, ascribing it to a positive feedback between the visual and auditory neurons, triggered by residual auditory activity at the position of the visual stimulus. Main results are: i) the less localized stimulus is strongly biased toward the most localized stimulus and not vice versa; ii) amount of the ventriloquism effect changes with visual-auditory spatial disparity; iii) ventriloquism is a robust behavior of the network with respect to parameter value changes. Moreover, the model implements Hebbian rules for potentiation and depression of lateral synapses, to explain ventriloquism aftereffect (that is, the enduring sound shift after exposure to spatially disparate audio-visual stimuli). By adaptively changing the weights of lateral synapses during cross-modal stimulation, the model produces post-adaptive shifts of auditory localization that agree with in-vivo observations. The model demonstrates that two unimodal layers reciprocally interconnected may explain ventriloquism effect and aftereffect, even without the presence of any convergent multimodal area. The proposed study may provide advancement in understanding neural architecture and mechanisms at the basis of visual-auditory integration in the spatial realm.     

Parietal neurons encoding visual space in a head-frame of reference.

Neurons of the visual system are known to have receptive fields organized in retinotopic coordinates. We wanted to test whether visual neurons existed whose receptive fields were organized in spatial coordinates. Extracellular recordings from single cells were carried out in one area of the posterior parietal cortex (area V6) of a behaving macaque monkey. Among a great majority of retinotopically organized visual cells, neurons whose visual receptive field did not shift with gaze were also found. These cells responded to the visual stimulation of the same spatial position independently of the animal's direction of gaze, that is, their receptive field was anchored to an absolute spatial location. We suggest that these neurons directly encode visual space and are involved in programming visually-guided motor actions in space.     

A spiking neural network model of the midbrain superior colliculus that generates saccadic motor commands

Single-unit recordings suggest that the midbrain superior colliculus (SC) acts as an optimal controller for saccadic gaze shifts. The SC is proposed to be the site within the visuomotor system where the nonlinear spatial-to-temporal transformation is carried out: the population encodes the intended saccade vector by its location in the motor map (spatial), and its trajectory and velocity by the distribution of firing rates (temporal). The neurons’ burst profiles vary systematically with their anatomical positions and intended saccade vectors, to account for the nonlinear main-sequence kinematics of saccades. Yet, the underlying collicular mechanisms that could result in these firing patterns are inaccessible to current neurobiological techniques. Here, we propose a simple spiking neural network model that reproduces the spike trains of saccade-related cells in the intermediate and deep SC layers during saccades. The model assumes that SC neurons have distinct biophysical properties for spike generation that depend on their anatomical position in combination with a center–surround lateral connectivity. Both factors are needed to account for the observed firing patterns. Our model offers a basis for neuronal algorithms for spatiotemporal transformations and bio-inspired optimal controllers.     

Inhomogeneous retino-cortical mapping is supported and stabilized with correlation-learning during self-motion

In primates, the area of primary visual cortex representing a fixed area of visual space decreases with increasing eccentricity. We identify visual situations to which this inhomogeneous retino-cortical mapping is well adapted and study their relevance during natural vision and development. We assume that cortical activations caused by stationary objects during self-motion along the direction of gaze travel on average with constant speed across the cortical surface, independent of retinal eccentricity. This is the case if the distribution of objects corresponds to an ellipsoid with the observer in its center. We apply the resulting flow field to train a simple network of pulse coding neurons with Hebbian learning and demonstrate that the density of learned receptive field centers is in close agreement with primate retino-cortical magnification. In addition, the model reproduces the increase of receptive field size and the decrease of its peak sensitivity with increasing eccentricity. Our results suggest that self-motion may have played an important role in the evolution of the visual system and that cortical magnification can be refined and stabilized by Hebbian learning mechanisms in ontogenesis under natural viewing conditions.     

The synthesis and use of the owl’s auditory space map

The barn owl (Tyto alba) is capable of capturing prey by passive hearing alone, guided by a topographic map of auditory space in the external nucleus of its inferior colliculus. The neurons of this auditory space map have discrete spatial receptive fields that result from the computation of interaural differences in the level (ILD) and time-of-arrival (ITD) of sounds. Below we review the synthesis of the spatial receptive fields from the frequency-specific ITDs and ILDs to which the neurons are tuned, concentrating on recent studies exploiting virtual auditory space techniques to analyze the contribution of ILD. We then compared the owls spatial discrimination, assessed behaviorally, with that of its space map neurons. Spatial discrimination was assessed using a novel paradigm involving the pupillary dilation response (PDR), and neuronal acuity was assessed by measuring the changes in firing rate resulting from changes in source location, scaled to the variance. This signal-detection-based approach revealed that the change in the position of the neural image on this map best explains the spatial discrimination measured using the PDR. We compare this result to recent studies in mammalian systems.     

Basic maps in the auditory midbrain

Topologic maps at consecutive levels of sensory pathways indicate behaviorally relevant features of stimuli at increasing degrees of complexity. In the auditory system, except for tonotopic maps, the nature of represented features is unknown. In a model analogous to visual map formation we show that in the auditory midbrain, layers of neurons with preference to the same frequency (isofrequency planes) may hold maps of two basic, mutually orthogonal parameters--instantaneous amplitude and phase--of basilar membrane displacement at the cochlear location responding to that frequency. The proposed neural tuning to frequency, amplitude, and phase implies that sound is transformed into specific temporal trajectories of neural activation, with consequences for experimental design and interpretation of neural response behavior.     

Encoding of Temporal Information by Timing,Rate, and Place in Cat Auditory Cortex

A central goal in auditory neuroscience is to understand the neural coding of species-specific communication and human speech sounds. Low-rate repetitive sounds are elemental features of communication sounds, and core auditory cortical regions have been implicated in processing these information-bearing elements. Repetitive sounds could be encoded by at least three neural response properties: 1) the event-locked spike-timing precision, 2) the mean firing rate, and 3) the interspike interval (ISI). To determine how well these response aspects capture information about the repetition rate stimulus, we measured local group responses of cortical neurons in cat anterior auditory field (AAF) to click trains and calculated their mutual information based on these different codes. ISIs of the multiunit responses carried substantially higher information about low repetition rates than either spike-timing precision or firing rate. Combining firing rate and ISI codes was synergistic and captured modestly more repetition information. Spatial distribution analyses showed distinct local clustering properties for each encoding scheme for repetition information indicative of a place code. Diversity in local processing emphasis and distribution of different repetition rate codes across AAF may give rise to concurrent feed-forward processing streams that contribute differently to higher-order sound analysis.     

Enhanced tactile performance at the destination of an upcoming saccade

Previous work has demonstrated that upcoming saccades influence visual and auditory performance even for stimuli presented before the saccade is executed. These studies suggest a close relationship between saccade generation and visual/auditory attention. Furthermore, they provide support for Rizzolatti et al.'s premotor model of attention, which suggests that the same circuits involved in motor programming are also responsible for shifts in covert orienting (shifting attention without moving the eyes or changing posture). In a series of experiments, we demonstrate that saccade programming also affects tactile perception. Participants made speeded saccades to the left and right side as well as tactile discriminations of up versus down. The first experiment demonstrates that participants were reliably faster at responding to tactile stimuli near the location of upcoming saccades. In our second experiment, we had the subjects cross their hands and demonstrated that the effect occurs in visual space (rather than the early representations of touch). In our third experiment, the tactile events usually occurred on the opposite side of upcoming eye movement. We found that the benefit at the saccade target location vanished, suggesting that this shift is not obligatory but that it may be vetoed on the basis of expectation.     

Neural network simulations of the primate oculomotor system III. An one-dimensional, one-directional model of the superior colliculus

This report evaluates the performance of a biologically motivated neural network model of the primate superior colliculus (SC). Consistent with known anatomy and physiology, its major features include excitatory connections between its output elements, nigral gating mechanisms, and an eye displacement feedback of reticular origin to recalculate the metrics of saccades to memorized targets in retinotopic coordinates. Despite the fact that it makes no use of eye position or eye velocity information, the model can account for the accuracy of saccades in double step stimulation experiments. Further, the model accounts for the effects of focal SC lesions. Finally, it accounts for the properties of saccades evoked in response to the electrical stimulation of the SC. These include the approximate size constancy of evoked saccades despite increases of stimulus intensity, the fact that the size of evoked saccades depends on the time that has elapsed from a previous saccade, the fact that staircases of saccades are evoked in response to prolonged stimuli, and the fact that the size of saccades evoked in response to the simultaneous stimulation of two SC sites is the average of the saccades that are evoked when the two sites are separately stimulated. Received: 3 November 1997 / Accepted in revised form: 30 June 1998     

Eye position influences auditory responses in primate inferior colliculus

We examined the frame of reference of auditory responses in the inferior colliculus in monkeys fixating visual stimuli at different locations. Eye position modulated the level of auditory responses in 33% of the neurons we encountered, but it did not appear to shift their spatial tuning. The effect of eye position on auditory responses was substantial-comparable in magnitude to that of sound location. The eye position signal appeared to interact with the auditory responses in at least a partly multiplicative fashion. We conclude that the representation of sound location in primate IC is distributed and that the frame of reference is intermediate between head- and eye-centered coordinates. The information contained in these neurons appears to be sufficient for later neural stages to calculate the positions of sounds with respect to the eyes.     

Effects of binaural decorrelation on neural and behavioral processing of interaural level differences in the barn owl (Tyto alba)

The effect of binaural decorrelation on the processing of interaural level difference cues in the barn owl (Tyto alba) was examined behaviorally and electrophysiologically. The electrophysiology experiment measured the effect of variations in binaural correlation on the first stage of interaural level difference encoding in the central nervous system. The responses of single neurons in the posterior part of the ventral nucleus of the lateral lemniscus were recorded to stimulation with binaurally correlated and binaurally uncorrelated noise. No significant differences in interaural level difference sensitivity were found between conditions. Neurons in the posterior part of the ventral nucleus of the lateral lemniscus encode the interaural level difference of binaurally correlated and binaurally uncorrelated noise with equal accuracy and precision. This nucleus therefore supplies higher auditory centers with an undegraded interaural level difference signal for sound stimuli that lack a coherent interaural time difference. The behavioral experiment measured auditory saccades in response to interaural level differences presented in binaurally correlated and binaurally uncorrelated noise. The precision and accuracy of sound localization based on interaural level difference was reduced but not eliminated for binaurally uncorrelated signals. The observation that barn owls continue to vary auditory saccades with the interaural level difference of binaurally uncorrelated stimuli suggests that neurons that drive head saccades can be activated by incomplete auditory spatial information.