Characterizing auditory receptive fields

In this issue of Neuron, two papers by Atencio et al. and Nagel and Doupe adapt new computational methods to map the spectrotemporal response fields of neurons in the auditory cortex. The papers take different but complementary approaches to apply theoretical techniques to classical methods of receptive field mapping and, in doing so, provide exciting new insights into the way in which sounds are processed in the auditory cortex.     

Spectro-temporal receptive fields of auditory neurons in the grassfrog

The nature of the stimulus-response relation for single auditory neurons is reflected in the properties of the Pre-Event Stimulus Ensemble: the ensemble of stimuli, preceding the occurrence of an action potential (neural event). This paper describes methods to analyse the spectro-temporal properties of this ensemble. These methods are based on the analytic signal representation of acoustic signals and functionals derived from it: the instantaneous amplitude and instantaneous frequency and the dynamic power spectrum. The procedures have been applied to a number of extra-cellular single unit recordings from the grassfrog, Rana temporatia L., recorded during presentation of an ensemble of tonal stimuli. The outcome of this analysis describes the spectro-temporal receptive field of the neuron under the present stimulus conditions. The procedure, based on the dynamic power spectrum is applicable to an arbitrary stimulus ensemble, thus allowing a comparison of the spectrotemporal receptive fields for different types of stimuli.     

Spectro-temporal receptive fields of auditory neurons in the grassfrog

The stimulus-event relation of single units in the auditory midbrain area, the torus semicircularis, of the anaesthetized grassfrog (Rana temporaria L.) during stimulation with a wide ensemble of natural stimuli, was analysed using first and second order statistical analysis techniques. The average stimulus preceding the occurrence of action potentials, in general, did not prove to give very informative results. The second order procedure consisted in the determination of the average dynamic power spectrum of the pre-event stimuli, following procedures as described elsewhere (Aertsen and Johannesma, 1980; Aertsen et al., 1980). The outcome of this analysis was filtered with the overall power spectrum of the complete stimulus ensemble in order to correct for its non-uniform spectral composition. The stimulus-filtered average pre-event dynamic spectrum gives a first indication of the spectro-temporal receptive field of a neuron under natural stimulus conditions. Results for a limited number of recordings are presented and, globally, compared to the outcome of an analogous analysis of experiments with tonal stimuli.     

The spatial substructure of visual receptive fields in the cat's superior colliculus

Although the direction selective properties of the superficial layer cells of the cat's superior colliculus have been extensively studied, the mechanisms underlying this property remain controversial. With the aim to understand the mechanism(s) underlying directional selectivity of collicular neurons we examined the substructure of their visual receptive fields. 1. The strength of cell responses and the direction selectivity indices varied in relation to the location of the tested region within the receptive field and the amplitude of stimulus movement. 2. Decrease of the amplitude of motion resulted in a decrease of direction selectivity index both in the group of direction-selective cells and in the group of cells classified as direction nonselective but with a directional bias. 3. The decrease of direction selectivity for small amplitude movement resulted mainly from increase in the magnitude of response in the nonpreferred direction of movement. 4. These results suggest that the receptive fields of most collicular cells are composed of subregions with different response profiles and indicate that inhibitory mechanisms dictate direction selectivity of collicular cells.     

The linearity of emergent spectro-temporal receptive fields in a model of auditory cortex

The responses of cortical neurons are often characterized by measuring their spectro-temporal receptive fields (STRFs). The STRF of a cell can be thought of as a representation of its stimulus 'preference' but it is also a filter or 'kernel' that represents the best linear prediction of the response of that cell to any stimulus. A range of in vivo STRFs with varying properties have been reported in various species, although none in humans. Using a computational model it has been shown that responses of ensembles of artificial STRFs, derived from limited sets of formative stimuli, preserve information about utterance class and prosody as well as the identity and sex of the speaker in a model speech classification system. In this work we help to put this idea on a biologically plausible footing by developing a simple model thalamo-cortical system built of conductance based neurons and synapses some of which exhibit spike-time-dependent plasticity. We show that the neurons in such a model when exposed to formative stimuli develop STRFs with varying temporal properties exhibiting a range of heterotopic integration. These model neurons also, in common with neurons measured in vivo, exhibit a wide range of non-linearities; this deviation from linearity can be exposed by characterizing the difference between the measured response of each neuron to a stimulus, and the response predicted by the STRF estimated for that neuron. The proposed model, with its simple architecture, learning rule, and modest number of neurons (<1000), is suitable for implementation in neuromorphic analogue VLSI hardware and hence could form the basis of a developmental, real time, neuromorphic sound classification system.     

Multiple-band trigger features of midbrain auditory neurons revealed in composite spectro-temporal receptive fields

Receptive fields of single units in the auditory midbrain of anesthetized rats were studied using random FM-tone stimuli of narrow frequency-ranges. Peri-spike averaging of the modulating waveform first produced a spectro-temporal receptive field (STRF). Combining STRFs obtained from the same unit at different frequency regions generated a composite receptive field covering a wider frequency range of 2 to 3 octaves. About 20% of the composite STRFs (26/122) showed a pattern of multiple-bands which were not clear in the non-composite maps. Multiple-bands in a given composite map were often oriented in the same direction (representing upward or downward FM ramp) separated at rather regular frequency intervals. They reflect multiple FM trigger features in the stimulus rather than repetitive firing to a single trigger feature. Results showed that the subcortical auditory pathways are capable of detecting multiple FM features and such sensitivity could be useful in detecting multiple-harmonic FM bands present in the vocalization sounds.     

A computational model of rapid task-related plasticity of auditory cortical receptive fields

Receptive field properties of neurons in A1 can rapidly adapt their shapes during task performance in accord with specific task demands and salient sensory cues (Fritz et al., Hearing Research, 206:159–176, 2005a, Nature Neuroscience, 6: 1216–1223, 2003). Such modulatory changes selectively enhance overall cortical responsiveness to target (foreground) sounds and thus increase the likelihood of detection against the background of reference sounds. In this study, we develop a mathematical model to describe how enhancing discrimination between two arbitrary classes of sounds can lead to the observed receptive field changes in a variety of spectral and temporal discrimination tasks. Cortical receptive fields are modeled as filters that change their spectro-temporal tuning properties so as to respond best to the discriminatory acoustic features between foreground and background stimuli. We also illustrate how biologically plausible constraints on the spectro-temporal tuning of the receptive fields can be used to optimize the plasticity. Results of the model simulations are compared to published data from a variety of experimental paradigms.     

Theory of spatial position and spatial frequency relations in the receptive fields of simple cells in the visual cortex

Striate cells showing linear spatial summation obey very general mathematical inequalities relating the size of their receptive fields to the corresponding spatial frequency and orientation tuning characteristics. The experimental data show that, in the preferred direction of stimulus motion, the spatial response profiles of cells in the simple family are well described by the mathematical form of Gabor elementary signals. The product of the uncertainties in signalling spatial position (x) and spatial frequency (f) has, therefore, a theoretical minimum value of xf=1/2. We examine the implications that these conclusions have for the relationship between the spatial response profiles of simple cells and the characteristics of their spatial frequency tuning curves. Examples of the spatial frequency tuning curves and their associated spatial response profiles are discussed and illustrated. The advantages for the operation of the visual system of different relationships between the spatial response profiles and the characteristics of the spatial frequency tuning curves are examined. Two examples are discussed in detail, one system having a constant receptive field size and the other a constant bandwidth.     

Contextual modulation of V1 receptive fields depends on their spatial symmetry

The apparent receptive field characteristics of sensory neurons depend on the statistics of the stimulus ensemble—a nonlinear phenomenon often called contextual modulation. Since visual cortical receptive fields determined from simple stimuli typically do not predict responses to complex stimuli, understanding contextual modulation is crucial to understanding responses to natural scenes. To analyze contextual modulation, we examined how apparent receptive fields differ for two stimulus ensembles that are matched in first- and second-order statistics, but differ in their feature content: one ensemble is enriched in elongated contours. To identify systematic trends across the neural population, we used a multidimensional scaling method, the Procrustes transformation. We found that contextual modulation of receptive field components increases with their spatial extent. More surprisingly, we also found that odd-symmetric components change systematically, but even-symmetric components do not. This symmetry dependence suggests that contextual modulation is driven by oriented On/Off dyads, i.e., modulation of the strength of intracortically-generated signals. Electronic supplementary material  The online version of this article (doi:) contains supplementary material, which is available to authorized users.     

The function of the medial superior olive in small mammals: temporal receptive fields in auditory analysis

Traditionally, the medial superior olive, a mammalian auditory brainstem structure, is considered to encode interaural time differences, the main cue for localizing low-frequency sounds. Detection of binaural excitatory and inhibitory inputs are considered as an underlying mechanism. Most small mammals, however, hear high frequencies well beyond 50 kHz and have small interaural distances. Therefore, they can not use interaural time differences for sound localization and yet possess a medial superior olive. Physiological studies in bats revealed that medial superior olive cells show similar interaural time difference coding as in larger mammals tuned to low-frequency hearing. Their interaural time difference sensitivity, however, is far too coarse to serve in sound localization. Thus, interaural time difference sensitivity in medial superior olive of small mammals is an epiphenomenon. We propose that the original function of the medial superior olive is a binaural cooperation causing facilitation due to binaural excitation. Lagging inhibitory inputs, however, suppress reverberations and echoes from the acoustic background. Thereby, generation of antagonistically organized temporal fields is the basic and original function of the mammalian medial superior olive. Only later in evolution with the advent of larger mammals did interaural distances, and hence interaural time differences, became large enough to be used as cues for sound localization of low-frequency stimuli. Accepted: 28 February 2000     

Comparison of LFP-based and spike-based spectro-temporal receptive fields and cross-correlation in cat primary auditory cortex

Multi-electrode array recordings of spike and local field potential (LFP) activity were made from primary auditory cortex of 12 normal hearing, ketamine-anesthetized cats. We evaluated 259 spectro-temporal receptive fields (STRFs) and 492 frequency-tuning curves (FTCs) based on LFPs and spikes simultaneously recorded on the same electrode. We compared their characteristic frequency (CF) gradients and their cross-correlation distances. The CF gradient for spike-based FTCs was about twice that for 2-40 Hz-filtered LFP-based FTCs, indicating greatly reduced frequency selectivity for LFPs. We also present comparisons for LFPs band-pass filtered between 4-8 Hz, 8-16 Hz and 16-40 Hz, with spike-based STRFs, on the basis of their marginal frequency distributions. We find on average a significantly larger correlation between the spike based marginal frequency distributions and those based on the 16-40 Hz filtered LFP, compared to those based on the 4-8 Hz, 8-16 Hz and 2-40 Hz filtered LFP. This suggests greater frequency specificity for the 16-40 Hz LFPs compared to those of lower frequency content. For spontaneous LFP and spike activity we evaluated 1373 pair correlations for pairs with >200 spikes in 900 s per electrode. Peak correlation-coefficient space constants were similar for the 2-40 Hz filtered LFP (5.5 mm) and the 16-40 Hz LFP (7.4 mm), whereas for spike-pair correlations it was about half that, at 3.2 mm. Comparing spike-pairs with 2-40 Hz (and 16-40 Hz) LFP-pair correlations showed that about 16% (9%) of the variance in the spike-pair correlations could be explained from LFP-pair correlations recorded on the same electrodes within the same electrode array. This larger correlation distance combined with the reduced CF gradient and much broader frequency selectivity suggests that LFPs are not a substitute for spike activity in primary auditory cortex.     

Functional organization of auditory cortical fields in the mongolian gerbil (Meriones unguiculatus): Binaural 2-deoxyglucose patterns

Summary Unilaterally deafened (cochlear destruction) gerbils were exposed to white noise after injection of 14-C-2-deoxyglucose. The labelling patterns were compared to those of unstimulated operated animals, noise stimulated control animals and bilaterally ear plugged animals.Serial transverse, horizontal and tangential autoradiographs through the cortex were analysed. In lesioned animals, labelling was strongly reduced on the side contralateral to the lesion in the high frequency regions of A1 and the anterior auditory field (AAF). We assume that these regions correspond to the high frequency EI cell areas. Fine banding could be seen superimposed on this pattern in transverse and tangential sections. We suggest that this may be due to alternating strips of EI and EE cells orthogonal to iso-frequency contours. In the low frequency regions of A1 and AAF, labelling asymmetries were also present, but were less pronounced. We assume that these effects are due to low frequency EE cells.In sub-cortical structures, labelling was reduced in the inferior colliculus and ventral part of the medial geniculate body contralateral to the lesioned ear, but no labelling pattern was visible. We presume that the spatial separation of EE and EI inputs to these structures is not marked enough to allow labelling patterns to be seen. In the superior olivary complex, labelling was reduced on the side contralateral to the lesioned ear in the medial dendritic field of the medial superior olivary nucleus and in the nucleus of the trapezoid body. Ipsilateral to the lesioned ear, labelling was reduced in the lateral dendritic field of the medial superior olive.     

Extents of visual, auditory and bimodal receptive fields of single neurons in the feline visual associative cortex

Extracellular microelectrode recordings were carried out on 150 neurons in the anterior ectosylvian sulcal region of halothane-anesthetized, immobilized, artificially ventilated cats. Fifty-nine neurons were visual, 60 were auditory and 31 were bimodal visual-auditory. As the extent of the receptive fields has never been exactly determined, we introduced a quasi-objective, computer-based, statistical method in order to estimate the receptive field sizes in the anterior half of the perimeter. The visual, auditory and bimodal cells had very large receptive fields, often with portions extending well into the ipsilateral hemifield. The mean extents of the visual and auditory receptive fields in the horizontal plane were 75.75 degrees (N=59, SD: +/- 28.620, range: 15-135 degrees), and 132.5 degrees (N=60, SD: +/- 46.72 degrees, range: 15-165 degrees) respectively. These data suggest that a single visual neuron can carry information from the whole visual field of the right eye and a single auditory unit can carry information of azimuths throughout the whole area of the horizontal plane studied. The mean extent of the bimodal receptive fields in the horizontal plane was 82.1 degrees (N=31, SD: +/- 24.24 degrees, range: 30-135 degrees). In 21 of the 31 bimodal cells we observed a facilitatory interaction between visual and auditory stimuli. The mean extent of the facilitatory interactions in these cells was 75.75 degrees (N=21, SD: +/- 24.56 degrees, range: 45-135 degrees).     

Orientation selectivity and spatial frequency characteristics of receptive fields of occipital cortical neurons in cats

Spatial frequency characteristics of receptive fields of occipital cortical neurons were investigated in cats during presentation of visual stimuli consisting of gratings in four or eight standard orientations. The maximal increase in discharge frequency of the neurons was observed when the grating was presented in one particular orientation, which was taken to be optimal for those particular neurons. Responses of some neurons to presentation of gratings in nonoptimal orientations were less than optimal; inhibition of activity below the spontaneous discharge level was observed in other cells in this case. Maximal inhibition was observed to the orientation perpendicular to optimal. Inhibition of unit activity evoked by presentation of gratings in the nonoptimal orientation was shown to be a function of spatial frequency.I. P. Pavlov Institute of Physiology, Academy of Sciences of the USSR, Leningrad. Translated from Neirofiziologiya, Vol. 13, No. 3, pp. 227–232, May–June, 1981.     

Understanding auditory spectro-temporal receptive fields and their changes with input statistics by efficient coding principles

Spectro-temporal receptive fields (STRFs) have been widely used as linear approximations to the signal transform from sound spectrograms to neural responses along the auditory pathway. Their dependence on statistical attributes of the stimuli, such as sound intensity, is usually explained by nonlinear mechanisms and models. Here, we apply an efficient coding principle which has been successfully used to understand receptive fields in early stages of visual processing, in order to provide a computational understanding of the STRFs. According to this principle, STRFs result from an optimal tradeoff between maximizing the sensory information the brain receives, and minimizing the cost of the neural activities required to represent and transmit this information. Both terms depend on the statistical properties of the sensory inputs and the noise that corrupts them. The STRFs should therefore depend on the input power spectrum and the signal-to-noise ratio, which is assumed to increase with input intensity. We analytically derive the optimal STRFs when signal and noise are approximated as Gaussians. Under the constraint that they should be spectro-temporally local, the STRFs are predicted to adapt from being band-pass to low-pass filters as the input intensity reduces, or the input correlation becomes longer range in sound frequency or time. These predictions qualitatively match physiological observations. Our prediction as to how the STRFs should be determined by the input power spectrum could readily be tested, since this spectrum depends on the stimulus ensemble. The potentials and limitations of the efficient coding principle are discussed.     

Recursive features of circular receptive fields

The distribution of excitability in retinal receptive fields may be well approximated by functions with recursive features. Physiological data do not exclude an implementation of recursive structures in the visual system. It is the most remarkable advantage of a recursive visual system, that cortical receptive fields tuned to different spatial frequencies will have an identical neuronal circuitry. Structural consequences for retina, LGN and visual cortex are discussed.     

A computational theory of visual receptive fields

A receptive field constitutes a region in the visual field where a visual cell or a visual operator responds to visual stimuli. This paper presents a theory for what types of receptive field profiles can be regarded as natural for an idealized vision system, given a set of structural requirements on the first stages of visual processing that reflect symmetry properties of the surrounding world. These symmetry properties include (i) covariance properties under scale changes, affine image deformations, and Galilean transformations of space–time as occur for real-world image data as well as specific requirements of (ii) temporal causality implying that the future cannot be accessed and (iii) a time-recursive updating mechanism of a limited temporal buffer of the past as is necessary for a genuine real-time system. Fundamental structural requirements are also imposed to ensure (iv) mutual consistency and a proper handling of internal representations at different spatial and temporal scales. It is shown how a set of families of idealized receptive field profiles can be derived by necessity regarding spatial, spatio-chromatic, and spatio-temporal receptive fields in terms of Gaussian kernels, Gaussian derivatives, or closely related operators. Such image filters have been successfully used as a basis for expressing a large number of visual operations in computer vision, regarding feature detection, feature classification, motion estimation, object recognition, spatio-temporal recognition, and shape estimation. Hence, the associated so-called scale-space theory constitutes a both theoretically well-founded and general framework for expressing visual operations. There are very close similarities between receptive field profiles predicted from this scale-space theory and receptive field profiles found by cell recordings in biological vision. Among the family of receptive field profiles derived by necessity from the assumptions, idealized models with very good qualitative agreement are obtained for (i) spatial on-center/off-surround and off-center/on-surround receptive fields in the fovea and the LGN, (ii) simple cells with spatial directional preference in V1, (iii) spatio-chromatic double-opponent neurons in V1, (iv) space–time separable spatio-temporal receptive fields in the LGN and V1, and (v) non-separable space–time tilted receptive fields in V1, all within the same unified theory. In addition, the paper presents a more general framework for relating and interpreting these receptive fields conceptually and possibly predicting new receptive field profiles as well as for pre-wiring covariance under scaling, affine, and Galilean transformations into the representations of visual stimuli. This paper describes the basic structure of the necessity results concerning receptive field profiles regarding the mathematical foundation of the theory and outlines how the proposed theory could be used in further studies and modelling of biological vision. It is also shown how receptive field responses can be interpreted physically, as the superposition of relative variations of surface structure and illumination variations, given a logarithmic brightness scale, and how receptive field measurements will be invariant under multiplicative illumination variations and exposure control mechanisms.