Cortical sensitivity to visual features in natural scenes

A central hypothesis concerning sensory processing is that the neuronal circuits are specifically adapted to represent natural stimuli efficiently. Here we show a novel effect in cortical coding of natural images. Using spike-triggered average or spike-triggered covariance analyses, we first identified the visual features selectively represented by each cortical neuron from its responses to natural images. We then measured the neuronal sensitivity to these features when they were present in either natural images or random stimuli. We found that in the responses of complex cells, but not of simple cells, the sensitivity was markedly higher for natural images than for random stimuli. Such elevated sensitivity leads to increased detectability of the visual features and thus an improved cortical representation of natural scenes. Interestingly, this effect is due not to the spatial power spectra of natural images, but to their phase regularities. These results point to a distinct visual-coding strategy that is mediated by contextual modulation of cortical responses tuned to the spatial-phase structure of natural scenes.     

Estimating receptive fields from responses to natural stimuli with asymmetric intensity distributions

The reasons for using natural stimuli to study sensory function are quickly mounting, as recent studies have revealed important differences in neural responses to natural and artificial stimuli. However, natural stimuli typically contain strong correlations and are spherically asymmetric (i.e. stimulus intensities are not symmetrically distributed around the mean), and these statistical complexities can bias receptive field (RF) estimates when standard techniques such as spike-triggered averaging or reverse correlation are used. While a number of approaches have been developed to explicitly correct the bias due to stimulus correlations, there is no complementary technique to correct the bias due to stimulus asymmetries. Here, we develop a method for RF estimation that corrects reverse correlation RF estimates for the spherical asymmetries present in natural stimuli. Using simulated neural responses, we demonstrate how stimulus asymmetries can bias reverse-correlation RF estimates (even for uncorrelated stimuli) and illustrate how this bias can be removed by explicit correction. We demonstrate the utility of the asymmetry correction method under experimental conditions by estimating RFs from the responses of retinal ganglion cells to natural stimuli and using these RFs to predict responses to novel stimuli.     

Spatio-temporal organization of receptive fields of the cat striate cortex

The responses of cortical cells to gratings and bars were compared. The excitatory and inhibitory on-and off-zones of a simple cell are composed of on- and off-subfields of CGL. Any zone is formed by an opponent pair of subfields one of which gives an excitatory effect, the other — inhibitory. Such organization assumes the linear properties of a simple field. The deviations from linearity are due to spatial dis-placements of the subfields, heterogeneity of subfields, or the absence of one subfield in the opponent pair. Subfields may be both phasic and tonic, even in the same RF. Analysis of the most common type of a complex cell with modulated responses against unmodulated background shows that a mask eliminating stimulation of any half of the RF causes (according to the theory of filtres) increasing the bandwidth due to the increase or the appearance of responses to side low and high frequencies. The modulated components of the responses from both halves of the RF are out of phase. Analysis of this fact and the responses to thin bars suggests that a complex field is formed by linear and nonlinear subsystems converging onto output neuron. Other types of complex fields are organized by different combinations of subsystems. Limited in area by masking the RF responds to much higher spatial frequencies than the whole RF. The optimal frequency in two-dimensional spatial frequency characteristics of the RF does not change with orientation. Simple RFs and a part of complex RF calculate the amplitude and the phase of the stimulus, the other part of complex RFs (with unmodulated response) calculate only amplitude. Given all this, the RFs are grating filters of spatial frequency.     

A linear model for symmetric receptive fields: implications for classification tests with flashed and moving images

The purpose of this study was to explore the effects of spatial and temporal properties on the expected responses of visual neurons that have linear receptive fields (RFs), particularly those having a mirror symmetric distribution of spatial subregions. Receptive fields that are symmetric in at least one spatial dimension occur in neurons of the retina, the lateral geniculate nucleus (LGN), and the visual cortex of mammals. Responses to flashing bars, moving bars, and moving edges were studied for different configurations of an analog RF model in which spatial and temporal aspects were varied independently. Responses of the model at intermediate stimulus speeds were found to agree with responses in the literature for X and Y units of the LGN and often for simple units of the visual cortex. In particular, having separated regions of response to light and dark edges, an identifying property of simple cells, was found to be a linear consequence of RF regions responding inversely to stimuli of opposite polarity. Model differences from responses of cortical complex units show that a linear model cannot mimic their responses, and imply that complex units employ major nonlinearities in coding image polarity (light vs dark), which signifies a nonlinearity in coding intensity. Because sudden flux changes inherent in flashing bars test mainly temporal RF properties, and slowly moving edges test mainly spatial properties, these two tests form a useful minimal set with which to describe and classify RFs. The usefulness of this set derives both from its sensitivity to spatial and temporal variables, and from the correlation between the linearity of a cell's processing of stimulus intensity and its RF classification.     

Changes in visual receptive fields with microstimulation of frontal cortex

The influence of attention on visual cortical neurons has been described in terms of its effect on the structure of receptive fields (RFs), where multiple stimuli compete to drive neural responses and ultimately behavior. We stimulated the frontal eye field (FEF) of passively fixating monkeys and produced changes in V4 responses similar to known effects of voluntary attention. Subthreshold FEF stimulation enhanced visual responses at particular locations within the RF and altered the interaction between pairs of RF stimuli to favor those aligned with the activated FEF site. Thus, we could influence which stimulus drove the responses of individual V4 neurons. These results suggest that spatial signals involved in saccade preparation are used to covertly select among multiple stimuli appearing within the RFs of visual cortical neurons.     

A Nonlinear Model of the Behavior of Simple Cells in Visual Cortex

Despite their structured receptive fields (RFs) and the strong linear components in their responses, most simple cells in mammalian visual cortex exhibit nonlinear behaviors. Besides the contrast-response function, nonlinearities are evident in various types of failure at superposition tasks, in the disagreement between direction indices computed from drifting and counterphase flickering gratings, in various forms of response suppression (including end- and side-stopping, spatial-frequency-specific inhibition and cross-orientation inhibition), in the advance of phase with increasing contrast, and in phase-insensitive and frequency-doubled responses to counterphase flickering gratings. These behaviors suggest that nonlinearities are involved in the operation of simple cells, but current models fail to explain them. A quantitative model is presented here that purports to describe basic and common principles of operation for all visual cortical cells. Simple cells are described as receiving afferents from multiple subunits that differ in their individual RFs and temporal impulse responses (TIRs). Subunits are independent and perform a spatial integration across their RFs followed by halfwave rectification and temporal convolution with their TIRs. This parallel operation yields a set of temporal functions representing each subunit's contribution to the membrane potential of the host cell, whose final form is given by the weighted sum of all subunits' contributions. By varying the number of subunits and their particular characteristics, different instances of the model are obtained each of which displays a different set of behaviors. Extensive simulation results are presented that illustrate how all of the reported nonlinear behaviors of simple cells arise from these multi-subunit organizations.     

Studies of functional connectivity in the developing and mature visual cortex

We have investigated several aspects of cortical organization in adult cats and in young kittens. First, we determined receptive field (RF) maps of correlated discharge between pairs of cortical cells. Unique bicellular RFs appear to convey high resolution information. Second, we studied the dynamics of neural interaction between pairs of cells. Using cross-correlation analysis, we studied monosynaptic and polysynaptic interactions in both kittens and cats. A somewhat surprising finding is that there were no cases of monosynaptic excitation from simple to complex cells as would be predicted by a simple hierarchical processing theory. Third, we studied length and side tuning characteristics of cortical cells and worked out the relationships between them. Fourth, we carried out an investigation of binocular processing in which we compared monocular and binocular sensitivity of cortical cells with respect to contrast. Our results are comparable to those found in psychophysical work. Fifth, we examined how stereoscopic depth information is encoded by simple cells in the visual cortex. We show that structural differences in RFs of left and right eyes may be expressed in terms of phase. Phase-based encoding appears to be a very plausible alternative to the standard position-based notion. Sixth, we attempted to induce plastic changes in connections between cell pairs by long-term activation (up to 2 h) in kittens and cats. Although connection strength between some cell pairs was increased during long-term activation, there was no consistent pattern of this effect. Seventh, we attempted to study the functional basis of reported claims of RF expansion following use of an artificial scotoma. However, we found no receptive field size change from this procedure. For some cells, there is an apparent change of gain in the form of base (spontaneous) rates and absolute response levels. Finally, we have examined RF dynamics in the central visual pathways. The standard treatment of RFs is to consider only spatial aspects. But the RF is inherently both temporal and spatial in nature and we have examined the dynamics of spatiotemporal organization of RFs in central visual pathways.     

Interacting roles of attention and visual salience in V4

Attention increases the contrast gain of V4 neurons, causing them to respond to an attended stimulus as though its contrast had increased. When multiple stimuli appear within a neuron's receptive field (RF), the neuron responds primarily to the attended stimulus. This suggests that cortical cells may be "hard wired" to respond preferentially to the highest-contrast stimulus in their RF, and neural systems for attention capitalize on this mechanism by dynamically increasing the effective contrast of the stimulus that is task relevant. To test this, we varied the relative contrast of two stimuli within the recorded neurons' RFs, while the monkeys attended away to another location. Increasing the physical contrast of one stimulus caused V4 neurons to respond preferentially to that stimulus and reduced their responses to competing stimuli. When attention was directed to the lower-contrast stimulus, it partially overcame the influence of a competing, higher-contrast stimulus.     

Receptive Fields of Visually Sensitive Neurons of the Extrastriate Associative Area 21b of the Cat Cerebral Cortex

Organization of the receptive fields (RFs) of neurons of the extrastriate associative region 21b of the cerebral cortex was studied in cats. Most neurons under study (63%) were “monocular,” while 37% of the cells were “binocular” units. Among 178 neurons examined in detail, heterogeneous RF functional organization was typical of about 76% of the units; point-to-point testing of the entire RF area by stationary stimuli resulted in the generation of various types of responses (on, off, or on-off). The rest of the neurons (24%) generated homogeneous responses. The dimension, form, and functional organization of RFs of the neurons under study depended to a certain extent on the parameters of visual stimuli used for the measurements. Examination of the influence of the visual space, which surrounded the RF, on responses of the neurons evoked by stimulation of the RF per se showed that darkening of the visual space adjacent to the RF inhibited neuronal responses to moving stimuli; in some cases the responses were totally suppressed. Analysis of spatial overlapping of the RF sequentially recorded in the course of each insertion of the electrode showed that the density of distribution of the overlapping RF areas of neighboring neurons with the RF of the examined neuron is irregular, and that the RF is of a mosaic nature. We hypothesize that the visual space surrounding the RF plays a significant role in the formation of responses of visually sensitive neurons to presentation of moving stimuli. Neirofiziologiya/Neurophysiology, Vol. 37, No. 3, pp. 223–234, May–June, 2005.     

Simple model for encoding natural images by retinal ganglion cells with nonlinear spatial integration

A central goal in sensory neuroscience is to understand the neuronal signal processing involved in the encoding of natural stimuli. A critical step towards this goal is the development of successful computational encoding models. For ganglion cells in the vertebrate retina, the development of satisfactory models for responses to natural visual scenes is an ongoing challenge. Standard models typically apply linear integration of visual stimuli over space, yet many ganglion cells are known to show nonlinear spatial integration, in particular when stimulated with contrast-reversing gratings. We here study the influence of spatial nonlinearities in the encoding of natural images by ganglion cells, using multielectrode-array recordings from isolated salamander and mouse retinas. We assess how responses to natural images depend on first- and second-order statistics of spatial patterns inside the receptive field. This leads us to a simple extension of current standard ganglion cell models. We show that taking not only the weighted average of light intensity inside the receptive field into account but also its variance over space can partly account for nonlinear integration and substantially improve response predictions of responses to novel images. For salamander ganglion cells, we find that response predictions for cell classes with large receptive fields profit most from including spatial contrast information. Finally, we demonstrate how this model framework can be used to assess the spatial scale of nonlinear integration. Our results underscore that nonlinear spatial stimulus integration translates to stimulation with natural images. Furthermore, the introduced model framework provides a simple, yet powerful extension of standard models and may serve as a benchmark for the development of more detailed models of the nonlinear structure of receptive fields.     

Spatial organization of receptive fields and dynamic peculiarities of neurons of the extrastriate area 21a of the cat cerebral cortex

In neurons of the extrastriate area 21a of the cat cortex, we examined the mode of initiation and peculiarities of inhibitory components in responses of these units to visual stimulation. About 31% of the studied neurons generated complex responses to mobile visual stimuli; the parameters of inhibitory components in these responses (location and duration) were different and depended on the contrast, dimension, and shape of the visual stimuli presented. We compared in detail the stationary spatial organization of receptive fields (RFs) and parameters of neuronal responses to presentation of moving stimuli in order to estimate the correlation between static and dynamic characteristics of the activity generated by the studied neurons. Our experiments showed that in most cases the neurons possessing identical homogeneous static characteristics of the RFs with off, on-off, and on responses could demonstrate quite different patterns of responses to moving stimuli, which differed from each other both in localization of inhibitory zones and discharge centers within the RFs and in time parameters of the components of these responses. The obtained data allow us to hypothesize that the dynamic characteristics of visually sensitive neurons in the extrastriate associative cortical regions are formed due to complex processes of spatial interaction between their “classic” RFs and the surrounding visual space. Neirofiziologiya/Neurophysiology, Vol. 40, No. 2, pp. 119–129, March–April, 2008.     

Responses of neurons of the extrastriate cortex of the cat brain to moving stimuli of different forms

We examined responses of neurons of the field 21b of the cat brain cortex to presentation of moving visual stimuli of different forms. Characteristics of the responses of about 54% of the studied neurons showed that in these cases configurations of the contours of moving stimuli were to a certain extent discriminated. Most neurons selectively reacting to changes in the form of the stimulus were dark-sensitive units (they generated optimum responses to presentation of dark visual stimuli on the light background). Detailed examination of the spatial infrastructure of receptive fields (RFs) of the neurons and comparison of this structure with the selectivity of neuronal responses showed that there is no significant correlation between static organization of the RF and responses of the neuron to the movements of stimuli of different forms. We hypothesize that the dynamic infrastructure of the RF and the combined activity of functional groups of neurons, whose RFs spatially overlap the RF of the neuron under study, play a definite role in the mechanisms responsible for neuronal discrimination of the form of the visual stimulus. Neirofiziologiya/Neurophysiology, Vol. 38, No. 1, pp. 61–71, January–February, 2006.     

Receptive field properties of near neighbor orientation selective neurons in the visual cortex: a modeling study

The primary visual cortex is organized into clusters of cells having similar receptive fields (RFs). A purely feedforward model has been shown to produce realistic simple cell receptive fields. The modeled cells capture a wide range of receptive field properties of orientation selective cortical cells. We have analyzed the responses of 78 nearby cell pairs to study which RF properties are clustered. Orientation preference shows strongest clustering. Orientation tuning width (hwhh) and tuning height (spikes/sec) at the preferred orientation are not as tightly clustered. Spatial frequency is also not as tightly clustered and RF phase has the least clustering. Clustering property of orientation preference, orientation tuning height and width depend on the location of cells in the orientation map. No such location dependence is observed for spatial frequency and RF phase. Our results agree well with experimental data.     

Responses of Neurons in the Rat Nucleus Submedius to Noxious and Innocuous Mechanical Cutaneous Stimulation

Extracellular recordings were used to characterize responses to cutaneous mechanical stimulation of 78 neurons in the rat nucleus submedius (SM). Thirty-nine of these units were activated by some type of cutaneous mechanical stimulation. Eighteen cells were activated exclusively by noxious stimuli. In 13 of these cells, responses were of swift onset and relatively rapid termination following stimulus application. In contrast, in three neurons responses were delayed both in onset and termination, and in two the response was immediate, but the markedly increased evoked activity outlasted stimulus application by 13 min. Receptive fields (RFs) of these nociceptive neurons were generally large, although none were bilateral. Four SM neurons were activated by innocuous stimuli, but their maximal response was obtained only after noxious stimulation. Responses of all of these neurons were of immediate onset and recovery, and their RFs were large (two were bilateral). Twelve SM neurons were activated maximally by innocuous stimuli. Responses of seven of these cells were immediate in onset and termination, while that of three were delayed in both onset and termination. Two of the 12 innocuous-only neurons quickly became unresponsive to repeated stimulus applications, and could be reactivated only after a rest period during which no stimuli were applied. RFs of these units were also generally large, and in three cases were bilateral. Five SM neurons responded by decreasing, or completely ceasing, their firing subsequent to noxious-only (n = 2), or innocuous-only (n = 3) stimulation. Four of these units had large RFs (two were bilateral). The remaining 39 SM neurons could not be activated by any type of mechanical cutaneous stimulation we tried.

Electrical stimulation of the ventrolateral orbital cortex (VLO) was employed to examine frontal cortical projections of 21 SM neurons. Ten of these units were activated, although all of them synaptically rather than antidromically, and two were inhibited. There was no clear-cut relationship between neuronal location, physiological type, RF site, or VLO stimulation effects among the 39 SM neurons.

These results provide further support for the involvement of SM neurons in nociceptive information signaling, and suggest additionally that the role of the nucleus is not limited to nociception but encompasses a wider range of cutaneous sensations.     

Responses of neurons in the rat nucleus submedius to noxious and innocuous mechanical cutaneous stimulation

Extracellular recordings were used to characterize responses to cutaneous mechanical stimulation of 78 neurons in the rat nucleus submedius (SM). Thirty-nine of these units were activated by some type of cutaneous mechanical stimulation. Eighteen cells were activated exclusively by noxious stimuli. In 13 of these cells, responses were of swift onset and relatively rapid termination following stimulus application. In contrast, in three neurons responses were delayed both in onset and termination, and in two the response was immediate, but the markedly increased evoked activity outlasted stimulus application by 13 min. Receptive fields (RFs) of these nociceptive neurons were generally large, although none were bilateral. Four SM neurons were activated by innocuous stimuli, but their maximal response was obtained only after noxious stimulation. Responses of all of these neurons were of immediate onset and recovery, and their RFs were large (two were bilateral). Twelve SM neurons were activated maximally by innocuous stimuli. Responses of seven of these cells were immediate in onset and termination, while that of three were delayed in both onset and termination. Two of the 12 innocuous-only neurons quickly became unresponsive to repeated stimulus applications, and could be reactivated only after a rest period during which no stimuli were applied. RFs of these units were also generally large, and in three cases were bilateral. Five SM neurons responded by decreasing, or completely ceasing, their firing subsequent to noxious-only (n = 2), or innocuous-only (n = 3) stimulation. Four of these units had large RFs (two were bilateral). The remaining 39 SM neurons could not be activated by any type of mechanical cutaneous stimulation we tried. Electrical stimulation of the ventrolateral orbital cortex (VLO) was employed to examine frontal cortical projections of 21 SM neurons. Ten of these units were activated, although all of them synaptically rather than antidromically, and two were inhibited. There was no clear-cut relationship between neuronal location, physiological type, RF site, or VLO stimulation effects among the 39 SM neurons. These results provide further support for the involvement of SM neurons in nociceptive information signaling, and suggest additionally that the role of the nucleus is not limited to nociception but encompasses a wider range of cutaneous sensations.     

Formation and functional significance of the dark receptive fields of the cat visual cortex

Receptive fields (RFs) of single units in the 17th field of the visual cortex of immobilized cat were investigated under dark adaptation. The mean RF size was equal to 67 degrees and varied from 3 degrees up to 120 degrees. The RFs with centres located near gaze were from 3 degrees up to 120 degrees in dia, but with growth of excentricity the number of small RFs decreased, and in the region of 70 to 100 degrees from gaze only RFs with diameters equal to 100 degrees were found. The shape of "dark" RFs was either ellipsoidal (in most cases) or round. Detector properties (orientational, directional, size and velocity selectivity) of the "dark" RFs were significantly less manifest or absent. Under photopic light adaptation the same units reorganized their RFs to well known sizes and configuration. The hypothesis is discussed of the formation of local detector RF in the visual cortex in light adaptation by selective cortical inhibition which is activated in darkness only slightly. This view is an alternative to the commonly-accepted scheme of local cortical RF formation by the hierarchical and selective excitatory convergence.     

Response histogram shapes and tuning curves: The predicted responses of several cortical cell types to drifting gratings stimuli

The responses to visual stimuli of simple cortical cells show linear spatial summation within and between their receptive field subunits. Complex cortical cells do not show this linearity. We analyzed the simulated responses to drifting sinusoidal grating stimuli of simple and of several types of complex cells. The complex cells, whose responses are seen to be half-wave rectified before pooling, have receptive fields consisting of two or more DOG (difference-of-Gaussians) shaped subunits. In both cases of stimulation by contrast-reversal gratings or drifting gratings, the cells' response as a function of spatial frequency is affected by the subunit distances 2 and the stimulation frequency . Furthermore, an increased number of subunits (a larger receptive field) yields a narrower peak tuning curve with decreased modulation depth for many of the spatial frequencies. The average and the peak response tuning curves are compared for the different receptive field types.     

Reorganization of Receptive Fields of Cortical Field 21a Neurons and Formation of Responses to Moving Visual Stimuli

Using extracellular recording of spike activity from single neurons of field 21a of the cat neocortex, we examined in detail the spatial organization of receptive fields (RFs) of such cells after conditions of presentation of an immobile blinking light spot (a static RF) and moving visual stimuli (dynamic RFs). As was shown, the excitability of different RF subfields of a group of neurons possessing homogeneous on–off organization of the static RF changes significantly depended on the contrast, shape, dimension, orientation, and direction of movement of the applied mobile visual stimulus. This is manifested in changes in the number of discharge centers and shifts of their spatial localization. A hypothesis on the possible role of synchronous activation of the neurons neighboring the cell under study in the formation of an additional neuronal mechanism providing specialization of neuronal responses is proposed.     

Types of receptive fields in the lateral geniculate body and their functional model

In the Type I receptive fields (RFs) changes of the luminance leads to a shift of the curve relating the response and the stimulus area along the abscissa, in the Type II RFs the maximum of a response does not shift with changes of the luminance (Types I and II on classification by Glezer et al., 1971, 1972). The transient responses were observed in the Type I RFs and sustained responses in the Type II RFs. In the Type I RFs variation of the stimulus area and intensity brings about the change in the temporal and spatial frequency characteristics. This is produced by functional reorganization of the RF. In the Type II RFs there is no functional reorganization. The data obtained indicate that the Type I RFs are non-linear. By contrast, the Type II RFs are linear systems. The analysis of the model has shown that the distinctions in the dynamic characteristics of the responses of RFs belonging to different types is mainly due to different time constants for excitation and inhibition as well as inhibition coefficients. Distinctions in the mode of dependence of the RF response on stimulus parameters have been found to result from different relationship between delay time and stimulus parameters as well as different forms of the spatial weighting functions. It is shown that the Type I RFs transmit higher frequency components of the image spectrum, i.e. they emphasise the temporal and spatial contrasts. The Type II RFs transmit low frequency components of the spectrum including information about the intensity of an input stimulus.