A spherical model for orientation and spatial-frequency tuning in a cortical hypercolumn

A theory is presented of the way in which the hypercolumns in primary visual cortex (V1) are organized to detect important features of visual images, namely local orientation and spatial-frequency. Given the existence in V1 of dual maps for these features, both organized around orientation pinwheels, we constructed a model of a hypercolumn in which orientation and spatial-frequency preferences are represented by the two angular coordinates of a sphere. The two poles of this sphere are taken to correspond, respectively, to high and low spatial-frequency preferences. In Part I of the paper, we use mean-field methods to derive exact solutions for localized activity states on the sphere. We show how cortical amplification through recurrent interactions generates a sharply tuned, contrast-invariant population response to both local orientation and local spatial frequency, even in the case of a weakly biased input from the lateral geniculate nucleus (LGN). A major prediction of our model is that this response is non-separable with respect to the local orientation and spatial frequency of a stimulus. That is, orientation tuning is weaker around the pinwheels, and there is a shift in spatial-frequency tuning towards that of the closest pinwheel at non-optimal orientations. In Part II of the paper, we demonstrate that a simple feed-forward model of spatial-frequency preference, unlike that for orientation preference, does not generate a faithful representation when amplified by recurrent interactions in V1. We then introduce the idea that cortico-geniculate feedback modulates LGN activity to generate a faithful representation, thus providing a new functional interpretation of the role of this feedback pathway. Using linear filter theory, we show that if the feedback from a cortical cell is taken to be approximately equal to the reciprocal of the corresponding feed-forward receptive field (in the two-dimensional Fourier domain), then the mismatch between the feed-forward and cortical frequency representations is eliminated. We therefore predict that cortico-geniculate feedback connections innervate the LGN in a pattern determined by the orientation and spatial-frequency biases of feed-forward receptive fields. Finally, we show how recurrent cortical interactions can generate cross-orientation suppression.     

Reverberation of recent visual experience in spontaneous cortical waves

Spontaneous waves of activity propagating across large cortical areas may play important roles in sensory processing and circuit refinement. However, whether these waves are in turn shaped by sensory experience remains unclear. Here we report that visually evoked cortical activity reverberates in subsequent spontaneous waves. Voltage-sensitive dye imaging in rat visual cortex shows that following repetitive presentation of a given visual stimulus, spatiotemporal activity patterns resembling the evoked response appear more frequently in the spontaneous waves. This effect is specific to the response pattern evoked by the repeated stimulus, and it persists for several minutes without further visual stimulation. Such wave-mediated reverberation could contribute to short-term memory and help to consolidate the transient effects of recent sensory experience into long-lasting cortical modifications.     

The influence of cortical feature maps on the encoding of the orientation of a short line

The inhomogeneous distribution of the receptive fields of cortical neurons influences the cortical representation of the orientation of short lines seen in visual images. We construct a model of the response of populations of neurons in the human primary visual cortex by combining realistic response properties of individual neurons and cortical maps of orientation and location preferences. The encoding error, which characterizes the difference between the parameters of a visual stimulus and their cortical representation, is calculated using Fisher information as the square root of the variance of a statistically efficient estimator. The error of encoding orientation varies considerably with the location and orientation of the short line stimulus as modulated by the underlying orientation preference map. The average encoding error depends only weakly on the structure of the orientation preference map and is much smaller than the human error of estimating orientation measured psychophysically. From this comparison we conclude that the actual mechanism of orientation perception does not make efficient use of all the information available in the neuronal responses and that it is the decoding of visual information from neuronal responses that limits psychophysical performance. Action Editor: Terrence Sejnowski     

Local non-linear interactions in the visual cortex may reflect global decorrelation

The classical receptive field in the primary visual cortex have been successfully explained by sparse activation of relatively independent units, whose tuning properties reflect the statistical dependencies in the natural environment. Robust surround modulation, emerging from stimulation beyond the classical receptive field, has been associated with increase of lifetime sparseness in the V1, but the system-wide modulation of response strength have currently no theoretical explanation. We measured fMRI responses from human visual cortex and quantified the contextual modulation with a decorrelation coefficient (d), derived from a subtractive normalization model. All active cortical areas demonstrated local non-linear summation of responses, which were in line with hypothesis of global decorrelation of voxels responses. In addition, we found sensitivity to surrounding stimulus structure across the ventral stream, and large-scale sensitivity to the number of simultaneous objects. Response sparseness across voxel population increased consistently with larger stimuli. These data suggest that contextual modulation for a stimulus event reflect optimization of the code and perhaps increase in energy efficiency throughout the ventral stream hierarchy. Our model provides a novel prediction that average suppression of response amplitude for simultaneous stimuli across the cortical network is a monotonic function of similarity of response strengths in the network when the stimuli are presented alone.     

The local and non-local components of the local field potential in awake primate visual cortex

The Local Field Potential (LFP) is the analog signal recorded from a microelectrode inserted into cortex, typically in the frequency band of approximately 1 to 200 Hz. Here visual stimuli were flashed on in the receptive fields of primary visual cortical neurons in awake behaving macaques, and both isolated single units (neurons) and the LFP signal were recorded from the same unipolar microelectrode. The fall-off of single unit activity as a visual stimulus was moved from near the center to near the edge of the receptive field paralleled the fall-off of the stimulus-locked (evoked) LFP response. This suggests that the evoked LFP strongly reflects local neuronal activity. However, the evoked LFP could be significant even when the visual stimulus was completely outside the receptive field and the single unit response had fallen to zero, although this phenomenon was variable. Some of the non-local components of the LFP may be related to the slow distributed, or non-retinotopic, LFP signal previously observed in anesthetized animals. The induced (not time-locked to stimulus onset) component of the LFP showed significant increases only for stimuli within the receptive field of the single units. While the LFP primarily reflects local neuronal activity, it can also reflect neuronal activity at more distant sites, although these non-local components are typically more variable, slower, and weaker than the local components.     

Recursive features of circular receptive fields

The distribution of excitability in retinal receptive fields may be well approximated by functions with recursive features. Physiological data do not exclude an implementation of recursive structures in the visual system. It is the most remarkable advantage of a recursive visual system, that cortical receptive fields tuned to different spatial frequencies will have an identical neuronal circuitry. Structural consequences for retina, LGN and visual cortex are discussed.     

The visual cortical association field: A Gestalt concept or a psychophysiological entity?

The receptive field of a visual neurone is classically defined as the region of space (or retina) where a visual stimulus evokes a change in its firing activity. Intracellular recordings in cat area 17 show that the visually evoked synaptic integration field extends over a much larger area than that established on the basis of spike activity. Synaptic depolarizing (dominant excitation) responses decrease in strength for stimuli that are flashed at increasing distances away from the centre of the discharge field, while their onset latency increases. A detailed spatio-temporal analysis of these electrophysiological data shows that subthreshold synaptic responses observed in the 'silent' surround of cortical receptive fields result from the intracortical spread of activation waves carried by slowly conducting horizontal axons within primary visual cortex. They also predict that a perceptual facilitation may occur when feedforward activation produced by the motion signal in the retina travels in phase in the primary visual cortex with the visually induced spread of horizontal activation. A psychophysical correlate has been obtained in humans, showing that apparent motion produced by a sequence of co-linear Gabor patches, known to preferentially activate V1 orientation selective cells, are perceived by human observers as much faster than non co-linear sequences of the same physical speed.     

Cortical Resonance Frequencies Emerge from Network Size and Connectivity

Neural oscillations occur within a wide frequency range with different brain regions exhibiting resonance-like characteristics at specific points in the spectrum. At the microscopic scale, single neurons possess intrinsic oscillatory properties, such that is not yet known whether cortical resonance is consequential to neural oscillations or an emergent property of the networks that interconnect them. Using a network model of loosely-coupled Wilson-Cowan oscillators to simulate a patch of cortical sheet, we demonstrate that the size of the activated network is inversely related to its resonance frequency. Further analysis of the parameter space indicated that the number of excitatory and inhibitory connections, as well as the average transmission delay between units, determined the resonance frequency. The model predicted that if an activated network within the visual cortex increased in size, the resonance frequency of the network would decrease. We tested this prediction experimentally using the steady-state visual evoked potential where we stimulated the visual cortex with different size stimuli at a range of driving frequencies. We demonstrate that the frequency corresponding to peak steady-state response inversely correlated with the size of the network. We conclude that although individual neurons possess resonance properties, oscillatory activity at the macroscopic level is strongly influenced by network interactions, and that the steady-state response can be used to investigate functional networks.     

Sparse Coding Models Can Exhibit Decreasing Sparseness while Learning Sparse Codes for Natural Images

The sparse coding hypothesis has enjoyed much success in predicting response properties of simple cells in primary visual cortex (V1) based solely on the statistics of natural scenes. In typical sparse coding models, model neuron activities and receptive fields are optimized to accurately represent input stimuli using the least amount of neural activity. As these networks develop to represent a given class of stimulus, the receptive fields are refined so that they capture the most important stimulus features. Intuitively, this is expected to result in sparser network activity over time. Recent experiments, however, show that stimulus-evoked activity in ferret V1 becomes less sparse during development, presenting an apparent challenge to the sparse coding hypothesis. Here we demonstrate that some sparse coding models, such as those employing homeostatic mechanisms on neural firing rates, can exhibit decreasing sparseness during learning, while still achieving good agreement with mature V1 receptive field shapes and a reasonably sparse mature network state. We conclude that observed developmental trends do not rule out sparseness as a principle of neural coding per se: a mature network can perform sparse coding even if sparseness decreases somewhat during development. To make comparisons between model and physiological receptive fields, we introduce a new nonparametric method for comparing receptive field shapes using image registration techniques.     

Inhomogeneous retino-cortical mapping is supported and stabilized with correlation-learning during self-motion

In primates, the area of primary visual cortex representing a fixed area of visual space decreases with increasing eccentricity. We identify visual situations to which this inhomogeneous retino-cortical mapping is well adapted and study their relevance during natural vision and development. We assume that cortical activations caused by stationary objects during self-motion along the direction of gaze travel on average with constant speed across the cortical surface, independent of retinal eccentricity. This is the case if the distribution of objects corresponds to an ellipsoid with the observer in its center. We apply the resulting flow field to train a simple network of pulse coding neurons with Hebbian learning and demonstrate that the density of learned receptive field centers is in close agreement with primate retino-cortical magnification. In addition, the model reproduces the increase of receptive field size and the decrease of its peak sensitivity with increasing eccentricity. Our results suggest that self-motion may have played an important role in the evolution of the visual system and that cortical magnification can be refined and stabilized by Hebbian learning mechanisms in ontogenesis under natural viewing conditions.     

Selective disruption of one Cartesian axis of cortical maps and receptive fields by deficiency in ephrin-As and structured activity

The topographic representation of visual space is preserved from retina to thalamus to cortex. We have previously shown that precise mapping of thalamocortical projections requires both molecular cues and structured retinal activity. To probe the interaction between these two mechanisms, we studied mice deficient in both ephrin-As and retinal waves. Functional and anatomical cortical maps in these mice were nearly abolished along the nasotemporal (azimuth) axis of the visual space. Both the structure of single-cell receptive fields and large-scale topography were severely distorted. These results demonstrate that ephrin-As and structured neuronal activity are two distinct pathways that mediate map formation in the visual cortex and together account almost completely for the formation of the azimuth map. Despite the dramatic disruption of azimuthal topography, the dorsoventral (elevation) map was relatively normal, indicating that the two axes of the cortical map are organized by separate mechanisms.     

A network that uses few active neurones to code visual input predicts the diverse shapes of cortical receptive fields

Computational models of primary visual cortex have demonstrated that principles of efficient coding and neuronal sparseness can explain the emergence of neurones with localised oriented receptive fields. Yet, existing models have failed to predict the diverse shapes of receptive fields that occur in nature. The existing models used a particular "soft" form of sparseness that limits average neuronal activity. Here we study models of efficient coding in a broader context by comparing soft and "bard" forms of neuronal sparseness. As a result of our analyses, we propose a novel network model for visual cortex. The model forms efficient visual representations in which the number of active neurones, rather than mean neuronal activity, is limited. This form of hard sparseness also economises cortical resources like synaptic memory and metabolic energy. Furthermore, our model accurately predicts the distribution of receptive field shapes found in the primary visual cortex of cat and monkey.     

Coding of natural scenes in primary visual cortex

Natural scene coding in ferret visual cortex was investigated using a new technique for multi-site recording of neuronal activity from the cortical surface. Surface recordings accurately reflected radially aligned layer 2/3 activity. At individual sites, evoked activity to natural scenes was weakly correlated with the local image contrast structure falling within the cells' classical receptive field. However, a population code, derived from activity integrated across cortical sites having retinotopically overlapping receptive fields, correlated strongly with the local image contrast structure. Cell responses demonstrated high lifetime sparseness, population sparseness, and high dispersal values, implying efficient neural coding in terms of information processing. These results indicate that while cells at an individual cortical site do not provide a reliable estimate of the local contrast structure in natural scenes, cell activity integrated across distributed cortical sites is closely related to this structure in the form of a sparse and dispersed code.     

Visual Interactions Conform to Pattern Decorrelation in Multiple Cortical Areas

Neural responses to visual stimuli are strongest in the classical receptive field, but they are also modulated by stimuli in a much wider region. In the primary visual cortex, physiological data and models suggest that such contextual modulation is mediated by recurrent interactions between cortical areas. Outside the primary visual cortex, imaging data has shown qualitatively similar interactions. However, whether the mechanisms underlying these effects are similar in different areas has remained unclear. Here, we found that the blood oxygenation level dependent (BOLD) signal spreads over considerable cortical distances in the primary visual cortex, further than the classical receptive field. This indicates that the synaptic activity induced by a given stimulus occurs in a surprisingly extensive network. Correspondingly, we found suppressive and facilitative interactions far from the maximum retinotopic response. Next, we characterized the relationship between contextual modulation and correlation between two spatial activation patterns. Regardless of the functional area or retinotopic eccentricity, higher correlation between the center and surround response patterns was associated with stronger suppressive interaction. In individual voxels, suppressive interaction was predominant when the center and surround stimuli produced BOLD signals with the same sign. Facilitative interaction dominated in the voxels with opposite BOLD signal signs. Our data was in unison with recently published cortical decorrelation model, and was validated against alternative models, separately in different eccentricities and functional areas. Our study provides evidence that spatial interactions among neural populations involve decorrelation of macroscopic neural activation patterns, and suggests that the basic design of the cerebral cortex houses a robust decorrelation mechanism for afferent synaptic input.     

Spontaneous symmetry-breaking energy functions and the emergence of orientation selective cortical cells

The mammalian visual cortex is comprised of hypercolumns of orientation selective cells. The developmental process by which cells are generated with receptive fields tuned to a variety of orientations has so far remained a mystery. We present a model for the production of orientation selective cells that requires no external stimuli and a minimum of input parameters. The process involves spontaneous symmetry-breaking in an energy function that governs the maturation of the cortical cells in a multi-layer network of Hebb-type feedforward neurons. An important feature is that the symmetry breaking occurs for each cell separately and is not due to global organizing effects. We present examples of receptive field profiles calculated with the symmetry-breaking procedure and note that the results seem robust and may be useful in the study of development in several types of cortical cells. The inclusion of long range lateral (intra-layer) correlations in the energy function could result in the development of cell groups with correlated preferred orientations that resemble the hypercolumns seen in the visual cortex.     

The mechanisms for compression and reflection of cortical waves

Waves are common in cortical networks and may be important for carrying information about a stimulus from one local circuit to another. In a recent study of visually evoked waves in rat cortex, compression and reflection of waves are observed as the activation passes from visual areas V1 to V2. The authors of this study apply bicuculline (BMI) and demonstrate that the reflection disappears. They conclude that inhibition plays a major role in compression and reflection. We present several models for propagating waves in heterogeneous media and show that the velocity and thus compression depends weakly on inhibition. We propose that the main site of action of BMI with respect to wave propagation is on the threshold for firing which we suggest is related to action on potassium channels. We combine numerical and analytic methods to explore both compression and reflection in an excitable system with synaptic coupling.     

Spectral Characteristics of Phase Sensitivity and Discharge Rate of Neurons in the Ascending Tectofugal Visual System

Drifting gratings can modulate the activity of visual neurons at the temporal frequency of the stimulus. In order to characterize the temporal frequency modulation in the cat’s ascending tectofugal visual system, we recorded the activity of single neurons in the superior colliculus, the suprageniculate nucleus, and the anterior ectosylvian cortex during visual stimulation with drifting sine-wave gratings. In response to such stimuli, neurons in each structure showed an increase in firing rate and/or oscillatory modulated firing at the temporal frequency of the stimulus (phase sensitivity). To obtain a more complete characterization of the neural responses in spatiotemporal frequency domain, we analyzed the mean firing rate and the strength of the oscillatory modulations measured by the standardized Fourier component of the response at the temporal frequency of the stimulus. We show that the spatiotemporal stimulus parameters that elicit maximal oscillations often differ from those that elicit a maximal discharge rate. Furthermore, the temporal modulation and discharge-rate spectral receptive fields often do not overlap, suggesting that the detection range for visual stimuli provided jointly by modulated and unmodulated response components is larger than the range provided by a one response component.     

A neuronal network model of primary visual cortex explains spatial frequency selectivity

We address how spatial frequency selectivity arises in Macaque primary visual cortex (V1) by simulating V1 with a large-scale network model consisting of O(10⁴) excitatory and inhibitory integrate-and-fire neurons with realistic synaptic conductances. The new model introduces variability of the widths of subregions in V1 neuron receptive fields. As a consequence different model V1 neurons prefer different spatial frequencies. The model cortex has distributions of spatial frequency selectivity and of preference that resemble experimental findings from the real V1. Two main sources of spatial frequency selectivity in the model are the spatial arrangement of feedforward excitation, and cortical nonlinear suppression, a result of cortical inhibition. Action Editor: Jonathan D. Victor     

Mathematical modeling and parameter estimation of axonal cargo transport

This paper is about how cortical recurrent interactions in primary visual cortex (V1) together with feedback from extrastriate cortex can account for spectral peaks in the V1 local field potential (LFP). Recent studies showed that visual stimulation enhances the γ-band (25–90 Hz) of the LFP power spectrum in macaque V1. The height and location of the γ-band peak in the LFP spectrum were correlated with visual stimulus size. Extensive spatial summation, possibly mediated by feedback connections from extrastriate cortex and long-range horizontal connections in V1, must play a crucial role in the size dependence of the LFP. To analyze stimulus-effects on the LFP of V1 cortex, we propose a network model for the visual cortex that includes two populations of V1 neurons, excitatory and inhibitory, and also includes feedback to V1 from extrastriate cortex. The neural network model for V1 was a resonant system. The model’s resonance frequency (ResF) was in the γ-band and varied up or down in frequency depending on cortical feedback. The model’s ResF shifted downward with stimulus size, as in the real cortex, because increased size recruited more activity in extrastriate cortex and V1 thereby causing stronger feedback. The model needed to have strong local recurrent inhibition within V1 to obtain ResFs that agree with cortical data. Network resonance as a consequence of recurrent excitation and inhibition appears to be a likely explanation for γ-band peaks in the LFP power spectrum of the primary visual cortex.