Integrate-and-fire vs Poisson models of LGN input to V1 cortex: noisier inputs reduce orientation selectivity

One of the reasons the visual cortex has attracted the interest of computational neuroscience is that it has well-defined inputs. The lateral geniculate nucleus (LGN) of the thalamus is the source of visual signals to the primary visual cortex (V1). Most large-scale cortical network models approximate the spike trains of LGN neurons as simple Poisson point processes. However, many studies have shown that neurons in the early visual pathway are capable of spiking with high temporal precision and their discharges are not Poisson-like. To gain an understanding of how response variability in the LGN influences the behavior of V1, we study response properties of model V1 neurons that receive purely feedforward inputs from LGN cells modeled either as noisy leaky integrate-and-fire (NLIF) neurons or as inhomogeneous Poisson processes. We first demonstrate that the NLIF model is capable of reproducing many experimentally observed statistical properties of LGN neurons. Then we show that a V1 model in which the LGN input to a V1 neuron is modeled as a group of NLIF neurons produces higher orientation selectivity than the one with Poisson LGN input. The second result implies that statistical characteristics of LGN spike trains are important for V1’s function. We conclude that physiologically motivated models of V1 need to include more realistic LGN spike trains that are less noisy than inhomogeneous Poisson processes.     

A visual thalamocortical slice

We describe a thalamocortical slice preparation in which connectivity between the mouse lateral geniculate nucleus (LGN) and primary visual cortex (V1) is preserved. Through DiI injections in fixed brains we traced and created a three-dimensional model of the mouse visual pathways. From this computer model we designed a slice preparation that contains a projection from LGN to V1. We prepared brain slices with these predicted coordinates and demonstrated anatomical LGN-V1 connectivity in these slices after LGN tracer injections. We also revealed functional LGN-V1 connectivity by stimulating LGN electrically and detecting responses in layer 4 of V1 using calcium imaging, field potential recordings and whole-cell recordings. We also identified layer-4 neurons that receive direct thalamocortical input. Finally, we compared cortical activity after LGN stimulation with spontaneous cortical activity and found significant overlap of the spatiotemporal dynamics generated by both types of events.     

A reaction-diffusion model to capture disparity selectivity in primary visual cortex

Decades of experimental studies are available on disparity selective cells in visual cortex of macaque and cat. Recently, local disparity map for iso-orientation sites for near-vertical edge preference is reported in area 18 of cat visual cortex. No experiment is yet reported on complete disparity map in V1. Disparity map for layer IV in V1 can provide insight into how disparity selective complex cell receptive field is organized from simple cell subunits. Though substantial amounts of experimental data on disparity selective cells is available, no model on receptive field development of such cells or disparity map development exists in literature. We model disparity selectivity in layer IV of cat V1 using a reaction-diffusion two-eye paradigm. In this model, the wiring between LGN and cortical layer IV is determined by resource an LGN cell has for supporting connections to cortical cells and competition for target space in layer IV. While competing for target space, the same type of LGN cells, irrespective of whether it belongs to left-eye-specific or right-eye-specific LGN layer, cooperate with each other while trying to push off the other type. Our model captures realistic 2D disparity selective simple cell receptive fields, their response properties and disparity map along with orientation and ocular dominance maps. There is lack of correlation between ocular dominance and disparity selectivity at the cell population level. At the map level, disparity selectivity topography is not random but weakly clustered for similar preferred disparities. This is similar to the experimental result reported for macaque. The details of weakly clustered disparity selectivity map in V1 indicate two types of complex cell receptive field organization.     

Combined Hebbian development of geniculocortical and lateral connectivity in a model of primary visual cortex

We present a network model of visual map development in layer 4 of primary visual cortex. Our model comprises excitatory and inhibitory spiking neurons. The input to the network consists of correlated spike trains to mimick the activity of neurons in the lateral geniculate nucleus (LGN). An activity-driven Hebbian learning mechanism governs the development of both the network's lateral connectivity and feedforward projections from LGN to cortex. Plasticity of inhibitory synapses has been included into the model so as to control overall cortical activity. Even without feedforward input, Hebbian modification of the excitatory lateral connections can lead to the development of an intracortical orientation map. We have found that such an intracortical map can guide the development of feedforward connections from LGN to cortical simple cells so that the structure of the final feedforward orientation map is predetermined by the intracortical map. In a scenario in which left- and right-eye geniculocortical inputs develop sequentially one after the other, the resulting maps are therefore very similar, provided the intracortical connectivity remains unaltered. This may explain the outcome of so-called reverse lid-suture experiments, where animals are reared so that both eyes never receive input at the same time, but the orientation maps measured separately for the two eyes are nevertheless nearly identical. Received: 20 December 1999 / Accepted in revised form: 9 June 2000     

A cooperation and competition based simple cell receptive field model and study of feed-forward linear and nonlinear contributions to orientation selectivity

We present a model for development of orientation selectivity in layer IV simple cells. Receptive field (RF) development in the model, is determined by diffusive cooperation and resource limited competition guided axonal growth and retraction in geniculocortical pathway. The simulated cortical RFs resemble experimental RFs. The receptive field model is incorporated in a three-layer visual pathway model consisting of retina, LGN and cortex. We have studied the effect of activity dependent synaptic scaling on orientation tuning of cortical cells. The mean value of hwhh (half width at half the height of maximum response) in simulated cortical cells is 58° when we consider only the linear excitatory contribution from LGN. We observe a mean improvement of 22.8° in tuning response due to the non-linear spiking mechanisms that include effects of threshold voltage and synaptic scaling factor.     

Predictive Feedback Can Account for Biphasic Responses in the Lateral Geniculate Nucleus

Biphasic neural response properties, where the optimal stimulus for driving a neural response changes from one stimulus pattern to the opposite stimulus pattern over short periods of time, have been described in several visual areas, including lateral geniculate nucleus (LGN), primary visual cortex (V1), and middle temporal area (MT). We describe a hierarchical model of predictive coding and simulations that capture these temporal variations in neuronal response properties. We focus on the LGN-V1 circuit and find that after training on natural images the model exhibits the brain's LGN-V1 connectivity structure, in which the structure of V1 receptive fields is linked to the spatial alignment and properties of center-surround cells in the LGN. In addition, the spatio-temporal response profile of LGN model neurons is biphasic in structure, resembling the biphasic response structure of neurons in cat LGN. Moreover, the model displays a specific pattern of influence of feedback, where LGN receptive fields that are aligned over a simple cell receptive field zone of the same polarity decrease their responses while neurons of opposite polarity increase their responses with feedback. This phase-reversed pattern of influence was recently observed in neurophysiology. These results corroborate the idea that predictive feedback is a general coding strategy in the brain.     

A neural network model of attention-modulated neurodynamics

Visual attention appears to modulate cortical neurodynamics and synchronization through various cholinergic mechanisms. In order to study these mechanisms, we have developed a neural network model of visual cortex area V4, based on psychophysical, anatomical and physiological data. With this model, we want to link selective visual information processing to neural circuits within V4, bottom-up sensory input pathways, top-down attention input pathways, and to cholinergic modulation from the prefrontal lobe. We investigate cellular and network mechanisms underlying some recent analytical results from visual attention experimental data. Our model can reproduce the experimental findings that attention to a stimulus causes increased gamma-frequency synchronization in the superficial layers. Computer simulations and STA power analysis also demonstrate different effects of the different cholinergic attention modulation action mechanisms.     

Computational Modeling of Orientation Tuning Dynamics in Monkey Primary Visual Cortex

In the primate visual pathway, orientation tuning of neurons is first observed in the primary visual cortex. The LGN cells that comprise the thalamic input to V1 are not orientation tuned, but some V1 neurons are quite selective. Two main classes of theoretical models have been offered to explain orientation selectivity: feedforward models, in which inputs from spatially aligned LGN cells are summed together by one cortical neuron; and feedback models, in which an initial weak orientation bias due to convergent LGN input is sharpened and amplified by intracortical feedback. Recent data on the dynamics of orientation tuning, obtained by a cross-correlation technique, may help to distinguish between these classes of models. To test this possibility, we simulated the measurement of orientation tuning dynamics on various receptive field models, including a simple Hubel-Wiesel type feedforward model: a linear spatiotemporal filter followed by an integrate-and-fire spike generator. The computational study reveals that simple feedforward models may account for some aspects of the experimental data but fail to explain many salient features of orientation tuning dynamics in V1 cells. A simple feedback model of interacting cells is also considered. This model is successful in explaining the appearance of Mexican-hat orientation profiles, but other features of the data continue to be unexplained.     

A spherical model for orientation and spatial-frequency tuning in a cortical hypercolumn

A theory is presented of the way in which the hypercolumns in primary visual cortex (V1) are organized to detect important features of visual images, namely local orientation and spatial-frequency. Given the existence in V1 of dual maps for these features, both organized around orientation pinwheels, we constructed a model of a hypercolumn in which orientation and spatial-frequency preferences are represented by the two angular coordinates of a sphere. The two poles of this sphere are taken to correspond, respectively, to high and low spatial-frequency preferences. In Part I of the paper, we use mean-field methods to derive exact solutions for localized activity states on the sphere. We show how cortical amplification through recurrent interactions generates a sharply tuned, contrast-invariant population response to both local orientation and local spatial frequency, even in the case of a weakly biased input from the lateral geniculate nucleus (LGN). A major prediction of our model is that this response is non-separable with respect to the local orientation and spatial frequency of a stimulus. That is, orientation tuning is weaker around the pinwheels, and there is a shift in spatial-frequency tuning towards that of the closest pinwheel at non-optimal orientations. In Part II of the paper, we demonstrate that a simple feed-forward model of spatial-frequency preference, unlike that for orientation preference, does not generate a faithful representation when amplified by recurrent interactions in V1. We then introduce the idea that cortico-geniculate feedback modulates LGN activity to generate a faithful representation, thus providing a new functional interpretation of the role of this feedback pathway. Using linear filter theory, we show that if the feedback from a cortical cell is taken to be approximately equal to the reciprocal of the corresponding feed-forward receptive field (in the two-dimensional Fourier domain), then the mismatch between the feed-forward and cortical frequency representations is eliminated. We therefore predict that cortico-geniculate feedback connections innervate the LGN in a pattern determined by the orientation and spatial-frequency biases of feed-forward receptive fields. Finally, we show how recurrent cortical interactions can generate cross-orientation suppression.     

Mathematical modeling and parameter estimation of axonal cargo transport

This paper is about how cortical recurrent interactions in primary visual cortex (V1) together with feedback from extrastriate cortex can account for spectral peaks in the V1 local field potential (LFP). Recent studies showed that visual stimulation enhances the γ-band (25–90 Hz) of the LFP power spectrum in macaque V1. The height and location of the γ-band peak in the LFP spectrum were correlated with visual stimulus size. Extensive spatial summation, possibly mediated by feedback connections from extrastriate cortex and long-range horizontal connections in V1, must play a crucial role in the size dependence of the LFP. To analyze stimulus-effects on the LFP of V1 cortex, we propose a network model for the visual cortex that includes two populations of V1 neurons, excitatory and inhibitory, and also includes feedback to V1 from extrastriate cortex. The neural network model for V1 was a resonant system. The model’s resonance frequency (ResF) was in the γ-band and varied up or down in frequency depending on cortical feedback. The model’s ResF shifted downward with stimulus size, as in the real cortex, because increased size recruited more activity in extrastriate cortex and V1 thereby causing stronger feedback. The model needed to have strong local recurrent inhibition within V1 to obtain ResFs that agree with cortical data. Network resonance as a consequence of recurrent excitation and inhibition appears to be a likely explanation for γ-band peaks in the LFP power spectrum of the primary visual cortex.     

Seeing invisible motion: a human FMRI study

A common view about visual consciousness is that it could arise when and where activity reaches some higher level of processing along the cortical hierarchy. Reports showing that activity in striate cortex can be dissociated from awareness , whereas the latter modulates activity in higher areas , point in this direction. In the specific case of visual motion, a central, "perceptual" role has been assigned to area V5: several human and monkey studies have shown V5 activity to correlate with the motion percept. Here we show that activity in this and other higher cortical areas can be also dissociated from perception and follow the physical stimulus instead. The motion information in a peripheral grating modulated fMRI responses, despite being invisible to human volunteers: under crowding conditions , areas V3A, V5, and parietal cortex still showed increased activity when the grating was moving compared to when it was flickering. We conclude that stimulus-specific activation of higher cortical areas does not necessarily result in awareness of the underlying stimulus.     

A neural network model for the self-organization of cortical grating cells

A neural network model with incremental Hebbian learning of afferent and lateral synaptic couplings is proposed,which simulates the activity-dependent self-organization of grating cells in upper layers of striate cortex. These cells, found in areas V1 and V2 of the visual cortex of monkeys, respond vigorously and exclusively to bar gratings of a preferred orientation and periodicity. Response behavior to varying contrast and to an increasing number of bars in the grating show threshold and saturation effects. Their location with respect to the underlying orientation map and their nonlinear response behavior are investigated. The number of emerging grating cells is controlled in the model by the range and strength of the lateral coupling structure.     

Low response variability in simultaneously recorded retinal, thalamic, and cortical neurons

The response of a cortical cell to a repeated stimulus can be highly variable from one trial to the next. Much lower variability has been reported of retinal cells. We recorded visual responses simultaneously from three successive stages of the cat visual system: retinal ganglion cells (RGCs), thalamic (LGN) relay cells, and simple cells in layer 4 of primary visual cortex. Spike count variability was lower than that of a Poisson process at all three stages but increased at each stage. Absolute and relative refractory periods largely accounted for the reliability at all three stages. Our results show that cortical responses can be more reliable than previously thought. The differences in reliability in retina, LGN, and cortex can be explained by (1) decreasing firing rates and (2) decreasing absolute and relative refractory periods.     

Learning receptive field properties of complex cells in V1

There are two distinct classes of cells in the primary visual cortex (V1): simple cells and complex cells. One defining feature of complex cells is their spatial phase invariance; they respond strongly to oriented grating stimuli with a preferred orientation but with a wide range of spatial phases. A classical model of complete spatial phase invariance in complex cells is the energy model, in which the responses are the sum of the squared outputs of two linear spatially phase-shifted filters. However, recent experimental studies have shown that complex cells have a diverse range of spatial phase invariance and only a subset can be characterized by the energy model. While several models have been proposed to explain how complex cells could learn to be selective to orientation but invariant to spatial phase, most existing models overlook many biologically important details. We propose a biologically plausible model for complex cells that learns to pool inputs from simple cells based on the presentation of natural scene stimuli. The model is a three-layer network with rate-based neurons that describes the activities of LGN cells (layer 1), V1 simple cells (layer 2), and V1 complex cells (layer 3). The first two layers implement a recently proposed simple cell model that is biologically plausible and accounts for many experimental phenomena. The neural dynamics of the complex cells is modeled as the integration of simple cells inputs along with response normalization. Connections between LGN and simple cells are learned using Hebbian and anti-Hebbian plasticity. Connections between simple and complex cells are learned using a modified version of the Bienenstock, Cooper, and Munro (BCM) rule. Our results demonstrate that the learning rule can describe a diversity of complex cells, similar to those observed experimentally.     

Parvalbumin-expressing interneurons linearly transform cortical responses to visual stimuli

The response of cortical neurons to a sensory stimulus is shaped by the network in which they are embedded. Here we establish a role of parvalbumin (PV)-expressing cells, a large class of inhibitory neurons that target the soma and perisomatic compartments of pyramidal cells, in controlling cortical responses. By bidirectionally manipulating PV cell activity in visual cortex we show that these neurons strongly modulate layer 2/3 pyramidal cell spiking responses to visual stimuli while only modestly affecting their tuning properties. PV cells' impact on pyramidal cells is captured by a linear transformation, both additive and multiplicative, with a threshold. These results indicate that PV cells are ideally suited to modulate cortical gain and establish a causal relationship between a select neuron type and specific computations performed by the cortex during sensory processing.     

The emergence of contrast-invariant orientation tuning in simple cells of cat visual cortex

Simple cells in primary visual cortex exhibit contrast-invariant orientation tuning, in seeming contradiction to feed-forward models that rely on lateral geniculate nucleus (LGN) input alone. Contrast invariance has therefore been thought to depend on the presence of intracortical lateral inhibition. In vivo intracellular recordings instead suggest that contrast invariance can be explained by three properties of the excitatory pathway. (1) Depolarizations evoked by orthogonal stimuli are determined by the amount of excitation a cell receives from the LGN, relative to the excitation it receives from other cortical cells. (2) Depolarizations evoked by preferred stimuli saturate at lower contrasts than the spike output of LGN relay cells. (3) Visual stimuli evoke contrast-dependent changes in trial-to-trial variability, which lead to contrast-dependent changes in the relationship between membrane potential and spike rate. Thus, high-contrast, orthogonally oriented stimuli that evoke significant depolarizations evoke few spikes. Together these mechanisms, without lateral inhibition, can account for contrast-invariant stimulus selectivity.     

S cone contributions to the magnocellular visual pathway in macaque monkey

The magnocellular visual pathway is believed to receive input from long (L) and middle (M), but not short (S), wavelength-sensitive cones. Recording from neurons in magnocellular layers of lateral geniculate nucleus (LGN) in macaque monkeys, we found that magnocellular neurons were unequivocally responsive to S cone-isolating stimuli. A quantitative analysis suggests that S cones provided about 10% of the input to these cells, on average, while L:M ratios were far more variable. S cone signals influenced responses with the same sign as L and M cone inputs (i.e., no color opponency). Magnocellular afferent recordings following inactivation of primary visual cortex demonstrated that S cone signals were feedforward in nature and did not arise from cortical feedback to LGN     

Reciprocal inhibition and slow calcium decay in perigeniculate interneurons explain changes of spontaneous firing of thalamic cells caused by cortical inactivation

The role of cortical feedback in the thalamocortical processing loop has been extensively investigated over the last decades. With an exception of several cases, these searches focused on the cortical feedback exerted onto thalamo-cortical relay (TC) cells of the dorsal lateral geniculate nucleus (LGN). In a previous, physiological study, we showed in the cat visual system that cessation of cortical input, despite decrease of spontaneous activity of TC cells, increased spontaneous firing of their recurrent inhibitory interneurons located in the perigeniculate nucleus (PGN). To identify mechanisms underlying such functional changes we conducted a modeling study in NEURON on several networks of point neurons with varied model parameters, such as membrane properties, synaptic weights and axonal delays. We considered six network topologies of the retino-geniculo-cortical system. All models were robust against changes of axonal delays except for the delay between the LGN feed-forward interneuron and the TC cell. The best representation of physiological results was obtained with models containing reciprocally connected PGN cells driven by the cortex and with relatively slow decay of intracellular calcium. This strongly indicates that the thalamic reticular nucleus plays an essential role in the cortical influence over thalamo-cortical relay cells while the thalamic feed-forward interneurons are not essential in this process. Further, we suggest that the dependence of the activity of PGN cells on the rate of calcium removal can be one of the key factors determining individual cell response to elimination of cortical input.     

Determination of the fraction of active inputs required by a neuron to fire

What fraction of the inputs to a neuron in the primary visual cortex (V1) need to be active for that neuron to reach its firing threshold? The paper describes a numerical method for estimating the selectivity of visual neurons, in terms of the required fraction of active excitatory inputs, from standard data produced by intracellular electro-physiological recordings. The method also provides an estimate of the relative strength of the feedforward inhibition in a push-pull model of the inputs to V1 simple cells. The method is tested on two V1 cells described in Carandini and Ferster [Carandini, M., Ferster, D., 2000. Membrane potential and firing rate in cat primary visual cortex. J. Neurosci. 20, 470-484]. The results indicate that the maximum strength of feedforward inhibition is around 30% of the maximum strength of feedforward excitation. The two V1 neurons investigated fire if more than around 40% of their excitatory LGN inputs are active.     

Dynamics of orientation selectivity in the primary visual cortex and the importance of cortical inhibition

To test theories of orientation selectivity in primary visual cortex (V1), we have done experiments to measure the dynamics of orientation tuning of single neurons in the V1 cortex of macaque monkeys. Based on our dynamics results, we propose that a V1 cell's orientation selectivity is generated mainly by both tuned enhancement and global suppression. Enhancement near the preferred orientation is probably caused by feed-forward input from LGN (plus amplification by cortical-cortical interaction). Global suppression could be supplied by cortical inhibition. Additionally, in about 1/3 of V1 neurons (usually the most sharply tuned) there is tuned suppression, centered near the cell's preferred orientation but broader than tuned enhancement. These mechanisms also can explain important features of steady-state selectivity in the V1 neuron population. Furthermore, similar neuronal mechanisms may be used generally throughout the cerebral cortex.