Computational Modeling of Orientation Tuning Dynamics in Monkey Primary Visual Cortex

In the primate visual pathway, orientation tuning of neurons is first observed in the primary visual cortex. The LGN cells that comprise the thalamic input to V1 are not orientation tuned, but some V1 neurons are quite selective. Two main classes of theoretical models have been offered to explain orientation selectivity: feedforward models, in which inputs from spatially aligned LGN cells are summed together by one cortical neuron; and feedback models, in which an initial weak orientation bias due to convergent LGN input is sharpened and amplified by intracortical feedback. Recent data on the dynamics of orientation tuning, obtained by a cross-correlation technique, may help to distinguish between these classes of models. To test this possibility, we simulated the measurement of orientation tuning dynamics on various receptive field models, including a simple Hubel-Wiesel type feedforward model: a linear spatiotemporal filter followed by an integrate-and-fire spike generator. The computational study reveals that simple feedforward models may account for some aspects of the experimental data but fail to explain many salient features of orientation tuning dynamics in V1 cells. A simple feedback model of interacting cells is also considered. This model is successful in explaining the appearance of Mexican-hat orientation profiles, but other features of the data continue to be unexplained.     

The role of cortical feedback in the generation of the temporal receptive field responses of lateral geniculate nucleus neurons: a computational modelling study

The influence of cortical feedback on thalamic visual responses has been a source of much discussion in recent years. In this study we examine the possible role of cortical feedback in shaping the spatiotemporal receptive field (STRF) responses of thalamocortical (TC) cells in the lateral geniculate nucleus (LGN) of the thalamus. A population-based computational model of the thalamocortical network is used to generate a representation of the STRF response of LGN TC cells within the corticothalamic feedback circuit. The cortical feedback is shown to have little influence on the spatial response properties of the STRF organization. However, the model suggests that cortical feedback may play a key role in modifying the experimentally observed biphasic temporal response property of the STRF, that is, the reversal over time of the polarity of ON and OFF responses of the centre and surround of the receptive field, in particular accounting for the experimentally observed mismatch between retinal cells and TC cells in respect of the magnitude of the second (rebound) phase of the temporal response. The model results also show that this mismatch may result from an anti-phase corticothalamic feedback mechanism.     

A reaction-diffusion model to capture disparity selectivity in primary visual cortex

Decades of experimental studies are available on disparity selective cells in visual cortex of macaque and cat. Recently, local disparity map for iso-orientation sites for near-vertical edge preference is reported in area 18 of cat visual cortex. No experiment is yet reported on complete disparity map in V1. Disparity map for layer IV in V1 can provide insight into how disparity selective complex cell receptive field is organized from simple cell subunits. Though substantial amounts of experimental data on disparity selective cells is available, no model on receptive field development of such cells or disparity map development exists in literature. We model disparity selectivity in layer IV of cat V1 using a reaction-diffusion two-eye paradigm. In this model, the wiring between LGN and cortical layer IV is determined by resource an LGN cell has for supporting connections to cortical cells and competition for target space in layer IV. While competing for target space, the same type of LGN cells, irrespective of whether it belongs to left-eye-specific or right-eye-specific LGN layer, cooperate with each other while trying to push off the other type. Our model captures realistic 2D disparity selective simple cell receptive fields, their response properties and disparity map along with orientation and ocular dominance maps. There is lack of correlation between ocular dominance and disparity selectivity at the cell population level. At the map level, disparity selectivity topography is not random but weakly clustered for similar preferred disparities. This is similar to the experimental result reported for macaque. The details of weakly clustered disparity selectivity map in V1 indicate two types of complex cell receptive field organization.     

Reciprocal inhibition and slow calcium decay in perigeniculate interneurons explain changes of spontaneous firing of thalamic cells caused by cortical inactivation

The role of cortical feedback in the thalamocortical processing loop has been extensively investigated over the last decades. With an exception of several cases, these searches focused on the cortical feedback exerted onto thalamo-cortical relay (TC) cells of the dorsal lateral geniculate nucleus (LGN). In a previous, physiological study, we showed in the cat visual system that cessation of cortical input, despite decrease of spontaneous activity of TC cells, increased spontaneous firing of their recurrent inhibitory interneurons located in the perigeniculate nucleus (PGN). To identify mechanisms underlying such functional changes we conducted a modeling study in NEURON on several networks of point neurons with varied model parameters, such as membrane properties, synaptic weights and axonal delays. We considered six network topologies of the retino-geniculo-cortical system. All models were robust against changes of axonal delays except for the delay between the LGN feed-forward interneuron and the TC cell. The best representation of physiological results was obtained with models containing reciprocally connected PGN cells driven by the cortex and with relatively slow decay of intracellular calcium. This strongly indicates that the thalamic reticular nucleus plays an essential role in the cortical influence over thalamo-cortical relay cells while the thalamic feed-forward interneurons are not essential in this process. Further, we suggest that the dependence of the activity of PGN cells on the rate of calcium removal can be one of the key factors determining individual cell response to elimination of cortical input.     

Dynamics of orientation selectivity in the primary visual cortex and the importance of cortical inhibition

To test theories of orientation selectivity in primary visual cortex (V1), we have done experiments to measure the dynamics of orientation tuning of single neurons in the V1 cortex of macaque monkeys. Based on our dynamics results, we propose that a V1 cell's orientation selectivity is generated mainly by both tuned enhancement and global suppression. Enhancement near the preferred orientation is probably caused by feed-forward input from LGN (plus amplification by cortical-cortical interaction). Global suppression could be supplied by cortical inhibition. Additionally, in about 1/3 of V1 neurons (usually the most sharply tuned) there is tuned suppression, centered near the cell's preferred orientation but broader than tuned enhancement. These mechanisms also can explain important features of steady-state selectivity in the V1 neuron population. Furthermore, similar neuronal mechanisms may be used generally throughout the cerebral cortex.     

Development of spatial coarse-to-fine processing in the visual pathway

The sequential analysis of information in a coarse-to-fine manner is a fundamental mode of processing in the visual pathway. Spatial frequency (SF) tuning, arguably the most fundamental feature of spatial vision, provides particular intuition within the coarse-to-fine framework: low spatial frequencies convey global information about an image (e.g., general orientation), while high spatial frequencies carry more detailed information (e.g., edges). In this paper, we study the development of cortical spatial frequency tuning. As feedforward input from the lateral geniculate nucleus (LGN) has been shown to have significant influence on cortical coarse-to-fine processing, we present a firing-rate based thalamocortical model which includes both feedforward and feedback components. We analyze the relationship between various model parameters (including cortical feedback strength) and responses. We confirm the importance of the antagonistic relationship between the center and surround responses in thalamic relay cell receptive fields (RFs), and further characterize how specific structural LGN RF parameters affect cortical coarse-to-fine processing. Our results also indicate that the effect of cortical feedback on spatial frequency tuning is age-dependent: in particular, cortical feedback more strongly affects coarse-to-fine processing in kittens than in adults. We use our results to propose an experimentally testable hypothesis for the function of the extensive feedback in the corticothalamic circuit.     

The functional geometry of local and horizontal connections in a model of V1.

A mathematical model of interacting hypercolumns in primary visual cortex (V1) is presented that incorporates details concerning the geometry of local and long-range horizontal connections. Each hypercolumn is modeled as a network of interacting excitatory and inhibitory neural populations with orientation and spatial frequency preferences organized around a pair of pinwheels. The pinwheels are arranged on a planar lattice, reflecting the crystalline-like structure of cortex. Local interactions within a hypercolumn generate orientation and spatial frequency tuning curves, which are modulated by horizontal connections between different hypercolumns on the lattice. The symmetry properties of the local and long-range connections play an important role in determining the types of spontaneous activity patterns that can arise in cortex.     

Predictive Feedback Can Account for Biphasic Responses in the Lateral Geniculate Nucleus

Biphasic neural response properties, where the optimal stimulus for driving a neural response changes from one stimulus pattern to the opposite stimulus pattern over short periods of time, have been described in several visual areas, including lateral geniculate nucleus (LGN), primary visual cortex (V1), and middle temporal area (MT). We describe a hierarchical model of predictive coding and simulations that capture these temporal variations in neuronal response properties. We focus on the LGN-V1 circuit and find that after training on natural images the model exhibits the brain's LGN-V1 connectivity structure, in which the structure of V1 receptive fields is linked to the spatial alignment and properties of center-surround cells in the LGN. In addition, the spatio-temporal response profile of LGN model neurons is biphasic in structure, resembling the biphasic response structure of neurons in cat LGN. Moreover, the model displays a specific pattern of influence of feedback, where LGN receptive fields that are aligned over a simple cell receptive field zone of the same polarity decrease their responses while neurons of opposite polarity increase their responses with feedback. This phase-reversed pattern of influence was recently observed in neurophysiology. These results corroborate the idea that predictive feedback is a general coding strategy in the brain.     

Top-Down Inputs Enhance Orientation Selectivity in Neurons of the Primary Visual Cortex during Perceptual Learning

Perceptual learning has been used to probe the mechanisms of cortical plasticity in the adult brain. Feedback projections are ubiquitous in the cortex, but little is known about their role in cortical plasticity. Here we explore the hypothesis that learning visual orientation discrimination involves learning-dependent plasticity of top-down feedback inputs from higher cortical areas, serving a different function from plasticity due to changes in recurrent connections within a cortical area. In a Hodgkin-Huxley-based spiking neural network model of visual cortex, we show that modulation of feedback inputs to V1 from higher cortical areas results in shunting inhibition in V1 neurons, which changes the response properties of V1 neurons. The orientation selectivity of V1 neurons is enhanced without changing orientation preference, preserving the topographic organizations in V1. These results provide new insights to the mechanisms of plasticity in the adult brain, reconciling apparently inconsistent experiments and providing a new hypothesis for a functional role of the feedback connections.     

Extended difference-of-Gaussians model incorporating cortical feedback for relay cells in the lateral geniculate nucleus of cat

A striking feature of the organization of the early visual pathway is the significant feedback from primary visual cortex to cells in the dorsal lateral geniculate nucleus (LGN). Despite numerous experimental and modeling studies, the functional role for this feedback remains elusive. We present a new firing-rate-based model for LGN relay cells in cat, explicitly accounting for thalamocortical loop effects. The established DOG model, here assumed to account for the spatial aspects of the feedforward processing of visual stimuli, is extended to incorporate the influence of thalamocortical loops including a full set of orientation-selective cortical cell populations. Assuming a phase-reversed push-pull arrangement of ON and OFF cortical feedback as seen experimentally, this extended DOG (eDOG) model exhibits linear firing properties despite non-linear firing characteristics of the corticothalamic cells. The spatiotemporal receptive field of the eDOG model has a simple algebraic structure in Fourier space, while the real-space receptive field, as well as responses to visual stimuli, are found by evaluation of an integral. As an example application we use the eDOG model to study effects of cortical feedback on responses to flashing circular spots and patch-grating stimuli and find that the eDOG model can qualitatively account for experimental findings.     

Origin and dynamics of extraclassical suppression in the lateral geniculate nucleus of the macaque monkey

In addition to the classical, center/surround receptive field of neurons in the lateral geniculate nucleus (LGN), there is an extraclassical, nonlinear surround that can strongly suppress LGN responses. This form of suppression likely plays an important role in adjusting the gain of LGN responses to visual stimuli. We performed experiments in alert and anesthetized macaque monkies to quantify extraclassical suppression in the LGN and determine the roles of feedforward and feedback pathways in the generation of LGN suppression. Results show that suppression is significantly stronger among magnocellular neurons than parvocellular neurons and that suppression arises too quickly for involvement from cortical feedback. Furthermore, the amount of suppression supplied by the retina is not significantly different from that in the LGN. These results indicate that extraclassical suppression in the macaque LGN relies on feedforward mechanisms and suggest that suppression in the cortex likely includes a component established in the retina.     

A cooperation and competition based simple cell receptive field model and study of feed-forward linear and nonlinear contributions to orientation selectivity

We present a model for development of orientation selectivity in layer IV simple cells. Receptive field (RF) development in the model, is determined by diffusive cooperation and resource limited competition guided axonal growth and retraction in geniculocortical pathway. The simulated cortical RFs resemble experimental RFs. The receptive field model is incorporated in a three-layer visual pathway model consisting of retina, LGN and cortex. We have studied the effect of activity dependent synaptic scaling on orientation tuning of cortical cells. The mean value of hwhh (half width at half the height of maximum response) in simulated cortical cells is 58° when we consider only the linear excitatory contribution from LGN. We observe a mean improvement of 22.8° in tuning response due to the non-linear spiking mechanisms that include effects of threshold voltage and synaptic scaling factor.     

Lateral connectivity and contextual interactions in macaque primary visual cortex

Two components of cortical circuits could mediate contour integration in primary visual cortex (V1): intrinsic horizontal connections and feedback from higher cortical areas. To distinguish between these, we combined functional mapping with a new technique for labeling axons, a recombinant adenovirus bearing the gene for green fluorescent protein (GFP), to determine the extent, density, and orientation specificity of V1 intrinsic connections and V2 to V1 feedback. Both connections cover portions of V1 representing regions of visual space up to eight times larger than receptive fields as classically defined, though the intrinsic connections are an order of magnitude denser than the feedback. Whereas the intrinsic connections link similarly oriented domains in V1, V2 to V1 feedback displays no such specificity. These findings suggest that V1 intrinsic horizontal connections provide a more likely substrate for contour integration.     

Thalamocortical control of feed-forward inhibition in awake somatosensory 'barrel' cortex

Intracortical inhibition plays a role in shaping sensory cortical receptive fields and is mediated by both feed-forward and feedback mechanisms. Feed-forward inhibition is the faster of the two processes, being generated by inhibitory interneurons driven by monosynaptic thalamocortical (TC) input. In principle, feed-forward inhibition can prevent targeted cortical neurons from ever reaching threshold when TC input is weak. To do so, however, inhibitory interneurons must respond to TC input at low thresholds and generate spikes very quickly. A powerful feed-forward inhibition would sharpen the tuning characteristics of targeted cortical neurons, and interneurons with sensitive and broadly tuned receptive fields could mediate this process. Suspected inhibitory interneurons (SINs) with precisely these properties are found in layer 4 of the somatosensory (S1) 'barrel' cortex of rodents and rabbits. These interneurons lack the directional selectivity seen in most cortical spiny neurons and in ventrobasal TC afferents, but are much more sensitive than cortical spiny neurons to low-amplitude whisker displacements. This paper is concerned with the activation of S1 SINs by TC impulses, and with the consequences of this activation. Multiple TC neurons and multiple S1 SINs were simultaneously studied in awake rabbits, and cross-correlation methods were used to examine functional connectivity. The results demonstrate a potent, temporally precise, dynamic and highly convergent/divergent functional input from ventrobasal TC neurons to SINs of the topographically aligned S1 barrel. Whereas the extensive pooling of convergent TC inputs onto SINs generates sensitive and broadly tuned inhibitory receptive fields, the potent TC divergence onto many SINs generates sharply synchronous activity among these elements. This TC feed-forward inhibitory network is well suited to provide a fast, potent, sensitive and broadly tuned inhibition of targeted spiny neurons that will suppress spike generation following all but the most optimal feed-forward excitatory inputs.     

Mapping of contextual modulation in the population response of primary visual cortex

We review the evidence of long-range contextual modulation in V1. Populations of neurons in V1 are activated by a wide variety of stimuli outside of their classical receptive fields (RF), well beyond their surround region. These effects generally involve extra-RF features with an orientation component. The population mapping of orientation preferences to the upper layers of V1 is well understood, as far as the classical RF properties are concerned, and involves organization into pinwheel-like structures. We introduce a novel hypothesis regarding the organization of V1’s contextual response. We show that RF and extra-RF orientation preferences are mapped in related ways. Orientation pinwheels are the foci of both types of features. The mapping of contextual features onto the orientation pinwheel has a form that recapitulates the organization of the visual field: an iso-orientation patch within the pinwheel also responds to extra-RF stimuli of the same orientation. We hypothesize that the same form of mapping applies to other stimulus properties that are mapped out in V1, such as colour and contrast selectivity. A specific consequence is that fovea-like properties will be mapped in a systematic way to orientation pinwheels. We review the evidence that cytochrome oxidase blobs comprise the foci of this contextual remapping for colour and low contrasts. Neurodynamics and motion in the visual field are argued to play an important role in the shaping and maintenance of this type of mapping in V1.     

Patterns of ongoing activity and the functional architecture of the primary visual cortex

Ongoing spontaneous activity in the cerebral cortex exhibits complex spatiotemporal patterns in the absence of sensory stimuli. To elucidate the nature of this ongoing activity, we present a theoretical treatment of two contrasting scenarios of cortical dynamics: (1) fluctuations about a single background state and (2) wandering among multiple "attractor" states, which encode a single or several stimulus features. Studying simplified network rate models of the primary visual cortex (V1), we show that the single state scenario is characterized by fast and high-dimensional Gaussian-like fluctuations, whereas in the multiple state scenario the fluctuations are slow, low dimensional, and highly non-Gaussian. Studying a more realistic model that incorporates correlations in the feed-forward input, spatially restricted cortical interactions, and an experimentally derived layout of pinwheels, we show that recent optical-imaging data of ongoing activity in V1 are consistent with the presence of either a single background state or multiple attractor states encoding many features.     

A minimal mechanistic model for temporal signal processing in the lateral geniculate nucleus

The receptive fields of cells in the lateral geniculate nucleus (LGN) are shaped by their diverse set of impinging inputs: feedforward synaptic inputs stemming from retina, and feedback inputs stemming from the visual cortex and the thalamic reticular nucleus. To probe the possible roles of these feedforward and feedback inputs in shaping the temporal receptive-field structure of LGN relay cells, we here present and investigate a minimal mechanistic firing-rate model tailored to elucidate their disparate features. The model for LGN relay ON cells includes feedforward excitation and inhibition (via interneurons) from retinal ON cells and excitatory and inhibitory (via thalamic reticular nucleus cells and interneurons) feedback from cortical ON and OFF cells. From a general firing-rate model formulated in terms of Volterra integral equations, we derive a single delay differential equation with absolute delay governing the dynamics of the system. A freely available and easy-to-use GUI-based MATLAB version of this minimal mechanistic LGN circuit model is provided. We particularly investigate the LGN relay-cell impulse response and find through thorough explorations of the model’s parameter space that both purely feedforward models and feedback models with feedforward excitation only, can account quantitatively for previously reported experimental results. We find, however, that the purely feedforward model predicts two impulse response measures, the time to first peak and the biphasic index (measuring the relative weight of the rebound phase) to be anticorrelated. In contrast, the models with feedback predict different correlations between these two measures. This suggests an experimental test assessing the relative importance of feedforward and feedback connections in shaping the impulse response of LGN relay cells.     

Retinal and cortical nonlinearities combine to produce masking in V1 responses to plaids

The visual response of a cell in the primary visual cortex (V1) to a drifting grating stimulus at the cell’s preferred orientation decreases when a second, perpendicular, grating is superimposed. This effect is called masking. To understand the nonlinear masking effect, we model the response of Macaque V1 simple cells in layer 4Cα to input from magnocellular Lateral Geniculate Nucleus (LGN) cells. The cortical model network is a coarse-grained reduction of an integrate-and-fire network with excitation from LGN input and inhibition from other cortical neurons. The input is modeled as a sum of LGN cell responses. Each LGN cell is modeled as the convolution of a spatio-temporal filter with the visual stimulus, normalized by a retinal contrast gain control, and followed by rectification representing the LGN spike threshold. In our model, the experimentally observed masking arises at the level of LGN input to the cortex. The cortical network effectively induces a dynamic threshold that forces the test grating to have high contrast before it can overcome the masking provided by the perpendicular grating. The subcortical nonlinearities and the cortical network together account for the masking effect. Melinda Koelling is formerly from Center for Neural Science and Courant Institute, New York University.     

Integrate-and-fire vs Poisson models of LGN input to V1 cortex: noisier inputs reduce orientation selectivity

One of the reasons the visual cortex has attracted the interest of computational neuroscience is that it has well-defined inputs. The lateral geniculate nucleus (LGN) of the thalamus is the source of visual signals to the primary visual cortex (V1). Most large-scale cortical network models approximate the spike trains of LGN neurons as simple Poisson point processes. However, many studies have shown that neurons in the early visual pathway are capable of spiking with high temporal precision and their discharges are not Poisson-like. To gain an understanding of how response variability in the LGN influences the behavior of V1, we study response properties of model V1 neurons that receive purely feedforward inputs from LGN cells modeled either as noisy leaky integrate-and-fire (NLIF) neurons or as inhomogeneous Poisson processes. We first demonstrate that the NLIF model is capable of reproducing many experimentally observed statistical properties of LGN neurons. Then we show that a V1 model in which the LGN input to a V1 neuron is modeled as a group of NLIF neurons produces higher orientation selectivity than the one with Poisson LGN input. The second result implies that statistical characteristics of LGN spike trains are important for V1’s function. We conclude that physiologically motivated models of V1 need to include more realistic LGN spike trains that are less noisy than inhomogeneous Poisson processes.