Combined Hebbian development of geniculocortical and lateral connectivity in a model of primary visual cortex

We present a network model of visual map development in layer 4 of primary visual cortex. Our model comprises excitatory and inhibitory spiking neurons. The input to the network consists of correlated spike trains to mimick the activity of neurons in the lateral geniculate nucleus (LGN). An activity-driven Hebbian learning mechanism governs the development of both the network's lateral connectivity and feedforward projections from LGN to cortex. Plasticity of inhibitory synapses has been included into the model so as to control overall cortical activity. Even without feedforward input, Hebbian modification of the excitatory lateral connections can lead to the development of an intracortical orientation map. We have found that such an intracortical map can guide the development of feedforward connections from LGN to cortical simple cells so that the structure of the final feedforward orientation map is predetermined by the intracortical map. In a scenario in which left- and right-eye geniculocortical inputs develop sequentially one after the other, the resulting maps are therefore very similar, provided the intracortical connectivity remains unaltered. This may explain the outcome of so-called reverse lid-suture experiments, where animals are reared so that both eyes never receive input at the same time, but the orientation maps measured separately for the two eyes are nevertheless nearly identical. Received: 20 December 1999 / Accepted in revised form: 9 June 2000     

Development and plasticity of the primary visual cortex

Hubel and Wiesel began the modern study of development and plasticity of primary visual cortex (V1), discovering response properties of cortical neurons that distinguished them from their inputs and that were arranged in a functional architecture. Their findings revealed an early innate period of development and a later critical period of dramatic experience-dependent plasticity. Recent studies have used rodents to benefit from biochemistry and genetics. The roles of spontaneous neural activity and molecular signaling in innate, experience-independent development have been clarified, as have the later roles of visual experience. Plasticity produced by monocular visual deprivation (MD) has been dissected into stages governed by distinct signaling mechanisms, some of whose molecular players are known. Many crucial questions remain, but new tools for perturbing cortical cells and measuring plasticity at the level of changes in connections among identified neurons now exist. The future for the study of V1 to illuminate cortical development and plasticity is bright.     

Hebbian spike-driven synaptic plasticity for learning patterns of mean firing rates

Synaptic plasticity is believed to underlie the formation of appropriate patterns of connectivity that stabilize stimulus-selective reverberations in the cortex. Here we present a general quantitative framework for studying the process of learning and memorizing of patterns of mean spike rates. General considerations based on the limitations of material (biological or electronic) synaptic devices show that most learning networks share the palimpsest property: old stimuli are forgotten to make room for the new ones. In order to prevent too-fast forgetting, one can introduce a stochastic mechanism for selecting only a small fraction of synapses to be changed upon the presentation of a stimulus. Such a mechanism can be easily implemented by exploiting the noisy fluctuations in the pre- and postsynaptic activities to be encoded. The spike-driven synaptic dynamics described here can implement such a selection mechanism to achieve slow learning, which is shown to maximize the performance of the network as an associative memory.     

An adaptive visual neuronal model implementing competitive, temporally asymmetric Hebbian learning

A novel depth-from-motion vision model based on leaky integrate-and-fire (I&F) neurons incorporates the implications of recent neurophysiological findings into an algorithm for object discovery and depth analysis. Pulse-coupled I&F neurons capture the edges in an optical flow field and the associated time of travel of those edges is encoded as the neuron parameters, mainly the time constant of the membrane potential and synaptic weight. Correlations between spikes and their timing thus code depth in the visual field. Neurons have multiple output synapses connecting to neighbouring neurons with an initial Gaussian weight distribution. A temporally asymmetric learning rule is used to adapt the synaptic weights online, during which competitive behaviour emerges between the different input synapses of a neuron. It is shown that the competition mechanism can further improve the model performance. After training, the weights of synapses sourced from a neuron do not display a Gaussian distribution, having adapted to encode features of the scenes to which they have been exposed.     

A columnar model of somatosensory reorganizational plasticity based on Hebbian and non-Hebbian learning rules

Topographical and functional aspects of neuronal plasticity were studied in the primary somatosensory cortex of adult rats in acute electrophysiological experiments. Under these experimental conditions, we observed short-term reversible reorganization induced by intracortical microstimulation or by an associative pairing of peripheral tactile stimulation. Both types of stimulation generate large-scale and reversible changes of the representational topography and of single cell functional properties. We present a model to simulate the spatial and functional reorganizational aspects of this type of short-term and reversible plasticity. The columnar structure of the network architecture is described and discussed from a biological point of view. The simulated architecture contains three main levels of information processing. The first one is a sensor array corresponding to the sensory surface of the hind paw. The second level, a pre-cortical relay cell array, represents the thalamo-cortical projection with different levels of excitatory and inhibitory relay cells and inhibitory nuclei. The array of cortical columns, the third level, represents stellate, double bouquet, basket and pyramidal cell interactions. The dynamics of the network are ruled by two integro-differential equations of the lateral-inhibition type. In order to implement neuronal plasticity, synaptic weight parameters in those equations are variables. The learning rules are motivated by the original concept of Hebb, but include a combination of both Hebbian and non-Hebbian rules, which modifies different intra- and inter-columnar interactions. We discuss the implications of neuronal plasticity from a behavioral point of view in terms of information processing and computational resources.     

Distributed neural plasticity for shape learning in the human visual cortex

Expertise in recognizing objects in cluttered scenes is a critical skill for our interactions in complex environments and is thought to develop with learning. However, the neural implementation of object learning across stages of visual analysis in the human brain remains largely unknown. Using combined psychophysics and functional magnetic resonance imaging (fMRI), we show a link between shape-specific learning in cluttered scenes and distributed neuronal plasticity in the human visual cortex. We report stronger fMRI responses for trained than untrained shapes across early and higher visual areas when observers learned to detect low-salience shapes in noisy backgrounds. However, training with high-salience pop-out targets resulted in lower fMRI responses for trained than untrained shapes in higher occipitotemporal areas. These findings suggest that learning of camouflaged shapes is mediated by increasing neural sensitivity across visual areas to bolster target segmentation and feature integration. In contrast, learning of prominent pop-out shapes is mediated by associations at higher occipitotemporal areas that support sparser coding of the critical features for target recognition. We propose that the human brain learns novel objects in complex scenes by reorganizing shape processing across visual areas, while taking advantage of natural image correlations that determine the distinctiveness of target shapes.     

An information integration model of the primary visual cortex under grating stimulations

During the course of information processing, a visual system extracts characteristic information of the visual image and integrates the spatial and temporal visual information simultaneously. In this study, we investigate the integration effect of neurons in the primary visual cortex (V1 area) under the grating stimulation. First, an information integration model was established based on the receptive field properties of the extracted features of the visual images features, the interaction between neurons and the nonlinear integration of those neurons. Then the neuropsychological experiments were designed both to provide parameters for the model and to verify its effect. The experimental results with factual visual image were largely consistent with the model’s forecast output. This demonstrates that our model can truly reflect the integration effect of the primary visual system when being subjected to grating stimulations with different orientations. Our results indicate the primary visual system integrates the visual information in the following manner: it first extracts visual information through different types of receptive field, and then its neurons interact with each other in a non-linear manner, finally the neurons fire spikes recorded as responses to the visual stimulus.     

Hebbian errors in learning: An analysis using the Oja model

Background: Recent work on long term potentiation in brain slices shows that Hebb's rule is not completely synapse-specific, probably due to intersynapse diffusion of calcium or other factors. We previously suggested that such errors in Hebbian learning might be analogous to mutations in evolution.Methods and findings: We examine this proposal quantitatively, extending the classical Oja unsupervised model of learning by a single linear neuron to include Hebbian inspecificity. We introduce an error matrix E, which expresses possible crosstalk between updating at different connections. When there is no inspecificity, this gives the classical result of convergence to the first principal component of the input distribution (PC1). We show the modified algorithm converges to the leading eigenvector of the matrix EC, where C is the input covariance matrix. In the most biologically plausible case when there are no intrinsically privileged connections, E has diagonal elements Q and off-diagonal elements (1-Q)/(n-1), where Q, the quality, is expected to decrease with the number of inputs n and with a synaptic parameter b that reflects synapse density, calcium diffusion, etc. We study the dependence of the learning accuracy on b, n and the amount of input activity or correlation (analytically and computationally). We find that accuracy increases (learning becomes gradually less useful) with increases in b, particularly for intermediate (i.e., biologically realistic) correlation strength, although some useful learning always occurs up to the trivial limit Q=1/n.Conclusions and significance: We discuss the relation of our results to Hebbian unsupervised learning in the brain. When the mechanism lacks specificity, the network fails to learn the expected, and typically most useful, result, especially when the input correlation is weak. Hebbian crosstalk would reflect the very high density of synapses along dendrites, and inevitably degrades learning.     

Perceptual learning and dynamic changes in primary visual cortex

Perceptual learning is the improved performance that follows practice in a perceptual task. In this issue of Neuron, Yotsumoto et al. use fMRI to show that stimuli presented at the location used in training initially evoke greater activation in primary visual cortex than stimuli presented elsewhere, but this difference disappears once learning asymptotes.     

Neural network model of the primary visual cortex: From functional architecture to lateral connectivity and back

The role of intrinsic cortical dynamics is a debatable issue. A recent optical imaging study (Kenet et al., 2003) found that activity patterns similar to orientation maps (OMs), emerge in the primary visual cortex (V1) even in the absence of sensory input, suggesting an intrinsic mechanism of OM activation. To better understand these results and shed light on the intrinsic V1 processing, we suggest a neural network model in which OMs are encoded by the intrinsic lateral connections. The proposed connectivity pattern depends on the preferred orientation and, unlike previous models, on the degree of orientation selectivity of the interconnected neurons. We prove that the network has a ring attractor composed of an approximated version of the OMs. Consequently, OMs emerge spontaneously when the network is presented with an unstructured noisy input. Simulations show that the model can be applied to experimental data and generate realistic OMs. We study a variation of the model with spatially restricted connections, and show that it gives rise to states composed of several OMs. We hypothesize that these states can represent local properties of the visual scene. Action Editor: Jonathan D. Victor     

Dual synaptic plasticity in the hippocampus: Hebbian and spatiotemporal learning dynamics

We assume that Hebbian learning dynamics (HLD) and spatiotemporal learning dynamics (SLD) are involved in the mechanism of synaptic plasticity in the hippocampal neurons. While HLD is driven by pre- and postsynaptic spike timings through the backpropagating action potential, SLD is evoked by presynaptic spike timings alone. Since the backpropagation attenuates as it nears the distal dendrites, we assume an extreme case as a neuron model where HLD exists only at proximal dendrites and SLD exists only at the distal dendrites. We examined how the synaptic weights change in response to three types of synaptic inputs in computer simulations. First, in response to a Poisson train having a constant mean frequency, the synaptic weights in HLD and SLD are qualitatively similar. Second, SLD responds more rapidly than HLD to synchronous input patterns, while each responds to them. Third, HLD responds more rapidly to more frequent inputs, while SLD shows fluctuating synaptic weights. These results suggest an encoding hypothesis in that a transient synchronous structure in spatiotemporal input patterns will be encoded into distal dendrites through SLD and that persistent synchrony or firing rate information will be encoded into proximal dendrites through HLD.     

A mathematical model of the primary visual cortex and hypercolumn

A mathematical model of the primary visual cortex is presented. Basically, the model comprises two features. Firstly, in analogy with the principle of the computerized tomography (CT), it assumes that simple cells in each hypercolumn are not merely detecting line segments in images as features, but rather that they are as a whole representing the local image with a certain representation. Secondly, it assumes that each hypercolumn is performing spatial frequency analyses of local images using that representation, and that the resultant spectra are represented by complex cells. The model is analyzed using numerical simulations and its advantages are discussed from the viewpoint of visual information processing. It is shown that 1) the proposed processing is tolerant to shifts in position of input images, and that 2) spatial frequency filtering operations can be easily performed in the model.     

Learning strengthens the response of primary visual cortex to simple patterns

Training can significantly improve performance on even the most basic visual tasks, such as detecting a faint patch of light or determining the orientation of a bar (for reviews, see ). The neural mechanisms of visual learning, however, remain controversial. One simple way to improve behavior is to increase the overall neural response to the trained stimulus by increasing the number or gain of responsive neurons. Learning of this type has been observed in other sensory modalities, where training increases the number of receptive fields that cover the trained stimulus. Here, we show that visual learning can selectively increase the overall response to trained stimuli in primary visual cortex (V1). We used functional magnetic resonance imaging (fMRI) to measure neural signals before and after one month of practice at detecting very low-contrast oriented patterns. Training increased V1 response for practiced orientations relative to control orientations by an average of 39%, and the magnitude of the change in V1 correlated moderately well with the magnitude of changes in detection performance. The elevation of V1 activity by training likely results from an increase in the number of neurons responding to the trained stimulus or an increase in response gain.     

Conductance-based refractory density model of primary visual cortex

A layered continual population model of primary visual cortex has been constructed, which reproduces a set of experimental data, including postsynaptic responses of single neurons on extracellular electric stimulation and spatially distributed activity patterns in response to visual stimulation. In the model, synaptically interacting excitatory and inhibitory neuronal populations are described by a conductance-based refractory density approach. Populations of two-compartment excitatory and inhibitory neurons in cortical layers 2/3 and 4 are distributed in the 2-d cortical space and connected by AMPA, NMDA and GABA type synapses. The external connections are pinwheel-like, according to the orientation of a stimulus. Intracortical connections are isotropic local and patchy between neurons with similar orientations. The model proposes better temporal resolution and more detailed elaboration than conventional mean-field models. In comparison to large network simulations, it excludes a posteriori statistical data manipulation and provides better computational efficiency and minimal parametrization.     

Simulation of plasticity in the adult visual cortex

 Retinal plasticity has been shown in the adult visual nervous system in mammals. Following a retinal lesion (scotoma) there is a reorganization of the cortical receptive field distribution: cortical neurons selective to visual stimuli in the area of the visual field corresponding to the retinal lesion, become selective to other parts of the visual field. In this work, we study this effect with a self-organizing neural network. In a first stage, the network reaches a pattern of connectivity that represents normal development of neuronal selectivity. The scotoma is simulated by perturbing accordingly the properties of a region of the input layer representing the retina. The system evolves to a new receptive field distribution mainly by means of the reorganization of the intra cortical connectivity. No major change of the geniculo cortical connectivity is detected. This may explain the surprisingly short time scale of the event. Received: 6 June 2000 / Accepted in revised form: 16 October 2000     

How the mechanisms of long-term synaptic potentiation and depression serve experience-dependent plasticity in primary visual cortex

Donald Hebb chose visual learning in primary visual cortex (V1) of the rodent to exemplify his theories of how the brain stores information through long-lasting homosynaptic plasticity. Here, we revisit V1 to consider roles for bidirectional ‘Hebbian’ plasticity in the modification of vision through experience. First, we discuss the consequences of monocular deprivation (MD) in the mouse, which have been studied by many laboratories over many years, and the evidence that synaptic depression of excitatory input from the thalamus is a primary contributor to the loss of visual cortical responsiveness to stimuli viewed through the deprived eye. Second, we describe a less studied, but no less interesting form of plasticity in the visual cortex known as stimulus-selective response potentiation (SRP). SRP results in increases in the response of V1 to a visual stimulus through repeated viewing and bears all the hallmarks of perceptual learning. We describe evidence implicating an important role for potentiation of thalamo-cortical synapses in SRP. In addition, we present new data indicating that there are some features of this form of plasticity that cannot be fully accounted for by such feed-forward Hebbian plasticity, suggesting contributions from intra-cortical circuit components.