A neural network model on self-organizing emergence of simple-cell receptive field with orientation selectivity in visual cortex

In order to probe into the self-organizing emergence of simple cell orientation selectivity, we tried to construct a neural network model that consists of LGN neurons and simple cells in visual cortex and obeys the Hebbian learning rule. We investigated the neural coding and representation of simple cells to a natural image by means of this model. The results show that the structures of their receptive fields are determined by the preferred orientation selectivity of simple cells. However, they are also decided by the emergence of self-organization in the unsupervision learning process. This kind of orientation selectivity results from dynamic self-organization based on the interactions between LGN and cortex.     

Computational Modeling of Orientation Tuning Dynamics in Monkey Primary Visual Cortex

In the primate visual pathway, orientation tuning of neurons is first observed in the primary visual cortex. The LGN cells that comprise the thalamic input to V1 are not orientation tuned, but some V1 neurons are quite selective. Two main classes of theoretical models have been offered to explain orientation selectivity: feedforward models, in which inputs from spatially aligned LGN cells are summed together by one cortical neuron; and feedback models, in which an initial weak orientation bias due to convergent LGN input is sharpened and amplified by intracortical feedback. Recent data on the dynamics of orientation tuning, obtained by a cross-correlation technique, may help to distinguish between these classes of models. To test this possibility, we simulated the measurement of orientation tuning dynamics on various receptive field models, including a simple Hubel-Wiesel type feedforward model: a linear spatiotemporal filter followed by an integrate-and-fire spike generator. The computational study reveals that simple feedforward models may account for some aspects of the experimental data but fail to explain many salient features of orientation tuning dynamics in V1 cells. A simple feedback model of interacting cells is also considered. This model is successful in explaining the appearance of Mexican-hat orientation profiles, but other features of the data continue to be unexplained.     

视觉系统皮层下细胞的方位和方向敏感性

视觉方位、方向选择性曾被认为是高等哺乳动物视皮层细胞的特有功能。近年来大量的实验结果表明,视皮层下的外膝体神经元和视网膜神经节细胞都具一定程度的方位和方向敏感性,这些性质是遗传决定的,不受后天环境的影响。在外膝体内,已为视皮层细胞高度的方位、方向选择性和功能柱的形成做出了初步的分类与编组,提供了前级安排。这种皮层下的方位、方向敏感性细胞在发育过程中传递和加工了环境视觉信息,促进了视皮层更强的方位、方向选择性机制和方位功能柱的形成。外膝体在视觉信息平行处理通道的形成上起着分类集聚的重要作用。     

Learning receptive field properties of complex cells in V1

There are two distinct classes of cells in the primary visual cortex (V1): simple cells and complex cells. One defining feature of complex cells is their spatial phase invariance; they respond strongly to oriented grating stimuli with a preferred orientation but with a wide range of spatial phases. A classical model of complete spatial phase invariance in complex cells is the energy model, in which the responses are the sum of the squared outputs of two linear spatially phase-shifted filters. However, recent experimental studies have shown that complex cells have a diverse range of spatial phase invariance and only a subset can be characterized by the energy model. While several models have been proposed to explain how complex cells could learn to be selective to orientation but invariant to spatial phase, most existing models overlook many biologically important details. We propose a biologically plausible model for complex cells that learns to pool inputs from simple cells based on the presentation of natural scene stimuli. The model is a three-layer network with rate-based neurons that describes the activities of LGN cells (layer 1), V1 simple cells (layer 2), and V1 complex cells (layer 3). The first two layers implement a recently proposed simple cell model that is biologically plausible and accounts for many experimental phenomena. The neural dynamics of the complex cells is modeled as the integration of simple cells inputs along with response normalization. Connections between LGN and simple cells are learned using Hebbian and anti-Hebbian plasticity. Connections between simple and complex cells are learned using a modified version of the Bienenstock, Cooper, and Munro (BCM) rule. Our results demonstrate that the learning rule can describe a diversity of complex cells, similar to those observed experimentally.     

A computational neural model of orientation detection based on multiple guesses: comparison of geometrical and algebraic models

The implementation of Hubel-Wiesel hypothesis that orientation selectivity of a simple cell is based on ordered arrangement of its afferent cells has some difficulties. It requires the receptive fields (RFs) of those ganglion cells (GCs) and LGN cells to be similar in size and sub-structure and highly arranged in a perfect order. It also requires an adequate number of regularly distributed simple cells to match ubiquitous edges. However, the anatomical and electrophysiological evidence is not strong enough to support this geometry-based model. These strict regularities also make the model very uneconomical in both evolution and neural computation. We propose a new neural model based on an algebraic method to estimate orientations. This approach synthesizes the guesses made by multiple GCs or LGN cells and calculates local orientation information subject to a group of constraints. This algebraic model need not obey the constraints of Hubel-Wiesel hypothesis, and is easily implemented with a neural network. By using the idea of a satisfiability problem with constraints, we also prove that the precision and efficiency of this model are mathematically practicable. The proposed model makes clear several major questions which Hubel-Wiesel model does not account for. Image-rebuilding experiments are conducted to check whether this model misses any important boundary in the visual field because of the estimation strategy. This study is significant in terms of explaining the neural mechanism of orientation detection, and finding the circuit structure and computational route in neural networks. For engineering applications, our model can be used in orientation detection and as a simulation platform for cell-to-cell communications to develop bio-inspired eye chips.     

A reaction-diffusion model to capture disparity selectivity in primary visual cortex

Decades of experimental studies are available on disparity selective cells in visual cortex of macaque and cat. Recently, local disparity map for iso-orientation sites for near-vertical edge preference is reported in area 18 of cat visual cortex. No experiment is yet reported on complete disparity map in V1. Disparity map for layer IV in V1 can provide insight into how disparity selective complex cell receptive field is organized from simple cell subunits. Though substantial amounts of experimental data on disparity selective cells is available, no model on receptive field development of such cells or disparity map development exists in literature. We model disparity selectivity in layer IV of cat V1 using a reaction-diffusion two-eye paradigm. In this model, the wiring between LGN and cortical layer IV is determined by resource an LGN cell has for supporting connections to cortical cells and competition for target space in layer IV. While competing for target space, the same type of LGN cells, irrespective of whether it belongs to left-eye-specific or right-eye-specific LGN layer, cooperate with each other while trying to push off the other type. Our model captures realistic 2D disparity selective simple cell receptive fields, their response properties and disparity map along with orientation and ocular dominance maps. There is lack of correlation between ocular dominance and disparity selectivity at the cell population level. At the map level, disparity selectivity topography is not random but weakly clustered for similar preferred disparities. This is similar to the experimental result reported for macaque. The details of weakly clustered disparity selectivity map in V1 indicate two types of complex cell receptive field organization.     

A cooperation and competition based simple cell receptive field model and study of feed-forward linear and nonlinear contributions to orientation selectivity

We present a model for development of orientation selectivity in layer IV simple cells. Receptive field (RF) development in the model, is determined by diffusive cooperation and resource limited competition guided axonal growth and retraction in geniculocortical pathway. The simulated cortical RFs resemble experimental RFs. The receptive field model is incorporated in a three-layer visual pathway model consisting of retina, LGN and cortex. We have studied the effect of activity dependent synaptic scaling on orientation tuning of cortical cells. The mean value of hwhh (half width at half the height of maximum response) in simulated cortical cells is 58° when we consider only the linear excitatory contribution from LGN. We observe a mean improvement of 22.8° in tuning response due to the non-linear spiking mechanisms that include effects of threshold voltage and synaptic scaling factor.     

Integrate-and-fire vs Poisson models of LGN input to V1 cortex: noisier inputs reduce orientation selectivity

One of the reasons the visual cortex has attracted the interest of computational neuroscience is that it has well-defined inputs. The lateral geniculate nucleus (LGN) of the thalamus is the source of visual signals to the primary visual cortex (V1). Most large-scale cortical network models approximate the spike trains of LGN neurons as simple Poisson point processes. However, many studies have shown that neurons in the early visual pathway are capable of spiking with high temporal precision and their discharges are not Poisson-like. To gain an understanding of how response variability in the LGN influences the behavior of V1, we study response properties of model V1 neurons that receive purely feedforward inputs from LGN cells modeled either as noisy leaky integrate-and-fire (NLIF) neurons or as inhomogeneous Poisson processes. We first demonstrate that the NLIF model is capable of reproducing many experimentally observed statistical properties of LGN neurons. Then we show that a V1 model in which the LGN input to a V1 neuron is modeled as a group of NLIF neurons produces higher orientation selectivity than the one with Poisson LGN input. The second result implies that statistical characteristics of LGN spike trains are important for V1’s function. We conclude that physiologically motivated models of V1 need to include more realistic LGN spike trains that are less noisy than inhomogeneous Poisson processes.     

A neural network model for the self-organization of cortical grating cells

A neural network model with incremental Hebbian learning of afferent and lateral synaptic couplings is proposed,which simulates the activity-dependent self-organization of grating cells in upper layers of striate cortex. These cells, found in areas V1 and V2 of the visual cortex of monkeys, respond vigorously and exclusively to bar gratings of a preferred orientation and periodicity. Response behavior to varying contrast and to an increasing number of bars in the grating show threshold and saturation effects. Their location with respect to the underlying orientation map and their nonlinear response behavior are investigated. The number of emerging grating cells is controlled in the model by the range and strength of the lateral coupling structure.     

Combined Hebbian development of geniculocortical and lateral connectivity in a model of primary visual cortex

We present a network model of visual map development in layer 4 of primary visual cortex. Our model comprises excitatory and inhibitory spiking neurons. The input to the network consists of correlated spike trains to mimick the activity of neurons in the lateral geniculate nucleus (LGN). An activity-driven Hebbian learning mechanism governs the development of both the network's lateral connectivity and feedforward projections from LGN to cortex. Plasticity of inhibitory synapses has been included into the model so as to control overall cortical activity. Even without feedforward input, Hebbian modification of the excitatory lateral connections can lead to the development of an intracortical orientation map. We have found that such an intracortical map can guide the development of feedforward connections from LGN to cortical simple cells so that the structure of the final feedforward orientation map is predetermined by the intracortical map. In a scenario in which left- and right-eye geniculocortical inputs develop sequentially one after the other, the resulting maps are therefore very similar, provided the intracortical connectivity remains unaltered. This may explain the outcome of so-called reverse lid-suture experiments, where animals are reared so that both eyes never receive input at the same time, but the orientation maps measured separately for the two eyes are nevertheless nearly identical. Received: 20 December 1999 / Accepted in revised form: 9 June 2000     

A functional model of the wiring of the simple cells of visual cortex

A computer model of the simple cells in the mammalian visual cortex was constructed. The model cells received inputs from a great number of isopolar centre/surround cells assumed to be located in the lateral geniculate nucleus (LGN). The distribution of input to the model simple cells was either inhibitory/excitatory or inhibitory/excitatory/inhibitory. Such arrangements produced receptive fields containing four or five consecutively antagonistic subfields. Responses produced by the model cells to different types of stimuli (periodical as well as nonperiodical) were obtained and compared to responses of living cells reported from various laboratories under comparable stimulus conditions. In all the situations tested, the responses of the model cells corresponded qualitatively very well to those of living cells. It was seen that the same wiring mechanism was able to account for orientation selectivity, spatial frequency filtering, various phase relationships between stimulus and response, subfield orientational selectivity, and slight end-inhibition. Furthermore, the receptive fields of the model simple cells closely resemble Gabor functions.     

Visual Receptive Field Properties of Neurons in the Mouse Lateral Geniculate Nucleus

The lateral geniculate nucleus (LGN) is increasingly regarded as a “smart-gating” operator for processing visual information. Therefore, characterizing the response properties of LGN neurons will enable us to better understand how neurons encode and transfer visual signals. Efforts have been devoted to study its anatomical and functional features, and recent advances have highlighted the existence in rodents of complex features such as direction/orientation selectivity. However, unlike well-researched higher-order mammals such as primates, the full array of response characteristics vis-à-vis its morphological features have remained relatively unexplored in the mouse LGN. To address the issue, we recorded from mouse LGN neurons using multisite-electrode-arrays (MEAs) and analysed their discharge patterns in relation to their location under a series of visual stimulation paradigms. Several response properties paralleled results from earlier studies in the field and these include centre-surround organization, size of receptive field, spontaneous firing rate and linearity of spatial summation. However, our results also revealed “high-pass” and “low-pass” features in the temporal frequency tuning of some cells, and greater average contrast gain than reported by earlier studies. In addition, a small proportion of cells had direction/orientation selectivity. Both “high-pass” and “low-pass” cells, as well as direction and orientation selective cells, were found only in small numbers, supporting the notion that these properties emerge in the cortex. ON- and OFF-cells showed distinct contrast sensitivity and temporal frequency tuning properties, suggesting parallel projections from the retina. Incorporating a novel histological technique, we created a 3-D LGN volume model explicitly capturing the morphological features of mouse LGN and localising individual cells into anterior/middle/posterior LGN. Based on this categorization, we show that the ON/OFF, DS/OS and linear response properties are not regionally restricted. Our study confirms earlier findings of spatial pattern selectivity in the LGN, and builds on it to demonstrate that relatively elaborate features are computed early in the visual pathway.     

Feedforward origins of response variability underlying contrast invariant orientation tuning in cat visual cortex

Contrast invariant orientation tuning in simple cells of the visual cortex depends critically on contrast dependent trial-to-trial variability in their membrane potential responses. This observation raises the question of whether this variability originates from within the cortical circuit or the feedforward inputs from the lateral geniculate nucleus (LGN). To distinguish between these two sources of variability, we first measured membrane potential responses while inactivating the surrounding cortex, and found that response variability was nearly unaffected. We then studied variability in the LGN, including contrast dependence, and the trial-to-trial correlation in responses between nearby neurons. Variability decreased significantly with contrast, whereas correlation changed little. When these experimentally measured parameters of variability were applied to a feedforward model of simple cells that included realistic mechanisms of synaptic integration, contrast-dependent, orientation independent variability emerged in the membrane potential responses. Analogous mechanisms might contribute to the stimulus dependence and propagation of variability throughout the neocortex.     

Predictive Feedback Can Account for Biphasic Responses in the Lateral Geniculate Nucleus

Biphasic neural response properties, where the optimal stimulus for driving a neural response changes from one stimulus pattern to the opposite stimulus pattern over short periods of time, have been described in several visual areas, including lateral geniculate nucleus (LGN), primary visual cortex (V1), and middle temporal area (MT). We describe a hierarchical model of predictive coding and simulations that capture these temporal variations in neuronal response properties. We focus on the LGN-V1 circuit and find that after training on natural images the model exhibits the brain's LGN-V1 connectivity structure, in which the structure of V1 receptive fields is linked to the spatial alignment and properties of center-surround cells in the LGN. In addition, the spatio-temporal response profile of LGN model neurons is biphasic in structure, resembling the biphasic response structure of neurons in cat LGN. Moreover, the model displays a specific pattern of influence of feedback, where LGN receptive fields that are aligned over a simple cell receptive field zone of the same polarity decrease their responses while neurons of opposite polarity increase their responses with feedback. This phase-reversed pattern of influence was recently observed in neurophysiology. These results corroborate the idea that predictive feedback is a general coding strategy in the brain.     

A self-organizing neural network model for the development of complex cells

On the basis of recent neurophysiological findings on the mammalian visual cortex, a selforganizing neural network model is proposed for the understanding of the development of complex cells. The model is composed of two kinds of connections from LGN cells to a complex cell. One is direct excitatory connections and the other is indirect inhibitory connections via simple cells. Inhibitory synapses between simple cells and complex cells are assumed to be modifiable. The model was simulated on a computer to confirm its behavior.     

Emergence of orientation-selective inhibition in the primary visual cortex: a Bayes–Markov computational model

The recent consensus is that virtually all aspects of response selectivity exhibited by the primary visual cortex are either created or sharpened by cortical inhibitory interneurons. Experimental studies have shown that there are cortical inhibitory cells that are driven by geniculate cells and that, like their cortical excitatory counterparts, are orientation selective, though less sharply tuned. The main goal of this article is to demonstrate how orientation-selective inhibition might be created by the circuitry of the primary visual cortex (striate cortex, V1) from its nonoriented geniculate inputs. To fulfill this goal, first, a Bayes–Markov computational model is developed for the V1 area dedicated to foveal vision. The developed model consists of three parts: (i) a two-layered hierarchical Markov random field that is assumed to generate the activity patterns of the geniculate and cortical inhibitory cells, (ii) a Bayesian computational goal that is formulated based on the maximum a posteriori (MAP) estimation principle, and (iii) an iterative, deterministic, parallel algorithm that leads the cortical circuitry to achieve its assigned computational goal. The developed model is not fully LGN driven and it is not implementable by the neural machinery of V1. The model, then, is transformed into a fully LGN-driven and physiologically plausible form. Computer simulation is used to demonstrate the performance of the developed models.     

Retinal and cortical nonlinearities combine to produce masking in V1 responses to plaids

The visual response of a cell in the primary visual cortex (V1) to a drifting grating stimulus at the cell’s preferred orientation decreases when a second, perpendicular, grating is superimposed. This effect is called masking. To understand the nonlinear masking effect, we model the response of Macaque V1 simple cells in layer 4Cα to input from magnocellular Lateral Geniculate Nucleus (LGN) cells. The cortical model network is a coarse-grained reduction of an integrate-and-fire network with excitation from LGN input and inhibition from other cortical neurons. The input is modeled as a sum of LGN cell responses. Each LGN cell is modeled as the convolution of a spatio-temporal filter with the visual stimulus, normalized by a retinal contrast gain control, and followed by rectification representing the LGN spike threshold. In our model, the experimentally observed masking arises at the level of LGN input to the cortex. The cortical network effectively induces a dynamic threshold that forces the test grating to have high contrast before it can overcome the masking provided by the perpendicular grating. The subcortical nonlinearities and the cortical network together account for the masking effect. Melinda Koelling is formerly from Center for Neural Science and Courant Institute, New York University.     

Dynamics of orientation selectivity in the primary visual cortex and the importance of cortical inhibition

To test theories of orientation selectivity in primary visual cortex (V1), we have done experiments to measure the dynamics of orientation tuning of single neurons in the V1 cortex of macaque monkeys. Based on our dynamics results, we propose that a V1 cell's orientation selectivity is generated mainly by both tuned enhancement and global suppression. Enhancement near the preferred orientation is probably caused by feed-forward input from LGN (plus amplification by cortical-cortical interaction). Global suppression could be supplied by cortical inhibition. Additionally, in about 1/3 of V1 neurons (usually the most sharply tuned) there is tuned suppression, centered near the cell's preferred orientation but broader than tuned enhancement. These mechanisms also can explain important features of steady-state selectivity in the V1 neuron population. Furthermore, similar neuronal mechanisms may be used generally throughout the cerebral cortex.     

A multi-stage model for fundamental functional properties in primary visual cortex

Many neurons in mammalian primary visual cortex have properties such as sharp tuning for contour orientation, strong selectivity for motion direction, and insensitivity to stimulus polarity, that are not shared with their sub-cortical counterparts. Successful models have been developed for a number of these properties but in one case, direction selectivity, there is no consensus about underlying mechanisms. We here define a model that accounts for many of the empirical observations concerning direction selectivity. The model describes a single column of cat primary visual cortex and comprises a series of processing stages. Each neuron in the first cortical stage receives input from a small number of on-centre and off-centre relay cells in the lateral geniculate nucleus. Consistent with recent physiological evidence, the off-centre inputs to cortex precede the on-centre inputs by a small (～4 ms) interval, and it is this difference that confers direction selectivity on model neurons. We show that the resulting model successfully matches the following empirical data: the proportion of cells that are direction selective; tilted spatiotemporal receptive fields; phase advance in the response to a stationary contrast-reversing grating stepped across the receptive field. The model also accounts for several other fundamental properties. Receptive fields have elongated subregions, orientation selectivity is strong, and the distribution of orientation tuning bandwidth across neurons is similar to that seen in the laboratory. Finally, neurons in the first stage have properties corresponding to simple cells, and more complex-like cells emerge in later stages. The results therefore show that a simple feed-forward model can account for a number of the fundamental properties of primary visual cortex.     

Prediction of orientation selectivity from receptive field architecture in simple cells of cat visual cortex

From the intracellularly recorded responses to small, rapidly flashed spots, we have quantitatively mapped the receptive fields of simple cells in the cat visual cortex. We then applied these maps to a feedforward model of orientation selectivity. Both the preferred orientation and the width of orientation tuning of the responses to oriented stimuli were well predicted by the model. Where tested, the tuning curve was well predicted at different spatial frequencies. The model was also successful in predicting certain features of the spatial frequency selectivity of the cells. It did not successfully predict the amplitude of the responses to drifting gratings. Our results show that the spatial organization of the receptive field can account for a large fraction of the orientation selectivity of simple cells.