Binocular visual processing in the owl's telencephalon.

Single neurons recorded from the owl's visual Wulst are surprisingly similar to those found in mammalian striate cortex. The receptive fields of Wulst neurons are elaborated, in an apparently hierarchical fashion, from those of their monocular, concentrically organized inputs to produce binocular interneurons with increasingly sophisticated requirements for stimulus orientation, movement and binocular disparity. Output neurons located in the superficial laminae of the Wulst are the most sophisticated of all, with absolute requirements for a combination of stimuli, which include binocular presentation at a particular horizontal binocular disparity, and with no response unless all of the stimulus conditions are satisfied simultaneously. Such neurons have the properties required for 'global stereopsis', including a receptive field size many times larger than their optimal stimulus, which is more closely matched to the receptive fields of the simpler, disparity-selective interneurons. These marked similarities in functional organization between the avian and mammalian systems exist in spite of a number of structural differences which reflect their separate evoluntionary origins. Discussion therefore includes the possibility that there may exist for nervous systems only a very small number of possible solutions, perhaps a unique one, to the problem of stereopsis.     

Luminance,Colour, Viewpoint and Border Enhanced Disparity Energy Model

The visual cortex is able to extract disparity information through the use of binocular cells. This process is reflected by the Disparity Energy Model, which describes the role and functioning of simple and complex binocular neuron populations, and how they are able to extract disparity. This model uses explicit cell parameters to mathematically determine preferred cell disparities, like spatial frequencies, orientations, binocular phases and receptive field positions. However, the brain cannot access such explicit cell parameters; it must rely on cell responses. In this article, we implemented a trained binocular neuronal population, which encodes disparity information implicitly. This allows the population to learn how to decode disparities, in a similar way to how our visual system could have developed this ability during evolution. At the same time, responses of monocular simple and complex cells can also encode line and edge information, which is useful for refining disparities at object borders. The brain should then be able, starting from a low-level disparity draft, to integrate all information, including colour and viewpoint perspective, in order to propagate better estimates to higher cortical areas.     

Stereopsis: where depth is seen

Disparity-selective cells appear to occur in all parts of the visual cortex, but a recent fMRI study finds that some cortical areas are more strongly associated with disparity than others. More sophisticated tests of binocular function may be needed to identify the properties of single neurons that support this specialization.     

Receptive fields of disparity-tuned simple cells in macaque V1

Binocular simple cells in primary visual cortex (V1) are the first cells along the mammalian visual pathway to receive input from both eyes. Two models of how binocular simple cells could extract disparity information have been put forward. The phase-shift model proposes that the receptive fields in the two eyes have different subunit organizations, while the position-shift model proposes that they have different overall locations. In five fixating macaque monkeys, we recorded from 30 disparity-tuned simple cells that showed selectivity to the disparity in a random dot stereogram. High-resolution maps of the left and right eye receptive fields indicated that both phase and position shifts were common. Single cells usually showed a combination of the two, and the optimum disparity was best correlated with the sum of receptive field phase and position shift.     

Stereopsis and the random element in the organization of the striate cortex.

Receptive field position and orientation disparities are both properties of binocularly discharged striate neurons. Receptive field position desparities have been used as a key element in the neural theory for binocular depth discrimination. Since most striate cells in the cat are binocular, these position disparities require that cells immediately adjacent to one another in the cortex should show a random scatter in their monocular receptive field positions. Superimposed on the progressive topographical representation of the visual field on the striate cortex there is experimental evidence for a localized monocular receptive field position scatter. The suggestion is examined that the binocular position disparities are built up out of the two monocular position scatters. An examination of receptive field orientation disparities and their relation to the random variation in the monocular preferred orientations of immediately adjacent striate neurons also leads to the conclusion that binocular orientation disparities are a consequence of the two monocular scatters. As for receptive field position, the local scatter in preferred orientation is superimposed on a progressive representation of orientation over larger areas of the cortex. The representation in the striate cortex of visual field position and of stimulus orientation is examined in relation to the correlation between the disparities in receptive field position and preferred orientation. The role of orientation disparities in binocular vision is reviewed.     

Self-organizing maps for visual feature representation based on natural binocular stimuli

We model the stimulus-induced development of the topography of the primary visual cortex. The analysis uses a self-organizing Kohonen model based on high-dimensional coding. It allows us to obtain an arbitrary number of feature maps by defining different operators. Using natural binocular stimuli, we concentrate on discussing the orientation, ocular dominance, and disparity maps. We obtain orientation and ocular dominance maps that agree with essential aspects of biological findings. In contrast to orientation and ocular dominance, not much is known about the cortical representation of disparity. As a result of numerical simulations, we predict substructures of orientation and ocular dominance maps that correspond to disparity maps. In regions of constant orientation, we find a wide range of horizontal disparities to be represented. This points to geometrical relations between orientation, ocular dominance, and disparity maps that might be tested in experiments. Received: 9 July 1998 / Accepted in revised form: 2 June 1999     

视差检测：简单细胞、复杂细胞及能量模型

立体视觉信息的处理在于皮层双眼性细胞的活动.皮层中简单细胞对视差的编码方式被认为有两种：位置差（position shift）和相位差（phase shift）,但简单细胞并不适合作为视差检测器.对一些复杂细胞的视差响应特性的生理研究,发现复杂细胞是一种比较适合的视差检测器.模型的研究提出基于这类简单细胞的复杂细胞能量模型,可以很好的检测视差,并可以较好的解释一些生理现象.     

Cue combination in the motion correspondence problem

Image motion is a primary source of visual information about the world. However, before this information can be used the visual system must determine the spatio-temporal displacements of the features in the dynamic retinal image, which originate from objects moving in space. This is known as the motion correspondence problem. We investigated whether cross-cue matching constraints contribute to the solution of this problem, which would be consistent with physiological reports that many directionally selective cells in the visual cortex also respond to additional visual cues. We measured the maximum displacement limit (Dmax) for two-frame apparent motion sequences. Dmax increases as the number of elements in such sequences decreases. However, in our displays the total number of elements was kept constant while the number of a subset of elements, defined by a difference in contrast polarity, binocular disparity or colour, was varied. Dmax increased as the number of elements distinguished by a particular cue was decreased. Dmax was affected by contrast polarity for all observers, but only some observers were influenced by binocular disparity and others by colour information. These results demonstrate that the human visual system exploits local, cross-cue matching constraints in the solution of the motion correspondence problem.     

Vertical Binocular Disparity is Encoded Implicitly within a Model Neuronal Population Tuned to Horizontal Disparity and Orientation

Primary visual cortex is often viewed as a “cyclopean retina”, performing the initial encoding of binocular disparities between left and right images. Because the eyes are set apart horizontally in the head, binocular disparities are predominantly horizontal. Yet, especially in the visual periphery, a range of non-zero vertical disparities do occur and can influence perception. It has therefore been assumed that primary visual cortex must contain neurons tuned to a range of vertical disparities. Here, I show that this is not necessarily the case. Many disparity-selective neurons are most sensitive to changes in disparity orthogonal to their preferred orientation. That is, the disparity tuning surfaces, mapping their response to different two-dimensional (2D) disparities, are elongated along the cell''s preferred orientation. Because of this, even if a neuron''s optimal 2D disparity has zero vertical component, the neuron will still respond best to a non-zero vertical disparity when probed with a sub-optimal horizontal disparity. This property can be used to decode 2D disparity, even allowing for realistic levels of neuronal noise. Even if all V1 neurons at a particular retinotopic location are tuned to the expected vertical disparity there (for example, zero at the fovea), the brain could still decode the magnitude and sign of departures from that expected value. This provides an intriguing counter-example to the common wisdom that, in order for a neuronal population to encode a quantity, its members must be tuned to a range of values of that quantity. It demonstrates that populations of disparity-selective neurons encode much richer information than previously appreciated. It suggests a possible strategy for the brain to extract rarely-occurring stimulus values, while concentrating neuronal resources on the most commonly-occurring situations.     

Stereoscopic Depth Perception Using a Model Based on the Primary Visual Cortex

This work describes an approach inspired by the primary visual cortex using the stimulus response of the receptive field profiles of binocular cells for disparity computation. Using the energy model based on the mechanism of log-Gabor filters for disparity encodings, we propose a suitable model to consistently represent the complex cells by computing the wide bandwidths of the cortical cells. This way, the model ensures the general neurophysiological findings in the visual cortex (V1), emphasizing the physical disparities and providing a simple selection method for the complex cell response. The results suggest that our proposed approach can achieve better results than a hybrid model with phase-shift and position-shift using position disparity alone.     

Elimination of inhibitory synapses is a major component of adult ocular dominance plasticity

During development, cortical plasticity is associated with the rearrangement of excitatory connections. While these connections become more stable with age, plasticity can still be induced in the adult cortex. Here we provide evidence that structural plasticity of?inhibitory synapses onto pyramidal neurons is?a major component of plasticity in the adult neocortex. In?vivo two-photon imaging was used to monitor the formation and elimination of fluorescently labeled inhibitory structures on pyramidal neurons. We find that ocular dominance plasticity in the adult visual cortex is associated with rapid inhibitory synapse loss, especially of those present on dendritic spines. This occurs not only with monocular deprivation but also with subsequent restoration of binocular vision. We propose that in the adult visual cortex the experience-induced loss of inhibition may effectively strengthen specific visual inputs with limited need for rearranging the excitatory circuitry.     

Neural coding of 3D features of objects for hand action in the parietal cortex of the monkey.

In our previous studies of hand manipulation task-related neurons, we found many neurons of the parietal association cortex which responded to the sight of three-dimensional (3D) objects. Most of the task-related neurons in the AIP area (the lateral bank of the anterior intraparietal sulcus) were visually responsive and half of them responded to objects for manipulation. Most of these neurons were selective for the 3D features of the objects. More recently, we have found binocular visual neurons in the lateral bank of the caudal intraparietal sulcus (c-IPS area) that preferentially respond to a luminous bar or place at a particular orientation in space. We studied the responses of axis-orientation selective (AOS) neurons and surface-orientation selective (SOS) neurons in this area with stimuli presented on a 3D computer graphics display. The AOS neurons showed a stronger response to elongated stimuli and showed tuning to the orientation of the longitudinal axis. Many of them preferred a tilted stimulus in depth and appeared to be sensitive to orientation disparity and/or width disparity. The SOS neurons showed a stronger response to a flat than to an elongated stimulus and showed tuning to the 3D orientation of the surface. Their responses increased with the width or length of the stimulus. A considerable number of SOS neurons responded to a square in a random dot stereogram and were tuned to orientation in depth, suggesting their sensitivity to the gradient of disparity. We also found several SOS neurons that responded to a square with tilted or slanted contours, suggesting their sensitivity to orientation disparity and/or width disparity. Area c-IPS is likely to send visual signals of the 3D features of an object to area AIP for the visual guidance of hand actions.     

Stereoscopic vision: what's the first step?

Neurons in primary visual cortex respond to binocular disparity, the raw material of stereoscopic depth perception. Although these neurons are probably essential to depth perception, a recent study has shown that they are unable to compute depth itself.     

Stereoscopic Vision in the Absence of the Lateral Occipital Cortex

Both dorsal and ventral cortical visual streams contain neurons sensitive to binocular disparities, but the two streams may underlie different aspects of stereoscopic vision. Here we investigate stereopsis in the neurological patient D.F., whose ventral stream, specifically lateral occipital cortex, has been damaged bilaterally, causing profound visual form agnosia. Despite her severe damage to cortical visual areas, we report that DF''s stereo vision is strikingly unimpaired. She is better than many control observers at using binocular disparity to judge whether an isolated object appears near or far, and to resolve ambiguous structure-from-motion. DF is, however, poor at using relative disparity between features at different locations across the visual field. This may stem from a difficulty in identifying the surface boundaries where relative disparity is available. We suggest that the ventral processing stream may play a critical role in enabling healthy observers to extract fine depth information from relative disparities within one surface or between surfaces located in different parts of the visual field.     

Mouse visual cortex

Neurons in mouse visual cortex have diverse receptive field properties and they respond selectively to specific features of visual stimuli. Owing to the lateral position of the eyes, only about a third of the visual cortex receives input from both eyes, but many cells in this region are binocular. Similar to higher mammals, closing one eye during a critical period shifts the responses of cells, such that they are better driven by the non-deprived eye. In this review I illustrate how the combination of transgenic mouse technology with single cell recording and modern imaging techniques might lead to a further understanding of the mechanisms that underlie the development, plasticity, and function of the mammalian visual cortex.     

Binocular fusion in Panum''''s limiting case of stereopsis obeys the uniqueness constraint

In the information processing procedure of stereo vision, the uniqueness constraint has been used as one of the constraints to solve the "correspondence problem". While the uniqueness constraint is valid in most cases, whether it is still valid in some particular stimulus configuration (such as Panum's limiting case) has been a problem of widespread debate for a long time. To investigate the problem, we adopted the Panum's limiting case as its basic stimulus configuration, and delved into the phenomenon of binocular fusion from two distinct aspects: visual direction and orientation disparity. The results show that in Panum's limiting case binocular fusion does not comply with the rules governing regular binocular fusion as far as visual direction and orientation disparity are concerned. This indicates that double fusion does not happen in Panum's limiting case and that the uniqueness constraint is still valid.     

A binocular model for the simple cell

We authors propose a mathematical model for simple cell binocular response. It comprises two Gabor-type receptive fields (RF) having the same RF center, preferred spatial frequency, and preferred orientation. The model integrates the equally weighted signals from both eyes and performs a threshold operation. Poggio and Fischer (1977) classified binocular disparity cells in the striate cortex into four groups: tuned excitatory (TE), tuned inhibitory (TI), near, and far cells. They also found that most of the TE cells are ocularly balanced and that the other three types are usually unbalanced. This model can imitate these four types of disparity sensitivities and their ocular dominance tendency. We perform model fittings to Poggio's data using the “simulated annealing” method and discuss parameter dependence of the model's response. The model can also respond with exceptional disparity sensitivity: i.e., flat type, alternating type, and intermediate type.     

The Role of Binocular Disparity in Stereoscopic Images of Objects in the Macaque Anterior Intraparietal Area

Neurons in the macaque Anterior Intraparietal area (AIP) encode depth structure in random-dot stimuli defined by gradients of binocular disparity, but the importance of binocular disparity in real-world objects for AIP neurons is unknown. We investigated the effect of binocular disparity on the responses of AIP neurons to images of real-world objects during passive fixation. We presented stereoscopic images of natural and man-made objects in which the disparity information was congruent or incongruent with disparity gradients present in the real-world objects, and images of the same objects where such gradients were absent. Although more than half of the AIP neurons were significantly affected by binocular disparity, the great majority of AIP neurons remained image selective even in the absence of binocular disparity. AIP neurons tended to prefer stimuli in which the depth information derived from binocular disparity was congruent with the depth information signaled by monocular depth cues, indicating that these monocular depth cues have an influence upon AIP neurons. Finally, in contrast to neurons in the inferior temporal cortex, AIP neurons do not represent images of objects in terms of categories such as animate-inanimate, but utilize representations based upon simple shape features including aspect ratio.     

Fucntional specialization and binocular interaction in the visual areas of rhesus monkey prestriate cortex.

If is is believed that neural mechanisms mediating stereoscopic vision may be localized in specific areas of the visual cortex, then it becomes necessary to be able to define these areas adequately. This is no easy matter in the rhesus monkey, an animal close to man, where the cytoarchitecturally uniform prestriate cortex is folded into deep sulci with secondary gyri. One way around this awkward problem is to use the callosal connections of the prestriate cortex as the anatomical landmarks. Callosal connections are restricted to regions at which the vertical meridian is represented. Since the visual fields, including the vertical meridian, are separately represented in each area, each has its own callosal connections. These are of great help in defining some of the boundaries of these areas, since the boundaries often coincide with the representation of the vertical meridian. With the visual areas thus defined anatomically, it becomes relatively easy to assign recordings to particular areas. Studies of binocular interactions in these areas reveal that most cells in all prestriate areas are binocularly driven. Hence, theoretically, all of the prestriate areas are candidates for stereoscopic mechanisms. The degree of binocular interaction varies from cell to cell. At the two extremes are cells which either respond to monocular stimulation only and are inhibited by binocular stimulation or ones which respond to binocular stimulation only. Changing, as opposed to fixed, disparity is signalled by two types of cells. In one category are cells activated in opposite directions for the two eyes. Such cells are always binocularly driven. In the other category are cells, some of which are monocularly activated, that are capable of responding to changing image size. In the monkey, both these categories of cells have so far been found in the motion area of the superior temporal sulcus only.     

Binocular fusion in Panum’s limiting case of stereopsis obeys the uniqueness constraint

In the information processing procedure of stereo vision, the uniqueness constraint has been used as one of the constraints to solve the “correspondence problem”. While the uniqueness constraint is valid in most cases, whether it is still valid in some particular stimulus configuration (such as Panum’s limiting case) has been a problem of widespread debate for a long time. To investigate the problem, we adopted the Panum’s limiting case as its basic stimulus configuration, and delved into the phenomenon of binocular fusion from two distinct aspects: visual direction and orientation disparity. The results show that in Panum’s limiting case binocular fusion does not comply with the rules governing regular binocular fusion as far as visual direction and orientation disparity are concerned. This indicates that double fusion does not happen in Panum’s limiting case and that the uniqueness constraint is still valid.