Binocular depth perception and the cerebral cortex

Our ability to coordinate the use of our left and right eyes and to make use of subtle differences between the images received by each eye allows us to perceive stereoscopic depth, which is important for the visual perception of three-dimensional space. Binocular neurons in the visual cortex combine signals from the left and right eyes. Probing the roles of binocular neurons in different perceptual tasks has advanced our understanding of the stages within the visual cortex that lead to binocular depth perception.     

Optic lobe projections of marginal ommatidia in Calliphora erythrocephala specialized for detecting polarized light

Summary The structure of ommatidia at the dorsal eye margin of the fly, Calliphora erythrocephala is specialized for the detection of the e-vector of polarized light. Marginal zone ommatidia are distinguished by R7/R8 receptor cells with large-diameter, short, untwisted rhabdomeres and long axons to the medulla. The arrangement of the R7 microvillar directions along the marginal zone is fan-shaped. Ommatidia lining the dorsal and frontal edge of the eye lack primary screening pigments and have foreshortened crystalline cones. The marginal ommatidia from each eye view a strip that is 5 °–20 ° contralateral to the fly's longitudinal axis and that coincides with the outer boundaries of the binocular overlap.Cobalt injection into the retina demonstrates that photoreceptor axons arising from marginal ommatidia define a special area of marginal neuropil in the second visual neuropil, the medulla. Small-field neurons arising from the marginal medulla area define, in turn, a special area of marginal neuropil in the two deepest visual neuropils, the lobula and the lobula plate. From these arise local assemblies of columnar neurons that relay the marginal zones of one optic lobe to equivalent areas of the opposite lobe and to midbrain regions from which arise descending neurons destined for the the thoracic ganglia.Optically, the marginal zone of the retina represents the lateral edge of a larger area of ommatidia involved in dorsofrontal binocular overlap. This binocularity area is also represented by special arrangements of columnar neurons, which map the binocularity area of one eye into the lobula beneath the opposite eye. Another type of binocularity neuron terminates in the midbrain.These neuronal arrangements suggest two novel features of the insect optic lobes and brain: (1) Marginal neurons that directly connect the left and right optic lobes imply that each lobe receives a common input from areas of the left and right eye, specialized for detecting the pattern of polarized light. (2) Information about the e-vector pattern of sky-light polarization may be integrated with binocular and monocular pathways at the level of descending neurons leading to thoracic motor neuropil.     

Spontaneous symmetry breaking in self–organizing neural fields

We extend the theory of self-organizing neural fields in order to analyze the joint emergence of topography and feature selectivity in primary visual cortex through spontaneous symmetry breaking. We first show how a binocular one-dimensional topographic map can undergo a pattern forming instability that breaks the underlying symmetry between left and right eyes. This leads to the spatial segregation of eye specific activity bumps consistent with the emergence of ocular dominance columns. We then show how a 2-dimensional isotropic topographic map can undergo a pattern forming instability that breaks the underlying rotation symmetry. This leads to the formation of elongated activity bumps consistent with the emergence of orientation preference columns. A particularly interesting property of the latter symmetry breaking mechanism is that the linear equations describing the growth of the orientation columns exhibits a rotational shift-twist symmetry, in which there is a coupling between orientation and topography. Such coupling has been found in experimentally generated orientation preference maps     

综述: 初级视皮层的亮度信息加工

亮度(luminance)是最基本的视觉信息.与其他视觉特征相比,由于视神经元对亮度刺激的反应较弱,并且许多神经元对均匀亮度无反应,对亮度信息编码的神经机制知之甚少.初级视皮层部分神经元对亮度的反应要慢于对比度反应,被认为是由边界对比度诱导的亮度知觉(brightness)的神经基础.我们的研究表明,初级视皮层许多神经元的亮度反应要快于对比度反应,并且这些神经元偏好低的空间频率、高的时间频率和高的运动速度,提示皮层下具有低空间频率和高运动速度通路的信息输入对产生初级视皮层神经元的亮度反应有贡献.已经知道初级视皮层神经元对空间频率反应的时间过程是从低空间频率到高空间频率,我们发现的早期亮度反应是对极低空间频率的反应,与这一时间过程是一致的,是这一从粗到细的视觉信息加工过程的第一步,揭示了处理最早的粗的视觉信息的神经基础.另外,初级视皮层含有偏好亮度下降和高运动速度的神经元,这群神经元的活动有助于在光照差的环境中检测高速运动的低亮度物体.     

Spatial stereoresolution for depth corrugations may be set in primary visual cortex

Stereo "3D" depth perception requires the visual system to extract binocular disparities between the two eyes' images. Several current models of this process, based on the known physiology of primary visual cortex (V1), do this by computing a piecewise-frontoparallel local cross-correlation between the left and right eye's images. The size of the "window" within which detectors examine the local cross-correlation corresponds to the receptive field size of V1 neurons. This basic model has successfully captured many aspects of human depth perception. In particular, it accounts for the low human stereoresolution for sinusoidal depth corrugations, suggesting that the limit on stereoresolution may be set in primary visual cortex. An important feature of the model, reflecting a key property of V1 neurons, is that the initial disparity encoding is performed by detectors tuned to locally uniform patches of disparity. Such detectors respond better to square-wave depth corrugations, since these are locally flat, than to sinusoidal corrugations which are slanted almost everywhere. Consequently, for any given window size, current models predict better performance for square-wave disparity corrugations than for sine-wave corrugations at high amplitudes. We have recently shown that this prediction is not borne out: humans perform no better with square-wave than with sine-wave corrugations, even at high amplitudes. The failure of this prediction raised the question of whether stereoresolution may actually be set at later stages of cortical processing, perhaps involving neurons tuned to disparity slant or curvature. Here we extend the local cross-correlation model to include existing physiological and psychophysical evidence indicating that larger disparities are detected by neurons with larger receptive fields (a size/disparity correlation). We show that this simple modification succeeds in reconciling the model with human results, confirming that stereoresolution for disparity gratings may indeed be limited by the size of receptive fields in primary visual cortex.     

Motion-based analysis of spatial patterns by the human visual system

BACKGROUND: It is known that the visibility of patterns presented through stationary multiple slits is significantly improved by pattern movements. This study investigated whether this spatiotemporal pattern interpolation is supported by motion mechanisms, as opposed to the general belief that the human visual cortex initially analyses spatial patterns independent of their movements. RESULTS: Psychophysical experiments showed that multislit viewing could not be ascribed to such motion-irrelevant factors as retinal painting by tracking eye movements or an increase in the number of views by pattern movements. Pattern perception was more strongly impaired by the masking noise moving in the same direction than by the noise moving in the opposite direction, which indicates the direction selectivity of the pattern interpolation mechanism. A direction-selective impairment of pattern perception by motion adaptation also indicates the direction selectivity of the interpolation mechanism. Finally, the map of effective spatial frequencies, estimated by a reverse-correlation technique, indicates observers' perception of higher spatial frequencies, the recovery of which is theoretically impossible without the aid of motion information. CONCLUSIONS: These results provide clear evidence against the notion of separate analysis of pattern and motion. The visual system uses motion mechanisms to integrate spatial pattern information along the trajectory of pattern movement in order to obtain clear perception of moving patterns. The pattern integration mechanism is likely to be direction-selective filtering by V1 simple cells, but the integration of the local pattern information into a global figure should be guided by a higher-order motion mechanism such as MT pattern cells.     

Abnormal attentional modulation of retinotopic cortex in parietal patients with spatial neglect

Brain regions beyond visual cortex are thought to be responsible for attention-related modulation of visual processing [1, 2], but most evidence is indirect. Here, we applied functional magnetic resonance imaging (fMRI), including retinotopic mapping of visual areas, to patients with focal right-parietal lesions and left spatial neglect [3, 4]. When attentional load at fixation was minimal, retinotopic areas in right visual cortex showed preserved responses to task-irrelevant checkerboards in the contralateral left hemifield, analogously to left visual cortex for right-hemifield checkerboards, indicating a "symmetric" pattern in both hemispheres with respect to contralateral stimulation under these conditions. But when attentional load at fixation was increased, a functional asymmetry emerged for visual cortex, with contralateral responses in right visual areas being pathologically reduced (even eliminated for right V4/TEO), whereas left visual areas showed no such reduction in their contralateral response. These results reveal attention-dependent abnormalities in visual cortex after lesions in distant (parietal) regions. This may explain otherwise puzzling aspects of neglect [5, 6], as confirmed here by additional behavioral testing.     

Fix your eyes in the space you could reach: neurons in the macaque medial parietal cortex prefer gaze positions in peripersonal space

Interacting in the peripersonal space requires coordinated arm and eye movements to visual targets in depth. In primates, the medial posterior parietal cortex (PPC) represents a crucial node in the process of visual-to-motor signal transformations. The medial PPC area V6A is a key region engaged in the control of these processes because it jointly processes visual information, eye position and arm movement related signals. However, to date, there is no evidence in the medial PPC of spatial encoding in three dimensions. Here, using single neuron recordings in behaving macaques, we studied the neural signals related to binocular eye position in a task that required the monkeys to perform saccades and fixate targets at different locations in peripersonal and extrapersonal space. A significant proportion of neurons were modulated by both gaze direction and depth, i.e., by the location of the foveated target in 3D space. The population activity of these neurons displayed a strong preference for peripersonal space in a time interval around the saccade that preceded fixation and during fixation as well. This preference for targets within reaching distance during both target capturing and fixation suggests that binocular eye position signals are implemented functionally in V6A to support its role in reaching and grasping.     

Receptive fields of disparity-tuned simple cells in macaque V1

Binocular simple cells in primary visual cortex (V1) are the first cells along the mammalian visual pathway to receive input from both eyes. Two models of how binocular simple cells could extract disparity information have been put forward. The phase-shift model proposes that the receptive fields in the two eyes have different subunit organizations, while the position-shift model proposes that they have different overall locations. In five fixating macaque monkeys, we recorded from 30 disparity-tuned simple cells that showed selectivity to the disparity in a random dot stereogram. High-resolution maps of the left and right eye receptive fields indicated that both phase and position shifts were common. Single cells usually showed a combination of the two, and the optimum disparity was best correlated with the sum of receptive field phase and position shift.     

Predicting the stream of consciousness from activity in human visual cortex

Can the rapid stream of conscious experience be predicted from brain activity alone? Recently, spatial patterns of activity in visual cortex have been successfully used to predict feature-specific stimulus representations for both visible and invisible stimuli. However, because these studies examined only the prediction of static and unchanging perceptual states during extended periods of stimulation, it remains unclear whether activity in early visual cortex can also predict the rapidly and spontaneously changing stream of consciousness. Here, we used binocular rivalry to induce frequent spontaneous and stochastic changes in conscious experience without any corresponding changes in sensory stimulation, while measuring brain activity with fMRI. Using information that was present in the multivariate pattern of responses to stimulus features, we could accurately predict, and therefore track, participants' conscious experience from the fMRI signal alone while it underwent many spontaneous changes. Prediction in primary visual cortex primarily reflected eye-based signals, whereas prediction in higher areas reflected the color of the percept. Furthermore, accurate prediction during binocular rivalry could be established with signals recorded during stable monocular viewing, showing that prediction generalized across viewing conditions and did not require or rely on motor responses. It is therefore possible to predict the dynamically changing time course of subjective experience with only brain activity.     

Image-Based Grouping during Binocular Rivalry Is Dictated by Eye-Of-Origin

Prolonged viewing of dichoptically presented images with different content results in perceptual alternations known as binocular rivalry. This phenomenon is thought to be the result of competition at a local level, where local rivalry zones interact to give rise to a single, global dominant percept. Certain perceived combinations that result from this local competition are known to last longer than others, which is referred to as grouping during binocular rivalry. In recent years, the phenomenon has been suggested to be the result of competition at both eye- and image-based processing levels, although the exact contribution from each level remains elusive. Here we use a paradigm designed specifically to quantify the contribution of eye- and image-based processing to grouping during rivalry. In this paradigm we used sine-wave gratings as well as upright and inverted faces, with and without binocular disparity-based occlusion. These stimuli and conditions were used because they are known to result in processing at different stages throughout the visual processing hierarchy. Specifically, more complex images were included in order to maximize the potential contribution of image-based grouping. In spite of this, our results show that increasing image complexity did not lead to an increase in the contribution of image-based processing to grouping during rivalry. In fact, the results show that grouping was primarily affected by the eye-of-origin of the image parts, irrespective of stimulus type. We suggest that image content affects grouping during binocular rivalry at low-level processing stages, where it is intertwined with eye-of-origin information.     

Modulation of activity in human visual area V1 during memory masking

Neurons in the primary visual cortex, V1, are specialized for the processing of elemental features of the visual stimulus, such as orientation and spatial frequency. Recent fMRI evidence suggest that V1 neurons are also recruited in visual perceptual memory; a number of studies using multi-voxel pattern analysis have successfully decoded stimulus-specific information from V1 activity patterns during the delay phase in memory tasks. However, consistent fMRI signal modulations reflecting the memory process have not yet been demonstrated. Here, we report evidence, from three subjects, that the low V1 BOLD activity during retention of low-level visual features is caused by competing interactions between neural populations coding for different values along the spectrum of the dimension remembered. We applied a memory masking paradigm in which the memory representation of a masker stimulus interferes with a delayed spatial frequency discrimination task when its frequency differs from the discriminanda with ±1 octave and found that impaired behavioral performance due to masking is reflected in weaker V1 BOLD signals. This cross-channel inhibition in V1 only occurs with retinotopic overlap between the masker and the sample stimulus of the discrimination task. The results suggest that memory for spatial frequency is a local process in the retinotopically organized visual cortex.     

Dendritic spine dynamics are regulated by monocular deprivation and extracellular matrix degradation

The mammalian primary visual cortex (V1) is especially susceptible to changes in visual input over a well-defined critical period, during which closing one eye leads to a loss of responsiveness of neurons to the deprived eye and a shift in response toward the open eye. This functional plasticity can occur rapidly, following even a single day of eye closure, although the structural bases of these changes are unknown. Here, we show that rapid structural changes at the level of dendritic spines occur following brief monocular deprivation. These changes are evident in the supra- and infragranular layers of the binocular zone and can be mimicked by degradation of the extracellular matrix with the tPA/plasmin proteolytic cascade. Further, monocular deprivation occludes a subsequent effect of matrix degradation, suggesting that this mechanism is active in vivo to permit structural remodeling during ocular dominance plasticity.     

Tumor necrosis factor-alpha mediates one component of competitive, experience-dependent plasticity in developing visual cortex

Rapid, experience-dependent plasticity in developing visual cortex is thought to be competitive. After monocular visual deprivation, the reduction in response of binocular neurons to one eye is matched by a corresponding increase to the other. Chronic optical imaging in mice deficient in TNFalpha reveals the normal initial loss of deprived-eye responses, but the subsequent increase in response to the open eye is absent. This mutation also blocks homeostatic synaptic scaling of mEPSCs in visual cortex in vitro, without affecting LTP. In monocular cortex, thought not to be subject to competition, responses in TNFalpha mutants are as reduced as in the binocular zone. Pharmacological inhibition of endogenous TNFalpha in wild-type mice phenocopies the knockout. These findings suggest that experience-dependent competition in developing visual cortex is the outcome of two distinct, noncompetitive processes, a loss of deprived-eye responses followed by an apparently homeostatic increase in responses dependent on TNFalpha signaling.     

Spontaneous retinal activity mediates development of ocular dominance columns and binocular receptive fields in v1

The mechanisms that give rise to ocular dominance columns (ODCs) during development are controversial. Early experiments indicated a key role for retinal activity in ODC formation. However, later studies showed that in those early experiments, the retinal activity perturbation was initiated after ODCs had already formed. Moreover, recent studies concluded that early eye removals do not impact ODC segregation. Here we blocked spontaneous retinal activity during the very early stages of ODC development. This permanently disrupted the anatomical organization of ODCs and led to a dramatic increase in receptive field size for binocular cells in primary visual cortex. Our data suggest that early spontaneous retinal activity conveys crucial information about whether thalamocortical axons represent one or the other eye and that this activity mediates binocular competition important for shaping receptive fields in primary visual cortex.     

Binocular coordination during reading]

Is there an effect on binocular coordination during reading of oculomotor imbalance (heterophoria, strabismus and inadequate convergence) and of functional lateral characteristics (eye preference and perceptually privileged visual laterality)? Recordings of the binocular eye-movements of ten-year-old children show that oculomotor imbalances occur most often among children whose left visual perceptual channel is privileged, and that these subjects can present optomotor dissociation and manifest lack of motor coordination. Close binocular motor coordination is far from being the norm in reading. The faster reader displays saccades of differing spatial amplitude and the slower reader an oculomotor hyperactivity, especially during fixations. The recording of binocular movements in reading appears to be an excellent means of diagnosing difficulties related to visual laterality and to problems associated with oculomotor imbalance.     

Monocular focal retinal lesions induce short-term topographic plasticity in adult cat visual cortex

Electrophysiological recording in primary visual cortex (VI) was performed both prior to and in the hours immediately following the creation of a discrete retinal lesion in one eye with an argon laser. Lesion projection zones (LPZs; 21-64 mm2) were defined in the visual cortex by mapping the extent of the lesion onto the topographic representation in cortex. There was no effect on neuronal responses to the unlesioned eye or on its topographic representation. However, within hours of producing the retinal lesion, receptive fields obtained from stimulation of the lesioned eye were displaced onto areas surrounding the scotoma and were enlarged compared with the corresponding field obtained through the normal eye. The proportion of such responsive recording sites increased during the experiment such that 8-11 hours post-lesion, 56% of recording sites displayed neurons responsive to the lesioned eye. This is an equivalent proportion to that previously reported with long-term recovery (three weeks to three months). Responsive neurons were evident as far as 2.5 mm inside the border of the LPZ. The reorganization of the lesioned eye representation produced binocular disparities as great as 15 degrees, suggesting interactions between sites in VI up to 5.5 mm apart.     

Preserved Excitatory-Inhibitory Balance of Cortical Synaptic Inputs following Deprived Eye Stimulation after a Saturating Period of Monocular Deprivation in Rats

Monocular deprivation (MD) during development leads to a dramatic loss of responsiveness through the deprived eye in primary visual cortical neurons, and to degraded spatial vision (amblyopia) in all species tested so far, including rodents. Such loss of responsiveness is accompanied since the beginning by a decreased excitatory drive from the thalamo-cortical inputs. However, in the thalamorecipient layer 4, inhibitory interneurons are initially unaffected by MD and their synapses onto pyramidal cells potentiate. It remains controversial whether ocular dominance plasticity similarly or differentially affects the excitatory and inhibitory synaptic conductances driven by visual stimulation of the deprived eye and impinging onto visual cortical pyramids, after a saturating period of MD. To address this issue, we isolated visually-driven excitatory and inhibitory conductances by in vivo whole-cell recordings from layer 4 regular-spiking neurons in the primary visual cortex (V1) of juvenile rats. We found that a saturating period of MD comparably reduced visually–driven excitatory and inhibitory conductances driven by visual stimulation of the deprived eye. Also, the excitatory and inhibitory conductances underlying the synaptic responses driven by the ipsilateral, left open eye were similarly potentiated compared to controls. Multiunit recordings in layer 4 followed by spike sorting indicated that the suprathreshold loss of responsiveness and the MD-driven ocular preference shifts were similar for narrow spiking, putative inhibitory neurons and broad spiking, putative excitatory neurons. Thus, by the time the plastic response has reached a plateau, inhibitory circuits adjust to preserve the normal balance between excitation and inhibition in the cortical network of the main thalamorecipient layer.     

Sex & vision I: Spatio-temporal resolution

ABSTRACT: BACKGROUND: Cerebral cortex has a very large number of testosterone receptors, which could be a basis for sex differences in sensory functions. For example, audition has clear sex differences, which are related to serum testosterone levels. Of all major sensory systems only vision has not been examined for sex differences, which is surprising because occipital lobe (primary visual projection area) may have the highest density of testosterone receptors in the cortex. We have examined a basic visual function: spatial and temporal pattern resolution and acuity. METHODS: We tested large groups of young adults with normal vision. They were screened with a battery of standard tests that examined acuity, color vision, and stereopsis. We sampled the visual system's contrast-sensitivity function (CSF) across the entire spatio-temporal space: 6 spatial frequencies at each of 5 temporal rates. Stimuli were gratings with sinusoidal luminance profiles generated on a special-purpose computer screen; their contrast was also sinusoidally modulated in time. We measured threshold contrasts using a criterion-free (forced-choice), adaptive psychophysical method (QUEST algorithm). Also, each individual's acuity limit was estimated by fitting his or her data with a model and extrapolating to find the spatial frequency corresponding to 100 % contrast. RESULTS: At a very low temporal rate, the spatial CSF was the canonical inverted-U; but for higher temporal rates, the maxima of the spatial CSFs shifted: Observers lost sensitivity at high spatial frequencies and gained sensitivity at low frequencies; also, all the maxima of the CSFs shifted by about the same amount in spatial frequency. Main effect: there was a significant (ANOVA) sex difference. Across the entire spatio-temporal domain, males were more sensitive, especially at higher spatial frequencies; similarly males had significantly better acuity at all temporal rates. CONCLUSION: As with other sensory systems, there are marked sex differences in vision. The CSFs we measure are largely determined by inputs from specific sets of thalamic neurons to individual neurons in primary visual cortex. This convergence from thalamus to cortex is guided by cortex during embryogenesis. We suggest that testosterone plays a major role, leading to different connectivities in males and in females. But, for whatever reasons, we find that males have significantly greater sensitivity for fine detail and for rapidly moving stimuli. One interpretation is that this is consistent with sex roles in hunter-gatherer societies.