Detecting binocular 3D motion in static 3D noise: no effect of viewing distance

Relative binocular disparity cannot tell us the absolute 3D shape of an object, nor the 3D trajectory of its motion, unless the visual system has independent access to how far away the object is at any moment. Indeed, as the viewing distance is changed, the same disparate retinal motions will correspond to very different real 3D trajectories. In this paper we were interested in whether binocular 3D motion detection is affected by viewing distance. A visual search task was used, in which the observer is asked to detect a target dot, moving in 3D, amidst 3D stationary distractor dots. We found that distance does not affect detection performance. Motion-in-depth is consistently harder to detect than the equivalent lateral motion, for all viewing distances. For a constant retinal motion with both lateral and motion-in-depth components, detection performance is constant despite variations in viewing distance that produce large changes in the direction of the 3D trajectory. We conclude that binocular 3D motion detection relies on retinal, not absolute, visual signals.     

Human parieto-occipital visual cortex: lack of retinotopy and foveal magnification.

We studied visual representation in the parietal cortex by recording whole-scalp neuromagnetic responses to luminance stimuli of varying eccentricities. The stimuli were semicircles (5.5 degrees in radius) presented at horizontal eccentricities from 0 degree to 16 degrees, separately in the right and left hemifields. All stimuli evoked responses in the contralateral occipital and medial parietal areas. The waveforms and distributions of the occipital responses varied with stimulus side (left, right) and eccentricity, whereas the parietal responses were remarkably similar to all stimuli. The equivalent sources of the parietal signals clustered within 1 cm3 in the medial parieto-occipital sulcus and did not differ significantly between the stimuli. The strength of the parietal activation remained practically constant with increasing stimulus eccentricity, suggesting that the visual areas in the parieto-occipital sulcus lack the enhanced foveal representation typical of most other visual areas. This result strengthens our previous suggestion that the medial parieto-occipital sulcus is the human homologue of the monkey V6 complex, characterized by, for example, lack of retinotopy and the absence of relative foveal magnification.     

Does vertical disparity scale the perception of stereoscopic depth?

It has been suggested that a measure of the gradients of vertical disparity over a surface may scale the mapping between horizontal disparity and perceived depth. We have investigated this possibility by obtaining estimates of the depth within stereograms that simulated two apposed fronto-parallel planes placed at different distances from an observer. The gradients of vertical disparity in a stereogram were set to simulate those appropriate to a viewing distance of 12.5 cm, 25 cm, 50 cm or 100 cm, whereas the distance specified by vergence and accommodative cues was always fixed at 50 cm. Judgements of the perceived depth between the two planes were uninfluenced by changes in the gradients of vertical disparity. It thus seems that the human visual system does not employ vertical disparity as a scaling parameter in stereoscopic depth judgements.     

Stereoscopic depth constancy

Depth constancy is the ability to perceive a fixed depth interval in the world as constant despite changes in viewing distance and the spatial scale of depth variation. It is well known that the spatial frequency of depth variation has a large effect on threshold. In the first experiment, we determined that the visual system compensates for this differential sensitivity when the change in disparity is suprathreshold, thereby attaining constancy similar to contrast constancy in the luminance domain. In a second experiment, we examined the ability to perceive constant depth when the spatial frequency and viewing distance both changed. To attain constancy in this situation, the visual system has to estimate distance. We investigated this ability when vergence, accommodation and vertical disparity are all presented accurately and therefore provided veridical information about viewing distance. We found that constancy is nearly complete across changes in viewing distance. Depth constancy is most complete when the scale of the depth relief is constant in the world rather than when it is constant in angular units at the retina. These results bear on the efficacy of algorithms for creating stereo content.This article is part of the themed issue ‘Vision in our three-dimensional world’.     

用脑光学成像精确测定猫初级视皮层视野拓扑投射关系

利用基于脑内源信号的光学成像和二维互相关分析的方法,对猫初级视皮层17区的视野拓扑离心度(即视网膜-皮层拓扑关系)进行了精确测量。当采用在同一屏幕内处于上下视野的、方位互相垂直的两个相邻光栅刺激时,皮层中一部分区域的绝大部分细胞因同时兴奋而导致方位功能图模糊不清。将这种方位功能图和用单一方位(水平或垂直)全屏光栅刺激所得到的功能图进行比较,通过计算每一像素的互相关系数,从而获得皮层的精确视野拓扑离心度。同时用电生理的方法测量了同一视皮层内的单细胞的感受野位置,证明这种方法得到的视野离心度和光学记录方法得到的相同。因此,本研究为大面积地确定视皮层细胞感受野在视野中的位置提供了一种快速和较准确的方法。     

Stereoscopic acuity and observation distance

The amount of depth perceived from a fixed pattern of horizontal disparities varies with viewing distance. We investigated whether thresholds for discriminating stereoscopic corrugations at a range of spatial frequencies were also affected by viewing distance or whether they were determined solely by the angular disparity in the stimulus prior to scaling. Although thresholds were found to be determined primarily by disparity over a broad range of viewing distances, they were on average a factor of two higher at the shortest viewing distance (28.5 cm) than at larger viewing distances (57 to 450 cm). We found the same pattern of results when subjects' accommodation was arranged to be the same at all viewing distances. The change in thresholds at close distances is in the direction expected if subjects' performance is limited by a minimum perceived depth.     

Regional Neural Response Differences in the Determination of Faces or Houses Positioned in a Wide Visual Field

In human visual cortex, the primary visual cortex (V1) is considered to be essential for visual information processing; the fusiform face area (FFA) and parahippocampal place area (PPA) are considered as face-selective region and places-selective region, respectively. Recently, a functional magnetic resonance imaging (fMRI) study showed that the neural activity ratios between V1 and FFA were constant as eccentricities increasing in central visual field. However, in wide visual field, the neural activity relationships between V1 and FFA or V1 and PPA are still unclear. In this work, using fMRI and wide-view present system, we tried to address this issue by measuring neural activities in V1, FFA and PPA for the images of faces and houses aligning in 4 eccentricities and 4 meridians. Then, we further calculated ratio relative to V1 (RRV1) as comparing the neural responses amplitudes in FFA or PPA with those in V1. We found V1, FFA, and PPA showed significant different neural activities to faces and houses in 3 dimensions of eccentricity, meridian, and region. Most importantly, the RRV1s in FFA and PPA also exhibited significant differences in 3 dimensions. In the dimension of eccentricity, both FFA and PPA showed smaller RRV1s at central position than those at peripheral positions. In meridian dimension, both FFA and PPA showed larger RRV1s at upper vertical positions than those at lower vertical positions. In the dimension of region, FFA had larger RRV1s than PPA. We proposed that these differential RRV1s indicated FFA and PPA might have different processing strategies for encoding the wide field visual information from V1. These different processing strategies might depend on the retinal position at which faces or houses are typically observed in daily life. We posited a role of experience in shaping the information processing strategies in the ventral visual cortex.     

Fix your eyes in the space you could reach: neurons in the macaque medial parietal cortex prefer gaze positions in peripersonal space

Interacting in the peripersonal space requires coordinated arm and eye movements to visual targets in depth. In primates, the medial posterior parietal cortex (PPC) represents a crucial node in the process of visual-to-motor signal transformations. The medial PPC area V6A is a key region engaged in the control of these processes because it jointly processes visual information, eye position and arm movement related signals. However, to date, there is no evidence in the medial PPC of spatial encoding in three dimensions. Here, using single neuron recordings in behaving macaques, we studied the neural signals related to binocular eye position in a task that required the monkeys to perform saccades and fixate targets at different locations in peripersonal and extrapersonal space. A significant proportion of neurons were modulated by both gaze direction and depth, i.e., by the location of the foveated target in 3D space. The population activity of these neurons displayed a strong preference for peripersonal space in a time interval around the saccade that preceded fixation and during fixation as well. This preference for targets within reaching distance during both target capturing and fixation suggests that binocular eye position signals are implemented functionally in V6A to support its role in reaching and grasping.     

A neural mechanism for coordinate transformation predicts pre-saccadic remapping

Whenever we shift our gaze, any location information encoded in the retinocentric reference frame that is predominant in the visual system is obliterated. How is spatial memory retained across gaze changes? Two different explanations have been proposed: Retinocentric information may be transformed into a gaze-invariant representation through a mechanism consistent with gain fields observed in parietal cortex, or retinocentric information may be updated in anticipation of the shift expected with every gaze change, a proposal consistent with neural observations in LIP. The explanations were considered incompatible with each other, because retinocentric update is observed before the gaze shift has terminated. Here, we show that a neural dynamic mechanism for coordinate transformation can also account for retinocentric updating. Our model postulates an extended mechanism of reference frame transformation that is based on bidirectional mapping between a retinocentric and a body-centered representation and that enables transforming multiple object locations in parallel. The dynamic coupling between the two reference frames generates a shift of the retinocentric representation for every gaze change. We account for the predictive nature of the observed remapping activity by using the same kind of neural mechanism to generate an internal representation of gaze direction that is predictively updated based on corollary discharge signals. We provide evidence for the model by accounting for a series of behavioral and neural experimental observations.     

Detection and processing of vertical disparity by the human observer.

Based on the distinction between uniocular vertical magnification and vertical disparity, the induced size effect experiments were reinterpreted and new experiments done to show that vertical disparity signals can produce other stereoptic depth effects. The direction and efficiency of utilization of vertical disparity signals depend on the quadrant of the visual field and the stimulus position within it.     

Figure-ground activity in V1 and guidance of saccadic eye movements.

Every day we shift our gaze about 150.000 times mostly without noticing it. The direction of these gaze shifts are not random but directed by sensory information and internal factors. After each movement the eyes hold still for a brief moment so that visual information at the center of our gaze can be processed in detail. This means that visual information at the saccade target location is sufficient to accurately guide the gaze shift but yet is not sufficiently processed to be fully perceived. In this paper I will discuss the possible role of activity in the primary visual cortex (V1), in particular figure-ground activity, in oculo-motor behavior. Figure-ground activity occurs during the late response period of V1 neurons and correlates with perception. The strength of figure-ground responses predicts the direction and moment of saccadic eye movements. The superior colliculus, a gaze control center that integrates visual and motor signals, receives direct anatomical connections from V1. These projections may convey the perceptual information that is required for appropriate gaze shifts. In conclusion, figure-ground activity in V1 may act as an intermediate component linking visual and motor signals.     

Spatiotopic coding of BOLD signal in human visual cortex depends on spatial attention

The neural substrate of the phenomenological experience of a stable visual world remains obscure. One possible mechanism would be to construct spatiotopic neural maps where the response is selective to the position of the stimulus in external space, rather than to retinal eccentricities, but evidence for these maps has been inconsistent. Here we show, with fMRI, that when human subjects perform concomitantly a demanding attentive task on stimuli displayed at the fovea, BOLD responses evoked by moving stimuli irrelevant to the task were mostly tuned in retinotopic coordinates. However, under more unconstrained conditions, where subjects could attend easily to the motion stimuli, BOLD responses were tuned not in retinal but in external coordinates (spatiotopic selectivity) in many visual areas, including MT, MST, LO and V6, agreeing with our previous fMRI study. These results indicate that spatial attention may play an important role in mediating spatiotopic selectivity.     

Neural mechanisms for color perception in the primary visual cortex

New neurophysiological results show the existence of multiple transformations of color signals in the primary visual cortex (V1) in macaque monkey. These different color mechanisms may contribute separately to the perception of color boundaries and colored regions. Many cells in V1 respond to color and to black-white (luminance) patterns. These neurons are spatially selective and could provide signals about boundaries between differently colored regions. Other V1 neurons that prefer color over luminance respond without much spatial selectivity to colored stimuli, and could be the neural basis for the response to local color modulation within a region. How these different types of color cells combine inputs from cone photoreceptors is what gives them their different spatial selectivities for color.     

A direct projection from area V1 to area V3A of rhesus monkey visual cortex

Small cortical lesions were made in regions of the primary visual cortex (V1) representing different retinal eccentricities. It was found that, whereas all parts of V1 project to visual areas V2, V3 and the motion area of the superior temporal sulcus, only parts of V1 representing peripheral eccentricities (in excess of 30 degrees) project directly to visual area V3A.     

Psychophysical tests of the hypothesis of a bottom-up saliency map in primary visual cortex

A unique vertical bar among horizontal bars is salient and pops out perceptually. Physiological data have suggested that mechanisms in the primary visual cortex (V1) contribute to the high saliency of such a unique basic feature, but indicated little regarding whether V1 plays an essential or peripheral role in input-driven or bottom-up saliency. Meanwhile, a biologically based V1 model has suggested that V1 mechanisms can also explain bottom-up saliencies beyond the pop-out of basic features, such as the low saliency of a unique conjunction feature such as a red vertical bar among red horizontal and green vertical bars, under the hypothesis that the bottom-up saliency at any location is signaled by the activity of the most active cell responding to it regardless of the cell's preferred features such as color and orientation. The model can account for phenomena such as the difficulties in conjunction feature search, asymmetries in visual search, and how background irregularities affect ease of search. In this paper, we report nontrivial predictions from the V1 saliency hypothesis, and their psychophysical tests and confirmations. The prediction that most clearly distinguishes the V1 saliency hypothesis from other models is that task-irrelevant features could interfere in visual search or segmentation tasks which rely significantly on bottom-up saliency. For instance, irrelevant colors can interfere in an orientation-based task, and the presence of horizontal and vertical bars can impair performance in a task based on oblique bars. Furthermore, properties of the intracortical interactions and neural selectivities in V1 predict specific emergent phenomena associated with visual grouping. Our findings support the idea that a bottom-up saliency map can be at a lower visual area than traditionally expected, with implications for top-down selection mechanisms.     

Driving as night falls: the contribution of retinal flow and visual direction to the control of steering

We have the ability to locomote at high speeds, and we usually negotiate bends safely, even when visual information is degraded, for example, when driving at night. There are three sources of visual information that could support successful steering. An observer fixating a steering target that is eccentric to the current heading must rotate their gaze. The gaze rotation may be detected by using head and eye movement signals (extra-retinal direction: ERD) or their retinal counterpart, visual direction (VD). The gaze rotation also transforms the global retinal flow (RF) field, which may enable direct steering judgments. In this study, we manipulate VD and RF to determine their contribution toward steering a curved path in the presence of ERD. The results suggest a model that uses a weighted combination of all three information sources, but results also suggest that this weighting may change in reduced visibility, such as in low-light conditions.     

Temporal Structure of Human Gaze Dynamics Is Invariant During Free Viewing

We investigate the dynamic structure of human gaze and present an experimental study of the frequency components of the change in gaze position over time during free viewing of computer-generated fractal images. We show that changes in gaze position are scale-invariant in time with statistical properties that are characteristic of a random walk process. We quantify and track changes in the temporal structure using a well-defined scaling parameter called the Hurst exponent, H. We find H is robust regardless of the spatial complexity generated by the fractal images. In addition, we find the Hurst exponent is invariant across all participants, including those with distinct changes to higher order visual processes due to neural degeneration. The value we find for H of 0.57 shows that the gaze dynamics during free viewing of fractal images are consistent with a random walk process with persistent movements. Our research suggests the human visual system may have a common strategy that drives the dynamics of human gaze during exploration.     

Reflexive social attention in monkeys and humans

For humans, social cues often guide the focus of attention. Although many nonhuman primates, like humans, live in large, complex social groups, the extent to which human and nonhuman primates share fundamental mechanisms of social attention remains unexplored. Here, we show that, when viewing a rhesus macaque looking in a particular direction, both rhesus macaques and humans reflexively and covertly orient their attention in the same direction. Specifically, when performing a peripheral visual target detection task, viewing a monkey with either its eyes alone or with both its head and eyes averted to one side facilitated the detection of peripheral targets when they randomly appeared on the same side. Moreover, viewing images of a monkey with averted gaze evoked small but systematic shifts in eye position in the direction of gaze in the image. The similar magnitude and temporal dynamics of response facilitation and eye deviation in monkeys and humans suggest shared neural circuitry mediating social attention.