Detecting binocular 3D motion in static 3D noise: no effect of viewing distance

Relative binocular disparity cannot tell us the absolute 3D shape of an object, nor the 3D trajectory of its motion, unless the visual system has independent access to how far away the object is at any moment. Indeed, as the viewing distance is changed, the same disparate retinal motions will correspond to very different real 3D trajectories. In this paper we were interested in whether binocular 3D motion detection is affected by viewing distance. A visual search task was used, in which the observer is asked to detect a target dot, moving in 3D, amidst 3D stationary distractor dots. We found that distance does not affect detection performance. Motion-in-depth is consistently harder to detect than the equivalent lateral motion, for all viewing distances. For a constant retinal motion with both lateral and motion-in-depth components, detection performance is constant despite variations in viewing distance that produce large changes in the direction of the 3D trajectory. We conclude that binocular 3D motion detection relies on retinal, not absolute, visual signals.     

Is the Aligning Prism Measured with the Mallett Unit Correlated with Fusional Vergence Reserves?

Background

The Mallett Unit is a clinical test designed to detect the fixation disparity that is most likely to occur in the presence of a decompensated heterophoria. It measures the associated phoria, which is the “aligning prism” needed to nullify the subjective disparity. The technique has gained widespread acceptance within professions such as optometry, for investigating suspected cases of decompensating heterophoria; it is, however, rarely used by orthoptists and ophthalmologists. The aim of this study was to investigate whether fusional vergence reserves, measured routinely by both orthoptists and ophthalmologists to detect heterophoria decompensation, were correlated with aligning prism (associated phoria) in a normal clinical population.

Methodology/Principal Findings

Aligning prism (using the Mallett Unit) and fusional vergence reserves (using a prism bar) were measured in 500 participants (mean 41.63 years; standard deviation 11.86 years) at 40 cm and 6 m. At 40 cm a strong correlation (p<0.001) between base in aligning prism (Exo FD) and positive fusional reserves was found. Of the participants with zero aligning prism 30% had reduced fusional reserves. At 6 m a weak correlation between base out aligning prism (Eso FD) and negative fusional reserves was found to break (p = 0.01) and to recovery (p = 0.048). Of the participants with zero aligning prism 12% reported reduced fusional reserves.

Conclusions/Significance

For near vision testing, the strong inverse correlation between base in aligning prism (Exo FD) and fusional vergence reserves supports the notion that both measures are indicators of decompensation of heterophoria. For distance vision testing and for those patients reporting zero aligning prism further research is required to determine why the relationship appears to be weak/non-existent?     

Effects of Prism Eyeglasses on Objective and Subjective Fixation Disparity

In optometry of binocular vision, the question may arise whether prisms should be included in eyeglasses to compensate an oculomotor and/or sensory imbalance between the two eyes. The corresponding measures of objective and subjective fixation disparity may be reduced by the prisms, or the adaptability of the binocular vergence system may diminish effects of the prisms over time. This study investigates effects of wearing prisms constantly for about 5 weeks in daily life. Two groups of 12 participants received eyeglasses with prisms having either a base-in direction or a base-out direction with an amount up to 8 prism diopters. Prisms were prescribed based on clinical fixation disparity test plates at 6 m. Two dependent variables were used: (1) subjective fixation disparity was indicated by a perceived offset of dichoptic nonius lines that were superimposed on the fusion stimuli and (2) objective fixation disparity was measured with a video based eye tracker relative to monocular calibration. Stimuli were presented at 6 m and included either central or more peripheral fusion stimuli. Repeated measurements were made without the prisms and with the prisms after about 5 weeks of wearing these prisms. Objective and subjective fixation disparity were correlated, but the type of fusion stimulus and the direction of the required prism may play a role. The prisms did not reduce the fixation disparity to zero, but induced significant changes in fixation disparity with large effect sizes. Participants receiving base-out prisms showed hypothesized effects, which were concurrent in both types of fixation disparity. In participants receiving base-in prisms, the individual effects of subjective and objective effects were negatively correlated: the larger the subjective (sensory) effect, the smaller the objective (motor) effect. This response pattern was related to the vergence adaptability, i.e. the individual fusional vergence reserves.     

Dependence of the motor response time in discrimination task on the character of visual information available

The interaction of visual and proprioceptive afferentation were studied in the motor task for discrimination of weights of falling objects. The availability of visual information reduced the time of motor response; however, the degree of shortening depended on the type of this information. The decrease in the response time was significantly greater when the subject saw the beginning of the real falling of object instead of having only visual information about the beginning of the fall. Thus, a subject solves the motor task for discrimination of weights of falling objects more efficiently when he sees the real beginning of the fall, rather than in the case when the subject receives only a visual signal at the moment when an electromagnet releases the object. This may be due to the fact that seeing the initial part of a real trajectory instead of an abstract signal about the beginning of the fall allows the subject to better predict the moment of the impact.     

Binocular fusion in Panum’s limiting case of stereopsis obeys the uniqueness constraint

In the information processing procedure of stereo vision, the uniqueness constraint has been used as one of the constraints to solve the “correspondence problem”. While the uniqueness constraint is valid in most cases, whether it is still valid in some particular stimulus configuration (such as Panum’s limiting case) has been a problem of widespread debate for a long time. To investigate the problem, we adopted the Panum’s limiting case as its basic stimulus configuration, and delved into the phenomenon of binocular fusion from two distinct aspects: visual direction and orientation disparity. The results show that in Panum’s limiting case binocular fusion does not comply with the rules governing regular binocular fusion as far as visual direction and orientation disparity are concerned. This indicates that double fusion does not happen in Panum’s limiting case and that the uniqueness constraint is still valid.     

Dyslexic children are confronted with unstable binocular fixation while reading

Reading requires three-dimensional motor control: saccades bring the eyes from left to right, fixating word after word; and oblique saccades bring the eyes to the next line of the text. The angle of vergence of the two optic axes should be adjusted to the depth of the book or screen and--most importantly--should be maintained in a sustained manner during saccades and fixations. Maintenance of vergence is important as it is a prerequisite for a single clear image of each word to be projected onto the fovea of the eyes. Deficits in the binocular control of saccades and of vergence in dyslexics have been reported previously but only for tasks using single targets. This study examines saccades and vergence control during real text reading. Thirteen dyslexic and seven non-dyslexic children read the French text "L'Allouette" in two viewing distances (40 cm vs. 100 cm), while binocular eye movements were measured with the Chronos Eye-tracking system. We found that the binocular yoking of reading saccades was poor in dyslexic children (relative to non-dyslexics) resulting in vergence errors; their disconjugate drift during fixations was not correlated with the disconjugacy during their saccades, causing considerable variability of vergence angle from fixation to fixation. Due to such poor oculomotor adjustments during reading, the overall fixation disparity was larger for dyslexic children, putting larger demand on their sensory fusion processes. Moreover, for dyslexics the standard deviation of fixation disparity was larger particularly when reading at near distance. We conclude that besides documented phoneme processing disorders, visual/ocular motor imperfections may exist in dyslexics that lead to fixation instability and thus, to instability of the letters or words during reading; such instability may perturb fusional processes and might--in part--complicate letter/word identification.     

Binocular fusion in Panum’s limiting case of stereopsis obeys the uniqueness constraint

In the information processing procedure of stereo vision, the uniqueness constraint has been used as one of the constraints to solve the “correspondence problem”. While the uniqueness constraint is valid in most cases, whether it is still valid in some particular stimulus configuration (such as Panum’s limiting case) has been a problem of widespread debate for a long time. To investigate the problem, we adopted the Panum’s limiting case as its basic stimulus configuration, and delved into the phenomenon of binocular fusion from two distinct aspects: visual direction and orientation disparity. The results show that in Panum’s limiting case binocular fusion does not comply with the rules governing regular binocular fusion as far as visual direction and orientation disparity are concerned. This indicates that double fusion does not happen in Panum’s limiting case and that the uniqueness constraint is still valid.     

Visible binocular beats from invisible monocular stimuli during binocular rivalry

When two qualitatively different stimuli are presented at the same time, one to each eye, the stimuli can either integrate or compete with each other. When they compete, one of the two stimuli is alternately suppressed, a phenomenon called binocular rivalry [1,2]. When they integrate, observers see some form of the combined stimuli. Many different properties (for example, shape or color) of the two stimuli can induce binocular rivalry. Not all differences result in rivalry, however. Visual 'beats', for example, are the result of integration of high-frequency flicker between the two eyes [3,4], and are thus a binocular fusion phenomenon. It remains in dispute whether binocular fusion and rivalry can co-exist with one another [5-7]. Here, we report that rivalry and beats, two apparently opposing phenomena, can be perceived at the same time within the same spatial location. We hypothesized that the interocular difference in visual attributes that are predominantly processed in the Parvocellular pathway will lead to rivalry, and differences in visual attributes that are predominantly processed in the Magnocellular pathway tend to integrate. Further predictions based on this hypothesis were tested and confirmed.     

Luminance,Colour, Viewpoint and Border Enhanced Disparity Energy Model

The visual cortex is able to extract disparity information through the use of binocular cells. This process is reflected by the Disparity Energy Model, which describes the role and functioning of simple and complex binocular neuron populations, and how they are able to extract disparity. This model uses explicit cell parameters to mathematically determine preferred cell disparities, like spatial frequencies, orientations, binocular phases and receptive field positions. However, the brain cannot access such explicit cell parameters; it must rely on cell responses. In this article, we implemented a trained binocular neuronal population, which encodes disparity information implicitly. This allows the population to learn how to decode disparities, in a similar way to how our visual system could have developed this ability during evolution. At the same time, responses of monocular simple and complex cells can also encode line and edge information, which is useful for refining disparities at object borders. The brain should then be able, starting from a low-level disparity draft, to integrate all information, including colour and viewpoint perspective, in order to propagate better estimates to higher cortical areas.     

Isotropic integration of binocular disparity and relative motion in the perception of three-dimensional shape

Richards (1985) showed that veridical three-dimensional shape may be recovered from the integration of binocular disparity and retinal motion information, but proposed that this integration may only occur for horizontal retinal motion. Psychophysical evidence supporting the combination of stereo and motion information is limited to the case of horizontal motion (Johnston et al., 1994), and has been criticised on the grounds of potential object boundary cues to shape present in the stimuli. We investigated whether veridical shape can be recovered under more general conditions. Observers viewed cylinders that were defined by binocular disparity, two-frame motion or a combination of disparity and motion, presented at simulated distances of 30 cm, 90 cm or 150 cm. Horizontally and vertically oriented cylinders were rotated about vertical and horizontal axes. When rotation was about the cylinder's own axis, no boundary cues to shape were introduced. Settings were biased for the disparity and two-frame motion stimuli, while more veridical shape judgements were made under all conditions for combined cue stimuli. These results demonstrate that the improved perception of three-dimensional shape in these stimuli is not a consequence of the presence of object boundary cues, and that the combination of disparity and motion is not restricted to horizontal image motion.     

Binocular cues and the control of prehension

The present study was designed to assess the importance of binocular information (i.e. binocular disparity and angle of convergence) in the control of prehension. Previous studies which have addressed this question have typically used the same experimental manipulation: comparing prehensile movements executed either under binocular conditions to those executed when one eye was occluded (monocular). However this may not be the correct comparison as in addition to depriving the subject of binocular depth cues. it also deprives the subject of any visual information in one eye. Therefore we determined the prehensile performance when the subject viewed the target object and scene with either (i) two different views (binocular), (ii) two identical views (bi-ocular), or (iii) one view only (monocular). Overall, the qualitative and quantitative performance in the bi-ocular and monocular control conditions was very similar on all the main measures (and different from the performance in the binocular condition). We conclude that the deficits in performance observed found for 'monocular' reaches should be attributed to the lack of local depth information specified by the binocular cues. In addition we speculate that convergence angle and binocular disparity, although involved in both the pre-movement and movement-execution phases of the reach, the cues may be weighted differently in both phases of a prehension movement depending on the behavioural strategy involved.     

Neurontropy,an entropy-like measure of neural correlation,in binocular fusion and rivalry

Dynamic random dot stereograms were generated for which the left and right arrays were either identical (100% correlation), or uncorrelated (0% correlation), or the complements of each other (-100% correlation). Any two of these three states of correlation were presented in succession and duration thresholds for detecting the transitions were measured. These thresholds were much longer when the transition went from the uncorrelated state to the correlated state than vice versa. In order to explain the detection thresholds for the various transitions a model based on the notion of an entropy-like measure (to be called neurontropy) has been proposed. It was assumed that in binocular vision both a fusional and a rivalry process operate simultaneously, but in a dual fashion. Thus the correlated state would be regarded the same way by the fusional process as the complemented state by the rivalry process. Transitions from the uncorrelated to the complemented state (and vice versa) were the most difficult to detect, a task which only the rivalry process could accomplish. The long detection thresholds indicate that the rivalry process is less efficient than the fusional process.Address Fill Oct. 1, 1976: Prof. Dr. B. Julesz     

From optics to attention: visual perception in barn owls

Barn owls are nocturnal predators which have evolved specific sensory and morphological adaptations to a life in dim light. Here, some of the most fundamental properties of spatial vision in barn owls are reviewed. The eye with its tubular shape is rigidly integrated in the skull so that eye movements are very much restricted. The eyes are oriented frontally, allowing for a large binocular overlap. Accommodation, but not pupil dilation, is coupled between the two eyes. The retina is rod dominated and lacks a visible fovea. Retinal ganglion cells form a marked region of highest density that extends to a horizontally oriented visual streak. Behavioural visual acuity and contrast sensitivity are poor, although the optical quality of the ocular media is excellent. A low f-number allows high image quality at low light levels. Vernier acuity was found to be a hyperacute percept. Owls have global stereopsis with hyperacute stereo acuity thresholds. Neurons of the visual Wulst are sensitive to binocular disparities. Orientation based saliency was demonstrated in a visual-search experiment, and higher cognitive abilities were shown when the owl’s were able to use illusory contours for object discrimination.     

Angular smoothing and radial regularization of ODF fields: Application on deterministic crossing fiber tractography

The advent of high angular resolution diffusion imaging (HARDI) has opened up new perspectives for the delineation of crossing and branching fiber pathways. However, image acquisition under clinical conditions with limited measurement time faces the problem of poor spatial and angular resolution and the technique’s high susceptibility to noise. In this paper we present a straightforward spatial filter for ODF fields that uses the data-inherent structural information around a voxel as part of a directionally selective method for angular smoothing and radial regularization (ASRR). Especially in regions where fibers cross (multimodal voxels), the method allows us to reduce noise, improve the accuracy of ODF diffusion peaks, and strengthen signals of non-dominant fibers. Moreover, we propose a dynamic scheme in which regularization is applied only to ODFs classified as multimodal. The approach is quantitatively evaluated on synthetic datasets of various configurations. With an in vivo dataset of a human subject, measured under clinical imaging conditions, we demonstrate the method’s ability to improve tractography of non-dominant transcallosal fiber pathways and the long fibers of the superior longitudinal fasciculus.     

Multiscale Adaptive Marginal Analysis of Longitudinal Neuroimaging Data with Time‐Varying Covariates

Summary Neuroimaging data collected at repeated occasions are gaining increasing attention in the neuroimaging community due to their potential in answering questions regarding brain development, aging, and neurodegeneration. These datasets are large and complicated, characterized by the intricate spatial dependence structure of each response image, multiple response images per subject, and covariates that may vary with time. We propose a multiscale adaptive generalized method of moments (MA‐GMM) approach to estimate marginal regression models for imaging datasets that contain time‐varying, spatially related responses and some time‐varying covariates. Our method categorizes covariates into types to determine the valid moment conditions to combine during estimation. Further, instead of assuming independence of voxels (the components that make up each subject’s response image at each time point) as many current neuroimaging analysis techniques do, this method “adaptively smoothes” neuroimaging response data, computing parameter estimates by iteratively building spheres around each voxel and combining observations within the spheres with weights. MA‐GMM’s development adds to the few available modeling approaches intended for longitudinal imaging data analysis. Simulation studies and an analysis of a real longitudinal imaging dataset from the Alzheimer’s Disease Neuroimaging Initiative are used to assess the performance of MA‐GMM. Martha Skup, Hongtu Zhu, and Heping Zhang for the Alzheimer’s Disease Neuroimaging Initiative.     

Vibrotactile feedback for conveying object shape information as perceived by artificial sensing of robotic arm

This work is a preliminary study towards developing an alternative communication channel for conveying shape information to aid in recognition of items when tactile perception is hindered. Tactile data, acquired during object exploration by sensor fitted robot arm, are processed to recognize four basic geometric shapes. Patterns representing each shape, classified from tactile data, are generated using micro-controller-driven vibration motors which vibrotactually stimulate users to convey the particular shape information. These motors are attached on the subject’s arm and their psychological (verbal) responses are recorded to assess the competence of the system to convey shape information to the user in form of vibrotactile stimulations. Object shapes are classified from tactile data with an average accuracy of 95.21 %. Three successive sessions of shape recognition from vibrotactile pattern depicted learning of the stimulus from subjects’ psychological response which increased from 75 to 95 %. This observation substantiates the learning of vibrotactile stimulation in user over the sessions which in turn increase the system efficacy. The tactile sensing module and vibrotactile pattern generating module are integrated to complete the system whose operation is analysed in real-time. Thus, the work demonstrates a successful implementation of the complete schema of artificial tactile sensing system for object-shape recognition through vibrotactile stimulations.     

The neuro-ecology of resource localization in Drosophila: Behavioral components of perception and search

From the moment an adult fruit fly ecloses, its primary objective in life is to disperse and locate the source of an attractive food odor upon which to feed and reproduce. The evolution of flight has greatly enhanced the success of fruit flies specifically and insects more generally.1 Control of flight by Drosophila melanogaster is unequivocally visual. Strong optomotor reflexes towards translatory and rotational visual flow stabilize forward flight trajectory, altitude, and speed. 2, 3 The steering responses to translatory and rotational flow in particular are mediated by computationally separate neural circuits in the fly’s visual system,4 and gaze-stabilizing body saccades are elicited by threshold integration of expanding visual flow .5 However, visual information is not alone sufficient to enable a fruit fly to recognize and locate an appropriately smelly object due in part to the relatively poor resolution of its compound eyes. Rather, the animal uses an acute sense of smell to actively track odors during flight. Without a finely adapted olfactory system, the fly’s remarkable visual capabilities are for naught. The relative importance of vision is apparent in the cross-modal fusion of the two modalities for stable active odor tracking.6, 7 Olfactory processing in Drosophila is shaped by ecological and functional forces which are inextricably linked. Thus physiologists seeking the functional determinants of olfactory coding as well as ecologists seeking to understand the mechanisms of speciation do well to consider each others’ point of view. Here we synthesize a broad perspective that integrates across ultimate and proximate mechanisms of odor tracking in Drosophila.     

Depth perception in disparity-defined objects: finding the balance between averaging and segregation

Deciding what constitutes an object, and what background, is an essential task for the visual system. This presents a conundrum: averaging over the visual scene is required to obtain a precise signal for object segregation, but segregation is required to define the region over which averaging should take place. Depth, obtained via binocular disparity (the differences between two eyes’ views), could help with segregation by enabling identification of object and background via differences in depth. Here, we explore depth perception in disparity-defined objects. We show that a simple object segregation rule, followed by averaging over that segregated area, can account for depth estimation errors. To do this, we compared objects with smoothly varying depth edges to those with sharp depth edges, and found that perceived peak depth was reduced for the former. A computational model used a rule based on object shape to segregate and average over a central portion of the object, and was able to emulate the reduction in perceived depth. We also demonstrated that the segregated area is not predefined but is dependent on the object shape. We discuss how this segregation strategy could be employed by animals seeking to deter binocular predators.This article is part of the themed issue ‘Vision in our three-dimensional world’.     

Vision, touch and object manipulation in Senegal parrots Poicephalus senegalus

Parrots are exceptional among birds for their high levels of exploratory behaviour and manipulatory abilities. It has been argued that foraging method is the prime determinant of a bird's visual field configuration. However, here we argue that the topography of visual fields in parrots is related to their playful dexterity, unique anatomy and particularly the tactile information that is gained through their bill tip organ during object manipulation. We measured the visual fields of Senegal parrots Poicephalus senegalus using the ophthalmoscopic reflex technique and also report some preliminary observations on the bill tip organ in this species. We found that the visual fields of Senegal parrots are unlike those described hitherto in any other bird species, with both a relatively broad frontal binocular field and a near comprehensive field of view around the head. The behavioural implications are discussed and we consider how extractive foraging and object exploration, mediated in part by tactile cues from the bill, has led to the absence of visual coverage of the region below the bill in favour of more comprehensive visual coverage above the head.