Binocular fusion in Panum’s limiting case of stereopsis obeys the uniqueness constraint

In the information processing procedure of stereo vision, the uniqueness constraint has been used as one of the constraints to solve the “correspondence problem”. While the uniqueness constraint is valid in most cases, whether it is still valid in some particular stimulus configuration (such as Panum’s limiting case) has been a problem of widespread debate for a long time. To investigate the problem, we adopted the Panum’s limiting case as its basic stimulus configuration, and delved into the phenomenon of binocular fusion from two distinct aspects: visual direction and orientation disparity. The results show that in Panum’s limiting case binocular fusion does not comply with the rules governing regular binocular fusion as far as visual direction and orientation disparity are concerned. This indicates that double fusion does not happen in Panum’s limiting case and that the uniqueness constraint is still valid.     

Binocular fusion in Panum''''s limiting case of stereopsis obeys the uniqueness constraint

In the information processing procedure of stereo vision, the uniqueness constraint has been used as one of the constraints to solve the "correspondence problem". While the uniqueness constraint is valid in most cases, whether it is still valid in some particular stimulus configuration (such as Panum's limiting case) has been a problem of widespread debate for a long time. To investigate the problem, we adopted the Panum's limiting case as its basic stimulus configuration, and delved into the phenomenon of binocular fusion from two distinct aspects: visual direction and orientation disparity. The results show that in Panum's limiting case binocular fusion does not comply with the rules governing regular binocular fusion as far as visual direction and orientation disparity are concerned. This indicates that double fusion does not happen in Panum's limiting case and that the uniqueness constraint is still valid.     

Binocular fusion in Panum’s limiting case of stereopsis obeys the uniqueness constraint

In the information processing procedure of stereo vision, the uniqueness constraint has been used as one of the constraints to solve the “correspondence problem”. While the uniqueness constraint is valid in most cases, whether it is still valid in some particular stimulus configuration (such as Panum’s limiting case) has been a problem of widespread debate for a long time. To investigate the problem, we adopted the Panum’s limiting case as its basic stimulus configuration, and delved into the phenomenon of binocular fusion from two distinct aspects: visual direction and orientation disparity. The results show that in Panum’s limiting case binocular fusion does not comply with the rules governing regular binocular fusion as far as visual direction and orientation disparity are concerned. This indicates that double fusion does not happen in Panum’s limiting case and that the uniqueness constraint is still valid.     

A scheme for binocular depth perception suggested by neurophysiological evidence

A scheme suggested by neurophysiological evidence is proposed to account for the perceptual phenomena related to binocular stereopsis, especially those observed with Julesz' random stereograms. In the scheme, monocular local features are extracted first. Then the correspondence between the left and right local features is searched for. The correspondence is not one-to-one in general. Thus a sort of direction column due to Blakemore is formed. Each unit in the column is binocular and the receptive field belonging to one eye is located in the same part of the visual field as long as the unit belongs to the same column. However, the receptive fields belonging to the other eye are horizontally displaced to one another. That is, each unit is characterized by binocular disparity. If the correspondence is not one-to-one, then several units belonging to the same column respond simultaneously. Binocular stereopsis can be established if one-to-one correspondence is determined to yield global three dimensional regions. The determination of one-to-one correspondence is carried out through a sort of laterally interacting circuitry in the disparity domain. After the determination of local correspondence, three dimensional global regions are formed by detecting the boundary and by filling-in occluded regions. The results of computer simulation are presented regarding Julesz' stereograms with various types of perturbation. Furthermore, the case of random-dot stereogram in which there is a size difference between the left and right images is simulated. Finally, the computer simulation related to the hysteresis in binocular depth perception is carried out.     

Cue combination in the motion correspondence problem

Image motion is a primary source of visual information about the world. However, before this information can be used the visual system must determine the spatio-temporal displacements of the features in the dynamic retinal image, which originate from objects moving in space. This is known as the motion correspondence problem. We investigated whether cross-cue matching constraints contribute to the solution of this problem, which would be consistent with physiological reports that many directionally selective cells in the visual cortex also respond to additional visual cues. We measured the maximum displacement limit (Dmax) for two-frame apparent motion sequences. Dmax increases as the number of elements in such sequences decreases. However, in our displays the total number of elements was kept constant while the number of a subset of elements, defined by a difference in contrast polarity, binocular disparity or colour, was varied. Dmax increased as the number of elements distinguished by a particular cue was decreased. Dmax was affected by contrast polarity for all observers, but only some observers were influenced by binocular disparity and others by colour information. These results demonstrate that the human visual system exploits local, cross-cue matching constraints in the solution of the motion correspondence problem.     

The direction of retinal motion facilitates binocular stereopsis.

Visual information from binocular disparity and from relative motion provide information about three-dimensional structure and layout of the world. Although the mechanisms that process these cues have typically been studied independently, there is now a substantial body of evidence that suggests that they interact in the visual pathway. This paper investigates one advantage of such an interaction: whether retinal motion can be used as a matching constraint in the binocular correspondence process. Stimuli that contained identical disparity and motion signals but which differed in their fine-scale correlation were created to establish whether the direction, or the speed, of motion could enhance performance in a psychophysical task in which binocular matching is a limiting factor. The results of these experiments provide clear evidence that different directions of motion, but not different speeds, are processed separately in stereopsis. The results fit well with properties of neurons early in the cortical visual pathway which are thought to be involved in determining local matches between features in the two eyes'' images.     

Size-disparity correlation in human binocular depth perception.

To use the small horizontal disparities between images projected to the eyes for the recovery of three-dimensional information, our visual system must first identify which feature in one eye's image corresponds with which in the other. The earliest level of disparity processing in primates (V1) contains cells that are spatial-frequency tuned. If such cells have a disparity range that covers only a single period of their mean tuning frequency, there will always be exactly one potential match within this range. Here, this 'size-disparity' hypothesis was tested by measuring the contrast sensitivity of stereopsis as a function of disparity for single bandpass-filtered items. It was found that thresholds were low and relatively constant up to disparities an order of magnitude larger than is predicted by this constraint. Furthermore, peak sensitivity was relatively independent of spatial frequency. A control experiment showed that binocular correlation of the carrier is necessary for this task. In a third experiment, the maximum disparity that supports threshold performance was compared for an isolated bandpass item and bandpass-filtered noise. This limit was found to be five times larger for the isolated stimuli. In summary, these findings show that the initial stage of disparity detection is not limited by the size-disparity constraint. For stimuli with multiple false targets, however, processes subsequent to this stage reduce the disparity range over which the correspondence problem can be solved.     

Experiment Research on Binocular Perceptual Characteristics around Peripheral Vision for Development of Head Mounted Display with Wide View

The head mounted display （HMD） is widely used in virtual reality technology. In common HMD, however, the binocular disparity is set to an equal fixed value in the entire range of view. Such HMD systems have several shortcomings when used for wide views. In this study, in order to realize a natural stereo sensation of HMD with wide view, we measure the characteristics of binocular stereo perception and binocular light perception. Results show that both the stereoacuity and light sensitivity decrease as the retina＇s eccentricity increases from fovea to periphery. However, the decrease of the stereoacuity is more rapid than that of the light sensitivity. These results suggest that the binocular disparity at the peripheral field should be small, otherwise double images would be observed instead of a stereo view. Based on the results we develop a relative binocular stereoacuity model which can be applied for the design of HMD systems with wide view.     

Binocular visual processing in the owl's telencephalon.

Single neurons recorded from the owl's visual Wulst are surprisingly similar to those found in mammalian striate cortex. The receptive fields of Wulst neurons are elaborated, in an apparently hierarchical fashion, from those of their monocular, concentrically organized inputs to produce binocular interneurons with increasingly sophisticated requirements for stimulus orientation, movement and binocular disparity. Output neurons located in the superficial laminae of the Wulst are the most sophisticated of all, with absolute requirements for a combination of stimuli, which include binocular presentation at a particular horizontal binocular disparity, and with no response unless all of the stimulus conditions are satisfied simultaneously. Such neurons have the properties required for 'global stereopsis', including a receptive field size many times larger than their optimal stimulus, which is more closely matched to the receptive fields of the simpler, disparity-selective interneurons. These marked similarities in functional organization between the avian and mammalian systems exist in spite of a number of structural differences which reflect their separate evoluntionary origins. Discussion therefore includes the possibility that there may exist for nervous systems only a very small number of possible solutions, perhaps a unique one, to the problem of stereopsis.     

Oscillatory binocular system and temporal segmentation of stereoscopic depth surfaces

A dynamical neural network model of binocular stereopsis is proposed to solve the problem of segmentation which remains ambiguous even when the problem of binocular correspondence is solved. Being compatible with the recent neurophysiological findings (Engel et al. 1991), the model assumes that neural cells show oscillatory activities and that segmentation into a coherent depth surface is coded by synchronization of activities. Employing appropriate constraints for segmentation, the present model shows proper segmentation of depth surfaces and also solves segmentational ambiguity caused by a gap. It is newly shown that binocularly-unmatched monocular cells are discriminated in temporal segmentation of monocular cells caused by recurrent interactions between monocular and binocular cells. Integrative interactions with the other visual components through temporal segmentation are also discussed.     

Hierarchical organization of macaque and cat cortical sensory systems explored with a novel network processor

Neuroanatomists have described a large number of connections between the various structures of monkey and cat cortical sensory systems. Because of the complexity of the connection data, analysis is required to unravel what principles of organization they imply. To date, analysis of laminar origin and termination connection data to reveal hierarchical relationships between the cortical areas has been the most widely acknowledged approach. We programmed a network processor that searches for optimal hierarchical orderings of cortical areas given known hierarchical constraints and rules for their interpretation. For all cortical systems and all cost functions, the processor found a multitude of equally low-cost hierarchies. Laminar hierarchical constraints that are presently available in the anatomical literature were therefore insufficient to constrain a unique ordering for any of the sensory systems we analysed. Hierarchical orderings of the monkey visual system that have been widely reported, but which were derived by hand, were not among the optimal orderings. All the cortical systems we studied displayed a significant degree of hierarchical organization, and the anatomical constraints from the monkey visual and somato-motor systems were satisfied with very few constraint violations in the optimal hierarchies. The visual and somato-motor systems in that animal were therefore surprisingly strictly hierarchical. Most inconsistencies between the constraints and the hierarchical relationships in the optimal structures for the visual system were related to connections of area FST (fundus of superior temporal sulcus). We found that the hierarchical solutions could be further improved by assuming that FST consists of two areas, which differ in the nature of their projections. Indeed, we found that perfect hierarchical arrangements of the primate visual system, without any violation of anatomical constraints, could be obtained under two reasonable conditions, namely the subdivision of FST into two distinct areas, whose connectivity we predict, and the abolition of at least one of the less reliable rule constraints. Our analyses showed that the future collection of the same type of laminar constraints, or the inclusion of new hierarchical constraints from thalamocortical connections, will not resolve the problem of multiple optimal hierarchical representations for the primate visual system. Further data, however, may help to specify the relative ordering of some more areas. This indeterminacy of the visual hierarchy is in part due to the reported absence of some connections between cortical areas. These absences are consistent with limited cross-talk between differentiated processing streams in the system. Hence, hierarchical representation of the visual system is affected by, and must take into account, other organizational features, such as processing streams.     

At least at the level of inferior temporal cortex,the stereo correspondence problem is solved

Stereoscopic vision requires the correspondence problem to be solved, i.e., discarding "false" matches between images of the two eyes, while keeping correct ones. To advance our understanding of the underlying neuronal mechanisms, we compared single neuron responses to correlated and anticorrelated random dot stereograms (RDSs). Inferior temporal neurons, which respond selectively to disparity-defined three-dimensional shapes, showed robust selectivity for correlated RDSs portraying concave or convex surfaces, but unlike neurons in areas V1, MT/V5, and MST, were not selective for anticorrelated RDSs. These results show that the correspondence problem is solved at least in far extrastriate cortex, as it is in the monkey's perception.     

On the inverse problem of binocular 3D motion perception

It is shown that existing processing schemes of 3D motion perception such as interocular velocity difference, changing disparity over time, as well as joint encoding of motion and disparity, do not offer a general solution to the inverse optics problem of local binocular 3D motion. Instead we suggest that local velocity constraints in combination with binocular disparity and other depth cues provide a more flexible framework for the solution of the inverse problem. In the context of the aperture problem we derive predictions from two plausible default strategies: (1) the vector normal prefers slow motion in 3D whereas (2) the cyclopean average is based on slow motion in 2D. Predicting perceived motion directions for ambiguous line motion provides an opportunity to distinguish between these strategies of 3D motion processing. Our theoretical results suggest that velocity constraints and disparity from feature tracking are needed to solve the inverse problem of 3D motion perception. It seems plausible that motion and disparity input is processed in parallel and integrated late in the visual processing hierarchy.     

Stereoscopic correspondence for ambiguous targets is affected by elevation and fixation distance

Binocular correspondence must be determined if disparity is to be used to provide information about three-dimensional shape. The current study investigated whether knowledge of the statistical distribution of disparities in the natural environment is employed in this process. A simple model, which produces distributions of distances similar to those found in the natural environment, was used to predict the distribution of disparities in natural images. This model predicts that crossed disparities will be more likely as (i) stimulus elevation decreases below fixation and (ii) fixation distance increases. To determine whether these factors influence binocular correspondence for human observers, ambiguous stereograms were presented to observers, as stimulus elevation and fixation distance were manipulated. Clear biases were observed in the depth perceived in these stereograms, which were more likely to be seen as closer than fixation (i) for stimuli presented below fixation and (ii) as fixation distance increased. These results suggest that binocular correspondence is determined in a manner consistent with the distributions of disparities expected in natural scenes.     

Blur and disparity are complementary cues to depth

Estimating depth from binocular disparity is extremely precise, and the cue does not depend on statistical regularities in the environment. Thus, disparity is commonly regarded as the best visual cue for determining 3D layout. But depth from disparity is only precise near where one is looking; it is quite imprecise elsewhere. Away from fixation, vision resorts to using other depth cues-e.g., linear perspective, familiar size, aerial perspective. But those cues depend on statistical regularities in the environment and are therefore not always reliable. Depth from defocus blur relies on fewer assumptions and has the same geometric constraints as disparity but different physiological constraints. Blur could in principle fill in the parts of visual space where disparity is imprecise. We tested this possibility with a depth-discrimination experiment. Disparity was more precise near fixation and blur was indeed more precise away from fixation. When both cues were available, observers relied on the more informative one. Blur appears to play an important, previously unrecognized role in depth perception. Our findings lead to a new hypothesis about the evolution of slit-shaped pupils and have implications for the design and implementation of stereo 3D displays.     

Reduplication in Harmonic Serialism

In standard Optimality Theory, faithfulness constraints are defined in terms of an input-output correspondence relation, and similar constraints are applied to the correspondence relation between a stem and its reduplicative copy. In Harmonic Serialism, a derivational version of Optimality Theory, there is no input-output correspondence relation, and instead faithfulness violations are based on which operations the candidate-generating Gen component has applied. This article presents a novel theory of reduplication, situated within Harmonic Serialism, called Serial Template Satisfaction. Reduplicative correspondence constraints are replaced by operations that copy strings of constituents. Depending on the constraint ranking, phonological processes may precede or follow copying, with different effects. Serial Template Satisfaction and reduplicative correspondence theory make different predictions about partial reduplication, prosodic constituent copying, skipping effects, and reduplication-phonology interactions. The predictions of Serial Template Satisfaction are argued to be superior.     

Luminance,Colour, Viewpoint and Border Enhanced Disparity Energy Model

The visual cortex is able to extract disparity information through the use of binocular cells. This process is reflected by the Disparity Energy Model, which describes the role and functioning of simple and complex binocular neuron populations, and how they are able to extract disparity. This model uses explicit cell parameters to mathematically determine preferred cell disparities, like spatial frequencies, orientations, binocular phases and receptive field positions. However, the brain cannot access such explicit cell parameters; it must rely on cell responses. In this article, we implemented a trained binocular neuronal population, which encodes disparity information implicitly. This allows the population to learn how to decode disparities, in a similar way to how our visual system could have developed this ability during evolution. At the same time, responses of monocular simple and complex cells can also encode line and edge information, which is useful for refining disparities at object borders. The brain should then be able, starting from a low-level disparity draft, to integrate all information, including colour and viewpoint perspective, in order to propagate better estimates to higher cortical areas.     

CONSTRAINTS ON MAMMALIAN FORELIMB DEVELOPMENT: INSIGHTS FROM DEVELOPMENTAL DISPARITY

Tetrapod limb development has been studied extensively for decades, yet the strength and role of developmental constraints in this process remains unresolved. Mammals exhibit a particularly wide array of limb morphologies associated with various locomotion modes and behaviors, providing a useful system for identifying periods of developmental constraint and conserved developmental mechanisms or morphologies. In this study, landmark‐based geometric morphometrics are used to investigate levels and patterns of morphological diversity (disparity) among the developing forelimbs of four mammals with diverse limb morphologies: mice, opossums, horses, and pigs. Results indicate that disparity among the forelimbs of these species slightly decreases or stays the same from the appearance of the limb ridge to the bud stage, and increases dramatically from the paddle through tissue regression stages. Heterochrony exhibited by the precocial opossum limb was not found to drive these patterns of morphological disparity, suggesting that the low disparity of the middle stages of limb development (e.g., paddle stage) is driven by processes operating within the limb and is likely not a result of embryo‐wide constraint.     

Brain activation difference evoked by different binocular disparities of stereograms: An fMRI study

The binocular disparity of two retina images is a main cue of stereoscopic vision. However, the global dependency between brain response and binocular disparity still remains unclear. Here, we used functional Magnetic Resonance Imaging (fMRI) to identify stereopsis-related brain regions with a modified Random Dot Stereogram (RDS) and plotted the activation variation curves under different disparity size. In order to eliminate the confounding shape difference between the stereogram and the plane, commonly seen in RDS, we modified the RDS to a checkerboard version. We found that V3A, V7 and MT+/V5 in dorsal visual stream were activated in stereoscopic experiment, while little activation was found in ventral visual regions. According to the activation trends, 13 subjects were divided into three groups: 5 subjects with turning points (a shift from increased to decreased activation), 5 subjects without turning points and 3 subjects with activation unrelated to disparity. We inferred that the dorsal visual stream primarily processes spatial depth information, rather than shape information.     

Determining the role that ecological and developmental constraints play in controlling disparity: examples from the crinoid and blastozoan fossil record

It is widely believed that morphological constraints are responsible for the observed pattern of decreasing major morphological innovation in both the Metazoa and Metaphytes over geological time. This is readily seen as the decreasing trend of origination of higher taxa: phyla, classes, and orders. Currently, there are two competing evolutionary hypotheses that have been proposed to explain this phenomenon: (1) the empty ecospace hypothesis and (2) the developmental constraint hypothesis. To distinguish between hypotheses 1 and 2, the change of morphological innovation before and after several mass extinction events was measured in the Crinoidea and Blastozoa. Mass extinction intervals provided a means in which to remove ecospace limiting constraints and allow the developmental constraint hypothesis to be thoroughly tested. Within the Crinoidea, disparity was measured before and after three mass extinctions. Within the Blastozoa, disparity was measured before and after two mass extinctions. For each taxon, three suites of characters were analyzed: ecological, nonecological, or "developmental" and a combination of the two previous suites plus 50 additional characters. Four different measures of disparity were used to analyze each character suite. In the majority of the cases investigated, disparity rebounds to comparable levels or in some cases higher levels in both the Crinoidea and Blastozoa. The results indicate that developmental constraints are not responsible for the decrease in disparity throughout the geologic range of the taxa. The more likely scenario is that increasingly structured ecological guilds have made it much more difficult to allow large increases in disparity.