Visual filling-in for computing perceptual surface properties

 The visual system is constantly confronted with the problem of integrating local signals into more global arrangements. This arises from the nature of early cell responses, whether they signal localized measures of luminance, motion, retinal position differences, or discontinuities. Consequently, from sparse, local measurements, the visual system must somehow generate the most likely hypothesis that is consistent with them. In this paper, we study the problem of determining achromatic surface properties, namely brightness. Mechanisms of brightness filling-in have been described by qualitative as well as quantitative models, such as by the one proposed by Cohen and Grossberg [Cohen and Grossberg (1984) Percept Psychophys 36: 428–456]. We demonstrate that filling-in from contrast estimates leads to a regularized solution for the computational problem of generating brightness representations from sparse estimates. This provides deeper insights into the nature of filling-in processes and the underlying objective function one wishes to compute. This particularly guided the proposal of a new modified version of filling-in, namely confidence-based filling-in which generates more robust brightness representations. Our investigation relates the modeling of perceptual data for biological vision to the mathematical frameworks of regularization theory and linear spatially variant diffusion. It therefore unifies different research directions that have so far coexisted in different scientific communities. Received: 11 March 1999 / Accepted in revised form: 14 March 2001     

A motion illusion reveals mechanisms of perceptual stabilization

Visual illusions are valuable tools for the scientific examination of the mechanisms underlying perception. In the peripheral drift illusion special drift patterns appear to move although they are static. During fixation small involuntary eye movements generate retinal image slips which need to be suppressed for stable perception. Here we show that the peripheral drift illusion reveals the mechanisms of perceptual stabilization associated with these micromovements. In a series of experiments we found that illusory motion was only observed in the peripheral visual field. The strength of illusory motion varied with the degree of micromovements. However, drift patterns presented in the central (but not the peripheral) visual field modulated the strength of illusory peripheral motion. Moreover, although central drift patterns were not perceived as moving, they elicited illusory motion of neutral peripheral patterns. Central drift patterns modulated illusory peripheral motion even when micromovements remained constant. Interestingly, perceptual stabilization was only affected by static drift patterns, but not by real motion signals. Our findings suggest that perceptual instabilities caused by fixational eye movements are corrected by a mechanism that relies on visual rather than extraretinal (proprioceptive or motor) signals, and that drift patterns systematically bias this compensatory mechanism. These mechanisms may be revealed by utilizing static visual patterns that give rise to the peripheral drift illusion, but remain undetected with other patterns. Accordingly, the peripheral drift illusion is of unique value for examining processes of perceptual stabilization.     

Visual motion interferes with lexical decision on motion words

Embodied theories of cognition propose that neural substrates used in experiencing the referent of a word, for example perceiving upward motion, should be engaged in weaker form when that word, for example 'rise', is comprehended [1-3]. This claim has been broadly supported in the motor domain (for example [4,5]), whilst evidence is supportive, but less clear cut, for perception (for example [6-8]). Motivated by the finding that the perception of irrelevant background motion at near-threshold, but not supra-threshold, levels interferes with task execution [9], we assessed whether interference from near-threshold background motion was modulated by its congruence with the meaning of words (semantic content) when participants completed a lexical decision task (deciding if a string of letters is a real word or not). Reaction times for motion words, such as 'rise' or 'fall', were slower when the direction of visual motion and the 'motion' of the word were incongruent - but only when the visual motion was at near-threshold levels (supporting [9]). When motion was supra-threshold, the distribution of error rates, not reaction times, implicated low-level motion processing in the semantic processing of motion words. As the perception of near-threshold signals is not likely to be influenced by strategies [9], our results support a close contact between semantic information and perceptual systems.     

Spatiotopic perceptual maps in humans: evidence from motion adaptation

How our perceptual experience of the world remains stable and continuous despite the frequent repositioning eye movements remains very much a mystery. One possibility is that our brain actively constructs a spatiotopic representation of the world, which is anchored in external--or at least head-centred--coordinates. In this study, we show that the positional motion aftereffect (the change in apparent position after adaptation to motion) is spatially selective in external rather than retinal coordinates, whereas the classic motion aftereffect (the illusion of motion after prolonged inspection of a moving source) is selective in retinotopic coordinates. The results provide clear evidence for a spatiotopic map in humans: one which can be influenced by image motion.     

Visual detection of paradoxical motion in flies

Summary From psychophysics it is known that humans easily perceive motion in Fourier-stimuli in which dots are displaced coherently into one direction. Furthermore, motion can be extracted from Drift-balanced stimuli in which the dots on average have no distinct direction of motion, or even in paradox -motion stimuli where the dots are displaced opposite to the perceived direction of motion. Whereas Fourier-motion can be explained by very basic motion detectors and nonlinear preprocessing of the input can account for the detection of Drift-balanced motion, a hierarchical model with two layers of motion detectors was proposed to explain the perception of -motion. The well described visual system of the fly allows to investigate whether these complex motion stimuli can be detected in a comparatively simple brain.The detection of such motion stimuli was analyzed for various random-dot cinematograms with extracellular recordings from the motion-sensitive Hl-neuron in the third visual ganglion of the blowfly Calliphora erythrocephala. The results were compared to computer-simulations of a hierarchical model of motion detector networks.For Fourier- and Drift-balanced motion stimuli, the Hl-neuron responds directionally selective to the moving object, whereas for -motion stimuli, the preferred direction is given by the dot displacement. Assuming nonlinear preprocessing of the detector input, such as a half-wave rectification, elementary motion detectors of the correlation type can account for these results.Abbreviations EMD elementary motion detector     

Visual signalling by asymmetry: a review of perceptual processes.

Individual levels of asymmetry in traits that display fluctuating asymmetry could be used as visual signals of phenotypic (and perhaps genotypic) quality, as asymmetry can often be negatively related to fitness parameters. There are some data to support this hypothesis but the experimental protocols employed have commonly resulted in asymmetries far larger than those observed in nature. To date, there has been little consideration of the ability of animals to accurately discriminate small asymmetries (of the magnitude observed in the wild) from perfect symmetry. This is key to assessing the plausibility of the asymmetry-signalling hypothesis. Here, I review the perceptual processes that may lead to the discrimination of asymmetry and discuss a number of ecologically relevant factors that may influence asymmetry signalling. These include: signal orientation, distance of trait elements from the axis of symmetry, trait complexity, trait contrast and colour, and the behaviour of both signaller and receiver. I also discuss the evolution of symmetry preferences and make suggestions as to where researchers should focus attention to examine the generality of asymmetry-signalling theory. In highly developmentally stable signalling systems the magnitude of asymmetry may be too small to be detected accurately and reliably, hence asymmetry signalling is unlikely to have evolved in these situations.     

Visual motion and the perception of surface material

Many critical perceptual judgments, from telling whether fruit is ripe to determining whether the ground is slippery, involve estimating the material properties of surfaces. Very little is known about how the brain recognizes materials, even though the problem is likely as important for survival as navigating or recognizing objects. Though previous research has focused nearly exclusively on the properties of static images, recent evidence suggests that motion may affect the appearance of surface material. However, what kind of information motion conveys and how this information may be used by the brain is still unknown. Here, we identify three motion cues that the brain could rely on to distinguish between matte and shiny surfaces. We show that these motion measurements can override static cues, leading to dramatic changes in perceived material depending on the image motion characteristics. A classifier algorithm based on these cues correctly predicts both successes and some striking failures of human material perception. Together these results reveal a previously unknown use for optic flow in the perception of surface material properties.     

Visual motion,binocular correspondence and binocular rivalry

The human pupillary control system has been the subject of interest to biologists and engineers as an example of a sensorimotor reflex which can be embedded in a control system paradigm. We present a nonlinear feedback model whose compact structure allows us to hypothesize possible physiological mechanisms which generate the proper behavior of the pupil system. The important pupil responses, including pupil size effect, asymmetry, and response to high-frequency stimuli, are defined. This model was simulated on a digital computer and comparisons to the paradigm experimental responses were performed, demonstrating a fit to each of the observed conditions. Improvements on previous models are discussed.     

Choosing between two conflicting scientific hypotheses: The orce dilemmas

How may we choose between conflicting hypotheses when doing a scientific test? Bayesian theory of decision offers a tool to analyse what choosing actually is, preventing us either from giving too much value to rational compounds or from putting aside the scientists’ personal interests and prejudices. Gieres’ cognitive approach to the problem defines the Minimally Open-Minded Scientist’s approach as the right one to dial with the choice dilemma. This approach is used here to give an opinion on the status of the “Orce Man”.     

Visual motion: homing in on small target detectors

Tracking moving targets is essential for animals that pursue prey or conspecifics. Recent studies in male and female hoverflies have described classes of neurons that detect the movements of small targets against a moving background but the mechanisms generating their responses remain unclear.     

Visual motion induces a forward prediction of spatial pattern

Cortical motion analysis continuously encodes image velocity but might also be used to predict future patterns of sensory input along the motion path. We asked whether this predictive aspect of motion is exploited by the human visual system. Targets can be more easily detected at the leading as compared to the trailing edge of motion [1], but this effect has been attributed to a nonspecific boost in contrast gain at the leading edge, linked to motion-induced shifts in spatial position [1-4]. Here we show that the detectability of a local sinusoidal target presented at the ends of a region containing motion is phase dependent at the leading edge, but not at the trailing edge. These two observations rule out a simple gain control mechanism that modulates contrast energy and passive filtering explanations, respectively. By manipulating the relative orientation of the moving pattern and target, we demonstrate that the resulting spatial variation in detection threshold along the edge closely resembles the superposition of sensory input and an internally generated predicted signal. These findings show that motion induces a forward prediction of spatial pattern that combines with the cortical representation of the future stimulus.     

Visual perceptual difficulties and under-achievement at school in a large community-based sample of children

Introduction

Difficulties with visual perception (VP) are often described in children with neurological or developmental problems. However, there are few data regarding the range of visual perceptual abilities in populations of normal children, or on the impact of these abilities on children''s day-to-day functioning.

Methods

Data were obtained for 4512 participants in an ongoing birth cohort study (Avon Longitudinal Study of Parents and Children; ALSPAC). The children''s mothers responded to questions designed to elicit indications of visual perceptual difficulties or immaturity, when their children were aged 13 years. We examined associations with standardised school test results in reading and in mathematics at age 13–14 years (SATS-KS3), accounting for potential confounders including IQ.

Results

Three underlying factors explained half the variance in the VP question responses. These correlated best with questions on interpreting cluttered scenes; guidance of movement and face recognition. The adjusted parameter estimates (95% CI) for the cluttered-scenes factor (0.05; 0.02 to 0.08; p<0.001) suggested positive associations with the reading test results whilst that for the guidance-of-movement factor (0.03; 0.00 to 0.06; p = 0.026) suggested positive association with the mathematics results. The raw scores were associated with both test results.

Discussion

VP abilities were widely distributed in this sample of 13-year old children. Lower levels of VP function were associated with under-achievement in reading and in mathematics. Simple interventions can help children with VP difficulties, so research is needed into practicable, cost-effective strategies for identification and assessment, so that support can be targeted appropriately.