Perceptual illusion and the real-time control of action

Participants were cued by an auditory tone to grasp a target object from within a size-contrast display. The peak grip aperture was unaffected by the perceptual size illusion when the target array was visible between the response cue and movement onset (vision trials). The grasp was sensitive to the illusion, however, when the target array was occluded from view when the response was cued (occlusion trials). This was true when the occlusion occurred 2.5 s before the response cue (delay), but also when the occlusion coincided with the response cue (no-delay). Unlike previous experiments, vision and occlusion trials were presented in random sequence. The results suggest that dedicated, real-time visuomotor mechanisms are engaged for the control of action only after the response is cued, and only if the target is visible. These visuomotor mechanisms compute the absolute metrics of the target object and therefore resist size-contrast illusions. In other situations (e.g. prior to the response cue, or if the target is no longer visible), a perceptual representation of the target object can be used for action planning. Unlike the real-time visuomotor mechanisms, perception-based movement planning makes use of relational metrics, and is therefore sensitive to size-contrast illusions.     

Fooling the Eyes: The Influence of a Sound-Induced Visual Motion Illusion on Eye Movements

The question of whether perceptual illusions influence eye movements is critical for the long-standing debate regarding the separation between action and perception. To test the role of auditory context on a visual illusion and on eye movements, we took advantage of the fact that the presence of an auditory cue can successfully modulate illusory motion perception of an otherwise static flickering object (sound-induced visual motion effect). We found that illusory motion perception modulated by an auditory context consistently affected saccadic eye movements. Specifically, the landing positions of saccades performed towards flickering static bars in the periphery were biased in the direction of illusory motion. Moreover, the magnitude of this bias was strongly correlated with the effect size of the perceptual illusion. These results show that both an audio-visual and a purely visual illusion can significantly affect visuo-motor behavior. Our findings are consistent with arguments for a tight link between perception and action in localization tasks.     

Object Segmentation from Motion Discontinuities and Temporal Occlusions–A Biologically Inspired Model

Background

Optic flow is an important cue for object detection. Humans are able to perceive objects in a scene using only kinetic boundaries, and can perform the task even when other shape cues are not provided. These kinetic boundaries are characterized by the presence of motion discontinuities in a local neighbourhood. In addition, temporal occlusions appear along the boundaries as the object in front covers the background and the objects that are spatially behind it.

Methodology/Principal Findings

From a technical point of view, the detection of motion boundaries for segmentation based on optic flow is a difficult task. This is due to the problem that flow detected along such boundaries is generally not reliable. We propose a model derived from mechanisms found in visual areas V1, MT, and MSTl of human and primate cortex that achieves robust detection along motion boundaries. It includes two separate mechanisms for both the detection of motion discontinuities and of occlusion regions based on how neurons respond to spatial and temporal contrast, respectively. The mechanisms are embedded in a biologically inspired architecture that integrates information of different model components of the visual processing due to feedback connections. In particular, mutual interactions between the detection of motion discontinuities and temporal occlusions allow a considerable improvement of the kinetic boundary detection.

Conclusions/Significance

A new model is proposed that uses optic flow cues to detect motion discontinuities and object occlusion. We suggest that by combining these results for motion discontinuities and object occlusion, object segmentation within the model can be improved. This idea could also be applied in other models for object segmentation. In addition, we discuss how this model is related to neurophysiological findings. The model was successfully tested both with artificial and real sequences including self and object motion.     

Perceptual categories for spatial layout.

The central problems of vision are often divided into object identification and localization. Object identification, at least at fine levels of discrimination, may require the application of top-down knowledge to resolve ambiguous image information. Utilizing top-down knowledge, however, may require the initial rapid access of abstract object categories based on low-level image cues. Does object localization require a different set of operating principles than object identification or is category determination also part of the perception of depth and spatial layout? Three-dimensional graphics movies of objects and their cast shadows are used to argue that identifying perceptual categories is important for determining the relative depths of objects. Processes that can identify the causal class (e.g. the kind of material) that generates the image data can provide information to determine the spatial relationships between surfaces. Changes in the blurriness of an edge may be characteristically associated with shadows caused by relative motion between two surfaces. The early identification of abstract events such as moving object/shadow pairs may also be important for depth from shadows. Knowledge of how correlated motion in the image relates to an object and its shadow may provide a reliable cue to access such event categories.     

Motion-boundary illusions and their regularization

Humans use various cues to understand the structure of the world from images. One such cue is the contours of an object formed by occlusion or from surface discontinuities. It is known that contours in the image of an object provide various amounts of information about the shape of the object in view, depending on assumptions that the observer makes. Another powerful cue is motion. The ability of the human visual system to discern structure from a motion stimulus is well known and has a solid theoretical and experimental foundation. However, when humans interpret a visual scene they use various cues to understand what they observe, and the interpretation comes from combining the information acquired from the various modules devoted to specific cues. In such an integration of modules it seems that each cue carries a different weight and importance. We performed several experiments where we made sure that the only cues available to the observer were contour and motion. It turns out that when humans combine information from contour and motion to reconstruct the shape of an object in view, if the results of the two modules--shape from contour and structure from motion--are inconsistent, they experience a perceptual result which is due to the combination of the two modules, with the influence of the contour dominating, thus giving rise to the illusion. We describe here examples of such illusions and identify the conditions under which they happen. Finally, we introduce a computational theory for combining contour and motion using the theory of regularization. The theory explains such illusions and predicts many more.(ABSTRACT TRUNCATED AT 250 WORDS)     

Being Barbie: the size of one's own body determines the perceived size of the world

A classical question in philosophy and psychology is if the sense of one's body influences how one visually perceives the world. Several theoreticians have suggested that our own body serves as a fundamental reference in visual perception of sizes and distances, although compelling experimental evidence for this hypothesis is lacking. In contrast, modern textbooks typically explain the perception of object size and distance by the combination of information from different visual cues. Here, we describe full body illusions in which subjects experience the ownership of a doll's body (80 cm or 30 cm) and a giant's body (400 cm) and use these as tools to demonstrate that the size of one's sensed own body directly influences the perception of object size and distance. These effects were quantified in ten separate experiments with complementary verbal, questionnaire, manual, walking, and physiological measures. When participants experienced the tiny body as their own, they perceived objects to be larger and farther away, and when they experienced the large-body illusion, they perceived objects to be smaller and nearer. Importantly, despite identical retinal input, this "body size effect" was greater when the participants experienced a sense of ownership of the artificial bodies compared to a control condition in which ownership was disrupted. These findings are fundamentally important as they suggest a causal relationship between the representations of body space and external space. Thus, our own body size affects how we perceive the world.     

Reconstructing the world: switching from segmentation to integration allows neurons in area MT to make "sense" of the visual scene

Huang et al. in this issue of Neuron show that primate area MT neurons exploit contextual cues to adequately interpret motion information. MT neurons switch from segmentation to integration when motion arises from single rather than multiple objects. This switching may help solve the aperture problem and bind distant object components into a perceptual whole.     

The role of vergence in the perception of distance: a fair test of Bishop Berkeley's claim

Binocular eye movements were measured while subjects perceived the wallpaper illusion in order to test the claim made by Bishop Berkeley in 1709 that we perceive the distance of nearby objects by evaluating the vergence angles of our eyes. Four subjects looked through a nearby fronto-parallel array of vertical rods (28-35 cm away) as they binocularly fixated a point about 1 meter away. The wallpaper illusion was perceived under these conditions, i.e. the rods appeared farther away than their physical location. We found that although binocular fixation at an appropriate distance was needed to begin perceiving the wallpaper illusion (at least for naive observers), once established, the illusion was quite robust in the sense that it was not affected by changing vergence. No connection between the apparent localization of the rods and vergence was observed. We conclude that it is unlikely that vergence, itself, is responsible for the perceived distance shift in the wallpaper illusion, making it unlikely that vergence contributes to the perception of distance as Bishop Berkeley suggested. We found this to be true even when vergence angles were relatively large (more than 2 deg), the region in which the control of vergence eye movements has been shown to be both fast and effective.     

Filling-in and suppression of visual perception from context: a Bayesian account of perceptual biases by contextual influences

Visual object recognition and sensitivity to image features are largely influenced by contextual inputs. We study influences by contextual bars on the bias to perceive or infer the presence of a target bar, rather than on the sensitivity to image features. Human observers judged from a briefly presented stimulus whether a target bar of a known orientation and shape is present at the center of a display, given a weak or missing input contrast at the target location with or without a context of other bars. Observers are more likely to perceive a target when the context has a weaker rather than stronger contrast. When the context can perceptually group well with the would-be target, weak contrast contextual bars bias the observers to perceive a target relative to the condition without contexts, as if to fill in the target. Meanwhile, high-contrast contextual bars, regardless of whether they group well with the target, bias the observers to perceive no target. A Bayesian model of visual inference is shown to account for the data well, illustrating that the context influences the perception in two ways: (1) biasing observers' prior belief that a target should be present according to visual grouping principles, and (2) biasing observers' internal model of the likely input contrasts caused by a target bar. According to this model, our data suggest that the context does not influence the perceived target contrast despite its influence on the bias to perceive the target's presence, thereby suggesting that cortical areas beyond the primary visual cortex are responsible for the visual inferences.     

Factors contributing to depth perception: behavioral studies on the reverse perspective illusion

In three behavioral experiments using depth-inverted visual stimuli, the factors that contribute to the 'reverse perspective' illusion were measured. The density of linear perspective grid lines was found to induce the illusion most strongly, followed by shading/shadows, and texture/color information. The relative contributions of such pictorial cues to depth perception are similar to those that facilitate the normal perception of 3D space in 2D paintings.     

Structure-from-motion by tracking occlusion boundaries

Active visual tracking of points on occlusion boundaries can simplify certain computations involved in determining scene structure and dynamics based on visual motion. Tracking is particularly effective at surface boundaries where large, discontinuous changes in depth are occurring. Two such techniques are described here. The first provides a measure of ordinal depth by distinguishing between occluding and occluded surfaces at a surface boundary. The second can be used to determine the direction of observer motion through a scene.A preliminary version of this material appeared in the Proceedings of the Workshop on Visual Motion, 1989. This work was supported by NSF Grant IRI-8722576     

The plasticity of correspondence: After-effects,illusions and horopter shifts in depth perception

Retinal disparity is the cue for stereoscopic depth perception. Disparity detection begins with cortical single units driven binocularly from the two eyes. A previous paper (Nelson, 1975) has shown that inhibitory and facilitatory interactions are essential to insure successful disparity detection, particularly with repeating stimulus patterns, and that such a system will display all the appropriate properties of sensory fusion. This paper shows that most depth illusions occur as by-products of the same domain interactions. Such illusion effects fall into two classes: those caused by shifts in the distribution of activity along the appropriate sensory domain (here, the disparity domain) and those caused by changes in the average activity level within the domain. Profile shifts cause depth contrast illusions. The most important profile level change is an activity lowering due to disparity domain inhibition. This adversely affects fusional range (Panum's area). It is postulated that all domain interactions persist following cessation of stimulation. Persistent profile shifts cause depth after-effect illusions; persistent profile lowering is responsible for threshold elevation after-effects.Sensory fusion, the coding errors seen in illusions, the induced effect, and widespread failure to perceive depth from disparity input show that retinal correspondence is not stable in the normal individual. Yet horopter research has attempted to specify one set of retinal points as corresponding. Not surprisingly, horopter research shows systematic shifts in retinal correspondence linked to eye position. Small, simple, tonic modulations of the domain interactions responsible for so many other stereopsis system properties provide a satisfactory cortical mechanism for horopter changes.     

Mass is all that matters in the size-weight illusion

An object in outer space is weightless due to the absence of gravity, but astronauts can still judge whether one object is heavier than another one by accelerating the object. How heavy an object feels depends on the exploration mode: an object is perceived as heavier when holding it against the pull of gravity than when accelerating it. At the same time, perceiving an object’s size influences the percept: small objects feel heavier than large objects with the same mass (size–weight illusion). Does this effect depend on perception of the pull of gravity? To answer this question, objects were suspended from a long wire and participants were asked to push an object and rate its heaviness. This way the contribution of gravitational forces on the percept was minimised. Our results show that weight is not at all necessary for the illusion because the size–weight illusion occurred without perception of weight. The magnitude of the illusion was independent of whether inertial or gravitational forces were perceived. We conclude that the size–weight illusion does not depend on prior knowledge about weights of object, but instead on a more general knowledge about the mass of objects, independent of the contribution of gravity. Consequently, the size–weight illusion will have the same magnitude on Earth as it should have on the Moon or even under conditions of weightlessness.     

Subjective Size Perception Depends on Central Visual Cortical Magnification in Human V1

In the Ebbinghaus illusion, the context surrounding an object modulates its subjectively perceived size. Previous work implicates human primary visual cortex (V1) as the neural substrate mediating this contextual effect. Here we studied in healthy adult humans how two different types of context (large or small inducers) in this illusion affected size perception by comparing each to a reference stimulus without any context. We found that individual differences in the magnitudes of the illusion produced by either type of context were correlated with V1 area defined through retinotopic mapping using functional MRI. However, participants'' objective ability to discriminate the size of objects presented in isolation was unrelated to illusion strength and did not correlate with V1 area. Control analyses showed no correlations between behavioral measures and the overall V1 area estimated probabilistically on the basis of neuroanatomy alone. Therefore, subjective size perception correlated with variability in central cortical magnification rather than the anatomical extent of primary visual cortex. We propose that such changes in subjective perception of size are mediated by mechanisms that scale with the extent to which an individual''s V1 selectively represents the central visual field.     

Complex functions of the brain

Over the course of the last 50 years it has been possible to solve a number of basic problems in neurobiology. Interest is now turning more and more to problems concerning so-called “higherρ brain functions, including cognition. Examples from the visual system in primates are presented. First relatively elementary problems are illustrated, such as how long it takes to perceive an object or to respond to a stimulus or combinations of stimuli. Top-down modification of perception by expectation is demonstrated in an illusion of misdirected gaze. Interdisciplinary questions straddling the sciences and the humanities are also approached, such as which part of the brain mediates conscious perception. Finally, the problem of causality and freedom of will is addressed, taking into account the knowledge accumulated in the neurosciences during the last 5 decades.     

Laminar cortical dynamics of visual form and motion interactions during coherent object motion perception

How do visual form and motion processes cooperate to compute object motion when each process separately is insufficient? Consider, for example, a deer moving behind a bush. Here the partially occluded fragments of motion signals available to an observer must be coherently grouped into the motion of a single object. A 3D FORMOTION model comprises five important functional interactions involving the brain's form and motion systems that address such situations. Because the model's stages are analogous to areas of the primate visual system, we refer to the stages by corresponding anatomical names. In one of these functional interactions, 3D boundary representations, in which figures are separated from their backgrounds, are formed in cortical area V2. These depth-selective V2 boundaries select motion signals at the appropriate depths in MT via V2-to-MT signals. In another, motion signals in MT disambiguate locally incomplete or ambiguous boundary signals in V2 via MT-to-V1-to-V2 feedback. The third functional property concerns resolution of the aperture problem along straight moving contours by propagating the influence of unambiguous motion signals generated at contour terminators or corners. Here, sparse 'feature tracking signals' from, for example, line ends are amplified to overwhelm numerically superior ambiguous motion signals along line segment interiors. In the fourth, a spatially anisotropic motion grouping process takes place across perceptual space via MT-MST feedback to integrate veridical feature-tracking and ambiguous motion signals to determine a global object motion percept. The fifth property uses the MT-MST feedback loop to convey an attentional priming signal from higher brain areas back to V1 and V2. The model's use of mechanisms such as divisive normalization, endstopping, cross-orientation inhibition, and long-range cooperation is described. Simulated data include: the degree of motion coherence of rotating shapes observed through apertures, the coherent vs. element motion percepts separated in depth during the chopsticks illusion, and the rigid vs. nonrigid appearance of rotating ellipses.     

The effects of linear perspective on relative size discrimination in chimpanzees (Pan troglodytes) and humans (Homo sapiens)

In this study, we tested the corridor illusion in three chimpanzees and five humans, applying a relative size discrimination task to assess pictorial depth perception using linear perspective. The subjects were required to choose the physically larger cylinder of two on a background containing drawn linear perspective cues. We manipulated both background and cylinder size in each trial. Our findings suggest that chimpanzees, like humans, exhibit the corridor illusion.     

Stereoscopic Offset Makes Objects Easier to Recognize

Binocular vision is obviously useful for depth perception, but it might also enhance other components of visual processing, such as image segmentation. We used naturalistic images to determine whether giving an object a stereoscopic offset of 15-120 arcmin of crossed disparity relative to its background would make the object easier to recognize in briefly presented (33-133 ms), temporally masked displays. Disparity had a beneficial effect across a wide range of disparities and display durations. Most of this benefit occurred whether or not the stereoscopic contour agreed with the object’s luminance contour. We attribute this benefit to an orienting of spatial attention that selected the object and its local background for enhanced 2D pattern processing. At longer display durations, contour agreement provided an additional benefit, and a separate experiment using random-dot stimuli confirmed that stereoscopic contours plausibly contributed to recognition at the longer display durations in our experiment. We conclude that in real-world situations binocular vision confers an advantage not only for depth perception, but also for recognizing objects from their luminance patterns and bounding contours.     

Stereoscopic subsystems for position in depth and for motion in depth.

We describe psychophysical evidence that the human visual system contains information-processing channels for motion in depth in addition to those for position in depth. These motion-in-depth channels include some that are selectively sensitive to the relative velocities of the left and right retinal images. We propose that the visual pathway contains stereoscopic (cyclopean) motion filters that respond to only a narrow range of the directions of motion in depth. Turning to the single-neuron level we report that, in addition to neurons turned to position to depth, cat visual cortex contains neurons that emphasize information about the direction of motion at the expense of positional information. We describe psychophysical evidence for the existence of channels that are sensitive to change size, and are separate from the channels both for motion and for flicker. These changing-size channels respond independently of whether the stimulus is a bright square on a dark ground or a dark square on a bright ground. At the physiological level we report single neurons in cat visual cortex that respond selectively to increasing or to decreasing size independently of the sign of stimulus contrast. Adaptation to a changing-size stimulus produces two separable after-effects: an illusion of changing size, and an illusion of motion in depth. These after-effects have different decay time constants. We propose a psychophysical model in which changing-size filters feed a motion-in-depth stage, and suppose that the motion-in-depth after-effect is due to activity at the motion-in-depth stage, while the changing-size after-effect is due to to activity at the changing-size and more peripheral stages. The motion-in-depth after-effect can be cancelled either by a changing-size test stimulus or by relative motion of the left and right retinal images. Opposition of these two cues can also cancel the impression of motion in depth produced by the adapting stimulus. These findings link the stereoscopic (cyclopean) motion filters and the changing-size filters: both feed the same motion-in-depth stage.