On the functional significance of the P1 and N1 effects to illusory figures in the notch mode of presentation

The processing of Kanizsa figures have classically been studied by flashing the full "pacmen" inducers at stimulus onset. A recent study, however, has shown that it is advantageous to present illusory figures in the "notch" mode of presentation, that is by leaving the round inducers on screen at all times and by removing the inward-oriented notches delineating the illusory figure at stimulus onset. Indeed, using the notch mode of presentation, novel P1 and N1 effects have been found when comparing visual potentials (VEPs) evoked by an illusory figure and the VEPs to a control figure whose onset corresponds to the removal of outward-oriented notches, which prevents their integration into one delineated form. In Experiment 1, we replicated these findings, the illusory figure was found to evoke a larger P1 and a smaller N1 than its control. In Experiment 2, real grey squares were placed over the notches so that one condition, that with inward-oriented notches, shows a large central grey square and the other condition, that with outward-oriented notches, shows four unconnected smaller grey squares. In response to these "real" figures, no P1 effect was found but a N1 effect comparable to the one obtained with illusory figures was observed. Taken together, these results suggest that the P1 effect observed with illusory figures is likely specific to the processing of the illusory features of the figures. Conversely, the fact that the N1 effect was also obtained with real figures indicates that this effect may be due to more global processes related to depth segmentation or surface/object perception.     

Perception of illusory contours enhanced in motion

Investigation on illusory contours is important for understanding the mechanisms underlying the object recognition of human visual system. Numerous researches have shown that illusory contours formed in motion and stereopsis are generated by the unmatched features. Here we conduct three psychophysical experiments to test if Kanizsa illusory contours are also caused by unmatched information. Different types of motion (including horizontal translation, radial expanding and shrinking) are utilized in the experiments. The results show that no matter under what kind of motion, when figures or background move separately illusory contours are perceived stronger, and there is no significant difference between the perceived strength in these two types of motion. However, no such enhancement of perceived strength is found when figures and background move together. It is found that the strengthened unmatched features generate the enhancement effect of illusory contour perception in motion. Thus the results suggest that the process of unmatched information in visual system is a critical step in the formation of illusory contours.     

Perception of illusory contours enhanced in motion

Object perception is one of the most important components of visual perception of human beings and mammalian animals. It is a most confusing problem on object perception that how we separate object from background and obtain the picture of the whole object. In many cases one object partly occludes the other one in natural world. When the brightness of the occluding object is the same as or similar to that of the background, though there is no difference between visual stimuli, we can still ret…     

Extra-retinal adaptation of cortical motion-processing areas during pursuit eye movements

Repetitive eye movement produces a compelling motion aftereffect (MAE). One mechanism thought to contribute to the illusory movement is an extra-retinal motion signal generated after adaptation. However, extra-retinal signals are also generated during pursuit. They modulate activity within cortical motion-processing area MST, helping transform retinal motion into motion in the world during an eye movement. Given the evidence that MST plays a key role in generating MAE, it may also become indirectly adapted by prolonged pursuit. To differentiate between these two extra-retinal mechanisms we examined storage of the MAE across a period of darkness. In one condition observers were told to stare at a moving pattern, an instruction that induces a more reflexive type of eye movement. In another they were told to deliberately pursue it. We found equally long MAEs when testing immediately after adaptation but not when the test was delayed by 40 s. In the case of the reflexive eye movement the delay almost completely extinguished the MAE, whereas the illusory motion following pursuit remained intact. This suggests pursuit adapts cortical motion-processing areas whereas unintentional eye movement does not. A second experiment showed that cortical mechanisms cannot be the sole determinant of pursuit-induced MAE. Following oblique pursuit, we found MAE direction changes from oblique to vertical. Perceived MAE direction appears to be influenced by a subcortical mechanism as well, one based on the relative recovery rate of horizontal and vertical eye-movement processes recruited during oblique pursuit.     

Art pieces that 'move' in our minds--an explanation of illusory motion based on depth reversal

Certain art forms, such as Patrick Hughes's 'reverspectives', Dick Termes's 'Termespheres', intaglios, and hollow masks, appear to move vividly as viewers move in front of them, even though they are stationary. This illusory motion is accompanied by a perceived reversal of depth, where physical convex and concave surfaces are falsely seen as concave and convex, respectively. A geometric explanation is presented that considers this illusory motion as a result of the perceived depth reversal. The main argument is that the visual system constructs a three-dimensional representation of the surfaces, and that this representation is one of the sources that contribute to the illusory motion, together with vestibular signals of self-motion and signals of eye movements. This explanation is extended to stereograms that are also known to appear to move as viewers move in front of them. A quantitative model can be developed around this geometric explanation to examine the extent to which the visual system tolerates large distortions in size and shape and still maintains the illusion.     

Illusory contours over pathological retinal scotomas

Our visual percepts are not fully determined by physical stimulus inputs. Thus, in visual illusions such as the Kanizsa figure, inducers presented at the corners allow one to perceive the bounding contours of the figure in the absence of luminance-defined borders. We examined the discrimination of the curvature of these illusory contours that pass across retinal scotomas caused by macular degeneration. In contrast with previous studies with normal-sighted subjects that showed no perception of these illusory contours in the region of physiological scotomas at the optic nerve head, we demonstrated perfect discrimination of the curvature of the illusory contours over the pathological retinal scotoma. The illusion occurred despite the large scar around the macular lesion, strongly reducing discrimination of whether the inducer openings were acute or obtuse and suggesting that the coarse information in the inducers (low spatial frequency) sufficed. The result that subjective contours can pass through the pathological retinal scotoma suggests that the visual cortex, despite the loss of bottom-up input, can use low-spatial frequency information from the inducers to form a neural representation of new complex geometrical shapes inside the scotoma.     

Figure tracking by flies is supported by parallel visual streams

Visual figures may be distinguished based on elementary motion or higher-order non-Fourier features, and flies track both. The canonical elementary motion detector, a compact computation for Fourier motion direction and amplitude, can also encode higher-order signals provided elaborate preprocessing. However, the way in which a fly tracks a moving figure containing both elementary and higher-order signals has not been investigated. Using a novel white noise approach, we demonstrate that (1) the composite response to an object containing both elementary motion (EM) and uncorrelated higher-order figure motion (FM) reflects the linear superposition of each component; (2) the EM-driven component is velocity-dependent, whereas the FM component is driven by retinal position; (3) retinotopic variation in EM and FM responses are different from one another; (4) the FM subsystem superimposes saccadic turns upon smooth pursuit; and (5) the two systems in combination are necessary and sufficient to predict the full range of figure tracking behaviors, including those that generate no EM cues at all. This analysis requires an extension of the model that fly motion vision is based on simple elementary motion detectors and provides a novel method to characterize the subsystems responsible for the pursuit of visual figures.     

Motion-based mechanisms of illusory contour synthesis

Neurophysiological studies and computational models of illusory contour formation have focused on contour orientation as the underlying determinant of illusory contour shape in both static and moving displays. Here, we report a class of motion-induced illusory contours that demonstrate the existence of novel mechanisms of illusory contour synthesis. In a series of experiments, we show that the velocity of contour terminations and the direction of motion of a partially occluded figure regulate the perceived shape and apparent movement of illusory contours formed from moving image sequences. These results demonstrate the existence of neural mechanisms that reconstruct occlusion relationships from both real and inferred image velocities, in contrast to the static geometric mechanisms that have been the focus of studies to date.     

A motion illusion reveals mechanisms of perceptual stabilization

Visual illusions are valuable tools for the scientific examination of the mechanisms underlying perception. In the peripheral drift illusion special drift patterns appear to move although they are static. During fixation small involuntary eye movements generate retinal image slips which need to be suppressed for stable perception. Here we show that the peripheral drift illusion reveals the mechanisms of perceptual stabilization associated with these micromovements. In a series of experiments we found that illusory motion was only observed in the peripheral visual field. The strength of illusory motion varied with the degree of micromovements. However, drift patterns presented in the central (but not the peripheral) visual field modulated the strength of illusory peripheral motion. Moreover, although central drift patterns were not perceived as moving, they elicited illusory motion of neutral peripheral patterns. Central drift patterns modulated illusory peripheral motion even when micromovements remained constant. Interestingly, perceptual stabilization was only affected by static drift patterns, but not by real motion signals. Our findings suggest that perceptual instabilities caused by fixational eye movements are corrected by a mechanism that relies on visual rather than extraretinal (proprioceptive or motor) signals, and that drift patterns systematically bias this compensatory mechanism. These mechanisms may be revealed by utilizing static visual patterns that give rise to the peripheral drift illusion, but remain undetected with other patterns. Accordingly, the peripheral drift illusion is of unique value for examining processes of perceptual stabilization.     

The role of attention in ambiguous reversals of structure-from-motion

Multiple dots moving independently back and forth on a flat screen induce a compelling illusion of a sphere rotating in depth (structure-from-motion). If all dots simultaneously reverse their direction of motion, two perceptual outcomes are possible: either the illusory rotation reverses as well (and the illusory depth of each dot is maintained), or the illusory rotation is maintained (but the illusory depth of each dot reverses). We investigated the role of attention in these ambiguous reversals. Greater availability of attention--as manipulated with a concurrent task or inferred from eye movement statistics--shifted the balance in favor of reversing illusory rotation (rather than depth). On the other hand, volitional control over illusory reversals was limited and did not depend on tracking individual dots during the direction reversal. Finally, display properties strongly influenced ambiguous reversals. Any asymmetries between 'front' and 'back' surfaces--created either on purpose by coloring or accidentally by random dot placement--also shifted the balance in favor of reversing illusory rotation (rather than depth). We conclude that the outcome of ambiguous reversals depends on attention, specifically on attention to the illusory sphere and its surface irregularities, but not on attentive tracking of individual surface dots.     

Perception of Elasticity in the Kinetic Illusory Object with Phase Differences in Inducer Motion

Background

It is known that subjective contours are perceived even when a figure involves motion. However, whether this includes the perception of rigidity or deformation of an illusory surface remains unknown. In particular, since most visual stimuli used in previous studies were generated in order to induce illusory rigid objects, the potential perception of material properties such as rigidity or elasticity in these illusory surfaces has not been examined. Here, we elucidate whether the magnitude of phase difference in oscillation influences the visual impressions of an object''s elasticity (Experiment 1) and identify whether such elasticity perceptions are accompanied by the shape of the subjective contours, which can be assumed to be strongly correlated with the perception of rigidity (Experiment 2).

Methodology/Principal Findings

In Experiment 1, the phase differences in the oscillating motion of inducers were controlled to investigate whether they influenced the visual impression of an illusory object''s elasticity. The results demonstrated that the impression of the elasticity of an illusory surface with subjective contours was systematically flipped with the degree of phase difference. In Experiment 2, we examined whether the subjective contours of a perceived object appeared linear or curved using multi-dimensional scaling analysis. The results indicated that the contours of a moving illusory object were perceived as more curved than linear in all phase-difference conditions.

Conclusions/Significance

These findings suggest that the phase difference in an object''s motion is a significant factor in the material perception of motion-related elasticity.     

Lateral Inhibition in the Human Visual System in Patients with Glaucoma and Healthy Subjects: A Case-Control Study

In glaucoma, the density of retinal ganglion cells is reduced. It is largely unknown how this influences retinal information processing. An increase in spatial summation and a decrease in contrast gain control and contrast adaptation have been reported. A decrease in lateral inhibition might also arise. This could result in a larger than expected response to some stimuli, which could mask ganglion cell loss on functional testing (structure-function discrepancy). The aim of this study was to compare lateral inhibition between glaucoma patients and healthy subjects; we used a case-control design. Cases (n = 18) were selected to have advanced visual field loss in combination with a normal visual acuity. Controls (n = 50) were not allowed to have symptoms or signs of any eye disease. Lateral inhibition was measured psychophysically on a computer screen, with (1) a modified illusory movement experiment and (2) a contrast sensitivity (CS) test. Illusory movement was quantified by nulling it with a real movement; measure of lateral inhibition was the amount of illusory movement. CS was measured at 1 and 4 cycles per degree (cpd); measure of lateral inhibition was the difference between log CS at 4 and 1 cpd. Both measures were compared between cases and controls; analyses were adjusted for age and gender. There was no difference between cases and controls for these two measures of lateral inhibition (p = 0.58 for illusory movement; p = 0.20 for CS). The movement threshold was higher in cases than in controls (p = 0.008) and log CS was lower, at both 1 (-0.20; p = 0.008) and 4 (-0.28; p = 0.001) cpd. Our results indicate that spatially antagonistic mechanisms are not specifically affected in glaucoma, at least not in the intact center of a severely damaged visual field. This suggests that the structure-function discrepancy in glaucoma is not related to a decrease in lateral inhibition.     

Globally consistent depth sorting of overlapping 2D surfaces in a model using local recurrent interactions

The human visual system utilizes depth information as a major cue to group together visual items constituting an object and to segregate them from items belonging to other objects in the visual scene. Depth information can be inferred from a variety of different visual cues, such as disparity, occlusions and perspective. Many of these cues provide only local and relative information about the depth of objects. For example, at occlusions, T-junctions indicate the local relative depth precedence of surface patches. However, in order to obtain a globally consistent interpretation of the depth relations between the surfaces and objects in a visual scene, a mechanism is necessary that globally propagates such local and relative information. We present a computational framework in which depth information derived from T-junctions is propagated along surface contours using local recurrent interactions between neighboring neurons. We demonstrate that within this framework a globally consistent depth sorting of overlapping surfaces can be obtained on the basis of local interactions. Unlike previous approaches in which locally restricted cell interactions could merely distinguish between two depths (figure and ground), our model can also represent several intermediate depth positions. Our approach is an extension of a previous model of recurrent V1–V2 interaction for contour processing and illusory contour formation. Based on the contour representation created by this model, a recursive scheme of local interactions subsequently achieves a globally consistent depth sorting of several overlapping surfaces. Within this framework, the induction of illusory contours by the model of recurrent V1–V2 interaction gives rise to the figure-ground segmentation of illusory figures such as a Kanizsa square.     

Primary visual cortex activity along the apparent-motion trace reflects illusory perception

The illusion of apparent motion can be induced when visual stimuli are successively presented at different locations. It has been shown in previous studies that motion-sensitive regions in extrastriate cortex are relevant for the processing of apparent motion, but it is unclear whether primary visual cortex (V1) is also involved in the representation of the illusory motion path. We investigated, in human subjects, apparent-motion-related activity in patches of V1 representing locations along the path of illusory stimulus motion using functional magnetic resonance imaging. Here we show that apparent motion caused a blood-oxygenation-level-dependent response along the V1 representations of the apparent-motion path, including regions that were not directly activated by the apparent-motion-inducing stimuli. This response was unaltered when participants had to perform an attention-demanding task that diverted their attention away from the stimulus. With a bistable motion quartet, we confirmed that the activity was related to the conscious perception of movement. Our data suggest that V1 is part of the network that represents the illusory path of apparent motion. The activation in V1 can be explained either by lateral interactions within V1 or by feedback mechanisms from higher visual areas, especially the motion-sensitive human MT/V5 complex.     

Human brain activity during illusory visual jitter as revealed by functional magnetic resonance imaging

One central problem in vision is how to compensate for retinal slip. A novel illusion (visual jitter) suggests the compensation mechanism is based solely on retinal motion. Adaptation to visual noise attenuates the motion signals used by the compensation stage, producing illusory jitter due to the undercompensation of retinal slip. Here, we investigated the neural substrate of retinal slip compensation during this illusion using high-field fMRI and retinotopic mapping in flattened cortical format. When jitter perception occurred, MR signal decreased in lower stages of the visual system but increased prominently in area MT+. In conclusion, visual areas as early as V1 are responsible for the adaptation stage, and MT+ is involved in the compensation stage. The present finding suggests the pathway from V1 to MT+ has an important role in stabilizing the visual world.     

Saccadic Compression of Rectangle and Kanizsa Figures: Now You See It,Now You Don't

Background

Observers misperceive the location of points within a scene as compressed towards the goal of a saccade. However, recent studies suggest that saccadic compression does not occur for discrete elements such as dots when they are perceived as unified objects like a rectangle.

Methodology/Principal Findings

We investigated the magnitude of horizontal vs. vertical compression for Kanizsa figure (a collection of discrete elements unified into single perceptual objects by illusory contours) and control rectangle figures. Participants were presented with Kanizsa and control figures and had to decide whether the horizontal or vertical length of stimulus was longer using the two-alternative force choice method. Our findings show that large but not small Kanizsa figures are perceived as compressed, that such compression is large in the horizontal dimension and small or nil in the vertical dimension. In contrast to recent findings, we found no saccadic compression for control rectangles.

Conclusions

Our data suggest that compression of Kanizsa figure has been overestimated in previous research due to methodological artifacts, and highlight the importance of studying perceptual phenomena by multiple methods.     

Tuning Properties of MT and MSTd and Divisive Interactions for Eye-Movement Compensation

The primate brain intelligently processes visual information from the world as the eyes move constantly. The brain must take into account visual motion induced by eye movements, so that visual information about the outside world can be recovered. Certain neurons in the dorsal part of monkey medial superior temporal area (MSTd) play an important role in integrating information about eye movements and visual motion. When a monkey tracks a moving target with its eyes, these neurons respond to visual motion as well as to smooth pursuit eye movements. Furthermore, the responses of some MSTd neurons to the motion of objects in the world are very similar during pursuit and during fixation, even though the visual information on the retina is altered by the pursuit eye movement. We call these neurons compensatory pursuit neurons. In this study we develop a computational model of MSTd compensatory pursuit neurons based on physiological data from single unit studies. Our model MSTd neurons can simulate the velocity tuning of monkey MSTd neurons. The model MSTd neurons also show the pursuit compensation property. We find that pursuit compensation can be achieved by divisive interaction between signals coding eye movements and signals coding visual motion. The model generates two implications that can be tested in future experiments: (1) compensatory pursuit neurons in MSTd should have the same direction preference for pursuit and retinal visual motion; (2) there should be non-compensatory pursuit neurons that show opposite preferred directions of pursuit and retinal visual motion.     

Sounds Move a Static Visual Object

Background

Vision provides the most salient information with regard to stimulus motion, but audition can also provide important cues that affect visual motion perception. Here, we show that sounds containing no motion or positional cues can induce illusory visual motion perception for static visual objects.

Methodology/Principal Findings

Two circles placed side by side were presented in alternation producing apparent motion perception and each onset was accompanied by a tone burst of a specific and unique frequency. After exposure to this visual apparent motion with tones for a few minutes, the tones became drivers for illusory motion perception. When the flash onset was synchronized to tones of alternating frequencies, a circle blinking at a fixed location was perceived as lateral motion in the same direction as the previously exposed apparent motion. Furthermore, the effect lasted at least for a few days. The effect was well observed at the retinal position that was previously exposed to apparent motion with tone bursts.

Conclusions/Significance

The present results indicate that strong association between sound sequence and visual motion is easily formed within a short period and that, after forming the association, sounds are able to trigger visual motion perception for a static visual object.