Rapid Perceptual Switching of a Reversible Biological Figure

Certain visual stimuli can give rise to contradictory perceptions. In this paper we examine the temporal dynamics of perceptual reversals experienced with biological motion, comparing these dynamics to those observed with other ambiguous structure from motion (SFM) stimuli. In our first experiment, naïve observers monitored perceptual alternations with an ambiguous rotating walker, a figure that randomly alternates between walking in clockwise (CW) and counter-clockwise (CCW) directions. While the number of reported reversals varied between observers, the observed dynamics (distribution of dominance durations, CW/CCW proportions) were comparable to those experienced with an ambiguous kinetic depth cylinder. In a second experiment, we compared reversal profiles with rotating and standard point-light walkers (i.e. non-rotating). Over multiple test repetitions, three out of four observers experienced consistently shorter mean percept durations with the rotating walker, suggesting that the added rotational component may speed up reversal rates with biomotion. For both stimuli, the drift in alternation rate across trial and across repetition was minimal. In our final experiment, we investigated whether reversals with the rotating walker and a non-biological object with similar global dimensions (rotating cuboid) occur at random phases of the rotation cycle. We found evidence that some observers experience peaks in the distribution of response locations that are relatively stable across sessions. Using control data, we discuss the role of eye movements in the development of these reversal patterns, and the related role of exogenous stimulus characteristics. In summary, we have demonstrated that the temporal dynamics of reversal with biological motion are similar to other forms of ambiguous SFM. We conclude that perceptual switching with biological motion is a robust bistable phenomenon.     

Local factors determine the stabilization of monocular ambiguous and binocular rivalry stimuli

Perceptual alternation in viewing bistable stimuli can be slowed or halted if the stimuli are presented intermittently. Memory of the recent perceptual experience has been proposed to explain this stabilization effect. But the nature of this "perceptual memory" remains unclear. By using a bistable rotating cylinder and two dichoptically presented orthogonal gratings, we explored the features that are important for the stabilization by changing a particular feature of the stimuli between alternate presentations. For the rotating cylinder, changing its color, rotating speed, size, or its stereo depth had no or minimal effect on the stabilization of its perceived rotation direction. For binocular rivalry, when the two gratings were matched in strength and then swapped between the two eyes synchronously with the intermittent presentation, the percepts were usually stabilized to one eye. In both cases, perceptual stabilization occurred only if the stimuli were presented to the same retinal location. These results suggest that the stabilization of monocular bistable stimuli is likely due to the removal of local adaptation, insensitive to the features that define the object identity. For binocular rivalry, preservation of the direction of interocular suppression rather than memory of the stimulus identity accounts for the stabilization effect.     

Probing depth in monocular images

It is generally expected that depth (distance) is the internal representational primitive that corresponds to much of the perception of 3D. We tested this assumption in monocular surface stimuli that are devoid of distance information (due to orthographic projection and the chosen surface shape, with perspective projection used as a control) and yet are vividly three-dimensional. Slant judgments were found to be in close correspondence with the actual geometric slant of the stimuli; the spatial orientation of the surfaces was perceived accurately. The apparent depth in these stimuli was then tested by superimposing a stereo depth probe over the monocular surface. In both the perspective and orthographic projection the gradient of perceived depth, measured by matching the apparent depth of the stereo probe with that of the monocular surface at a series of locations, was substantial. The experiments demonstrate that in orthographic projection the visual system can compute from local surface orientation a depth quantity that is commensurate with the relative depth derived from stereo disparity. The depth data suggests that, at least in the near field, the zero value for relative depth lies at the same absolute depth as the stereo horopter (locus of zero stereo disparity). Relative to this zero value, the depth-from-slant computation seems to provide an estimate of distance information that is independent of the absolute distance to the surface.Supproted by Office of Naval Research Contract N00014-K-84-0533. We gratefully acknowledge the suggestions of Jacob Beck regarding the experimental design, and the assistance provided by Cathryn Stanford     

The role of attention in ambiguous reversals of structure-from-motion

Multiple dots moving independently back and forth on a flat screen induce a compelling illusion of a sphere rotating in depth (structure-from-motion). If all dots simultaneously reverse their direction of motion, two perceptual outcomes are possible: either the illusory rotation reverses as well (and the illusory depth of each dot is maintained), or the illusory rotation is maintained (but the illusory depth of each dot reverses). We investigated the role of attention in these ambiguous reversals. Greater availability of attention--as manipulated with a concurrent task or inferred from eye movement statistics--shifted the balance in favor of reversing illusory rotation (rather than depth). On the other hand, volitional control over illusory reversals was limited and did not depend on tracking individual dots during the direction reversal. Finally, display properties strongly influenced ambiguous reversals. Any asymmetries between 'front' and 'back' surfaces--created either on purpose by coloring or accidentally by random dot placement--also shifted the balance in favor of reversing illusory rotation (rather than depth). We conclude that the outcome of ambiguous reversals depends on attention, specifically on attention to the illusory sphere and its surface irregularities, but not on attentive tracking of individual surface dots.     

Oscillatory depth as a function of temporal frequency

The percept of oscillatory motion in depth was generated by a luminance modulation of a sinusoidal nature induced within each dot pair of a stationary random assembly of paired dots. The dots were miniature sources of polarized light viewed through a rotating ocular polarizer, which facilitated both the percept of oscillations and the modulation of luminance at any desired frequency. Depth responses were studied as a function of frequency within the 0-2 Hz range. A strong amplitude decrease was noticed at a mean frequency of f(1)=0.81 Hz; oscillations were perceived as 'rectified' for f > f(1) with an additional minimum of crossed-disparity depth at f(2)=1.60 Hz. It is suggested that the intensity modulation of the light beams mapping the stationary stimuli onto the retinae was a likely factor responsible for the observed depth minima and the rectification of faster oscillations. Results are compared to those obtained in a traditional setting, where the percept of oscillations in depth had been generated by disparity variations due to lateral motion of the stimuli.     

Lesions to right posterior parietal cortex impair visual depth perception from disparity but not motion cues

The posterior parietal cortex (PPC) is understood to be active when observers perceive three-dimensional (3D) structure. However, it is not clear how central this activity is in the construction of 3D spatial representations. Here, we examine whether PPC is essential for two aspects of visual depth perception by testing patients with lesions affecting this region. First, we measured subjects'' ability to discriminate depth structure in various 3D surfaces and objects using binocular disparity. Patients with lesions to right PPC (N = 3) exhibited marked perceptual deficits on these tasks, whereas those with left hemisphere lesions (N = 2) were able to reliably discriminate depth as accurately as control subjects. Second, we presented an ambiguous 3D stimulus defined by structure from motion to determine whether PPC lesions influence the rate of bistable perceptual alternations. Patients'' percept durations for the 3D stimulus were generally within a normal range, although the two patients with bilateral PPC lesions showed the fastest perceptual alternation rates in our sample. Intermittent stimulus presentation reduced the reversal rate similarly across subjects. Together, the results suggest that PPC plays a causal role in both inferring and maintaining the perception of 3D structure with stereopsis supported primarily by the right hemisphere, but do not lend support to the view that PPC is a critical contributor to bistable perceptual alternations.This article is part of the themed issue ‘Vision in our three-dimensional world’.     

Interaction between pools of binocular disparity detectors tuned to different disparities

Unambiguous dots (having one binocular disparity) when inserted in an ambiguous random-dot stereogram (with multiple disparity values) could pull the ambiguous percept. The unambiguous bias carried that ambiguous depth percept whose disparity was nearest to the disparity of the bias. The closer the disparities were to each other, the stronger the pulling effect that was observed. Even a physical bias of 4% density was adequate to overcome the natural bias of most observers. The stimulus duration had to be over 50 msec to provide a strong pulling effect. In all experiments the stimulus duration was 160 msec or shorter, indicating that the pulling effect was a product of neural interactions, rather than convergence movement of the eyes. As a result of these findings a parallel model of stereopsis has been proposed, which extends the spring-coupled dipole model of Julesz (1971).     

Isotropic integration of binocular disparity and relative motion in the perception of three-dimensional shape

Richards (1985) showed that veridical three-dimensional shape may be recovered from the integration of binocular disparity and retinal motion information, but proposed that this integration may only occur for horizontal retinal motion. Psychophysical evidence supporting the combination of stereo and motion information is limited to the case of horizontal motion (Johnston et al., 1994), and has been criticised on the grounds of potential object boundary cues to shape present in the stimuli. We investigated whether veridical shape can be recovered under more general conditions. Observers viewed cylinders that were defined by binocular disparity, two-frame motion or a combination of disparity and motion, presented at simulated distances of 30 cm, 90 cm or 150 cm. Horizontally and vertically oriented cylinders were rotated about vertical and horizontal axes. When rotation was about the cylinder's own axis, no boundary cues to shape were introduced. Settings were biased for the disparity and two-frame motion stimuli, while more veridical shape judgements were made under all conditions for combined cue stimuli. These results demonstrate that the improved perception of three-dimensional shape in these stimuli is not a consequence of the presence of object boundary cues, and that the combination of disparity and motion is not restricted to horizontal image motion.     

On the inverse problem of binocular 3D motion perception

It is shown that existing processing schemes of 3D motion perception such as interocular velocity difference, changing disparity over time, as well as joint encoding of motion and disparity, do not offer a general solution to the inverse optics problem of local binocular 3D motion. Instead we suggest that local velocity constraints in combination with binocular disparity and other depth cues provide a more flexible framework for the solution of the inverse problem. In the context of the aperture problem we derive predictions from two plausible default strategies: (1) the vector normal prefers slow motion in 3D whereas (2) the cyclopean average is based on slow motion in 2D. Predicting perceived motion directions for ambiguous line motion provides an opportunity to distinguish between these strategies of 3D motion processing. Our theoretical results suggest that velocity constraints and disparity from feature tracking are needed to solve the inverse problem of 3D motion perception. It seems plausible that motion and disparity input is processed in parallel and integrated late in the visual processing hierarchy.     

Learning to use an invisible visual signal for perception

How does the brain construct a percept from sensory signals? One approach to this fundamental question is to investigate perceptual learning as induced by exposure to statistical regularities in sensory signals [1-7]. Recent studies showed that exposure to novel correlations between sensory signals can cause a signal to have new perceptual effects [2, 3]. In those studies, however, the signals were clearly visible. The automaticity of the learning was therefore difficult to determine. Here we investigate whether learning of this sort, which causes new effects on appearance, can be low level and automatic by employing a visual signal whose perceptual consequences were made invisible-a vertical disparity gradient masked by other depth cues. This approach excluded high-level influences such as attention or consciousness. Our stimulus for probing perceptual appearance was a rotating cylinder. During exposure, we introduced a new contingency between the invisible signal and the rotation direction of the cylinder. When subsequently presenting an ambiguously rotating version of the cylinder, we found that the invisible signal influenced the perceived rotation direction. This demonstrates that perception can rapidly undergo "structure learning" by automatically picking up novel contingencies between sensory signals, thus automatically recruiting signals for novel uses during the construction of a percept.     

Depth generalization from stereo to motion parallax in the owl

Although many sources of three-dimensional information have been isolated and demonstrated to contribute independently, to depth vision in animal studies, it is not clear whether these distinct cues are perceived to be perceptually equivalent. Such ability is observed in humans and would seem to be advantageous for animals as well in coping with the often co-varying (or ambiguous) information about the layout of physical space. We introduce the expression primary-depth-cue equivalence to refer to the ability to perceive mutually consistent information about differences in depth from either stereopsis or motion-parallax. We found that owls trained to detect relative depth as a perceptual category (objects versus holes) when specified by binocular disparity alone (stereopsis), immediately transferred this discrimination to novel stimuli where the equivalent depth categories were available only through differences in motion information produced by head movements (observer-produced motion-parallax). Motion-parallax discrimination did occur under monocular viewing conditions and reliable performance depended heavily on the amplitude of side-to-side head movements. The presence of primary-depth-cue equivalence in the visual system of the owl provides further conformation of the hypothesis that neural systems evolved to detect differences in either disparity or motion information are likely to share similar processing mechanisms.     

Performance Characterization of Watson Ahumada Motion Detector Using Random Dot Rotary Motion Stimuli

The performance of Watson & Ahumada''s model of human visual motion sensing is compared against human psychophysical performance. The stimulus consists of random dots undergoing rotary motion, displayed in a circular annulus. The model matches psychophysical observer performance with respect to most parameters. It is able to replicate some key psychophysical findings such as invariance of observer performance to dot density in the display, and decrease of observer performance with frame duration of the display.Associated with the concept of rotary motion is the notion of a center about which rotation occurs. One might think that for accurate estimation of rotary motion in the display, this center must be accurately known. A simple vector analysis reveals that this need not be the case. Numerical simulations confirm this result, and may explain the position invariance of MST(d) cells. Position invariance is the experimental finding that rotary motion sensitive cells are insensitive to where in their receptive field rotation occurs.When all the dots in the display are randomly drawn from a uniform distribution, illusory rotary motion is perceived. This case was investigated by Rose & Blake previously, who termed the illusory rotary motion the omega effect. Two important experimental findings are reported concerning this effect. First, although the display of random dots evokes perception of rotary motion, the direction of motion perceived does not depend on what dot pattern is shown. Second, the time interval between spontaneous flips in perceived direction is lognormally distributed (mode≈2 s). These findings suggest the omega effect fits in the category of a typical bistable illusion, and therefore the processes that give rise to this illusion may be the same processes that underlie much of other bistable phenomenon.     

Perceptual switch rates with ambiguous structure-from-motion figures in bipolar disorder

Slowing of the rate at which a rivalrous percept switches from one configuration to another has been suggested as a potential trait marker for bipolar disorder. We measured perceptual alternations for a bistable, rotating, structure-from-motion cylinder in bipolar and control participants. In a control task, binocular depth rendered the direction of cylinder rotation unambiguous to monitor participants' performance and attention during the experimental task. A particular direction of rotation was perceptually stable, on average, for 33.5s in participants without psychiatric diagnosis. Euthymic, bipolar participants showed a slightly slower rate of switching between the two percepts (percept duration 42.3s). Under a parametric analysis of the best-fitting model for individual participants, this difference was statistically significant. However, the variability within groups was high, so this difference in average switch rates was not big enough to serve as a trait marker for bipolar disorder. We also found that low-level visual capacities, such as stereo threshold, influence perceptual switch rates. We suggest that there is no single brain location responsible for perceptual switching in all different ambiguous figures and that perceptual switching is generated by the actions of local cortical circuitry.     

Visual Working Memory Contents Bias Ambiguous Structure from Motion Perception

The way we perceive the visual world depends crucially on the state of the observer. In the present study we show that what we are holding in working memory (WM) can bias the way we perceive ambiguous structure from motion stimuli. Holding in memory the percept of an unambiguously rotating sphere influenced the perceived direction of motion of an ambiguously rotating sphere presented shortly thereafter. In particular, we found a systematic difference between congruent dominance periods where the perceived direction of the ambiguous stimulus corresponded to the direction of the unambiguous one and incongruent dominance periods. Congruent dominance periods were more frequent when participants memorized the speed of the unambiguous sphere for delayed discrimination than when they performed an immediate judgment on a change in its speed. The analysis of dominance time-course showed that a sustained tendency to perceive the same direction of motion as the prior stimulus emerged only in the WM condition, whereas in the attention condition perceptual dominance dropped to chance levels at the end of the trial. The results are explained in terms of a direct involvement of early visual areas in the active representation of visual motion in WM.     

Amplitude,frequency and phase determinants of perceived rotations and rigidity in the kinetic depth effect

In a previous experiment the author has shown how perceived rotations, in the kinetic depth effect, decrease as a function of temporal frequency. It was argued that many of the ambiguous motion effects, and the temporally limited nature of the phenomenon, are due to the inability to discriminate curvature and torsion information as well as the finite time required to extract these latter sequentially dependent image parameters. In this paper we extend the investigation to consider the perception of rotations and rigidity as a function of complexity, including amplitude and phase differences between image elements. Results indicate that perceived rigidity is specifically a function of phase information, or relative motion components, and that rotations decrease as a function of complexity. In this way the curvature and torsion extraction processes are integrated with the sinusoidal nature of the image motion.     

Does vertical disparity scale the perception of stereoscopic depth?

It has been suggested that a measure of the gradients of vertical disparity over a surface may scale the mapping between horizontal disparity and perceived depth. We have investigated this possibility by obtaining estimates of the depth within stereograms that simulated two apposed fronto-parallel planes placed at different distances from an observer. The gradients of vertical disparity in a stereogram were set to simulate those appropriate to a viewing distance of 12.5 cm, 25 cm, 50 cm or 100 cm, whereas the distance specified by vergence and accommodative cues was always fixed at 50 cm. Judgements of the perceived depth between the two planes were uninfluenced by changes in the gradients of vertical disparity. It thus seems that the human visual system does not employ vertical disparity as a scaling parameter in stereoscopic depth judgements.     

Spatio-temporal parameters and the three-dimensionality of apparent motion: evidence for two types of processing

The minimum ISI required for perceiving apparent motion in depth was measured as a function of the 2D separation of stimuli and the physical separation of stimuli in depth. It was found that temporal thresholds increased as a function of the separation of stimuli in depth. This supports the results of previous research indicating that the perceived three-dimensionality of apparent motion in depth increases with ISI. In addition, the rate of threshold increase was significantly greater in displays with short 2D separations of stimuli than in displays with large 2D separations. This robust functional dissociation of thresholds indicates that the short-range system may be involved in the processing of apparent motion in depth in the former case.     

Interaction between Depth Order and Density Affects Vection and Postural Sway

Objective

Vection, a feeling of self-motion while being physically stationary, and postural sway can be modulated by various visual factors. Moreover, vection and postural sway are often found to be closely related when modulated by such visual factors, suggesting a common neural mechanism. One well-known visual factor is the depth order of the stimulus. The density, i.e. number of objects per unit area, is proposed to interact with the depth order in the modulation of vection and postural sway, which has only been studied to a limited degree.

Methods

We therefore exposed 17 participants to 18 different stimuli containing a stationary pattern and a pattern rotating around the naso-occipital axis. The density of both patterns was varied between 10 and 90%; the densities combined always added up to 100%. The rotating pattern occluded or was occluded by the stationary pattern, suggesting foreground or background motion, respectively. During pattern rotation participants reported vection by pressing a button, and postural sway was recorded using a force plate.

Results

Participants always reported more vection and swayed significantly more when rotation was perceived in the background and when the rotating pattern increased in density. As hypothesized, we found that the perceived depth order interacted with pattern density. A pattern rotating in the background with a density between 60 and 80% caused significantly more vection and postural sway than when it was perceived to rotate in the foreground.

Conclusions

The findings suggest that the ratio between fore- and background pattern densities is an important factor in the interaction with the depth order, and it is not the density of rotating pattern per se. Moreover, the observation that vection and postural sway were modulated in a similar way points towards a common neural origin regulating both variables.     

Visual detection of paradoxical motion in flies

Summary From psychophysics it is known that humans easily perceive motion in Fourier-stimuli in which dots are displaced coherently into one direction. Furthermore, motion can be extracted from Drift-balanced stimuli in which the dots on average have no distinct direction of motion, or even in paradox -motion stimuli where the dots are displaced opposite to the perceived direction of motion. Whereas Fourier-motion can be explained by very basic motion detectors and nonlinear preprocessing of the input can account for the detection of Drift-balanced motion, a hierarchical model with two layers of motion detectors was proposed to explain the perception of -motion. The well described visual system of the fly allows to investigate whether these complex motion stimuli can be detected in a comparatively simple brain.The detection of such motion stimuli was analyzed for various random-dot cinematograms with extracellular recordings from the motion-sensitive Hl-neuron in the third visual ganglion of the blowfly Calliphora erythrocephala. The results were compared to computer-simulations of a hierarchical model of motion detector networks.For Fourier- and Drift-balanced motion stimuli, the Hl-neuron responds directionally selective to the moving object, whereas for -motion stimuli, the preferred direction is given by the dot displacement. Assuming nonlinear preprocessing of the detector input, such as a half-wave rectification, elementary motion detectors of the correlation type can account for these results.Abbreviations EMD elementary motion detector     

动态歧义图知觉中的瞳孔反射和眼动扫视行为

歧义图的双稳态知觉是一种非常有趣的视觉现象,但对其机制还不十分清楚.采用"运动产生的结构"(structurefrom-motion)的歧义图和无歧义的对照图,我们研究了这一问题.被试者在报告对歧义图和无歧义图的知觉发生翻转时,其瞳孔都扩张,而且在翻转之后都达到峰值;与无歧义图条件下不同,在报告知觉翻转前,歧义图条件下的瞳孔要明显小于均值,而在瞳孔扩张达到峰值之后,瞳孔仍然明显大于均值.这些结果说明知觉翻转后的瞳孔扩张是一个表达被试知觉状态已改变的指标.而对歧义图和无歧义图刺激的瞳孔反射的差异,可能反映了由歧义图所产生知觉翻转的神经信号和知觉状态的内源性.另外,被试眼动扫视的方向会随着运动轴的变化呈现不同的扫视分布模式,但在歧义图与无歧义图之间分布模式是一致的,这不仅表明被试从歧义图中感知到了与无歧义图同样的信息,也表明瞳孔反射变化与双稳态知觉变化相关的结论具有可靠性.本文对歧义图双稳态知觉的视觉机制提供了新的认识.