Tactile rivalry demonstrated with an ambiguous apparent-motion quartet

When observers view ambiguous visual stimuli, their perception will often alternate between the possible interpretations, a phenomenon termed perceptual rivalry [1]. To induce perceptual rivalry in the tactile domain, we developed a new tactile illusion, based on the visual apparent-motion quartet [2]. Pairs of 200 ms vibrotactile stimuli were applied to the finger pad at intervals separated by 300 ms. The location of each successive stimulus pair alternated between the opposing diagonal corners of the approximately 1 cm(2) stimulation array. This stimulation sequence led all participants to report switches between the perception of motion traveling either up and down or left and right across their fingertip. Adaptation to tactile stimulation biased toward one direction caused subsequent ambiguous stimulation to be experienced in the opposing direction. In contrast, when consecutive trials of ambiguous stimulation were presented, motion was generally perceived in the direction consistent with the motion reported in the previous trial. Voluntary eye movements induced shifts in the tactile perception toward a motion axis aligned along a world-centered coordinate frame. Because the tactile quartet results in switching perceptual states despite unvaried sensory input, it is ideally suited to future studies of the neural processes associated with conscious tactile perception.     

Temporal dynamics of auditory and visual bistability reveal common principles of perceptual organization

When dealing with natural scenes, sensory systems have to process an often messy and ambiguous flow of information. A stable perceptual organization nevertheless has to be achieved in order to guide behavior. The neural mechanisms involved can be highlighted by intrinsically ambiguous situations. In such cases, bistable perception occurs: distinct interpretations of the unchanging stimulus alternate spontaneously in the mind of the observer. Bistable stimuli have been used extensively for more than two centuries to study visual perception. Here we demonstrate that bistable perception also occurs in the auditory modality. We compared the temporal dynamics of percept alternations observed during auditory streaming with those observed for visual plaids and the susceptibilities of both modalities to volitional control. Strong similarities indicate that auditory and visual alternations share common principles of perceptual bistability. The absence of correlation across modalities for subject-specific biases, however, suggests that these common principles are implemented at least partly independently across sensory modalities. We propose that visual and auditory perceptual organization could rely on distributed but functionally similar neural competition mechanisms aimed at resolving sensory ambiguities.     

Influence of Visual Motion,Suggestion, and Illusory Motion on Self-Motion Perception in the Horizontal Plane

A moving visual field can induce the feeling of self-motion or vection. Illusory motion from static repeated asymmetric patterns creates a compelling visual motion stimulus, but it is unclear if such illusory motion can induce a feeling of self-motion or alter self-motion perception. In these experiments, human subjects reported the perceived direction of self-motion for sway translation and yaw rotation at the end of a period of viewing set visual stimuli coordinated with varying inertial stimuli. This tested the hypothesis that illusory visual motion would influence self-motion perception in the horizontal plane. Trials were arranged into 5 blocks based on stimulus type: moving star field with yaw rotation, moving star field with sway translation, illusory motion with yaw, illusory motion with sway, and static arrows with sway. Static arrows were used to evaluate the effect of cognitive suggestion on self-motion perception. Each trial had a control condition; the illusory motion controls were altered versions of the experimental image, which removed the illusory motion effect. For the moving visual stimulus, controls were carried out in a dark room. With the arrow visual stimulus, controls were a gray screen. In blocks containing a visual stimulus there was an 8s viewing interval with the inertial stimulus occurring over the final 1s. This allowed measurement of the visual illusion perception using objective methods. When no visual stimulus was present, only the 1s motion stimulus was presented. Eight women and five men (mean age 37) participated. To assess for a shift in self-motion perception, the effect of each visual stimulus on the self-motion stimulus (cm/s) at which subjects were equally likely to report motion in either direction was measured. Significant effects were seen for moving star fields for both translation (p = 0.001) and rotation (p<0.001), and arrows (p = 0.02). For the visual motion stimuli, inertial motion perception was shifted in the direction consistent with the visual stimulus. Arrows had a small effect on self-motion perception driven by a minority of subjects. There was no significant effect of illusory motion on self-motion perception for either translation or rotation (p>0.1 for both). Thus, although a true moving visual field can induce self-motion, results of this study show that illusory motion does not.     

Perceptual switch rates with ambiguous structure-from-motion figures in bipolar disorder

Slowing of the rate at which a rivalrous percept switches from one configuration to another has been suggested as a potential trait marker for bipolar disorder. We measured perceptual alternations for a bistable, rotating, structure-from-motion cylinder in bipolar and control participants. In a control task, binocular depth rendered the direction of cylinder rotation unambiguous to monitor participants' performance and attention during the experimental task. A particular direction of rotation was perceptually stable, on average, for 33.5s in participants without psychiatric diagnosis. Euthymic, bipolar participants showed a slightly slower rate of switching between the two percepts (percept duration 42.3s). Under a parametric analysis of the best-fitting model for individual participants, this difference was statistically significant. However, the variability within groups was high, so this difference in average switch rates was not big enough to serve as a trait marker for bipolar disorder. We also found that low-level visual capacities, such as stereo threshold, influence perceptual switch rates. We suggest that there is no single brain location responsible for perceptual switching in all different ambiguous figures and that perceptual switching is generated by the actions of local cortical circuitry.     

Interhemispheric connections shape subjective experience of bistable motion

The right and left visual hemifields are represented in different cerebral hemispheres and are bound together by connections through the corpus callosum. Much has been learned on the functions of these connections from split-brain patients [1-4], but little is known about their contribution to conscious visual perception in healthy humans. We used diffusion tensor imaging and functional magnetic resonance imaging to investigate which callosal connections contribute to the subjective experience of a visual motion stimulus that requires interhemispheric integration. The "motion quartet" is an ambiguous version of apparent motion that leads to perceptions of either horizontal or vertical motion [5]. Interestingly, observers are more likely to perceive vertical than horizontal motion when the stimulus is presented centrally in the visual field [6]. This asymmetry has been attributed to the fact that, with central fixation, perception of horizontal motion requires integration across hemispheres whereas perception of vertical motion requires only intrahemispheric processing [7]. We are able to show that the microstructure of individually tracked callosal segments connecting motion-sensitive areas of the human MT/V5 complex (hMT/V5+; [8]) can predict the conscious perception of observers. Neither connections between primary visual cortex (V1) nor other surrounding callosal regions exhibit a similar relationship.     

Rapid Perceptual Switching of a Reversible Biological Figure

Certain visual stimuli can give rise to contradictory perceptions. In this paper we examine the temporal dynamics of perceptual reversals experienced with biological motion, comparing these dynamics to those observed with other ambiguous structure from motion (SFM) stimuli. In our first experiment, naïve observers monitored perceptual alternations with an ambiguous rotating walker, a figure that randomly alternates between walking in clockwise (CW) and counter-clockwise (CCW) directions. While the number of reported reversals varied between observers, the observed dynamics (distribution of dominance durations, CW/CCW proportions) were comparable to those experienced with an ambiguous kinetic depth cylinder. In a second experiment, we compared reversal profiles with rotating and standard point-light walkers (i.e. non-rotating). Over multiple test repetitions, three out of four observers experienced consistently shorter mean percept durations with the rotating walker, suggesting that the added rotational component may speed up reversal rates with biomotion. For both stimuli, the drift in alternation rate across trial and across repetition was minimal. In our final experiment, we investigated whether reversals with the rotating walker and a non-biological object with similar global dimensions (rotating cuboid) occur at random phases of the rotation cycle. We found evidence that some observers experience peaks in the distribution of response locations that are relatively stable across sessions. Using control data, we discuss the role of eye movements in the development of these reversal patterns, and the related role of exogenous stimulus characteristics. In summary, we have demonstrated that the temporal dynamics of reversal with biological motion are similar to other forms of ambiguous SFM. We conclude that perceptual switching with biological motion is a robust bistable phenomenon.     

Color and luminance influence, but can not explain, binocular rivalry onset bias

When an observer is presented with dissimilar images to the right and left eye, the images will alternate every few seconds in a phenomenon known as binocular rivalry. During sustained viewing, the timing of these switches appears to be unpredictable. Recent research has suggested that the initial 'onset' period of rivalry is not random and may be different in its neural mechanism than subsequent dominance periods. It is known that differences in luminance and contrast have a significant influence on the average dominance during sustained rivalry and that perception of luminance can vary between individuals and across the visual field. We therefore investigated whether perception of luminance contrast plays a role in onset rivalry. Observers viewed rival targets of equal brightness for brief presentations in eight locations of the near periphery and reported the color that was first dominant in each location. Results show that minimizing differences in brightness and contrast yields a stronger pattern of onset dominance bias and reveals evidence of monocular dominance. The results suggest that both contrast and monocular dominance play a role in onset dominance, though neither can fully explain the effect.     

Anticipatory Smooth Eye Movements in Autism Spectrum Disorder

Smooth pursuit eye movements are important for vision because they maintain the line of sight on targets that move smoothly within the visual field. Smooth pursuit is driven by neural representations of motion, including a surprisingly strong influence of high-level signals representing expected motion. We studied anticipatory smooth eye movements (defined as smooth eye movements in the direction of expected future motion) produced by salient visual cues in a group of high-functioning observers with Autism Spectrum Disorder (ASD), a condition that has been associated with difficulties in either generating predictions, or translating predictions into effective motor commands. Eye movements were recorded while participants pursued the motion of a disc that moved within an outline drawing of an inverted Y-shaped tube. The cue to the motion path was a visual barrier that blocked the untraveled branch (right or left) of the tube. ASD participants showed strong anticipatory smooth eye movements whose velocity was the same as that of a group of neurotypical participants. Anticipatory smooth eye movements appeared on the very first cued trial, indicating that trial-by-trial learning was not responsible for the responses. These results are significant because they show that anticipatory capacities are intact in high-functioning ASD in cases where the cue to the motion path is highly salient and unambiguous. Once the ability to generate anticipatory pursuit is demonstrated, the study of the anticipatory responses with a variety of types of cues provides a window into the perceptual or cognitive processes that underlie the interpretation of events in natural environments or social situations.     

Lesions to right posterior parietal cortex impair visual depth perception from disparity but not motion cues

The posterior parietal cortex (PPC) is understood to be active when observers perceive three-dimensional (3D) structure. However, it is not clear how central this activity is in the construction of 3D spatial representations. Here, we examine whether PPC is essential for two aspects of visual depth perception by testing patients with lesions affecting this region. First, we measured subjects'' ability to discriminate depth structure in various 3D surfaces and objects using binocular disparity. Patients with lesions to right PPC (N = 3) exhibited marked perceptual deficits on these tasks, whereas those with left hemisphere lesions (N = 2) were able to reliably discriminate depth as accurately as control subjects. Second, we presented an ambiguous 3D stimulus defined by structure from motion to determine whether PPC lesions influence the rate of bistable perceptual alternations. Patients'' percept durations for the 3D stimulus were generally within a normal range, although the two patients with bilateral PPC lesions showed the fastest perceptual alternation rates in our sample. Intermittent stimulus presentation reduced the reversal rate similarly across subjects. Together, the results suggest that PPC plays a causal role in both inferring and maintaining the perception of 3D structure with stereopsis supported primarily by the right hemisphere, but do not lend support to the view that PPC is a critical contributor to bistable perceptual alternations.This article is part of the themed issue ‘Vision in our three-dimensional world’.     

Visual perception of ambiguous figures: synchronization based neural models

We develop and study two neural network models of perceptual alternations. Both models have a star-like architecture of connections with a central element connected to a set of peripheral elements. A particular perception is simulated in terms of partial synchronization between the central element and some sub-group of peripheral elements. The first model is constructed from phase oscillators and the mechanism of perceptual alternations is based on chaotic intermittency under fixed parameter values. Similar to experimental evidence, the distribution of times between perceptual alternations is represented by the gamma distribution. The second model is built of spiking neurons of the Hodgkin–Huxley type. The mechanism of perceptual alternations is based on plasticity of inhibitory synapses which increases the inhibition from the central unit to the neural assembly representing the current percept. As a result another perception is formed. Simulations show that the second model is in good agreement with behavioural data on switching times between percepts of ambiguous figures and with experimental results on binocular rivalry of two and four percepts. This article is part of a special issue on Neuronal Dynamics of Sensory Coding. This special issue is in honour of Professor Pepe Segundo who is one of the pioneers in the study of neural coding. Pepe has been an active participant in many Neural Coding Workshops sharing his great knowledge and experience of research in this field. I (R. Borisyuk) was very happy to meet Pepe for the first time in Prague when attending the first Neural Coding Workshop in 1995. From that time we regularly met at Neural Coding Workshops and these meetings have always been very stimulating and fruitful for my research. Remarkably, the first paper I studied at the beginning of my scientific career was a seminal paper by Moore et al. (1970). For me, this paper provided a great opportunity to learn the basic statistical techniques for the analysis of multiple spike trains and neural coding. According to the Institute of Scientific Information, this paper has been cited 380 times! This exciting paper has inspired my research into the synaptic and functional connectivity of neural circuits derived from spike-train recordings (Borisyuk et al. 1985; Stuart et al. 2005) and guided my search for new ideas on neural coding.     

Stabilized structure from motion without disparity induces disparity adaptation

3D structures can be perceived based on the patterns of 2D motion signals. With orthographic projection of a 3D stimulus onto a 2D plane, the kinetic information can give a vivid impression of depth, but the depth order is intrinsically ambiguous, resulting in bistable or even multistable interpretations. For example, an orthographic projection of dots on the surface of a rotating cylinder is perceived as a rotating cylinder with ambiguous direction of rotation. We show that the bistable rotation can be stabilized by adding information, not to the dots themselves, but to their spatial context. More interestingly, the stabilized bistable motion can generate consistent rotation aftereffects. The rotation aftereffect can only be observed when the adapting and test stimuli are presented at the same stereo depth and the same retinal location, and it is not due to attentional tracking. The observed rotation aftereffect is likely due to direction-contingent disparity adaptation, implying that stimuli with kinetic depth may have activated neurons sensitive to different disparities, even though the stimuli have zero relative disparity. Stereo depth and kinetic depth may be supported by a common neural mechanism at an early stage in the visual system.     

Onset rivalry: brief presentation isolates an early independent phase of perceptual competition

When the left and right eyes are simultaneously presented with different images, observers typically report exclusive awareness of only one image. This phenomenon is termed binocular rivalry, reflecting the fact that the dominant image alternates every few seconds in a cycle of perceptual competition that continues indefinitely. Despite the apparent continuity in perceptual switching, we now demonstrate that the initial "onset" period is fundamentally different to all subsequent rivalry epochs. Using brief intermittent presentations, rivalry dominance shows strong biases such that the same target is perceived with each successive stimulus onset. These biases remain consistent within any given location, but vary across the visual field in a distribution that is stable over multiple weeks but highly idiosyncratic across observers. If the presentation exceeds approximately 1sec at any location, however, the very different and much more balanced alternations of sustained binocular rivalry become apparent. These powerful onset biases are observed with brief intermittent presentations at a single location or with continual smooth motion of the targets. Periods of adaptation to one of the rivaling targets induced local switches in dominance to the non-adapted target. However, these effects were generally limited to the spatial site of adaptation and had less influence over each subsequent cycle of the target. We conclude that onset rivalry is independent of sustained rivalry and cannot be explained by local regions of monocular dominance or memory of past perceptual history, but rather reflects low-level, spatially localized factors that are stable over periods of weeks. These findings suggest that brief presentation paradigms are inappropriate for their current use in studies of the mechanisms underlying sustained rivalry. However, brief presentations are ideal for investigating early stages of perceptual competition.     

Psychophysics: catching the old codger's eye

Some visual stimuli are bistable, with perception alternating irregularly between two alternatives. Recent work suggests that the neural processing of these alternations must occur at low levels of the visual system.     

Binocular rivalry requires visual attention

An interocular conflict arises when different images are presented to each eye at the same spatial location. The visual system resolves this conflict through binocular rivalry: observers consciously perceive spontaneous alternations between the two images. Visual attention is generally important for resolving competition between neural representations. However, given the seemingly spontaneous and automatic nature of binocular rivalry, the role of attention in resolving interocular competition remains unclear. Here we test whether visual attention is necessary to?produce rivalry. Using an EEG frequency-tagging method to track cortical representations of the conflicting images, we show that when attention was diverted away, rivalry stopped. The EEG data further suggested that the neural representations of the dichoptic images combined without attention. Thus, attention is necessary for dichoptic images to be engaged in sustained rivalry and may be generally required for resolving conflicting, potentially ambiguous input and giving a single interpretation access to consciousness.     

MEG responses to the perception of global structure within glass patterns

Background

The perception of global form requires integration of local visual cues across space and is the foundation for object recognition. Here we used magnetoencephalography (MEG) to study the location and time course of neuronal activity associated with the perception of global structure from local image features. To minimize neuronal activity to low-level stimulus properties, such as luminance and contrast, the local image features were held constant during all phases of the MEG recording. This allowed us to assess the relative importance of striate (V1) versus extrastriate cortex in global form perception.

Methodology/Principal Findings

Stimuli were horizontal, rotational and radial Glass patterns. Glass patterns without coherent structure were viewed during the baseline period to ensure neuronal responses reflected perception of structure and not changes in local image features. The spatial distribution of task-related changes in source power was mapped using Synthetic Aperture Magnetometry (SAM), and the time course of activity within areas of maximal power change was determined by calculating time-frequency plots using a Hilbert transform. For six out of eight observers, passive viewing of global structure was associated with a reduction in 10–20 Hz cortical oscillatory power within extrastriate occipital cortex. The location of greatest power change was the same for each pattern type, being close to or within visual area V3a. No peaks of activity were observed in area V1. Time-frequency analyses indicated that neural activity was least for horizontal patterns.

Conclusions

We conclude: (i) visual area V3a is involved in the analysis of global form; (ii) the neural signature for perception of structure, as assessed using MEG, is a reduction in 10–20 Hz oscillatory power; (iii) different neural processes may underlie the perception of horizontal as opposed to radial or rotational structure; and (iv) area V1 is not strongly activated by global form in Glass patterns.     

Observational visuospatial encoding of the cache locations of others by western scrub-jays (<Emphasis Type="Italic">Aphelocoma californica</Emphasis>)

Western scrub-jays (Aphelocoma californica) hide food and rely on spatial memory to recover their caches at a later date. They also rely on observational spatial memory to steal caches made by other individuals. Successful pilfering may require an understanding of allocentric space because the observer will often be in a different position from the demonstrator when the caching event occurs. We compared cache recovery accuracy of pairs of observers that watched a demonstrator cache food. The pattern of recovery searches showed that observers were more accurate when they had observed the caching event from the same viewing direction as the demonstrator than when they had watched from the opposite direction. Search accuracy was not affected by whether or not the tray-specific local cues provided left–right landmark information (i.e. heterogeneous vs. homogeneous local cues), or whether or not the caching tray location was rotated. Taken together, these results suggest that observers have excellent spatial memory and that they have little difficulty with mental rotation.     

The neural basis of centre-surround interactions in visual motion processing

Perception of a moving visual stimulus can be suppressed or enhanced by surrounding context in adjacent parts of the visual field. We studied the neural processes underlying such contextual modulation with fMRI. We selected motion selective regions of interest (ROI) in the occipital and parietal lobes with sufficiently well defined topography to preclude direct activation by the surround. BOLD signal in the ROIs was suppressed when surround motion direction matched central stimulus direction, and increased when it was opposite. With the exception of hMT+/V5, inserting a gap between the stimulus and the surround abolished surround modulation. This dissociation between hMT+/V5 and other motion selective regions prompted us to ask whether motion perception is closely linked to processing in hMT+/V5, or reflects the net activity across all motion selective cortex. The motion aftereffect (MAE) provided a measure of motion perception, and the same stimulus configurations that were used in the fMRI experiments served as adapters. Using a linear model, we found that the MAE was predicted more accurately by the BOLD signal in hMT+/V5 than it was by the BOLD signal in other motion selective regions. However, a substantial improvement in prediction accuracy could be achieved by using the net activity across all motion selective cortex as a predictor, suggesting the overall conclusion that visual motion perception depends upon the integration of activity across different areas of visual cortex.     

The Direction of Celestial Rotation Affects the Development of Migratory Orientation in Pied Flycatchers,Ficedula hypoleuca

The migratory direction in young passerine migrants is based on innate information, with the geomagnetic field and celestial rotation as references. To test whether the direction of celestial rotation is of importance, hand-raised pied flycatchers in Latvia were exposed during the premigratory period to a planetarium rotating in different directions. During autumn migration, when their orientation behavior was recorded in the local geomagnetic field in the absence of celestial cues, birds that had been exposed to a sky rotating in the natural direction showed a unimodal preference of their south-westerly migratory direction. Birds that had been exposed to a sky rotating in the reversed direction, in contrast, showed a bimodal preference of an axis south-west-north-east. Their behavior was similar to that of pied flycatchers that had been raised without access to celestial cues. In Latvia, the magnetic field alone allows only orientation along the migratory axis, and celestial rotation enables birds to select the correct end of this axis. Our findings show that the direction of rotation is of crucial importance: celestial rotation is effective only if the stars move in the natural direction.     

Depth Perception Not Found in Human Observers for Static or Dynamic Anti-Correlated Random Dot Stereograms

One of the greatest challenges in visual neuroscience is that of linking neural activity with perceptual experience. In the case of binocular depth perception, important insights have been achieved through comparing neural responses and the perception of depth, for carefully selected stimuli. One of the most important types of stimulus that has been used here is the anti-correlated random dot stereogram (ACRDS). In these stimuli, the contrast polarity of one half of a stereoscopic image is reversed. While neurons in cortical area V1 respond reliably to the binocular disparities in ACRDS, they do not create a sensation of depth. This discrepancy has been used to argue that depth perception must rely on neural activity elsewhere in the brain. Currently, the psychophysical results on which this argument rests are not clear-cut. While it is generally assumed that ACRDS do not support the perception of depth, some studies have reported that some people, some of the time, perceive depth in some types of these stimuli. Given the importance of these results for understanding the neural correlates of stereopsis, we studied depth perception in ACRDS using a large number of observers, in order to provide an unambiguous conclusion about the extent to which these stimuli support the perception of depth. We presented observers with random dot stereograms in which correlated dots were presented in a surrounding annulus and correlated or anti-correlated dots were presented in a central circular region. While observers could reliably report the depth of the central region for correlated stimuli, we found no evidence for depth perception in static or dynamic anti-correlated stimuli. Confidence ratings for stereoscopic perception were uniformly low for anti-correlated stimuli, but showed normal variation with disparity for correlated stimuli. These results establish that the inability of observers to perceive depth in ACRDS is a robust phenomenon.     

Competitive Dynamics in MSTd: A Mechanism for Robust Heading Perception Based on Optic Flow

Human heading perception based on optic flow is not only accurate, it is also remarkably robust and stable. These qualities are especially apparent when observers move through environments containing other moving objects, which introduce optic flow that is inconsistent with observer self-motion and therefore uninformative about heading direction. Moving objects may also occupy large portions of the visual field and occlude regions of the background optic flow that are most informative about heading perception. The fact that heading perception is biased by no more than a few degrees under such conditions attests to the robustness of the visual system and warrants further investigation. The aim of the present study was to investigate whether recurrent, competitive dynamics among MSTd neurons that serve to reduce uncertainty about heading over time offer a plausible mechanism for capturing the robustness of human heading perception. Simulations of existing heading models that do not contain competitive dynamics yield heading estimates that are far more erratic and unstable than human judgments. We present a dynamical model of primate visual areas V1, MT, and MSTd based on that of Layton, Mingolla, and Browning that is similar to the other models, except that the model includes recurrent interactions among model MSTd neurons. Competitive dynamics stabilize the model’s heading estimate over time, even when a moving object crosses the future path. Soft winner-take-all dynamics enhance units that code a heading direction consistent with the time history and suppress responses to transient changes to the optic flow field. Our findings support recurrent competitive temporal dynamics as a crucial mechanism underlying the robustness and stability of perception of heading.