The spatial origin of a perceptual transition in binocular rivalry

When the left and the right eye are simultaneously presented with incompatible images at overlapping retinal locations, an observer typically reports perceiving only one of the two images at a time. This phenomenon is called binocular rivalry. Perception during binocular rivalry is not stable; one of the images is perceptually dominant for a certain duration (typically in the order of a few seconds) after which perception switches towards the other image. This alternation between perceptual dominance and suppression will continue for as long the images are presented. A characteristic of binocular rivalry is that a perceptual transition from one image to the other generally occurs in a gradual manner: the image that was temporarily suppressed will regain perceptual dominance at isolated locations within the perceived image, after which its visibility spreads throughout the whole image. These gradual transitions from perceptual suppression to perceptual dominance have been labeled as traveling waves of perceptual dominance. In this study we investigate whether stimulus parameters affect the location at which a traveling wave starts. We varied the contrast, spatial frequency or motion speed in one of the rivaling images, while keeping the same parameter constant in the other image. We used a flash-suppression paradigm to force one of the rival images into perceptual suppression. Observers waited until the suppressed image became perceptually dominant again, and indicated the position at which this breakthrough from suppression occurred. Our results show that the starting point of a traveling wave during binocular rivalry is highly dependent on local stimulus parameters. More specifically, a traveling wave most likely started at the location where the contrast of the suppressed image was higher than that of the dominant one, the spatial frequency of the suppressed image was lower than that of the dominant one, and the motion speed of the suppressed image was higher than that of the dominant one. We suggest that a breakthrough from suppression to dominance occurs at the location where salience (the degree to which a stimulus element stands out relative to neighboring elements) of the suppressed image is higher than that of the dominant one. Our results further show that stimulus parameters affecting the temporal dynamics during continuous viewing of rival images described in other studies, also affect the spatial origin of traveling waves during binocular rivalry.     

When perceptual time stands still: long percept-memory in binocular rivalry

We have carried out binocular rivalry experiments with a large number of subjects to obtain high quality statistics on probability distribution of dominance duration (PDDD) for two cases where (a) the rival stimulus is continuously presented and (b) the rival stimulus is periodically removed, with stimulus-on and stimulus-off intervals T(on) and T(off) respectively. In the present study we have chosen to study the regime of relatively long stimulus-on time, i.e., T(on)> 1s, where the stimulus presentation duration is significantly longer than the human reaction and recognition time. In the case of periodically removed stimulus, the total probability for percept reversal during each of the successive stimulus-on intervals T(on) can be predicted using the PDDD for continuous viewing. More importantly, this total probability for percept reversal during any stimulus-on interval is independent of the length T(off) of the preceding blank time, which can be quite long. We argue that this suggests that, in the regime of long T(on) and T(off) considered here, the variables representing the perceptual state do not change significantly during long blank intervals. We discuss that these findings impose challenges to theoretical models which aim at describing visual perception.     

Reduced models for binocular rivalry

Binocular rivalry occurs when two very different images are presented to the two eyes, but a subject perceives only one image at a given time. A number of computational models for binocular rivalry have been proposed; most can be categorised as either “rate” models, containing a small number of variables, or as more biophysically-realistic “spiking neuron” models. However, a principled derivation of a reduced model from a spiking model is lacking. We present two such derivations, one heuristic and a second using recently-developed data-mining techniques to extract a small number of “macroscopic” variables from the results of a spiking neuron model simulation. We also consider bifurcations that can occur as parameters are varied, and the role of noise in such systems. Our methods are applicable to a number of other models of interest.     

Visual motion,binocular correspondence and binocular rivalry

The human pupillary control system has been the subject of interest to biologists and engineers as an example of a sensorimotor reflex which can be embedded in a control system paradigm. We present a nonlinear feedback model whose compact structure allows us to hypothesize possible physiological mechanisms which generate the proper behavior of the pupil system. The important pupil responses, including pupil size effect, asymmetry, and response to high-frequency stimuli, are defined. This model was simulated on a digital computer and comparisons to the paradigm experimental responses were performed, demonstrating a fit to each of the observed conditions. Improvements on previous models are discussed.     

Independent binocular rivalry processes for motion and form

During binocular rivalry, conflicting monocular images undergo alternating suppression. This study explores rivalry suppression by probing visual sensitivity during rivalry with various probe stimuli. When two faces engage in rivalry, sensitivity to face probes is reduced 4-fold during suppression. Rivaling global motions also rivaled very deeply when probed with a global motion. However, in a surprising finding, sensitivity to face probes is completely unimpaired during global motion rivalry, and motion sensitivity is unimpaired during face rivalry. This suggests that rivalry suppression is localized to the neurons representing the image conflict, which means that probes of a different kind suffer no suppression. Sensibly, this would leave visual processes not involved in rivalry free to function normally.     

Bistable percepts in the brain: FMRI contrasts monocular pattern rivalry and binocular rivalry

The neural correlates of binocular rivalry have been actively debated in recent years, and are of considerable interest as they may shed light on mechanisms of conscious awareness. In a related phenomenon, monocular rivalry, a composite image is shown to both eyes. The subject experiences perceptual alternations in which the two stimulus components alternate in clarity or salience. The experience is similar to perceptual alternations in binocular rivalry, although the reduction in visibility of the suppressed component is greater for binocular rivalry, especially at higher stimulus contrasts. We used fMRI at 3T to image activity in visual cortex while subjects perceived either monocular or binocular rivalry, or a matched non-rivalrous control condition. The stimulus patterns were left/right oblique gratings with the luminance contrast set at 9%, 18% or 36%. Compared to a blank screen, both binocular and monocular rivalry showed a U-shaped function of activation as a function of stimulus contrast, i.e. higher activity for most areas at 9% and 36%. The sites of cortical activation for monocular rivalry included occipital pole (V1, V2, V3), ventral temporal, and superior parietal cortex. The additional areas for binocular rivalry included lateral occipital regions, as well as inferior parietal cortex close to the temporoparietal junction (TPJ). In particular, higher-tier areas MT+ and V3A were more active for binocular than monocular rivalry for all contrasts. In comparison, activation in V2 and V3 was reduced for binocular compared to monocular rivalry at the higher contrasts that evoked stronger binocular perceptual suppression, indicating that the effects of suppression are not limited to interocular suppression in V1.     

Stimulus motion propels traveling waves in binocular rivalry

State transitions in the nervous system often take shape as traveling waves, whereby one neural state is replaced by another across space in a wave-like manner. In visual perception, transitions between the two mutually exclusive percepts that alternate when the two eyes view conflicting stimuli (binocular rivalry) may also take shape as traveling waves. The properties of these waves point to a neural substrate of binocular rivalry alternations that have the hallmark signs of lower cortical areas. In a series of experiments, we show a potent interaction between traveling waves in binocular rivalry and stimulus motion. The course of the traveling wave is biased in the motion direction of the suppressed stimulus that gains dominance by means of the wave-like transition. Thus, stimulus motion may propel the traveling wave across the stimulus to the extent that the stimulus motion dictates the traveling wave's direction completely. Using a computational model, we show that a speed-dependent asymmetry in lateral inhibitory connections between retinotopically organized and motion-sensitive neurons can explain our results. We argue that such a change in suppressive connections may play a vital role in the resolution of dynamic occlusion situations.     

Cooperation between different spatial frequencies in binocular rivalry

In binocular rivalry, stimuli made up of any limited spatial frequency (sf-) range are perceived for a shorter time than patterns consisting of the whole sf-spectrum. This finding indicates a non-linear summation of primarily independent sf-channels in the human visual system.     

The interaction between binocular rivalry and negative afterimages

Afterimage formation, historically attributed to retinal mechanisms, may also involve postretinal process. Consistent with this notion are results from experiments, reported here, investigating the interaction between binocular rivalry and negative afterimages (AIs). In Experiment 1, one eye was exposed to a grating never consciously experienced by the observer because this grating remained suppressed in rivalry throughout induction (the exclusively dominant stimulus was designed to preclude formation of an AI). As expected, the suppressed grating generated a vivid AI whose orientation could be accurately identified; not surprisingly, the strength of this AI varied with induction contrast. Experiment 2 revealed, however, that the strength of this AI produced during suppression was significantly weaker than the AI produced by that same stimulus when it was visible throughout the entire induction period, implying that some component of AI induction is susceptible to interocular suppression. In Experiment 3, AIs of dichoptic, orthogonally oriented gratings were induced in a way ensuring that one of the two gratings was exclusively dominant during the induction period. Dissimilar monocular AIs engaged in rivalry, as expected, but, surprisingly, the AI induced by the suppressed grating initially dominated. We offer two alternative accounts of this counterintuitive finding, both based on differential neural adaptation.     

Willpower and conscious percept: volitional switching in binocular rivalry

When dissimilar images are presented to the left and right eyes, awareness switches spontaneously between the two images, such that one of the images is suppressed from awareness while the other is perceptually dominant. For over 170 years, it has been accepted that even though the periods of dominance are subject to attentional processes, we have no inherent control over perceptual switching. Here, we revisit this issue in response to evidence that top-down attention can target perceptually suppressed 'vision for action' representations in the dorsal stream. We investigated volitional control over rivalry between apparent motion (AM), drifting (DM) and stationary (ST) grating pairs. Observers demonstrated a remarkable ability to generate intentional switches in the AM and D conditions, but not in the ST condition. Corresponding switches in the pursuit direction of optokinetic nystagmus verified this finding objectively. We showed it is unlikely that intentional perceptual switches were triggered by saccadic eye movements, because their frequency was reduced substantially in the volitional condition and did not change around the time of perceptual switches. Hence, we propose that synergy between dorsal and ventral stream representations provides the missing link in establishing volitional control over rivalrous conscious percepts.     

Disrupting parietal function prolongs dominance durations in binocular rivalry

Human brain imaging studies of bistable perceptual phenomena revealed that frontal and parietal areas are activated during perceptual switches between the two conflicting percepts. However, these studies do not provide information about causality, i.e., whether activity reports a consequence or a cause of the perceptual change. Here we used functional magnetic resonance imaging to individually localize four parietal regions involved in perceptual switches during binocular rivalry in 15 subjects and subsequently disturbed their neural processing and that of a control site using 2 Hz repetitive transcranial magnetic stimulation (TMS) during binocular rivalry. We found that TMS over one of the sites, the right intraparietal sulcus (IPS), prolonged the periods of stable percepts. Additionally, the more lateralized the blood oxygen level-dependent signal was in IPS, the more lateralized the TMS effects were. Lateralization varied considerably across subjects, with a right-hemispheric bias. Control replay experiments rule out nonspecific effects of TMS on task performance, reaction times, or eye blinks. Our results thus demonstrate a causal, destabilizing, and individually lateralized effect of normal IPS function on perceptual continuity in rivalry. This is in accord with a role of IPS in perceptual selection, relating its role in rivalrous perception to that in attention.     

Scale-freeness of dominant and piecemeal perceptions during binocular rivalry

When two eyes are simultaneously stimulated by two inconsistent images, the observer’s perception switches between the two images every few seconds such that only one image is perceived at a time. This phenomenon is named binocular rivalry (BR). However, sometimes the perceived image is a piecemeal mixed of two stimuli known as piecemeal perceptions. In this study, a BR task was designed in which orthogonal gratings are presented to the two eyes. The subjects were trained to report 3 states: dominant perceptions (two state matching to perceived grating orientation) and the piecemeal perceptions (third state). We explored the scale-freeness of the BR percept durations considering the two dominant monocular states as well as the piecemeal transition state using detrended fluctuation analysis. Our results reproduced the previous finding of memory in the perceptual switches between the monocular perception states. Moreover, we showed that such memory also exists in the transitory periods of dichoptic piecemeal perceptions. These results support our hypothesis that the pool of unstable piecemeal perceptions could be regarded as separate multiple low-depth basin in the perceptual state landscape. Likewise, the transitions from these piecemeal state basins and stable monocular state basins are faced with resistance. Therefore there is inertia and memory (i.e. positive serial correlation) for the piecemeal dichoptic perception states as well as the monocular states.     

On the role of attention in binocular rivalry: electrophysiological evidence

During binocular rivalry visual consciousness fluctuates between two dissimilar monocular images. We investigated the role of attention in this phenomenon by comparing event-related potentials (ERPs) when binocular-rivalry stimuli were attended with when they were unattended. Stimuli were dichoptic, orthogonal gratings that yielded binocular rivalry and dioptic, identically oriented gratings that yielded binocular fusion. Events were all possible orthogonal changes in orientation of one or both gratings. We had two attention conditions: In the attend-to-grating condition, participants had to report changes in perceived orientation, focussing their attention on the gratings. In the attend-to-fixation condition participants had to report changes in a central fixation target, taking attention away from the gratings. We found, surprisingly, that attending to rival gratings yielded a smaller ERP component (the N1, from 160-210 ms) than attending to the fixation target. To explain this paradoxical effect of attention, we propose that rivalry occurs in the attend-to-fixation condition (we found an ERP signature of rivalry in the form of a sustained negativity from 210-300 ms) but that the mechanism processing the stimulus changes is more adapted in the attend-to-grating condition than in the attend-to-fixation condition. This is consistent with the theory that adaptation gives rise to changes of visual consciousness during binocular rivalry.     

Local factors determine the stabilization of monocular ambiguous and binocular rivalry stimuli

Perceptual alternation in viewing bistable stimuli can be slowed or halted if the stimuli are presented intermittently. Memory of the recent perceptual experience has been proposed to explain this stabilization effect. But the nature of this "perceptual memory" remains unclear. By using a bistable rotating cylinder and two dichoptically presented orthogonal gratings, we explored the features that are important for the stabilization by changing a particular feature of the stimuli between alternate presentations. For the rotating cylinder, changing its color, rotating speed, size, or its stereo depth had no or minimal effect on the stabilization of its perceived rotation direction. For binocular rivalry, when the two gratings were matched in strength and then swapped between the two eyes synchronously with the intermittent presentation, the percepts were usually stabilized to one eye. In both cases, perceptual stabilization occurred only if the stimuli were presented to the same retinal location. These results suggest that the stabilization of monocular bistable stimuli is likely due to the removal of local adaptation, insensitive to the features that define the object identity. For binocular rivalry, preservation of the direction of interocular suppression rather than memory of the stimulus identity accounts for the stabilization effect.     

Evidence for surface-based processing of binocular disparity

It is convenient to think of an object's location as a point within a Cartesian framework; the x axis corresponds to right and left, the y axis to up and down, and the z axis to forward or backward. When an observer is looking straight ahead, binocular disparities provide information about distance along the z axis from the fixation plane. In this coordinate system, changes in disparity are treated as independent of changes in location along the orthogonal x and y axes. Does the human visual system use this three-dimensional coordinate system, or does it specify feature location in a coordinate frame determined by other nearby visible features? Here we show that the sensitivity of the human stereo system is determined by the distance of points with respect to a local reference plane, rather than by the distance along the z axis with respect to the fixation plane. There is a distinct advantage to using a local frame of reference for specifying location. It obviates the need to construct a complex three-dimensional space in either eye-centered or head-centered coordinates that must be updated with every shift of the eyes and head.     

Neurontropy,an entropy-like measure of neural correlation,in binocular fusion and rivalry

Dynamic random dot stereograms were generated for which the left and right arrays were either identical (100% correlation), or uncorrelated (0% correlation), or the complements of each other (-100% correlation). Any two of these three states of correlation were presented in succession and duration thresholds for detecting the transitions were measured. These thresholds were much longer when the transition went from the uncorrelated state to the correlated state than vice versa. In order to explain the detection thresholds for the various transitions a model based on the notion of an entropy-like measure (to be called neurontropy) has been proposed. It was assumed that in binocular vision both a fusional and a rivalry process operate simultaneously, but in a dual fashion. Thus the correlated state would be regarded the same way by the fusional process as the complemented state by the rivalry process. Transitions from the uncorrelated to the complemented state (and vice versa) were the most difficult to detect, a task which only the rivalry process could accomplish. The long detection thresholds indicate that the rivalry process is less efficient than the fusional process.Address Fill Oct. 1, 1976: Prof. Dr. B. Julesz