The interaction between binocular rivalry and negative afterimages

Afterimage formation, historically attributed to retinal mechanisms, may also involve postretinal process. Consistent with this notion are results from experiments, reported here, investigating the interaction between binocular rivalry and negative afterimages (AIs). In Experiment 1, one eye was exposed to a grating never consciously experienced by the observer because this grating remained suppressed in rivalry throughout induction (the exclusively dominant stimulus was designed to preclude formation of an AI). As expected, the suppressed grating generated a vivid AI whose orientation could be accurately identified; not surprisingly, the strength of this AI varied with induction contrast. Experiment 2 revealed, however, that the strength of this AI produced during suppression was significantly weaker than the AI produced by that same stimulus when it was visible throughout the entire induction period, implying that some component of AI induction is susceptible to interocular suppression. In Experiment 3, AIs of dichoptic, orthogonally oriented gratings were induced in a way ensuring that one of the two gratings was exclusively dominant during the induction period. Dissimilar monocular AIs engaged in rivalry, as expected, but, surprisingly, the AI induced by the suppressed grating initially dominated. We offer two alternative accounts of this counterintuitive finding, both based on differential neural adaptation.     

Colour contrast influences perceived shape in combined shading and texture patterns

The 'colour-shading effect' describes the phenomenon whereby a chromatic pattern influences perceived shape-from-shading in a luminance pattern. Specifically, the depth corrugations perceived in sinusoidal luminance gratings can be enhanced by spatially non-aligned, and suppressed by spatially aligned sinusoidal chromatic gratings. Here we examine whether colour contrast can influence perceived shape in patterns that combine shape-from-shading with shape-from-texture. Stimuli consisted of sinusoidal modulations of texture (defined by orientation), luminance and colour. When the texture and luminance modulations were suitably combined, one obtained a vivid impression of a corrugated depth surface. The addition of a colour grating to the texture-luminance combination was found to enhance the impression of depth when out-of-phase with the luminance modulation, and suppress the impression of depth when in-phase with the luminance modulation. The degree of depth enhancement and depth suppression was approximately constant across texture amplitude when measured linearly. In the absence of the luminance grating however, the colour grating had no phase-dependent affect on perceived depth. These results show that colour contrast modulates the contribution of shading to perceived shape in combined shading and texture patterns.     

The spatial origin of a perceptual transition in binocular rivalry

When the left and the right eye are simultaneously presented with incompatible images at overlapping retinal locations, an observer typically reports perceiving only one of the two images at a time. This phenomenon is called binocular rivalry. Perception during binocular rivalry is not stable; one of the images is perceptually dominant for a certain duration (typically in the order of a few seconds) after which perception switches towards the other image. This alternation between perceptual dominance and suppression will continue for as long the images are presented. A characteristic of binocular rivalry is that a perceptual transition from one image to the other generally occurs in a gradual manner: the image that was temporarily suppressed will regain perceptual dominance at isolated locations within the perceived image, after which its visibility spreads throughout the whole image. These gradual transitions from perceptual suppression to perceptual dominance have been labeled as traveling waves of perceptual dominance. In this study we investigate whether stimulus parameters affect the location at which a traveling wave starts. We varied the contrast, spatial frequency or motion speed in one of the rivaling images, while keeping the same parameter constant in the other image. We used a flash-suppression paradigm to force one of the rival images into perceptual suppression. Observers waited until the suppressed image became perceptually dominant again, and indicated the position at which this breakthrough from suppression occurred. Our results show that the starting point of a traveling wave during binocular rivalry is highly dependent on local stimulus parameters. More specifically, a traveling wave most likely started at the location where the contrast of the suppressed image was higher than that of the dominant one, the spatial frequency of the suppressed image was lower than that of the dominant one, and the motion speed of the suppressed image was higher than that of the dominant one. We suggest that a breakthrough from suppression to dominance occurs at the location where salience (the degree to which a stimulus element stands out relative to neighboring elements) of the suppressed image is higher than that of the dominant one. Our results further show that stimulus parameters affecting the temporal dynamics during continuous viewing of rival images described in other studies, also affect the spatial origin of traveling waves during binocular rivalry.     

Perceptual grouping of biological motion promotes binocular rivalry

Investigation of perceptual rivalry between conflicting stimuli presented one to each eye can further understanding of the neural underpinnings of conscious visual perception. During rivalry, visual awareness fluctuates between perceptions of the two stimuli. Here, we demonstrate that high-level perceptual grouping can promote rivalry between stimulus pairs that would otherwise be perceived as nonrivalrous. Perceptual grouping was generated with point-light walker stimuli that simulate human motion, visible only as lights placed on the joints. Although such walking figures are unrecognizable when stationary, recognition judgments as complex as gender and identity can accurately be made from animated displays, demonstrating the efficiency with which our visual system can group dynamic local signals into a globally coherent walking figure. We find that point-light walker stimuli presented one to each eye and in different colors and configurations results in strong rivalry. However, rivalry is minimal when the two walkers are split between the eyes or both presented to one eye. This pattern of results suggests that processing animated walker figures promotes rivalry between signals from the two eyes rather than between higher-level representations of the walkers. This leads us to hypothesize that awareness during binocular rivalry involves the integrated activity of high-level perceptual mechanisms in conjunction with lower-level ocular suppression modulated via cortical feedback.     

A Model of Binocular Rivalry and Cross-orientation Suppression

Binocular rivalry and cross-orientation suppression are well-studied forms of competition in visual cortex, but models of these two types of competition are in tension with one another. Binocular rivalry occurs during the presentation of dichoptic grating stimuli, where two orthogonal gratings presented separately to the two eyes evoke strong alternations in perceptual dominance. Cross-orientation suppression occurs during the presentation of plaid stimuli, where the responses to a component grating presented to both eyes is weakened by the presence of a superimposed orthogonal grating. Conventional models of rivalry that rely on strong competition between orientation-selective neurons incorrectly predict rivalry between the components of plaids. Lowering the inhibitory weights in such models reduces rivalry for plaids, but also reduces it for dichoptic gratings. Using an exhaustive grid search, we show that this problem cannot be solved simply by adjusting the parameters of the model. Instead, we propose a robust class of models that rely on ocular opponency neurons, previously proposed as a mechanism for efficient stereo coding, to yield rivalry only for dichoptic gratings, not for plaids. This class of models reconciles models of binocular rivalry with the divisive normalization framework that has been used to explain cross-orientation. Our model makes novel predictions that we confirmed with psychophysical tests.     

Interactions between surround suppression and interocular suppression in human vision

Several types of suppression phenomena have been observed in the visual system. For example, the ability to detect a target stimulus is often impaired when the target is embedded in a high-contrast surround. This contextual modulation, known as surround suppression, was formerly thought to occur only in the periphery. Another type of suppression phenomena is interocular suppression, in which the sensitivity to a monocular target is reduced by a superimposed mask in the opposite eye. Here, we explored how the two types of suppression operating across different spatial regions interact with one another when they simultaneously exert suppressive influences on a common target presented at the fovea. In our experiments, a circular target grating presented to the fovea of one eye was suppressed interocularly by a noise pattern of the same size in the other eye. The foveal stimuli were either shown alone or surrounded by a monocular annular grating. The orientation and eye-of-origin of the surround grating were varied. We found that the detection of the foveal target subjected to interocular suppression was severely impaired by the addition of the surround grating, indicating strong surround suppression in the fovea. In contrast, when the interocular suppression was released by superimposing a binocular fusion ring onto both the target and the dichoptic mask, the surround suppression effect was found to be dramatically decreased. In addition, the surround suppression was found to depend on the contrast of the dichoptic noise with the greatest surround suppression effect being obtained only when the noise contrast was at an intermediate level. These findings indicate that surround suppression and interocular suppression are not independent of each other, but there are strong interactions between them. Moreover, our results suggest that strong surround suppression may also occur at the fovea and not just the periphery.     

Touch Interacts with Vision during Binocular Rivalry with a Tight Orientation Tuning

Multisensory integration is a common feature of the mammalian brain that allows it to deal more efficiently with the ambiguity of sensory input by combining complementary signals from several sensory sources. Growing evidence suggests that multisensory interactions can occur as early as primary sensory cortices. Here we present incompatible visual signals (orthogonal gratings) to each eye to create visual competition between monocular inputs in primary visual cortex where binocular combination would normally take place. The incompatibility prevents binocular fusion and triggers an ambiguous perceptual response in which the two images are perceived one at a time in an irregular alternation. One key function of multisensory integration is to minimize perceptual ambiguity by exploiting cross-sensory congruence. We show that a haptic signal matching one of the visual alternatives helps disambiguate visual perception during binocular rivalry by both prolonging the dominance period of the congruent visual stimulus and by shortening its suppression period. Importantly, this interaction is strictly tuned for orientation, with a mismatch as small as 7.5° between visual and haptic orientations sufficient to annul the interaction. These results indicate important conclusions: first, that vision and touch interact at early levels of visual processing where interocular conflicts are first detected and orientation tunings are narrow, and second, that haptic input can influence visual signals outside of visual awareness, bringing a stimulus made invisible by binocular rivalry suppression back to awareness sooner than would occur without congruent haptic input.     

Touch Influences Visual Perception with a Tight Orientation-Tuning

Stimuli from different sensory modalities are thought to be processed initially in distinct unisensory brain areas prior to convergence in multisensory areas. However, signals in one modality can influence the processing of signals from other modalities and recent studies suggest this cross-modal influence may occur early on, even in ‘unisensory’ areas. Some recent psychophysical studies have shown specific cross-modal effects between touch and vision during binocular rivalry, but these cannot completely rule out a response bias. To test for genuine cross-modal integration of haptic and visual signals, we investigated whether congruent haptic input could influence visual contrast sensitivity compared to incongruent haptic input in three psychophysical experiments using a two-interval, two-alternative forced-choice method to eliminate response bias. The initial experiment demonstrated that contrast thresholds for a visual grating were lower when exploring a haptic grating that shared the same orientation compared to an orthogonal orientation. Two subsequent experiments mapped the orientation and spatial frequency tunings for the congruent haptic facilitation of vision, finding a clear orientation tuning effect but not a spatial frequency tuning. In addition to an increased contrast sensitivity for iso-oriented visual-haptic gratings, we found a significant loss of sensitivity for orthogonally oriented visual-haptic gratings. We conclude that the tactile influence on vision is a result of a tactile input to orientation-tuned visual areas.     

Evidence for perceptual "trapping" and adaptation in multistable binocular rivalry

When a different pattern is presented to each eye, the perceived image spontaneously alternates between the two patterns (binocular rivalry); the dynamics of these bistable alternations are known to be stochastic. Examining multistable binocular rivalry (involving four dominant percepts), we demonstrated path dependence and on-line adaptation, which were equivalent whether perceived patterns were formed by single-eye dominance or by mixed-eye dominance. The spontaneous perceptual transitions tended to get trapped within a pair of related global patterns (e.g., opponent shapes and symmetric patterns), and during such trapping, the probability of returning to the repeatedly experienced patterns gradually decreased (postselection pattern adaptation). These results suggest that the structure of global shape coding and its adaptation play a critical role in directing spontaneous alternations of visual awareness in perceptual multistability.     

Contextual modulation outside of awareness

Contextual effects are ubiquitous in vision and reveal fundamental principles of sensory coding. Here, we demonstrate that an oriented surround grating can affect the perceived orientation of a central test grating even when backward masking of the surround prevents its orientation from being consciously perceived. The effect survives introduction of a gap between test and surround of over a degree even under masking, suggesting either that contextual information can effectively propagate across early visual cortex in the absence of awareness of the signaled context or that it can proceed undetected to higher processing levels at which such horizontal propagation may not be necessary. The effect under masking also shows partial interocular transfer, demonstrating processing of orientation by binocular neurons in visual cortex in the absence of conscious orientation perception. This pattern of results is consistent with the suggestion that simultaneous orientation contrast is mediated at multiple levels of the visual processing hierarchy, and it supports the view that propagation of signals to and, possibly, back from higher visual areas is necessary for conscious perception.     

Bistable percepts in the brain: FMRI contrasts monocular pattern rivalry and binocular rivalry

The neural correlates of binocular rivalry have been actively debated in recent years, and are of considerable interest as they may shed light on mechanisms of conscious awareness. In a related phenomenon, monocular rivalry, a composite image is shown to both eyes. The subject experiences perceptual alternations in which the two stimulus components alternate in clarity or salience. The experience is similar to perceptual alternations in binocular rivalry, although the reduction in visibility of the suppressed component is greater for binocular rivalry, especially at higher stimulus contrasts. We used fMRI at 3T to image activity in visual cortex while subjects perceived either monocular or binocular rivalry, or a matched non-rivalrous control condition. The stimulus patterns were left/right oblique gratings with the luminance contrast set at 9%, 18% or 36%. Compared to a blank screen, both binocular and monocular rivalry showed a U-shaped function of activation as a function of stimulus contrast, i.e. higher activity for most areas at 9% and 36%. The sites of cortical activation for monocular rivalry included occipital pole (V1, V2, V3), ventral temporal, and superior parietal cortex. The additional areas for binocular rivalry included lateral occipital regions, as well as inferior parietal cortex close to the temporoparietal junction (TPJ). In particular, higher-tier areas MT+ and V3A were more active for binocular than monocular rivalry for all contrasts. In comparison, activation in V2 and V3 was reduced for binocular compared to monocular rivalry at the higher contrasts that evoked stronger binocular perceptual suppression, indicating that the effects of suppression are not limited to interocular suppression in V1.     

On the role of attention in binocular rivalry: electrophysiological evidence

During binocular rivalry visual consciousness fluctuates between two dissimilar monocular images. We investigated the role of attention in this phenomenon by comparing event-related potentials (ERPs) when binocular-rivalry stimuli were attended with when they were unattended. Stimuli were dichoptic, orthogonal gratings that yielded binocular rivalry and dioptic, identically oriented gratings that yielded binocular fusion. Events were all possible orthogonal changes in orientation of one or both gratings. We had two attention conditions: In the attend-to-grating condition, participants had to report changes in perceived orientation, focussing their attention on the gratings. In the attend-to-fixation condition participants had to report changes in a central fixation target, taking attention away from the gratings. We found, surprisingly, that attending to rival gratings yielded a smaller ERP component (the N1, from 160-210 ms) than attending to the fixation target. To explain this paradoxical effect of attention, we propose that rivalry occurs in the attend-to-fixation condition (we found an ERP signature of rivalry in the form of a sustained negativity from 210-300 ms) but that the mechanism processing the stimulus changes is more adapted in the attend-to-grating condition than in the attend-to-fixation condition. This is consistent with the theory that adaptation gives rise to changes of visual consciousness during binocular rivalry.     

United we sense, divided we fail: context-driven perception of ambiguous visual stimuli

Ambiguous visual stimuli provide the brain with sensory information that contains conflicting evidence for multiple mutually exclusive interpretations. Two distinct aspects of the phenomenological experience associated with viewing ambiguous visual stimuli are the apparent stability of perception whenever one perceptual interpretation is dominant, and the instability of perception that causes perceptual dominance to alternate between perceptual interpretations upon extended viewing. This review summarizes several ways in which contextual information can help the brain resolve visual ambiguities and construct temporarily stable perceptual experiences. Temporal context through prior stimulation or internal brain states brought about by feedback from higher cortical processing levels may alter the response characteristics of specific neurons involved in rivalry resolution. Furthermore, spatial or crossmodal context may strengthen the neuronal representation of one of the possible perceptual interpretations and consequently bias the rivalry process towards it. We suggest that contextual influences on perceptual choices with ambiguous visual stimuli can be highly informative about the neuronal mechanisms of context-driven inference in the general processes of perceptual decision-making.     

Visible binocular beats from invisible monocular stimuli during binocular rivalry

When two qualitatively different stimuli are presented at the same time, one to each eye, the stimuli can either integrate or compete with each other. When they compete, one of the two stimuli is alternately suppressed, a phenomenon called binocular rivalry [1,2]. When they integrate, observers see some form of the combined stimuli. Many different properties (for example, shape or color) of the two stimuli can induce binocular rivalry. Not all differences result in rivalry, however. Visual 'beats', for example, are the result of integration of high-frequency flicker between the two eyes [3,4], and are thus a binocular fusion phenomenon. It remains in dispute whether binocular fusion and rivalry can co-exist with one another [5-7]. Here, we report that rivalry and beats, two apparently opposing phenomena, can be perceived at the same time within the same spatial location. We hypothesized that the interocular difference in visual attributes that are predominantly processed in the Parvocellular pathway will lead to rivalry, and differences in visual attributes that are predominantly processed in the Magnocellular pathway tend to integrate. Further predictions based on this hypothesis were tested and confirmed.     

A fresh look at the temporal dynamics of binocular rivalry

Human observers viewed dichoptic orthogonal sine-wave gratings and indicated when exclusive visibility occurred in either eye. Contrast was held constant in one eye and was increased or decreased in the other eye for a number of alternation cycles (continuous presentation) or for only the duration of a single period of exclusive visibility (synchronous presentation). The synchronous presentation condition allowed us to identify the differing effects of contrast during the suppressed and during the dominant periods. Mixed phases were recorded as distinct from suppressed and dominant phases, and new classifications of compound-dominant and compound-suppressed phases are defined. The results indicate that binocular rivalry responds to stimulus contrast in two ways. 1) The duty-cycle of dominance and suppression is determined by the relative image contrast between the two eyes, with dominance of the higher contrast image being favored, and 2) the overall rate of alternation is driven by monocular image contrast during the suppressed phase (increased monocular contrast increases the alternation rate) and to a lesser extent by monocular contrast during the dominant phase (increased monocular contrast decreases the rate). A model is developed to reflect these ideas. These results support a reciprocal inhibition oscillator as the underlying mechanism of binocular rivalry.     

Scale-freeness of dominant and piecemeal perceptions during binocular rivalry

When two eyes are simultaneously stimulated by two inconsistent images, the observer’s perception switches between the two images every few seconds such that only one image is perceived at a time. This phenomenon is named binocular rivalry (BR). However, sometimes the perceived image is a piecemeal mixed of two stimuli known as piecemeal perceptions. In this study, a BR task was designed in which orthogonal gratings are presented to the two eyes. The subjects were trained to report 3 states: dominant perceptions (two state matching to perceived grating orientation) and the piecemeal perceptions (third state). We explored the scale-freeness of the BR percept durations considering the two dominant monocular states as well as the piecemeal transition state using detrended fluctuation analysis. Our results reproduced the previous finding of memory in the perceptual switches between the monocular perception states. Moreover, we showed that such memory also exists in the transitory periods of dichoptic piecemeal perceptions. These results support our hypothesis that the pool of unstable piecemeal perceptions could be regarded as separate multiple low-depth basin in the perceptual state landscape. Likewise, the transitions from these piecemeal state basins and stable monocular state basins are faced with resistance. Therefore there is inertia and memory (i.e. positive serial correlation) for the piecemeal dichoptic perception states as well as the monocular states.     

How to Create and Use Binocular Rivalry

Each of our eyes normally sees a slightly different image of the world around us. The brain can combine these two images into a single coherent representation. However, when the eyes are presented with images that are sufficiently different from each other, an interesting thing happens: Rather than fusing the two images into a combined conscious percept, what transpires is a pattern of perceptual alternations where one image dominates awareness while the other is suppressed; dominance alternates between the two images, typically every few seconds. This perceptual phenomenon is known as binocular rivalry. Binocular rivalry is considered useful for studying perceptual selection and awareness in both human and animal models, because unchanging visual input to each eye leads to alternations in visual awareness and perception. To create a binocular rivalry stimulus, all that is necessary is to present each eye with a different image at the same perceived location. There are several ways of doing this, but newcomers to the field are often unsure which method would best suit their specific needs. The purpose of this article is to describe a number of inexpensive and straightforward ways to create and use binocular rivalry. We detail methods that do not require expensive specialized equipment and describe each method''s advantages and disadvantages. The methods described include the use of red-blue goggles, mirror stereoscopes and prism goggles.     

Binocular onset rivalry at the time of saccades and stimulus jumps

Recent studies suggest that binocular rivalry at stimulus onset, so called onset rivalry, differs from rivalry during sustained viewing. These observations raise the interesting question whether there is a relation between onset rivalry and rivalry in the presence of eye movements. We therefore studied binocular rivalry when stimuli jumped from one visual hemifield to the other, either through a saccade or through a passive stimulus displacement, and we compared rivalry after such displacements with onset and sustained rivalry. We presented opponent motion, orthogonal gratings and face/house stimuli through a stereoscope. For all three stimulus types we found that subjects showed a strong preference for stimuli in one eye or one hemifield (Experiment 1), and that these subject-specific biases did not persist during sustained viewing (Experiment 2). These results confirm and extend previous findings obtained with gratings. The results from the main experiment (Experiment 3) showed that after a passive stimulus jump, switching probability was low when the preferred eye was dominant before a stimulus jump, but when the non-preferred eye was dominant beforehand, switching probability was comparatively high. The results thus showed that dominance after a stimulus jump was tightly related to eye dominance at stimulus onset. In the saccade condition, however, these subject-specific biases were systematically reduced, indicating that the influence of saccades can be understood from a systematic attenuation of the subjects' onset rivalry biases. Taken together, our findings demonstrate a relation between onset rivalry and rivalry after retinal shifts and involvement of extra-retinal signals in binocular rivalry.     

Ensemble cortical responses to rival visual stimuli: Effect of monocular transient

Binocular rivalry is a fascinating perceptual phenomenon that has been characterized extensively at the psychophysical level. However, the underlying neural mechanism remains poorly understood. In particular, the role of the early visual pathway remains controversial. In this study, we used voltage-sensitive dye imaging to measure the spatiotemporal activity patterns in cat area 18 evoked by dichoptic orthogonal grating stimuli. We found that after several seconds of monocular stimulation with an oriented grating, an orthogonal stimulus to the other eye evoked a reversal of the cortical response pattern, which may contribute to flash suppression in perception. Furthermore, after several seconds of rival binocular stimulation with unequal contrasts, transient increase in the contrast of the weak stimulus evoked a long-lasting cortical response. This transient-triggered response could contribute to the perceptual switch during binocular rivalry. Together, these results point to a significant contribution of early visual cortex to transient-triggered switch in perceptual dominance.