The role of temporally coarse form processing during binocular rivalry

Presenting the eyes with spatially mismatched images causes a phenomenon known as binocular rivalry-a fluctuation of awareness whereby each eye's image alternately determines perception. Binocular rivalry is used to study interocular conflict resolution and the formation of conscious awareness from retinal images. Although the spatial determinants of rivalry have been well-characterized, the temporal determinants are still largely unstudied. We confirm a previous observation that conflicting images do not need to be presented continuously or simultaneously to elicit binocular rivalry. This process has a temporal limit of about 350 ms, which is an order of magnitude larger than the visual system's temporal resolution. We characterize this temporal limit of binocular rivalry by showing that it is independent of low-level information such as interocular timing differences, contrast-reversals, stimulus energy, and eye-of-origin information. This suggests the temporal factors maintaining rivalry relate more to higher-level form information, than to low-level visual information. Systematically comparing the role of form and motion-the processing of which may be assigned to ventral and dorsal visual pathways, respectively-reveals that this temporal limit is determined by form conflict rather than motion conflict. Together, our findings demonstrate that binocular conflict resolution depends on temporally coarse form-based processing, possibly originating in the ventral visual pathway.     

Dichoptic plaids may rival, but their motions can integrate

When the eyes view incompatible images, binocular rivalry usually results: image constituents in corresponding parts of the monocular visual fields are not perceived simultaneously. We asked naive undergraduates to view dichoptic, dioptic, and monoptic plaids. The dichoptic images evoked strong binocular rivalry when contrast was high, especially if the component gratings were set in motion. Nevertheless, the subjects' visual systems integrated the motion information across the two eyes, producing a unitary motion percept that did not reflect the image in either eye alone. By manipulating the relative spatial scale of the gratings, we affected how well the motion cohered: the results were remarkably similar between dichoptic and traditional dioptic plaids. By manipulating the relative speed of the gratings, we systematically affected the perceived direction of motion of the plaids; these results were also remarkably similar for dichoptic and dioptic plaids. Thus, the motion analysis of dichoptic and dioptic plaids is proceeding according to very similar rules, even though the dichoptic images are incompatible and evoke binocular rivalry.     

Single units and conscious vision.

Figures that can be seen in more than one way are invaluable tools for the study of the neural basis of visual awareness, because such stimuli permit the dissociation of the neural responses that underlie what we perceive at any given time from those forming the sensory representation of a visual pattern. To study the former type of responses, monkeys were subjected to binocular rivalry, and the response of neurons in a number of different visual areas was studied while the animals reported their alternating percepts by pulling levers. Perception-related modulations of neural activity were found to occur to different extents in different cortical visual areas. The cells that were affected by suppression were almost exclusively binocular, and their proportion was found to increase in the higher processing stages of the visual system. The strongest correlations between neural activity and perception were observed in the visual areas of the temporal lobe. A strikingly large number of neurons in the early visual areas remained active during the perceptual suppression of the stimulus, a finding suggesting that conscious visual perception might be mediated by only a subset of the cells exhibiting stimulus selective responses. These physiological findings, together with a number of recent psychophysical studies, offer a new explanation of the phenomenon of binocular rivalry. Indeed, rivalry has long been considered to be closely linked with binocular fusion and stereopsis, and the sequences of dominance and suppression have been viewed as the result of competition between the two monocular channels. The physiological data presented here are incompatible with this interpretation. Rather than reflecting interocular competition, the rivalry is most probably between the two different central neural representations generated by the dichoptically presented stimuli. The mechanisms of rivalry are probably the same as, or very similar to, those underlying multistable perception in general, and further physiological studies might reveal much about the neural mechanisms of our perceptual organization.     

Normalization regulates competition for visual awareness

Signals in our brain are in a constant state of competition, including those that vie for motor control, sensory dominance, and awareness. To shed light on the mechanisms underlying neural competition, we exploit binocular rivalry, a phenomenon that allows us to probe the competitive process that ordinarily transpires outside of our awareness. By measuring psychometric functions under different states of rivalry, we discovered a pattern of gain changes that are consistent with a model of competition in which attention interacts with normalization processes, thereby driving the ebb and flow between states of awareness. Moreover, we reveal that attention plays a crucial role in modulating competition; without attention, rivalry suppression for high-contrast stimuli is negligible. We propose a framework whereby our visual awareness of competing sensory representations is governed by a common neural computation: normalization.     

On the role of attention in binocular rivalry: electrophysiological evidence

During binocular rivalry visual consciousness fluctuates between two dissimilar monocular images. We investigated the role of attention in this phenomenon by comparing event-related potentials (ERPs) when binocular-rivalry stimuli were attended with when they were unattended. Stimuli were dichoptic, orthogonal gratings that yielded binocular rivalry and dioptic, identically oriented gratings that yielded binocular fusion. Events were all possible orthogonal changes in orientation of one or both gratings. We had two attention conditions: In the attend-to-grating condition, participants had to report changes in perceived orientation, focussing their attention on the gratings. In the attend-to-fixation condition participants had to report changes in a central fixation target, taking attention away from the gratings. We found, surprisingly, that attending to rival gratings yielded a smaller ERP component (the N1, from 160-210 ms) than attending to the fixation target. To explain this paradoxical effect of attention, we propose that rivalry occurs in the attend-to-fixation condition (we found an ERP signature of rivalry in the form of a sustained negativity from 210-300 ms) but that the mechanism processing the stimulus changes is more adapted in the attend-to-grating condition than in the attend-to-fixation condition. This is consistent with the theory that adaptation gives rise to changes of visual consciousness during binocular rivalry.     

A Model of Binocular Rivalry and Cross-orientation Suppression

Binocular rivalry and cross-orientation suppression are well-studied forms of competition in visual cortex, but models of these two types of competition are in tension with one another. Binocular rivalry occurs during the presentation of dichoptic grating stimuli, where two orthogonal gratings presented separately to the two eyes evoke strong alternations in perceptual dominance. Cross-orientation suppression occurs during the presentation of plaid stimuli, where the responses to a component grating presented to both eyes is weakened by the presence of a superimposed orthogonal grating. Conventional models of rivalry that rely on strong competition between orientation-selective neurons incorrectly predict rivalry between the components of plaids. Lowering the inhibitory weights in such models reduces rivalry for plaids, but also reduces it for dichoptic gratings. Using an exhaustive grid search, we show that this problem cannot be solved simply by adjusting the parameters of the model. Instead, we propose a robust class of models that rely on ocular opponency neurons, previously proposed as a mechanism for efficient stereo coding, to yield rivalry only for dichoptic gratings, not for plaids. This class of models reconciles models of binocular rivalry with the divisive normalization framework that has been used to explain cross-orientation. Our model makes novel predictions that we confirmed with psychophysical tests.     

Independent binocular rivalry processes for motion and form

During binocular rivalry, conflicting monocular images undergo alternating suppression. This study explores rivalry suppression by probing visual sensitivity during rivalry with various probe stimuli. When two faces engage in rivalry, sensitivity to face probes is reduced 4-fold during suppression. Rivaling global motions also rivaled very deeply when probed with a global motion. However, in a surprising finding, sensitivity to face probes is completely unimpaired during global motion rivalry, and motion sensitivity is unimpaired during face rivalry. This suggests that rivalry suppression is localized to the neurons representing the image conflict, which means that probes of a different kind suffer no suppression. Sensibly, this would leave visual processes not involved in rivalry free to function normally.     

Perceptual grouping of biological motion promotes binocular rivalry

Investigation of perceptual rivalry between conflicting stimuli presented one to each eye can further understanding of the neural underpinnings of conscious visual perception. During rivalry, visual awareness fluctuates between perceptions of the two stimuli. Here, we demonstrate that high-level perceptual grouping can promote rivalry between stimulus pairs that would otherwise be perceived as nonrivalrous. Perceptual grouping was generated with point-light walker stimuli that simulate human motion, visible only as lights placed on the joints. Although such walking figures are unrecognizable when stationary, recognition judgments as complex as gender and identity can accurately be made from animated displays, demonstrating the efficiency with which our visual system can group dynamic local signals into a globally coherent walking figure. We find that point-light walker stimuli presented one to each eye and in different colors and configurations results in strong rivalry. However, rivalry is minimal when the two walkers are split between the eyes or both presented to one eye. This pattern of results suggests that processing animated walker figures promotes rivalry between signals from the two eyes rather than between higher-level representations of the walkers. This leads us to hypothesize that awareness during binocular rivalry involves the integrated activity of high-level perceptual mechanisms in conjunction with lower-level ocular suppression modulated via cortical feedback.     

Touch Interacts with Vision during Binocular Rivalry with a Tight Orientation Tuning

Multisensory integration is a common feature of the mammalian brain that allows it to deal more efficiently with the ambiguity of sensory input by combining complementary signals from several sensory sources. Growing evidence suggests that multisensory interactions can occur as early as primary sensory cortices. Here we present incompatible visual signals (orthogonal gratings) to each eye to create visual competition between monocular inputs in primary visual cortex where binocular combination would normally take place. The incompatibility prevents binocular fusion and triggers an ambiguous perceptual response in which the two images are perceived one at a time in an irregular alternation. One key function of multisensory integration is to minimize perceptual ambiguity by exploiting cross-sensory congruence. We show that a haptic signal matching one of the visual alternatives helps disambiguate visual perception during binocular rivalry by both prolonging the dominance period of the congruent visual stimulus and by shortening its suppression period. Importantly, this interaction is strictly tuned for orientation, with a mismatch as small as 7.5° between visual and haptic orientations sufficient to annul the interaction. These results indicate important conclusions: first, that vision and touch interact at early levels of visual processing where interocular conflicts are first detected and orientation tunings are narrow, and second, that haptic input can influence visual signals outside of visual awareness, bringing a stimulus made invisible by binocular rivalry suppression back to awareness sooner than would occur without congruent haptic input.     

General validity of Levelt's propositions reveals common computational mechanisms for visual rivalry

The mechanisms underlying conscious visual perception are often studied with either binocular rivalry or perceptual rivalry stimuli. Despite existing research into both types of rivalry, it remains unclear to what extent their underlying mechanisms involve common computational rules. Computational models of binocular rivalry mechanisms are generally tested against Levelt's four propositions, describing the psychophysical relation between stimulus strength and alternation dynamics in binocular rivalry. Here we use a bistable rotating structure-from-motion sphere, a generally studied form of perceptual rivalry, to demonstrate that Levelt's propositions also apply to the alternation dynamics of perceptual rivalry. Importantly, these findings suggest that bistability in structure-from-motion results from active cross-inhibition between neural populations with computational principles similar to those present in binocular rivalry. Thus, although the neural input to the computational mechanism of rivalry may stem from different cortical neurons and different cognitive levels the computational principles just prior to the production of visual awareness appear to be common to the two types of rivalry.     

Attention driven phantom vision: measuring the sensory strength of attentional templates and their relation to visual mental imagery and aphantasia

When we search for an object in an array or anticipate attending to a future object, we create an ‘attentional template'' of the object. The definitions of attentional templates and visual imagery share many similarities as well as many of the same neural characteristics. However, the phenomenology of these attentional templates and their neural similarities to visual imagery and perception are rarely, if ever discussed. Here, we investigate the relationship between these two forms of non-retinal phantom vision through the use of the binocular rivalry technique, which allows us to measure the sensory strength of attentional templates in the absence of concurrent perceptual stimuli. We find that attentional templates correlate with both feature-based attention and visual imagery. Attentional templates, like imagery, were significantly disrupted by the presence of irrelevant visual stimuli, while feature-based attention was not. We also found that a special population who lack the ability to visualize (aphantasia), showed evidence of feature-based attention when measured using the binocular rivalry paradigm, but not attentional templates. Taken together, these data suggest functional similarities between attentional templates and visual imagery, advancing the theory of visual imagery as a general simulation tool used across cognition.This article is part of the theme issue ‘Offline perception: voluntary and spontaneous perceptual experiences without matching external stimulation’.     

Interhemispheric switching mediates perceptual rivalry

BACKGROUND: Binocular rivalry refers to the alternating perceptual states that occur when the images seen by the two eyes are too different to be fused into a single percept. Logothetis and colleagues have challenged suggestions that this phenomenon occurs early in the visual pathway. They have shown that, in alert monkeys, neurons in the primary visual cortex continue to respond to their preferred stimulus despite the monkey reporting its absence. Moreover, they found that neural activity higher in the visual pathway is highly correlated with the monkey's reported percept. These and other findings suggest that the neural substrate of binocular rivalry must involve high levels, perhaps the same levels involved in reversible figure alternations. RESULTS: We present evidence that activation or disruption of a single hemisphere in human subjects affects the perceptual alternations of binocular rivalry. Unilateral caloric vestibular stimulation changed the ratio of time spent in each competing perceptual state. Transcranial magnetic stimulation applied to one hemisphere disrupted normal perceptual alternations when the stimulation was timed to occur at one phase of the perceptual switch, but not at the other. Furthermore, activation of a single hemisphere by caloric stimulation affected the perceptual alternations of a reversible figure, the Necker cube. CONCLUSIONS: Our findings suggest that interhemispheric switching mediates perceptual rivalry. Thus, competition for awareness in both binocular rivalry and reversible figures occurs between, rather than within, each hemisphere. This interhemispheric switch hypothesis has implications for understanding the neural mechanisms of conscious experience and also has clinical relevance as the rate of both types of perceptual rivalry is slow in bipolar disorder (manic depression).     

Perceptual rivalry between illusory and real contours

The interactions between illusory and real contours have been investigated under monocular, binocular and dichoptic conditions. Results show that under all three presentation conditions, periodic alternations, generally called rivalry, occur during the perception of cognitive (or illusory) triangles, while earlier research had failed to find such rivalry (Bradley and Dumais 1975). With line triangles, rivalry is experienced only under dichoptic conditions. A model is proposed to account for the observed phenomena.     

Ensemble cortical responses to rival visual stimuli: Effect of monocular transient

Binocular rivalry is a fascinating perceptual phenomenon that has been characterized extensively at the psychophysical level. However, the underlying neural mechanism remains poorly understood. In particular, the role of the early visual pathway remains controversial. In this study, we used voltage-sensitive dye imaging to measure the spatiotemporal activity patterns in cat area 18 evoked by dichoptic orthogonal grating stimuli. We found that after several seconds of monocular stimulation with an oriented grating, an orthogonal stimulus to the other eye evoked a reversal of the cortical response pattern, which may contribute to flash suppression in perception. Furthermore, after several seconds of rival binocular stimulation with unequal contrasts, transient increase in the contrast of the weak stimulus evoked a long-lasting cortical response. This transient-triggered response could contribute to the perceptual switch during binocular rivalry. Together, these results point to a significant contribution of early visual cortex to transient-triggered switch in perceptual dominance.     

Effects of Awareness on Numerosity Adaptation

Numerosity perception is a process involving several stages of visual processing. This study investigated whether distinct mechanisms exist in numerosity adaptation under different awareness conditions to characterize how numerosity perception occurs at each stage. The status of awareness was controlled by masking conditions, in which monoptic and dichoptic masking were proposed to influence different levels of processing. Numerosity adaptation showed significant aftereffects when the participants were aware (monoptic masking) and unaware (dichoptic masking) of adaptors. The interocular transfer for numerosity adaptation was distinct under the different awareness conditions. Adaptation was primarily binocular when participants were aware of stimuli and was purely monocular when participants were unaware of adaptors. Moreover, numerosity adaptation was significantly reduced when the adaptor dots were clustered into chunks with awareness, whereas clustering had no effect on unaware adaptation. These results show that distinct mechanisms exist in numerosity processing under different awareness conditions. It is suggested that awareness is crucial to numerosity cognition. With awareness, grouping (by clustering) influences numerosity coding through altered object representations, which involves higher-level cognitive processing.     

Bistable percepts in the brain: FMRI contrasts monocular pattern rivalry and binocular rivalry

The neural correlates of binocular rivalry have been actively debated in recent years, and are of considerable interest as they may shed light on mechanisms of conscious awareness. In a related phenomenon, monocular rivalry, a composite image is shown to both eyes. The subject experiences perceptual alternations in which the two stimulus components alternate in clarity or salience. The experience is similar to perceptual alternations in binocular rivalry, although the reduction in visibility of the suppressed component is greater for binocular rivalry, especially at higher stimulus contrasts. We used fMRI at 3T to image activity in visual cortex while subjects perceived either monocular or binocular rivalry, or a matched non-rivalrous control condition. The stimulus patterns were left/right oblique gratings with the luminance contrast set at 9%, 18% or 36%. Compared to a blank screen, both binocular and monocular rivalry showed a U-shaped function of activation as a function of stimulus contrast, i.e. higher activity for most areas at 9% and 36%. The sites of cortical activation for monocular rivalry included occipital pole (V1, V2, V3), ventral temporal, and superior parietal cortex. The additional areas for binocular rivalry included lateral occipital regions, as well as inferior parietal cortex close to the temporoparietal junction (TPJ). In particular, higher-tier areas MT+ and V3A were more active for binocular than monocular rivalry for all contrasts. In comparison, activation in V2 and V3 was reduced for binocular compared to monocular rivalry at the higher contrasts that evoked stronger binocular perceptual suppression, indicating that the effects of suppression are not limited to interocular suppression in V1.     

Stimulus motion propels traveling waves in binocular rivalry

State transitions in the nervous system often take shape as traveling waves, whereby one neural state is replaced by another across space in a wave-like manner. In visual perception, transitions between the two mutually exclusive percepts that alternate when the two eyes view conflicting stimuli (binocular rivalry) may also take shape as traveling waves. The properties of these waves point to a neural substrate of binocular rivalry alternations that have the hallmark signs of lower cortical areas. In a series of experiments, we show a potent interaction between traveling waves in binocular rivalry and stimulus motion. The course of the traveling wave is biased in the motion direction of the suppressed stimulus that gains dominance by means of the wave-like transition. Thus, stimulus motion may propel the traveling wave across the stimulus to the extent that the stimulus motion dictates the traveling wave's direction completely. Using a computational model, we show that a speed-dependent asymmetry in lateral inhibitory connections between retinotopically organized and motion-sensitive neurons can explain our results. We argue that such a change in suppressive connections may play a vital role in the resolution of dynamic occlusion situations.     

The interaction between binocular rivalry and negative afterimages

Afterimage formation, historically attributed to retinal mechanisms, may also involve postretinal process. Consistent with this notion are results from experiments, reported here, investigating the interaction between binocular rivalry and negative afterimages (AIs). In Experiment 1, one eye was exposed to a grating never consciously experienced by the observer because this grating remained suppressed in rivalry throughout induction (the exclusively dominant stimulus was designed to preclude formation of an AI). As expected, the suppressed grating generated a vivid AI whose orientation could be accurately identified; not surprisingly, the strength of this AI varied with induction contrast. Experiment 2 revealed, however, that the strength of this AI produced during suppression was significantly weaker than the AI produced by that same stimulus when it was visible throughout the entire induction period, implying that some component of AI induction is susceptible to interocular suppression. In Experiment 3, AIs of dichoptic, orthogonally oriented gratings were induced in a way ensuring that one of the two gratings was exclusively dominant during the induction period. Dissimilar monocular AIs engaged in rivalry, as expected, but, surprisingly, the AI induced by the suppressed grating initially dominated. We offer two alternative accounts of this counterintuitive finding, both based on differential neural adaptation.     

Visual motion retards alternations between conflicting perceptual interpretations

When the visual system is faced with conflicting or ambiguous stimulus information, visual perception fluctuates over time. We found that perceptual alternations are slowed when inducing stimuli move within the visual field, constantly engaging fresh, unadapted neural tissue. During binocular rivalry, dominance durations were longer when rival figures moved compared to when they were stationary, yielding lower alternation rates. Rate was not reduced, however, when observers tracked the moving targets, keeping the images on approximately the same retinal area. Alternations were reliably triggered when rival targets passed through a local region of the visual field preadapted to one of the rival targets. During viewing of a kinetic globe whose direction of rotation was ambiguous, observers experienced fewer alternations in perceived direction when the globe moved around the visual field or when the globe's axis of rotation changed continuously. Evidently, local neural adaptation is a key ingredient in the instability of perception.     

The neural transfer characteristic (neurontropy) for binocular stochastic stimulation

Our binocular fusion/rivalry model for the processing of interocular correlations was extended to partial correlations. The results support the concepts of fusion/rivalry inhibition, of catabolism, of adaptation and of the power transforms of correlational information. They also indicate that the neural transfer characteristic for interocular correlation, (also called neurontropy), is highly nonlinear with respect to the degree of mathematical correlation.Address Fill Oct. 1, 1976: Prof. Dr. B. Julesz