Evidence for perceptual "trapping" and adaptation in multistable binocular rivalry

When a different pattern is presented to each eye, the perceived image spontaneously alternates between the two patterns (binocular rivalry); the dynamics of these bistable alternations are known to be stochastic. Examining multistable binocular rivalry (involving four dominant percepts), we demonstrated path dependence and on-line adaptation, which were equivalent whether perceived patterns were formed by single-eye dominance or by mixed-eye dominance. The spontaneous perceptual transitions tended to get trapped within a pair of related global patterns (e.g., opponent shapes and symmetric patterns), and during such trapping, the probability of returning to the repeatedly experienced patterns gradually decreased (postselection pattern adaptation). These results suggest that the structure of global shape coding and its adaptation play a critical role in directing spontaneous alternations of visual awareness in perceptual multistability.     

Perceptual rivalry: reflexes reveal the gradual nature of visual awareness

Rivalry is a common tool to probe visual awareness: a constant physical stimulus evokes multiple, distinct perceptual interpretations ("percepts") that alternate over time. Percepts are typically described as mutually exclusive, suggesting that a discrete (all-or-none) process underlies changes in visual awareness. Here we follow two strategies to address whether rivalry is an all-or-none process: first, we introduce two reflexes as objective measures of rivalry, pupil dilation and optokinetic nystagmus (OKN); second, we use a continuous input device (analog joystick) to allow observers a gradual subjective report. We find that the "reflexes" reflect the percept rather than the physical stimulus. Both reflexes show a gradual dependence on the time relative to perceptual transitions. Similarly, observers' joystick deflections, which are highly correlated with the reflex measures, indicate gradual transitions. Physically simulating wave-like transitions between percepts suggest piece-meal rivalry (i.e., different regions of space belonging to distinct percepts) as one possible explanation for the gradual transitions. Furthermore, the reflexes show that dominance durations depend on whether or not the percept is actively reported. In addition, reflexes respond to transitions with shorter latencies than the subjective report and show an abundance of short dominance durations. This failure to report fast changes in dominance may result from limited access of introspection to rivalry dynamics. In sum, reflexes reveal that rivalry is a gradual process, rivalry's dynamics is modulated by the required action (response mode), and that rapid transitions in perceptual dominance can slip away from awareness.     

Interhemispheric switching mediates perceptual rivalry

BACKGROUND: Binocular rivalry refers to the alternating perceptual states that occur when the images seen by the two eyes are too different to be fused into a single percept. Logothetis and colleagues have challenged suggestions that this phenomenon occurs early in the visual pathway. They have shown that, in alert monkeys, neurons in the primary visual cortex continue to respond to their preferred stimulus despite the monkey reporting its absence. Moreover, they found that neural activity higher in the visual pathway is highly correlated with the monkey's reported percept. These and other findings suggest that the neural substrate of binocular rivalry must involve high levels, perhaps the same levels involved in reversible figure alternations. RESULTS: We present evidence that activation or disruption of a single hemisphere in human subjects affects the perceptual alternations of binocular rivalry. Unilateral caloric vestibular stimulation changed the ratio of time spent in each competing perceptual state. Transcranial magnetic stimulation applied to one hemisphere disrupted normal perceptual alternations when the stimulation was timed to occur at one phase of the perceptual switch, but not at the other. Furthermore, activation of a single hemisphere by caloric stimulation affected the perceptual alternations of a reversible figure, the Necker cube. CONCLUSIONS: Our findings suggest that interhemispheric switching mediates perceptual rivalry. Thus, competition for awareness in both binocular rivalry and reversible figures occurs between, rather than within, each hemisphere. This interhemispheric switch hypothesis has implications for understanding the neural mechanisms of conscious experience and also has clinical relevance as the rate of both types of perceptual rivalry is slow in bipolar disorder (manic depression).     

A Common Neurodynamical Mechanism Could Mediate Externally Induced and Intrinsically Generated Transitions in Visual Awareness

The neural correlates of conscious visual perception are commonly studied in paradigms of perceptual multistability that allow multiple perceptual interpretations during unchanged sensory stimulation. What is the source of this multistability in the content of perception? From a theoretical perspective, a fine balance between deterministic and stochastic forces has been suggested to underlie the spontaneous, intrinsically driven perceptual transitions observed during multistable perception. Deterministic forces are represented by adaptation of feature-selective neuronal populations encoding the competing percepts while stochastic forces are modeled as noise-driven processes. Here, we used a unified neuronal competition model to study the dynamics of adaptation and noise processes in binocular flash suppression (BFS), a form of externally induced perceptual suppression, and compare it with the dynamics of intrinsically driven alternations in binocular rivalry (BR). For the first time, we use electrophysiological, biologically relevant data to constrain a model of perceptual rivalry. Specifically, we show that the mean population discharge pattern of a perceptually modulated neuronal population detected in electrophysiological recordings in the lateral prefrontal cortex (LPFC) during BFS, constrains the dynamical range of externally induced perceptual transitions to a region around the bifurcation separating a noise-driven attractor regime from an adaptation-driven oscillatory regime. Most interestingly, the dynamical range of intrinsically driven perceptual transitions during BR is located in the noise-driven attractor regime, where it overlaps with BFS. Our results suggest that the neurodynamical mechanisms of externally induced and spontaneously generated perceptual alternations overlap in a narrow, noise-driven region just before a bifurcation where the system becomes adaptation-driven.     

The nose smells what the eye sees: crossmodal visual facilitation of human olfactory perception

Human olfactory perception is notoriously unreliable, but shows substantial benefits from visual cues, suggesting important crossmodal integration between these primary sensory modalities. We used event-related fMRI to determine the underlying neural mechanisms of olfactory-visual integration in the human brain. Subjects participated in an olfactory detection task, whereby odors and pictures were delivered separately or together. By manipulating the degree of semantic correspondence between odor-picture pairs, we show a perceptual olfactory facilitation for semantically congruent (versus incongruent) trials. This behavioral advantage was associated with enhanced neural activity in anterior hippocampus and rostromedial orbitofrontal cortex. We suggest these findings can be interpreted as indicating that human hippocampus mediates reactivation of crossmodal semantic associations, even in the absence of explicit memory processing.     

How to Create and Use Binocular Rivalry

Each of our eyes normally sees a slightly different image of the world around us. The brain can combine these two images into a single coherent representation. However, when the eyes are presented with images that are sufficiently different from each other, an interesting thing happens: Rather than fusing the two images into a combined conscious percept, what transpires is a pattern of perceptual alternations where one image dominates awareness while the other is suppressed; dominance alternates between the two images, typically every few seconds. This perceptual phenomenon is known as binocular rivalry. Binocular rivalry is considered useful for studying perceptual selection and awareness in both human and animal models, because unchanging visual input to each eye leads to alternations in visual awareness and perception. To create a binocular rivalry stimulus, all that is necessary is to present each eye with a different image at the same perceived location. There are several ways of doing this, but newcomers to the field are often unsure which method would best suit their specific needs. The purpose of this article is to describe a number of inexpensive and straightforward ways to create and use binocular rivalry. We detail methods that do not require expensive specialized equipment and describe each method''s advantages and disadvantages. The methods described include the use of red-blue goggles, mirror stereoscopes and prism goggles.     

Stimulus motion propels traveling waves in binocular rivalry

State transitions in the nervous system often take shape as traveling waves, whereby one neural state is replaced by another across space in a wave-like manner. In visual perception, transitions between the two mutually exclusive percepts that alternate when the two eyes view conflicting stimuli (binocular rivalry) may also take shape as traveling waves. The properties of these waves point to a neural substrate of binocular rivalry alternations that have the hallmark signs of lower cortical areas. In a series of experiments, we show a potent interaction between traveling waves in binocular rivalry and stimulus motion. The course of the traveling wave is biased in the motion direction of the suppressed stimulus that gains dominance by means of the wave-like transition. Thus, stimulus motion may propel the traveling wave across the stimulus to the extent that the stimulus motion dictates the traveling wave's direction completely. Using a computational model, we show that a speed-dependent asymmetry in lateral inhibitory connections between retinotopically organized and motion-sensitive neurons can explain our results. We argue that such a change in suppressive connections may play a vital role in the resolution of dynamic occlusion situations.     

Learning to smell the roses: experience-dependent neural plasticity in human piriform and orbitofrontal cortices

It is widely presumed that odor quality is a direct outcome of odorant structure, but human studies indicate that molecular knowledge of an odorant is not always sufficient to predict odor quality. Indeed, the same olfactory input may generate different odor percepts depending on prior learning and experience. Combining functional magnetic resonance imaging with an olfactory paradigm of perceptual learning, we examined how sensory experience modifies odor perception and odor quality coding in the human brain. Prolonged exposure to a target odorant enhanced perceptual differentiation for odorants related in odor quality or functional group, an effect that was paralleled by learning-induced response increases in piriform cortex and orbitofrontal cortex (OFC). Critically, the magnitude of OFC activation predicted subsequent improvement in behavioral differentiation. Our findings suggest that neural representations of odor quality can be rapidly updated through mere perceptual experience, a mechanism that may underlie the development of odor perception.     

Bistable percepts in the brain: FMRI contrasts monocular pattern rivalry and binocular rivalry

The neural correlates of binocular rivalry have been actively debated in recent years, and are of considerable interest as they may shed light on mechanisms of conscious awareness. In a related phenomenon, monocular rivalry, a composite image is shown to both eyes. The subject experiences perceptual alternations in which the two stimulus components alternate in clarity or salience. The experience is similar to perceptual alternations in binocular rivalry, although the reduction in visibility of the suppressed component is greater for binocular rivalry, especially at higher stimulus contrasts. We used fMRI at 3T to image activity in visual cortex while subjects perceived either monocular or binocular rivalry, or a matched non-rivalrous control condition. The stimulus patterns were left/right oblique gratings with the luminance contrast set at 9%, 18% or 36%. Compared to a blank screen, both binocular and monocular rivalry showed a U-shaped function of activation as a function of stimulus contrast, i.e. higher activity for most areas at 9% and 36%. The sites of cortical activation for monocular rivalry included occipital pole (V1, V2, V3), ventral temporal, and superior parietal cortex. The additional areas for binocular rivalry included lateral occipital regions, as well as inferior parietal cortex close to the temporoparietal junction (TPJ). In particular, higher-tier areas MT+ and V3A were more active for binocular than monocular rivalry for all contrasts. In comparison, activation in V2 and V3 was reduced for binocular compared to monocular rivalry at the higher contrasts that evoked stronger binocular perceptual suppression, indicating that the effects of suppression are not limited to interocular suppression in V1.     

Disrupting parietal function prolongs dominance durations in binocular rivalry

Human brain imaging studies of bistable perceptual phenomena revealed that frontal and parietal areas are activated during perceptual switches between the two conflicting percepts. However, these studies do not provide information about causality, i.e., whether activity reports a consequence or a cause of the perceptual change. Here we used functional magnetic resonance imaging to individually localize four parietal regions involved in perceptual switches during binocular rivalry in 15 subjects and subsequently disturbed their neural processing and that of a control site using 2 Hz repetitive transcranial magnetic stimulation (TMS) during binocular rivalry. We found that TMS over one of the sites, the right intraparietal sulcus (IPS), prolonged the periods of stable percepts. Additionally, the more lateralized the blood oxygen level-dependent signal was in IPS, the more lateralized the TMS effects were. Lateralization varied considerably across subjects, with a right-hemispheric bias. Control replay experiments rule out nonspecific effects of TMS on task performance, reaction times, or eye blinks. Our results thus demonstrate a causal, destabilizing, and individually lateralized effect of normal IPS function on perceptual continuity in rivalry. This is in accord with a role of IPS in perceptual selection, relating its role in rivalrous perception to that in attention.     

Onset rivalry: brief presentation isolates an early independent phase of perceptual competition

When the left and right eyes are simultaneously presented with different images, observers typically report exclusive awareness of only one image. This phenomenon is termed binocular rivalry, reflecting the fact that the dominant image alternates every few seconds in a cycle of perceptual competition that continues indefinitely. Despite the apparent continuity in perceptual switching, we now demonstrate that the initial "onset" period is fundamentally different to all subsequent rivalry epochs. Using brief intermittent presentations, rivalry dominance shows strong biases such that the same target is perceived with each successive stimulus onset. These biases remain consistent within any given location, but vary across the visual field in a distribution that is stable over multiple weeks but highly idiosyncratic across observers. If the presentation exceeds approximately 1sec at any location, however, the very different and much more balanced alternations of sustained binocular rivalry become apparent. These powerful onset biases are observed with brief intermittent presentations at a single location or with continual smooth motion of the targets. Periods of adaptation to one of the rivaling targets induced local switches in dominance to the non-adapted target. However, these effects were generally limited to the spatial site of adaptation and had less influence over each subsequent cycle of the target. We conclude that onset rivalry is independent of sustained rivalry and cannot be explained by local regions of monocular dominance or memory of past perceptual history, but rather reflects low-level, spatially localized factors that are stable over periods of weeks. These findings suggest that brief presentation paradigms are inappropriate for their current use in studies of the mechanisms underlying sustained rivalry. However, brief presentations are ideal for investigating early stages of perceptual competition.     

Human brain activity during spontaneously reversing perception of ambiguous figures.

Looking at ambiguous figures results in rivalry with spontaneous alternation between two percepts. Using event-related functional magnetic resonance imaging, we localized transient human brain activity changes during perceptual reversals. Activation occurred in ventral occipital and intraparietal higher-order visual areas, deactivation in primary visual cortex and the pulvinar. Thus, without any physical stimulus changes, salient perceptual flips briefly engage widely separated specialized cortical areas, but are also associated with intermittent activity breakdown in structures putatively maintaining perceptual stability. Together, the dynamics of integrative perceptual experience are reflected in rapid spatially differentiated activity modulation within a cooperative set of neural structures.     

Visual perception of ambiguous figures: synchronization based neural models

We develop and study two neural network models of perceptual alternations. Both models have a star-like architecture of connections with a central element connected to a set of peripheral elements. A particular perception is simulated in terms of partial synchronization between the central element and some sub-group of peripheral elements. The first model is constructed from phase oscillators and the mechanism of perceptual alternations is based on chaotic intermittency under fixed parameter values. Similar to experimental evidence, the distribution of times between perceptual alternations is represented by the gamma distribution. The second model is built of spiking neurons of the Hodgkin–Huxley type. The mechanism of perceptual alternations is based on plasticity of inhibitory synapses which increases the inhibition from the central unit to the neural assembly representing the current percept. As a result another perception is formed. Simulations show that the second model is in good agreement with behavioural data on switching times between percepts of ambiguous figures and with experimental results on binocular rivalry of two and four percepts. This article is part of a special issue on Neuronal Dynamics of Sensory Coding. This special issue is in honour of Professor Pepe Segundo who is one of the pioneers in the study of neural coding. Pepe has been an active participant in many Neural Coding Workshops sharing his great knowledge and experience of research in this field. I (R. Borisyuk) was very happy to meet Pepe for the first time in Prague when attending the first Neural Coding Workshop in 1995. From that time we regularly met at Neural Coding Workshops and these meetings have always been very stimulating and fruitful for my research. Remarkably, the first paper I studied at the beginning of my scientific career was a seminal paper by Moore et al. (1970). For me, this paper provided a great opportunity to learn the basic statistical techniques for the analysis of multiple spike trains and neural coding. According to the Institute of Scientific Information, this paper has been cited 380 times! This exciting paper has inspired my research into the synaptic and functional connectivity of neural circuits derived from spike-train recordings (Borisyuk et al. 1985; Stuart et al. 2005) and guided my search for new ideas on neural coding.     

Olfactory perception in honeybees: Concatenated and mixed odorant stimuli,concentration, and exposure effects

Summary Here we present results obtained from 7 different series of experiments, all employing odor conditioning of proboscis extension in worker honeybees and each designed to address a particular question involving olfactory perception. The questions relate to: temporal complexity of odor cues; effects of concentration, suppression, and/or potentiation in mixture perception; acquisition and extinction rates, as well as levels of generalization associated with aliphatic compounds that have the same functional groups or same alkyl radical length; and the effects of continuous exposure to odorants in the first several days of adult life on various learning and discrimination tasks involving olfactory perception. From the data obtained in these experiments we were able to conclude the following: First, worker honeybees have a limited ability to perceive complex temporal odor-quality patterns in olfactory stimuli — they learn to associate the quality of only the last part of the stimulus with a sucrose reward. Second, we confirm that citral is qualitatively different in several perceptual contexts involving odor learning and conditioning and our results help elucidate the nature of these differences as they relate to learning, discrimination, mixture perception, and continuous exposure to particular odorants. Third, we appear to have uncovered some important perceptual differences between functional groups attached to the first as opposed to the second carbon atom of alkyl radicals. Finally, we failed to uncover any significant effects relating to continuous exposure to odorants during the first several days of a worker's adult life, despite evidence that considerable sensory development takes place during this period. Thus ontogenetic changes to the peripheral system due to environmental effects appear to leave basic perceptual systems unaltered.     

Single units and conscious vision.

Figures that can be seen in more than one way are invaluable tools for the study of the neural basis of visual awareness, because such stimuli permit the dissociation of the neural responses that underlie what we perceive at any given time from those forming the sensory representation of a visual pattern. To study the former type of responses, monkeys were subjected to binocular rivalry, and the response of neurons in a number of different visual areas was studied while the animals reported their alternating percepts by pulling levers. Perception-related modulations of neural activity were found to occur to different extents in different cortical visual areas. The cells that were affected by suppression were almost exclusively binocular, and their proportion was found to increase in the higher processing stages of the visual system. The strongest correlations between neural activity and perception were observed in the visual areas of the temporal lobe. A strikingly large number of neurons in the early visual areas remained active during the perceptual suppression of the stimulus, a finding suggesting that conscious visual perception might be mediated by only a subset of the cells exhibiting stimulus selective responses. These physiological findings, together with a number of recent psychophysical studies, offer a new explanation of the phenomenon of binocular rivalry. Indeed, rivalry has long been considered to be closely linked with binocular fusion and stereopsis, and the sequences of dominance and suppression have been viewed as the result of competition between the two monocular channels. The physiological data presented here are incompatible with this interpretation. Rather than reflecting interocular competition, the rivalry is most probably between the two different central neural representations generated by the dichoptically presented stimuli. The mechanisms of rivalry are probably the same as, or very similar to, those underlying multistable perception in general, and further physiological studies might reveal much about the neural mechanisms of our perceptual organization.     

A Model of Binocular Rivalry and Cross-orientation Suppression

Binocular rivalry and cross-orientation suppression are well-studied forms of competition in visual cortex, but models of these two types of competition are in tension with one another. Binocular rivalry occurs during the presentation of dichoptic grating stimuli, where two orthogonal gratings presented separately to the two eyes evoke strong alternations in perceptual dominance. Cross-orientation suppression occurs during the presentation of plaid stimuli, where the responses to a component grating presented to both eyes is weakened by the presence of a superimposed orthogonal grating. Conventional models of rivalry that rely on strong competition between orientation-selective neurons incorrectly predict rivalry between the components of plaids. Lowering the inhibitory weights in such models reduces rivalry for plaids, but also reduces it for dichoptic gratings. Using an exhaustive grid search, we show that this problem cannot be solved simply by adjusting the parameters of the model. Instead, we propose a robust class of models that rely on ocular opponency neurons, previously proposed as a mechanism for efficient stereo coding, to yield rivalry only for dichoptic gratings, not for plaids. This class of models reconciles models of binocular rivalry with the divisive normalization framework that has been used to explain cross-orientation. Our model makes novel predictions that we confirmed with psychophysical tests.     

Fusion and rivalry are dependent on the perceptual meaning of visual stimuli

We view the world with two eyes and yet are typically only aware of a single, coherent image. Arguably the simplest explanation for this is that the visual system unites the two monocular stimuli into a common stream that eventually leads to a single coherent sensation. However, this notion is inconsistent with the well-known phenomenon of rivalry; when physically different stimuli project to the same retinal location, the ensuing perception alternates between the two monocular views in space and time. Although fundamental for understanding the principles of binocular vision and visual awareness, the mechanisms under-lying binocular rivalry remain controversial. Specifically, there is uncertainty about what determines whether monocular images undergo fusion or rivalry. By taking advantage of the perceptual phenomenon of color contrast, we show that physically identical monocular stimuli tend to rival-not fuse-when they signify different objects at the same location in visual space. Conversely, when physically different monocular stimuli are likely to represent the same object at the same location in space, fusion is more likely to result. The data suggest that what competes for visual awareness in the two eyes is not the physical similarity between images but the similarity in their perceptual/empirical meaning.     

Olfactory discrimination: when vision matters?

Many previous studies have attempted to investigate the effect of visual cues on olfactory perception in humans. The majority of this research has only looked at the modulatory effect of color, which has typically been explained in terms of multisensory perceptual interactions. However, such crossmodal effects may equally well relate to interactions taking place at a higher level of information processing as well. In fact, it is well-known that semantic knowledge can have a substantial effect on people's olfactory perception. In the present study, we therefore investigated the influence of visual cues, consisting of color patches and/or shapes, on people's olfactory discrimination performance. Participants had to make speeded odor discrimination responses (lemon vs. strawberry) while viewing a red or yellow color patch, an outline drawing of a strawberry or lemon, or a combination of these color and shape cues. Even though participants were instructed to ignore the visual stimuli, our results demonstrate that the accuracy of their odor discrimination responses was influenced by visual distractors. This result shows that both color and shape information are taken into account during speeded olfactory discrimination, even when such information is completely task irrelevant, hinting at the automaticity of such higher level visual-olfactory crossmodal interactions.     

General validity of Levelt's propositions reveals common computational mechanisms for visual rivalry

The mechanisms underlying conscious visual perception are often studied with either binocular rivalry or perceptual rivalry stimuli. Despite existing research into both types of rivalry, it remains unclear to what extent their underlying mechanisms involve common computational rules. Computational models of binocular rivalry mechanisms are generally tested against Levelt's four propositions, describing the psychophysical relation between stimulus strength and alternation dynamics in binocular rivalry. Here we use a bistable rotating structure-from-motion sphere, a generally studied form of perceptual rivalry, to demonstrate that Levelt's propositions also apply to the alternation dynamics of perceptual rivalry. Importantly, these findings suggest that bistability in structure-from-motion results from active cross-inhibition between neural populations with computational principles similar to those present in binocular rivalry. Thus, although the neural input to the computational mechanism of rivalry may stem from different cortical neurons and different cognitive levels the computational principles just prior to the production of visual awareness appear to be common to the two types of rivalry.     

Perceptual grouping of biological motion promotes binocular rivalry

Investigation of perceptual rivalry between conflicting stimuli presented one to each eye can further understanding of the neural underpinnings of conscious visual perception. During rivalry, visual awareness fluctuates between perceptions of the two stimuli. Here, we demonstrate that high-level perceptual grouping can promote rivalry between stimulus pairs that would otherwise be perceived as nonrivalrous. Perceptual grouping was generated with point-light walker stimuli that simulate human motion, visible only as lights placed on the joints. Although such walking figures are unrecognizable when stationary, recognition judgments as complex as gender and identity can accurately be made from animated displays, demonstrating the efficiency with which our visual system can group dynamic local signals into a globally coherent walking figure. We find that point-light walker stimuli presented one to each eye and in different colors and configurations results in strong rivalry. However, rivalry is minimal when the two walkers are split between the eyes or both presented to one eye. This pattern of results suggests that processing animated walker figures promotes rivalry between signals from the two eyes rather than between higher-level representations of the walkers. This leads us to hypothesize that awareness during binocular rivalry involves the integrated activity of high-level perceptual mechanisms in conjunction with lower-level ocular suppression modulated via cortical feedback.