Binocular onset rivalry at the time of saccades and stimulus jumps

Recent studies suggest that binocular rivalry at stimulus onset, so called onset rivalry, differs from rivalry during sustained viewing. These observations raise the interesting question whether there is a relation between onset rivalry and rivalry in the presence of eye movements. We therefore studied binocular rivalry when stimuli jumped from one visual hemifield to the other, either through a saccade or through a passive stimulus displacement, and we compared rivalry after such displacements with onset and sustained rivalry. We presented opponent motion, orthogonal gratings and face/house stimuli through a stereoscope. For all three stimulus types we found that subjects showed a strong preference for stimuli in one eye or one hemifield (Experiment 1), and that these subject-specific biases did not persist during sustained viewing (Experiment 2). These results confirm and extend previous findings obtained with gratings. The results from the main experiment (Experiment 3) showed that after a passive stimulus jump, switching probability was low when the preferred eye was dominant before a stimulus jump, but when the non-preferred eye was dominant beforehand, switching probability was comparatively high. The results thus showed that dominance after a stimulus jump was tightly related to eye dominance at stimulus onset. In the saccade condition, however, these subject-specific biases were systematically reduced, indicating that the influence of saccades can be understood from a systematic attenuation of the subjects' onset rivalry biases. Taken together, our findings demonstrate a relation between onset rivalry and rivalry after retinal shifts and involvement of extra-retinal signals in binocular rivalry.     

On the role of attention in binocular rivalry: electrophysiological evidence

During binocular rivalry visual consciousness fluctuates between two dissimilar monocular images. We investigated the role of attention in this phenomenon by comparing event-related potentials (ERPs) when binocular-rivalry stimuli were attended with when they were unattended. Stimuli were dichoptic, orthogonal gratings that yielded binocular rivalry and dioptic, identically oriented gratings that yielded binocular fusion. Events were all possible orthogonal changes in orientation of one or both gratings. We had two attention conditions: In the attend-to-grating condition, participants had to report changes in perceived orientation, focussing their attention on the gratings. In the attend-to-fixation condition participants had to report changes in a central fixation target, taking attention away from the gratings. We found, surprisingly, that attending to rival gratings yielded a smaller ERP component (the N1, from 160-210 ms) than attending to the fixation target. To explain this paradoxical effect of attention, we propose that rivalry occurs in the attend-to-fixation condition (we found an ERP signature of rivalry in the form of a sustained negativity from 210-300 ms) but that the mechanism processing the stimulus changes is more adapted in the attend-to-grating condition than in the attend-to-fixation condition. This is consistent with the theory that adaptation gives rise to changes of visual consciousness during binocular rivalry.     

Binocular visual integration in the crustacean nervous system

Although the behavioral repertoire of crustaceans is largely guided by visual information their visual nervous system has been little explored. In search for central mechanisms of visual integration, this study was aimed at identifying and characterizing brain neurons in the crab involved in binocular visual processing. The study was performed in the intact animal, by recording intracellularly the response to visual stimuli of neurons from one of the two optic lobes. Identified neurons recorded from the medulla (second optic neuropil), which include sustaining neurons, dimming neurons, depolarizing and hyperpolarizing tonic neurons and on-off neurons, all presented exclusively monocular (ipsilateral) responses. In contrast, all wide field movement detector neurons recorded from the lobula (third optic neuropil) responded to moving stimuli presented to the ipsilateral and to the contralateral eye. In these cells, the responses evoked by ipsilateral or contralateral stimulation were almost identical, as revealed by analysing the number and amplitude of the elicited postsynaptic potentials and spikes, and the ability to habituate upon repeated visual stimulation. The results demonstrate that in crustaceans important binocular processing takes place at the level of the lobula.     

Computational modelling of visual attention

Five important trends have emerged from recent work on computational models of focal visual attention that emphasize the bottom-up, image-based control of attentional deployment. First, the perceptual saliency of stimuli critically depends on the surrounding context. Second, a unique 'saliency map' that topographically encodes for stimulus conspicuity over the visual scene has proved to be an efficient and plausible bottom-up control strategy. Third, inhibition of return, the process by which the currently attended location is prevented from being attended again, is a crucial element of attentional deployment. Fourth, attention and eye movements tightly interplay, posing computational challenges with respect to the coordinate system used to control attention. And last, scene understanding and object recognition strongly constrain the selection of attended locations. Insights from these five key areas provide a framework for a computational and neurobiological understanding of visual attention.     

Perceptual rivalry: reflexes reveal the gradual nature of visual awareness

Rivalry is a common tool to probe visual awareness: a constant physical stimulus evokes multiple, distinct perceptual interpretations ("percepts") that alternate over time. Percepts are typically described as mutually exclusive, suggesting that a discrete (all-or-none) process underlies changes in visual awareness. Here we follow two strategies to address whether rivalry is an all-or-none process: first, we introduce two reflexes as objective measures of rivalry, pupil dilation and optokinetic nystagmus (OKN); second, we use a continuous input device (analog joystick) to allow observers a gradual subjective report. We find that the "reflexes" reflect the percept rather than the physical stimulus. Both reflexes show a gradual dependence on the time relative to perceptual transitions. Similarly, observers' joystick deflections, which are highly correlated with the reflex measures, indicate gradual transitions. Physically simulating wave-like transitions between percepts suggest piece-meal rivalry (i.e., different regions of space belonging to distinct percepts) as one possible explanation for the gradual transitions. Furthermore, the reflexes show that dominance durations depend on whether or not the percept is actively reported. In addition, reflexes respond to transitions with shorter latencies than the subjective report and show an abundance of short dominance durations. This failure to report fast changes in dominance may result from limited access of introspection to rivalry dynamics. In sum, reflexes reveal that rivalry is a gradual process, rivalry's dynamics is modulated by the required action (response mode), and that rapid transitions in perceptual dominance can slip away from awareness.     

Splitting the spotlight of visual attention

Can the brain attend to more than a single location at one time? In this issue of Neuron, McMains and Somers report psychophysical and fMRI evidence showing that subjects can attend to two separate locations concurrently and that divided spatial attention leads to separate zones of attentional enhancement in early visual cortex.     

Distractor-target interactions during directed visual attention

The spatial extent of directed visual attention (DVA) was examined in a series of experiments using precuing in a suprathreshold luminance detection (reaction time) paradigm. Previous findings (Hughes, H. C. and Zimba, L. D. J. Exp. Psychol.; Human Percept Perf., 1985, 11, 409-430) indicated that, in an empty visual field, the effects of DVA were primarily manifest as a uniform elevation of response times to all probe targets in the hemifield contralateral to the observer's expectancy. The present experiments were designed to determine whether increased spatial selectivity could be found when luminous markers indicated the exact location of the expected visual target. To maintain equivalent states of adaptation in both hemifields, luminous markers were also present at the same location in the contralateral hemifield. In general, hemifield effects were again obtained, but with two notable exceptions. First, marking locations in the unattended hemifield produced a local increase (enhanced interference) in RTs above the level characteristic of other locations within that hemifield. Second, when multiple locations were indicated with identical luminous markers, graded costs were obtained in both hemifields. However, scaling the markers according to estimates of cortical magnification factor (M) substantially reduced the slope of these inhibitory gradients, and the results once again approached those characteristic of an unstructured visual field. The findings suggest that when attention is directed to a marked location along the horizontal meridian, a transition in performance typically occurs at the vertical meridian. In addition, irrelevant stimuli some distance from the attentional focus interfere with detection times to unexpected targets that appear in the same vicinity. This interference may relate to an enhanced susceptibility to spatial interactions between the distractors and target away from the attentional focus. The interference appears to extend over a constant area of visual cortex, since it is reduced when the markers are M-scaled.     

The dark side of visual attention

The limited capacity of neural processing restricts the number of objects and locations that can be attended to. Selected events are readily enhanced: the bright side of attention. However, such focal processing comes at a cost, namely, functional blindness for unattended events: the dark side of visual attention. Recent work has advanced our understanding of the neural mechanisms that facilitate visual processing, as well as the neural correlates of unattended, unconscious visual events. Also, new results have revealed how attentional deployment is optimized by non-visual factors such as behavioral set, past experience, and emotional salience.     

Binocular responses of neurons in the barn owl's visual Wulst

Binocular responses have been recorded extra-cellularly at 58 sites in the barn owl's (Tyto alba) visual Wulst. Neurons showed disparity tuning to stimulation with moving bars, moving sinewave gratings and a moving visual-noise stimulus. Responses to sinewave gratings as a function of disparity were cyclic, with the period of a cycle of the response being correlated to one cycle of the stimulus. Cyclic responses were also found when bars or noise were used as a stimulus, but, especially in response to visual noise, one response peak, the main peak, was different from the other peaks, the sidepeaks: usually, the main peak was either higher or narrower or both higher and narrower than the sidepeaks. When the responses to different spatial frequencies were compared, response maxima coincided at the main peak, but not at the other peaks. In analogy to auditory physiology the disparity at which the frequency-independent peak occurs is termed characteristic disparity. Spatial-frequency tuning revealed broad tuning, ranging from 1 to more than 3 octaves at 50% of the maximal response. Disparity tuning was broad at the onset of the response and sharpened later. The data are discussed within the framework of a model for the neural representation of visual disparity that was derived from a model proposed earlier for the representation of interaural time difference, the main cue for encoding sound-source azimuths in the barn owl.Abbreviations ITD interaural time difference - CD characteristic delay - RF receptive field     

Fusion and rivalry are dependent on the perceptual meaning of visual stimuli

We view the world with two eyes and yet are typically only aware of a single, coherent image. Arguably the simplest explanation for this is that the visual system unites the two monocular stimuli into a common stream that eventually leads to a single coherent sensation. However, this notion is inconsistent with the well-known phenomenon of rivalry; when physically different stimuli project to the same retinal location, the ensuing perception alternates between the two monocular views in space and time. Although fundamental for understanding the principles of binocular vision and visual awareness, the mechanisms under-lying binocular rivalry remain controversial. Specifically, there is uncertainty about what determines whether monocular images undergo fusion or rivalry. By taking advantage of the perceptual phenomenon of color contrast, we show that physically identical monocular stimuli tend to rival-not fuse-when they signify different objects at the same location in visual space. Conversely, when physically different monocular stimuli are likely to represent the same object at the same location in space, fusion is more likely to result. The data suggest that what competes for visual awareness in the two eyes is not the physical similarity between images but the similarity in their perceptual/empirical meaning.     

General validity of Levelt's propositions reveals common computational mechanisms for visual rivalry

The mechanisms underlying conscious visual perception are often studied with either binocular rivalry or perceptual rivalry stimuli. Despite existing research into both types of rivalry, it remains unclear to what extent their underlying mechanisms involve common computational rules. Computational models of binocular rivalry mechanisms are generally tested against Levelt's four propositions, describing the psychophysical relation between stimulus strength and alternation dynamics in binocular rivalry. Here we use a bistable rotating structure-from-motion sphere, a generally studied form of perceptual rivalry, to demonstrate that Levelt's propositions also apply to the alternation dynamics of perceptual rivalry. Importantly, these findings suggest that bistability in structure-from-motion results from active cross-inhibition between neural populations with computational principles similar to those present in binocular rivalry. Thus, although the neural input to the computational mechanism of rivalry may stem from different cortical neurons and different cognitive levels the computational principles just prior to the production of visual awareness appear to be common to the two types of rivalry.     

Cognitive mechanisms of nicotine on visual attention

Understanding nicotine's neurobiological and cognitive mechanisms may help explain both its addictive properties and potential therapeutic applications. As such, functional MRI was used to determine the neural substrates of nicotine's effects on a sustained attention (rapid visual information-processing) task. Performance was associated with activation in a fronto-parietal-thalamic network in both smokers and nonsmokers. Along with subtle behavioral deficits, mildly abstinent smokers showed less task-induced brain activation in the parietal cortex and caudate than did nonsmokers. Transdermal nicotine replacement improved task performance in smokers and increased task-induced brain activation in the parietal cortex, thalamus, and caudate, while nicotine induced a generalized increase in occipital cortex activity. These data suggest that nicotine improves attention in smokers by enhancing activation in areas traditionally associated with visual attention, arousal, and motor activation.     

Alpha ERD and human visual selective attention

We compared the alpha band EEG depression (event-related desynchnization, ERD) level in two tasks, involving activation of different attentional processes: visual search for a deviant relevant stimulus among many similar ones and visual oddball. Control data for the visual search task consisted of simple viewing of several stimuli being of the same shape as the relevant stimulus in the search trials. Gaze position was verified by eye tracking method. We interpreted alpha band ERD as a correlate of activation of attentional processes. Fixating the target in visual search task caused a significantly larger ERD than fixating the same stimuli in control trials over all leads. We suppose this to be related with task and visual environment complexities. The frontal ERD domination may indicate attentional control over voluntary movements execution (top-down attention). The caudal ERD may be related with updating of visual information as a result of search process (bottom-up attention). Both relevant and irrelevant stimuli in the oddball task also induced alpha band ERD, but it was larger in response to relevant one and reached maximum level over occipital leads. Domination of caudal ERD in oddball task is supposed to indicate bottom-up attention processes.     

The role of attention in visual processing

Attention to a visual stimulus typically increases the responses of cortical neurons to that stimulus. Because many studies have shown a close relationship between the performance of individual neurons and behavioural performance of animal subjects, it is important to consider how attention affects this relationship. Measurements of behavioural and neuronal performance taken from rhesus monkeys while they performed a motion detection task with two attentional states show that attention alters the relationship between behaviour and neuronal response. Notably, attention affects the relationship differently in different cortical visual areas. This indicates that a close relationship between neuronal and behavioural performance on a given task persists over changes in attentional state only within limited regions of visual cortex.     

A computational theory of visual attention.

A computational theory of visual attention is presented. The basic theory (TVA) combines the biased-choice model for single-stimulus recognition with the fixed-capacity independent race model (FIRM) for selection from multi-element displays. TVA organizes a large body of experimental findings on performance in visual recognition and attention tasks. A recent development (CTVA) combines TVA with a theory of perceptual grouping by proximity. CTVA explains effects of perceptual grouping and spatial distance between items in multi-element displays. A new account of spatial focusing is proposed in this paper. The account provides a framework for understanding visual search as an interplay between serial and parallel processes.