Interacting roles of attention and visual salience in V4

Attention increases the contrast gain of V4 neurons, causing them to respond to an attended stimulus as though its contrast had increased. When multiple stimuli appear within a neuron's receptive field (RF), the neuron responds primarily to the attended stimulus. This suggests that cortical cells may be "hard wired" to respond preferentially to the highest-contrast stimulus in their RF, and neural systems for attention capitalize on this mechanism by dynamically increasing the effective contrast of the stimulus that is task relevant. To test this, we varied the relative contrast of two stimuli within the recorded neurons' RFs, while the monkeys attended away to another location. Increasing the physical contrast of one stimulus caused V4 neurons to respond preferentially to that stimulus and reduced their responses to competing stimuli. When attention was directed to the lower-contrast stimulus, it partially overcame the influence of a competing, higher-contrast stimulus.     

Increased activity in human visual cortex during directed attention in the absence of visual stimulation

When subjects direct attention to a particular location in a visual scene, responses in the visual cortex to stimuli presented at that location are enhanced, and the suppressive influences of nearby distractors are reduced. What is the top-down signal that modulates the response to an attended versus an unattended stimulus? Here, we demonstrate increased activity related to attention in the absence of visual stimulation in extrastriate cortex when subjects covertly directed attention to a peripheral location expecting the onset of visual stimuli. Frontal and parietal areas showed a stronger signal increase during this expectation than did visual areas. The increased activity in visual cortex in the absence of visual stimulation may reflect a top-down bias of neural signals in favor of the attended location, which derives from a fronto-parietal network.     

Biased competition through variations in amplitude of <Emphasis Type="Italic">γ</Emphasis>-oscillations

Experiments in visual cortex have shown that the firing rate of a neuron in response to the simultaneous presentation of a preferred and non-preferred stimulus within the receptive field is intermediate between that for the two stimuli alone (stimulus competition). Attention directed to one of the stimuli drives the response towards the response induced by the attended stimulus alone (selective attention). This study shows that a simple feedforward model with fixed synaptic conductance values can reproduce these two phenomena using synchronization in the gamma-frequency range to increase the effective synaptic gain for the responses to the attended stimulus. The performance of the model is robust to changes in the parameter values. The model predicts that the phase locking between presynaptic input and output spikes increases with attention.     

Perceptual Grouping Enhances Visual Plasticity

Visual perceptual learning, a manifestation of neural plasticity, refers to improvements in performance on a visual task achieved by training. Attention is known to play an important role in perceptual learning, given that the observer''s discriminative ability improves only for those stimulus feature that are attended. However, the distribution of attention can be severely constrained by perceptual grouping, a process whereby the visual system organizes the initial retinal input into candidate objects. Taken together, these two pieces of evidence suggest the interesting possibility that perceptual grouping might also affect perceptual learning, either directly or via attentional mechanisms. To address this issue, we conducted two experiments. During the training phase, participants attended to the contrast of the task-relevant stimulus (oriented grating), while two similar task-irrelevant stimuli were presented in the adjacent positions. One of the two flanking stimuli was perceptually grouped with the attended stimulus as a consequence of its similar orientation (Experiment 1) or because it was part of the same perceptual object (Experiment 2). A test phase followed the training phase at each location. Compared to the task-irrelevant no-grouping stimulus, orientation discrimination improved at the attended location. Critically, a perceptual learning effect equivalent to the one observed for the attended location also emerged for the task-irrelevant grouping stimulus, indicating that perceptual grouping induced a transfer of learning to the stimulus (or feature) being perceptually grouped with the task-relevant one. Our findings indicate that no voluntary effort to direct attention to the grouping stimulus or feature is necessary to enhance visual plasticity.     

Eye position affects orienting of visuospatial attention

The ability to detect an incoming visual stimulus is enhanced by knowledge of stimulus location (orienting of visuospatial attention). Although the brain mechanisms at the basis of this enhancement are not yet fully clarified, there is evidence that orienting of attention is accompanied by the activation of oculomotor circuits. It remains unclear, however, whether this oculomotor activity is an epiphenomenon or is functionally related to the attentional process. Attentional benefits are usually measured by the classical Posner paradigm. When subjects fixate centrally and are requested to detect a visual stimulus that could appear in an attended or unattended location, they react faster to stimuli appearing in the attended one. Here, we demonstrate that in monocular vision visuospatial attention was significantly modulated by the position of the eye in the orbit. When the screen was placed 40 degrees to the right or to the left of subjects' sagittal plane, attentional benefits for stimuli appearing in subjects' temporal spatial hemifield dramatically decayed, even if the retinal stimulation was exactly the same as in the classical paradigm. The finding that eyes and attention show a common limit stop point supports their close functional coupling.     

The temporal resolution of neural codes: does response latency have a unique role?

This article reviews the nature of the neural code in non-human primate cortex and assesses the potential for neurons to carry two or more signals simultaneously. Neurophysiological recordings from visual and motor systems indicate that the evidence for a role for precisely timed spikes relative to other spike times (ca. 1-10 ms resolution) is inconclusive. This indicates that the visual system does not carry a signal that identifies whether the responses were elicited when the stimulus was attended or not. Simulations show that the absence of such a signal reduces, but does not eliminate, the increased discrimination between stimuli that are attended compared with when the stimuli are unattended. The increased accuracy asymptotes with increased gain control, indicating limited benefit from increasing attention. The absence of a signal identifying the attentional state under which stimuli were viewed can produce the greatest discrimination between attended and unattended stimuli. Furthermore, the greatest reduction in discrimination errors occurs for a limited range of gain control, again indicating that attention effects are limited. By contrast to precisely timed patterns of spikes where the timing is relative to other spikes, response latency provides a fine temporal resolution signal (ca. 10 ms resolution) that carries information that is unavailable from coarse temporal response measures. Changes in response latency and changes in response magnitude can give rise to different predictions for the patterns of reaction times. The predictions are verified, and it is shown that the standard method for distinguishing executive and slave processes is only valid if the representations of interest, as evidenced by the neural code, are known. Overall, the data indicate that the signalling evident in neural signals is restricted to the spike count and the precise times of spikes relative to stimulus onset (response latency). These coding issues have implications for our understanding of cognitive models of attention and the roles of executive and slave systems.     

Attention without awareness in blindsight.

The act of attending has frequently been equated with visual awareness. We examined this relationship in 'blindsight'--a condition in which the latter is absent or diminished as a result of damage to the primary visual cortex. Spatially selective visual attention is demonstrated when information that stimuli are likely to appear at a specific location enhances the speed or accuracy of detection of stimuli subsequently presented at that location. In a blindsight subject, we showed that attention can confer an advantage in processing stimuli presented at an attended location, without those stimuli entering consciousness. Attention could be directed both by symbolic cues in the subject's spared field of vision or cues presented in his blind field. Cues in his blind field were even effective in directing his attention to a second location remote from that at which the cue was presented. These indirect cues were effective whether or not they themselves elicited non-visual awareness. We concluded that the spatial selection of information by an attentional mechanism and its entry into conscious experience cannot be one and the same process.     

Delayed striate cortical activation during spatial attention

Recordings of event-related potentials (ERPs) and event-related magnetic fields (ERMFs) were combined with functional magnetic resonance imaging (fMRI) to study visual cortical activity in humans during spatial attention. While subjects attended selectively to stimulus arrays in one visual field, fMRI revealed stimulus-related activations in the contralateral primary visual cortex and in multiple extrastriate areas. ERP and ERMF recordings showed that attention did not affect the initial evoked response at 60-90 ms poststimulus that was localized to primary cortex, but a similarly localized late response at 140-250 ms was enhanced to attended stimuli. These findings provide evidence that the primary visual cortex participates in the selective processing of attended stimuli by means of delayed feedback from higher visual-cortical areas.     

Attentional modulation of firing rate and synchrony in a model cortical network

The response of a neuron in the visual cortex to stimuli of different contrast placed in its receptive field is commonly characterized using the contrast response curve. When attention is directed into the receptive field of a V4 neuron, its contrast response curve is shifted to lower contrast values (Reynolds et al., 2000). The neuron will thus be able to respond to weaker stimuli than it responded to without attention. Attention also increases the coherence between neurons responding to the same stimulus (Fries et al., 2001). We studied how the firing rate and synchrony of a densely interconnected cortical network varied with contrast and how they were modulated by attention. The changes in contrast and attention were modeled as changes in driving current to the network neurons. We found that an increased driving current to the excitatory neurons increased the overall firing rate of the network, whereas variation of the driving current to inhibitory neurons modulated the synchrony of the network. We explain the synchrony modulation in terms of a locking phenomenon during which the ratio of excitatory to inhibitory firing rates is approximately constant for a range of driving current values. We explored the hypothesis that contrast is represented primarily as a drive to the excitatory neurons, whereas attention corresponds to a reduction in driving current to the inhibitory neurons. Using this hypothesis, the model reproduces the following experimental observations: (1) the firing rate of the excitatory neurons increases with contrast; (2) for high contrast stimuli, the firing rate saturates and the network synchronizes; (3) attention shifts the contrast response curve to lower contrast values; (4) attention leads to stronger synchronization that starts at a lower value of the contrast compared with the attend-away condition. In addition, it predicts that attention increases the delay between the inhibitory and excitatory synchronous volleys produced by the network, allowing the stimulus to recruit more downstream neurons. Action Editor: David Golomb     

Functionally independent components of early event-related potentials in a visual spatial attention task.

Spatial visual attention modulates the first negative-going deflection in the human averaged event-related potential (ERP) in response to visual target and non-target stimuli (the N1 complex). Here we demonstrate a decomposition of N1 into functionally independent subcomponents with functionally distinct relations to task and stimulus conditions. ERPs were collected from 20 subjects in response to visual target and non-target stimuli presented at five attended and non-attended screen locations. Independent component analysis, a new method for blind source separation, was trained simultaneously on 500 ms grand average responses from all 25 stimulus-attention conditions and decomposed the non-target N1 complexes into five spatially fixed, temporally independent and physiologically plausible components. Activity of an early, laterally symmetrical component pair (N1aR and N1aL) was evoked by the left and right visual field stimuli, respectively. Component N1aR peaked ca. 9 ms earlier than N1aL. Central stimuli evoked both components with the same peak latency difference, producing a bilateral scalp distribution. The amplitudes of these components were no reliably augmented by spatial attention. Stimuli in the right visual field evoked activity in a spatio-temporally overlapping bilateral component (N1b) that peaked at ca. 180 ms and was strongly enhanced by attention. Stimuli presented at unattended locations evoked a fourth component (P2a) peaking near 240 ms. A fifth component (P3f) was evoked only by targets presented in either visual field. The distinct response patterns of these components across the array of stimulus and attention conditions suggest that they reflect activity in functionally independent brain systems involved in processing attended and unattended visuospatial events.     

Computational modelling of visual attention

Five important trends have emerged from recent work on computational models of focal visual attention that emphasize the bottom-up, image-based control of attentional deployment. First, the perceptual saliency of stimuli critically depends on the surrounding context. Second, a unique 'saliency map' that topographically encodes for stimulus conspicuity over the visual scene has proved to be an efficient and plausible bottom-up control strategy. Third, inhibition of return, the process by which the currently attended location is prevented from being attended again, is a crucial element of attentional deployment. Fourth, attention and eye movements tightly interplay, posing computational challenges with respect to the coordinate system used to control attention. And last, scene understanding and object recognition strongly constrain the selection of attended locations. Insights from these five key areas provide a framework for a computational and neurobiological understanding of visual attention.     

Attentional modulations related to spatial gating but not to allocation of limited resources in primate V1

Attention can modulate neural responses in sensory cortical areas and improve behavioral performance in perceptual tasks. However, the nature and purpose of these modulations remain under debate. Here we?used voltage-sensitive dye imaging (VSDI) to measure V1 population responses while monkeys performed a difficult detection task under focal or distributed attention. We found that V1 responses at attended locations are significantly elevated relative to actively ignored or irrelevant locations, consistent with the hypothesis that an important goal of attention in V1 is to highlight task-relevant information. Surprisingly, these modulations were indistinguishable under focal and distributed attention, suggesting a minor or no role for attention as a mechanism for allocating limited representational resources in V1. The response elevation at attended locations is additive, is widespread, and starts shortly before stimulus onset. This elevation could contribute to spatial gating by biasing competition in subsequent processing stages in favor of attended stimuli.     

Tactile-spatial and cross-modal attention effects in the second somatosensory and 7b cortical areas of rhesus monkeys

Abstract This study analyzed neuronal responses in the second somatosensory (SII) and 7b cortical areas during a selective attention task. Cues directed attention to one of three simultaneous stimuli: vibrotactile stimuli applied to mirror sites on both hands or to a similarly timed auditory tone. Two stimulus patterns appeared with equal probability for the cued stimulus: a constant amplitude sinewave or the latter with a superimposed brief amplitude pulse midway in the trial. Uncued stimuli always contained amplitude pulses. Monkeys demonstrated whether an amplitude pulse at the cued location was present or absent by making appropriately rewarded up and down foot pedal movements. Cue location and stimulus pattern varied trial-wise and pseudo-randomly. Average firing rates to vibrotactile stimuli in 82 of 181 SII cells and 13 of 22 area 7b cells differed significantly during at least one epoch for trials cued to the contralateral hand when compared to trials cued to the ipsilateral hand or auditory stimulus. Predominant were relatively suppressed firing rates during times prior to the epoch containing the amplitude pulses or enhanced activity during and after these pulses. Generally, different cells showed suppression early vs enhancement later in a trial. Analyses of the ratio between firing rates before and during the amplitude pulses suggested improved evoked signals to the amplitude pulses. The discussion considers attention as a mechanism for reducing distractions, early in the trial through suppressing these signals, or for selectively increasing response magnitudes in the cued channel, especially around times when amplitude pulses were present or absent.     

Attention Narrows Position Tuning of Population Responses in V1

When attention is directed to a region of space, visual resolution at that location flexibly adapts, becoming sharper to resolve fine-scale details or coarser to reflect large-scale texture and surface properties [1]. By what mechanism does attention improve spatial resolution? An improved signal-to-noise ratio (SNR) at the attended location contributes [2], because of retinotopically specific signal gain [3], [4], [5], [6], [7], [8], [9] and [10]. Additionally, attention could sharpen position tuning at the neural population level, so that adjacent objects activate more distinct regions of the visual cortex. A dual mechanism involving both signal gain and sharpened position tuning would be highly efficient at improving visual resolution, but there is no direct evidence that attention can narrow the position tuning of population responses. Here, we compared the spatial spread of the fMRI BOLD response for attended versus ignored stimuli. The activity produced by adjacent stimuli overlapped less when subjects were attending at their locations versus attending elsewhere, despite a stronger peak response with attention. Our results show that even as early as primary visual cortex (V1), spatially directed attention narrows the tuning of population-coded position representations.     

Shifting attention within memory representations involves early visual areas

Prior studies have shown that spatial attention modulates early visual cortex retinotopically, resulting in enhanced processing of external perceptual representations. However, it is not clear whether the same visual areas are modulated when attention is focused on, and shifted within a working memory representation. In the current fMRI study participants were asked to memorize an array containing four stimuli. After a delay, participants were presented with a verbal cue instructing them to actively maintain the location of one of the stimuli in working memory. Additionally, on a number of trials a second verbal cue instructed participants to switch attention to the location of another stimulus within the memorized representation. Results of the study showed that changes in the BOLD pattern closely followed the locus of attention within the working memory representation. A decrease in BOLD-activity (V1-V3) was observed at ROIs coding a memory location when participants switched away from this location, whereas an increase was observed when participants switched towards this location. Continuous increased activity was obtained at the memorized location when participants did not switch. This study shows that shifting attention within memory representations activates the earliest parts of visual cortex (including V1) in a retinotopic fashion. We conclude that even in the absence of visual stimulation, early visual areas support shifting of attention within memorized representations, similar to when attention is shifted in the outside world. The relationship between visual working memory and visual mental imagery is discussed in light of the current findings.     

Specific contributions of ventromedial, anterior cingulate, and lateral prefrontal cortex for attentional selection and stimulus valuation

Attentional control ensures that neuronal processes prioritize the most relevant stimulus in a given environment. Controlling which stimulus is attended thus originates from neurons encoding the relevance of stimuli, i.e. their expected value, in hand with neurons encoding contextual information about stimulus locations, features, and rules that guide the conditional allocation of attention. Here, we examined how these distinct processes are encoded and integrated in macaque prefrontal cortex (PFC) by mapping their functional topographies at the time of attentional stimulus selection. We find confined clusters of neurons in ventromedial PFC (vmPFC) that predominantly convey stimulus valuation information during attention shifts. These valuation signals were topographically largely separated from neurons predicting the stimulus location to which attention covertly shifted, and which were evident across the complete medial-to-lateral extent of the PFC, encompassing anterior cingulate cortex (ACC), and lateral PFC (LPFC). LPFC responses showed particularly early-onset selectivity and primarily facilitated attention shifts to contralateral targets. Spatial selectivity within ACC was delayed and heterogeneous, with similar proportions of facilitated and suppressed responses during contralateral attention shifts. The integration of spatial and valuation signals about attentional target stimuli was observed in a confined cluster of neurons at the intersection of vmPFC, ACC, and LPFC. These results suggest that valuation processes reflecting stimulus-specific outcome predictions are recruited during covert attentional control. Value predictions and the spatial identification of attentional targets were conveyed by largely separate neuronal populations, but were integrated locally at the intersection of three major prefrontal areas, which may constitute a functional hub within the larger attentional control network.     

A role of dopamine-dependent activity reorganizations in the cortico-basal ganglia-thalamocortical loops in visual attention (hypothetical mechanism)

A mechanism of attention is proposed according to which its influence on visual processing is switched on by release of dopamine into the striatum. A dopamine release during involuntary attention is promoted by visual activation of striatonigral cells via the thalamus and subsequent disinhibition through the basal ganglia of the superior colliculus. A dopamine release during voluntary attention is promoted by activation of prefrontal cortex. The strengthening of responses of neocortical neurons to attended stimulus, and suppression of responses to other stimuli is the result of opposite modulatory action of dopamine on the efficacy of strong and weak corticostriatal inputs. This leads to changes in the output basal ganglia signals ("attentional filter") that exert disinhibitory and inhibitory influence (via the thalamus) on neocortical cells that initially were strongly and weakly activated by a stimulus, respectively. From proposed mechanism follows, that attention modulates only those components of responses of cortical neurons which latency exceeds the latency of reactions of dopaminergic cells (80-100 ms).     

The Effects of Incidentally Learned Temporal and Spatial Predictability on Response Times and Visual Fixations during Target Detection and Discrimination

Responses are quicker to predictable stimuli than if the time and place of appearance is uncertain. Studies that manipulate target predictability often involve overt cues to speed up response times. However, less is known about whether individuals will exhibit faster response times when target predictability is embedded within the inter-trial relationships. The current research examined the combined effects of spatial and temporal target predictability on reaction time (RT) and allocation of overt attention in a sustained attention task. Participants responded as quickly as possible to stimuli while their RT and eye movements were measured. Target temporal and spatial predictability were manipulated by altering the number of: 1) different time intervals between a response and the next target; and 2) possible spatial locations of the target. The effects of target predictability on target detection (Experiment 1) and target discrimination (Experiment 2) were tested. For both experiments, shorter RTs as target predictability increased across both space and time were found. In addition, the influences of spatial and temporal target predictability on RT and the overt allocation of attention were task dependent; suggesting that effective orienting of attention relies on both spatial and temporal predictability. These results indicate that stimulus predictability can be increased without overt cues and detected purely through inter-trial relationships over the course of repeated stimulus presentations.     

Influence of Contrast and Coherence on the Temporal Dynamics of Binocular Motion Rivalry

Levelt’s four propositions (L1–L4), which characterize the relation between changes in “stimulus strength” in the two eyes and percept alternations, are considered benchmark for binocular rivalry models. It was recently demonstrated that adaptation mutual-inhibition models of binocular rivalry capture L4 only in a limited range of input strengths, predicting an increase rather than a decrease in dominance durations with increasing stimulus strength for weak stimuli. This observation challenges the validity of those models, but possibly L4 itself is invalid. So far, L1–L4 have been tested mainly by varying the contrast of static stimuli, but since binocular rivalry breaks down at low contrasts, it has been difficult to study L4. To circumvent this problem, and to test if the recent revision of L2 has more general validity, we studied changes in binocular rivalry evoked by manipulating coherence of oppositely-moving random-dot stimuli in the two eyes, and compared them against the effects of stimulus contrast. Thirteen human observers participated. Both contrast and coherence manipulations in one eye produced robust changes in both eyes; dominance durations of the eye receiving the stronger stimulus increased while those of the other eye decreased, albeit less steeply. This is inconsistent with L2 but supports its revision. When coherence was augmented in both eyes simultaneously, dominance durations first increased at low coherence, and then decreased for further increases in coherence. The same held true for the alternation periods. The initial increase in dominance durations was absent in the contrast experiments, but with coherence manipulations, rivalry could be tested at much lower stimulus strengths. Thus, we found that L4, like L2, is only valid in a limited range of stimulus strengths. Outside that range, the opposite is true. Apparent discrepancies between contrast and coherence experiments could be fully reconciled with adaptation mutual-inhibition models using a simple input transfer-function.