Neural correlates of individual performance differences in resolving perceptual conflict

Attentional mechanisms are a crucial prerequisite to organize behavior. Most situations may be characterized by a 'competition' between salient, but irrelevant stimuli and less salient, relevant stimuli. In such situations top-down and bottom-up mechanisms interact with each other. In the present fMRI study, we examined how interindividual differences in resolving situations of perceptual conflict are reflected in brain networks mediating attentional selection. Doing so, we employed a change detection task in which subjects had to detect luminance changes in the presence and absence of competing distractors. The results show that good performers presented increased activation in the orbitofrontal cortex (BA 11), anterior cingulate (BA 25), inferior parietal lobule (BA 40) and visual areas V2 and V3 but decreased activation in BA 39. This suggests that areas mediating top-down attentional control are stronger activated in this group. Increased activity in visual areas reflects distinct neuronal enhancement relating to selective attentional mechanisms in order to solve the perceptual conflict. Opposed to good performers, brain areas activated by poor performers comprised the left inferior parietal lobule (BA 39) and fronto-parietal and visual regions were continuously deactivated, suggesting that poor performers perceive stronger conflict than good performers. Moreover, the suppression of neural activation in visual areas might indicate a strategy of poor performers to inhibit the processing of the irrelevant non-target feature. These results indicate that high sensitivity in perceptual areas and increased attentional control led to less conflict in stimulus processing and consequently to higher performance in competitive attentional selection.     

Exploring BOLD Changes during Spatial Attention in Non-Stimulated Visual Cortex

Blood oxygen level-dependent (BOLD) responses were measured in parts of primary visual cortex that represented unstimulated visual field regions at different distances from a stimulated central target location. The composition of the visual scene varied by the presence or absence of additional peripheral distracter stimuli. Bottom-up effects were assessed by comparing peripheral activity during central stimulation vs. no stimulation. Top-down effects were assessed by comparing active vs. passive conditions. In passive conditions subjects simply watched the central letter stimuli and in active conditions they had to report occurrence of pre-defined targets in a rapid serial letter stream. Onset of the central letter stream enhanced activity in V1 representations of the stimulated region. Within representations of the periphery activation decreased and finally turned into deactivation with increasing distance from the stimulated location. This pattern was most pronounced in the active conditions and during the presence of peripheral stimuli. Active search for a target did not lead to additional enhancement at areas representing the attentional focus but to a stronger deactivation in the vicinity. Suppressed neuronal activity was also found in the non distracter condition suggesting a top-down attention driven effect. Our observations suggest that BOLD signal decreases in primary visual cortex are modulated by bottom-up sensory-driven factors such as the presence of distracters in the visual field as well as by top-down attentional processes.     

Reward-Priming of Location in Visual Search

Existing visual search research has demonstrated that the receipt of reward will be beneficial for subsequent perceptual and attentional processing of features that have characterized targets, but detrimental for processing of features that have characterized irrelevant distractors. Here we report a similar effect of reward on location. Observers completed a visual search task in which they selected a target, ignored a salient distractor, and received random-magnitude reward for correct performance. Results show that when target selection garnered rewarding outcome attention is subsequently a.) primed to return to the target location, and b.) biased away from the location that was occupied by the salient, task-irrelevant distractor. These results suggest that in addition to priming features, reward acts to guide visual search by priming contextual locations of visual stimuli.     

Top-Down but Not Bottom-Up Visual Scanning is Affected in Hereditary Pure Cerebellar Ataxia

The aim of this study was to clarify the nature of visual processing deficits caused by cerebellar disorders. We studied the performance of two types of visual search (top-down visual scanning and bottom-up visual scanning) in 18 patients with pure cerebellar types of spinocerebellar degeneration (SCA6: 11; SCA31: 7). The gaze fixation position was recorded with an eye-tracking device while the subjects performed two visual search tasks in which they looked for a target Landolt figure among distractors. In the serial search task, the target was similar to the distractors and the subject had to search for the target by processing each item with top-down visual scanning. In the pop-out search task, the target and distractor were clearly discernible and the visual salience of the target allowed the subjects to detect it by bottom-up visual scanning. The saliency maps clearly showed that the serial search task required top-down visual attention and the pop-out search task required bottom-up visual attention. In the serial search task, the search time to detect the target was significantly longer in SCA patients than in normal subjects, whereas the search time in the pop-out search task was comparable between the two groups. These findings suggested that SCA patients cannot efficiently scan a target using a top-down attentional process, whereas scanning with a bottom-up attentional process is not affected. In the serial search task, the amplitude of saccades was significantly smaller in SCA patients than in normal subjects. The variability of saccade amplitude (saccadic dysmetria), number of re-fixations, and unstable fixation (nystagmus) were larger in SCA patients than in normal subjects, accounting for a substantial proportion of scattered fixations around the items. Saccadic dysmetria, re-fixation, and nystagmus may play important roles in the impaired top-down visual scanning in SCA, hampering precise visual processing of individual items.     

视觉注意与神经振荡

人脑每时每刻都要接收大量视觉信息，由于人脑加工信息的能力有限，所以在较大视野内将注意分配给相关信息，同时抑制引起注意分散的不相关信息，对执行目标导向的行为至关重要。这种对视觉信息的选择性和主动性加工以适应当前目标的过程被称作视觉注意（visual attention），且视觉注意可分为自上而下的注意与自下而上的注意两种不同功能。由于来自大脑电信号的神经振荡活动在认知加工中发挥重要作用，已有研究综述了视觉注意与神经振荡（neural oscillation）的密切关系，但并未涉及不同的注意功能与神经振荡的关系。本文系统性调查了不同注意功能与神经振荡的关系，发现额-顶区域的theta频带振荡活动反映了自上而下的认知控制，而后部脑区的theta振荡与自下而上的注意相关。顶-枕区域alpha振荡的偏侧化有助于注意分配，而alpha频带的大规模同步促成了注意对视皮层自上而下的影响。Beta振荡介导了自上而下的信息与自下而上的信息之间的互动，作为信息载体促进了视觉信息处理。Gamma振荡则可能与自上而下和自下而上的注意间整合相关。本文就视觉注意功能与神经振荡关系的研究现状展开综述，旨在揭示不同的神经振荡活动在特定的视觉注意功能中的作用。     

Increased activity in human visual cortex during directed attention in the absence of visual stimulation

When subjects direct attention to a particular location in a visual scene, responses in the visual cortex to stimuli presented at that location are enhanced, and the suppressive influences of nearby distractors are reduced. What is the top-down signal that modulates the response to an attended versus an unattended stimulus? Here, we demonstrate increased activity related to attention in the absence of visual stimulation in extrastriate cortex when subjects covertly directed attention to a peripheral location expecting the onset of visual stimuli. Frontal and parietal areas showed a stronger signal increase during this expectation than did visual areas. The increased activity in visual cortex in the absence of visual stimulation may reflect a top-down bias of neural signals in favor of the attended location, which derives from a fronto-parietal network.     

Pre-stimulus activity predicts the winner of top-down vs. bottom-up attentional selection

Our ability to process visual information is fundamentally limited. This leads to competition between sensory information that is relevant for top-down goals and sensory information that is perceptually salient, but task-irrelevant. The aim of the present study was to identify, from EEG recordings, pre-stimulus and pre-saccadic neural activity that could predict whether top-down or bottom-up processes would win the competition for attention on a trial-by-trial basis. We employed a visual search paradigm in which a lateralized low contrast target appeared alone, or with a low (i.e., non-salient) or high contrast (i.e., salient) distractor. Trials with a salient distractor were of primary interest due to the strong competition between top-down knowledge and bottom-up attentional capture. Our results demonstrated that 1) in the 1-sec pre-stimulus interval, frontal alpha (8-12 Hz) activity was higher on trials where the salient distractor captured attention and the first saccade (bottom-up win); and 2) there was a transient pre-saccadic increase in posterior-parietal alpha (7-8 Hz) activity on trials where the first saccade went to the target (top-down win). We propose that the high frontal alpha reflects a disengagement of attentional control whereas the transient posterior alpha time-locked to the saccade indicates sensory inhibition of the salient distractor and suppression of bottom-up oculomotor capture.     

A deficit in covert attention after parietal cortex inactivation in the monkey

Although the parietal cortex has been repeatedly implicated in controlling attention, the nature and importance of this contribution remain unclear. Here we show that inactivating the lateral intraparietal area in monkeys delays the detection of a visual target located in the contralateral visual field. This effect was observed using different visual scene configurations, e.g., with distractors that differ in number or that differ from the target by a conjunction of shape and color or by a single feature. Since eye movements were not allowed during the searching tasks, these results argue for an unambiguous role of the parietal cortex in the top-down control of attentional deployment in space.     

Selective attention to task-irrelevant emotional distractors is unaffected by the perceptual load associated with a foreground task

A number of studies have shown that emotionally arousing stimuli are preferentially processed in the human brain. Whether or not this preference persists under increased perceptual load associated with a task at hand remains an open question. Here we manipulated two possible determinants of the attentional selection process, perceptual load associated with a foreground task and the emotional valence of concurrently presented task-irrelevant distractors. As a direct measure of sustained attentional resource allocation in early visual cortex we used steady-state visual evoked potentials (SSVEPs) elicited by distinct flicker frequencies of task and distractor stimuli. Subjects either performed a detection (low load) or discrimination (high load) task at a centrally presented symbol stream that flickered at 8.6 Hz while task-irrelevant neutral or unpleasant pictures from the International Affective Picture System (IAPS) flickered at a frequency of 12 Hz in the background of the stream. As reflected in target detection rates and SSVEP amplitudes to both task and distractor stimuli, unpleasant relative to neutral background pictures more strongly withdrew processing resources from the foreground task. Importantly, this finding was unaffected by the factor 'load' which turned out to be a weak modulator of attentional processing in human visual cortex.     

Feature-based attention in the frontal eye field and area V4 during visual search

When we search for a target in a crowded visual scene, we often use the distinguishing features of the target, such as color or shape, to guide our attention and eye movements. To investigate the neural mechanisms of feature-based attention, we simultaneously recorded neural responses in the frontal eye field (FEF) and area V4 while monkeys performed a visual search task. The responses of cells in both areas were modulated by feature attention, independent of spatial attention, and the magnitude of response enhancement was inversely correlated with the number of saccades needed to find the target. However, an analysis of the latency of sensory and attentional influences on responses suggested that V4 provides bottom-up sensory information about stimulus features, whereas the FEF provides a top-down attentional bias toward target features that modulates sensory processing in V4 and that could be used to guide the eyes to a searched-for target.     

Neuronal correlates of the set-size effect in monkey lateral intraparietal area

It has long been known that the brain is limited in the amount of sensory information that it can process at any given time. A well-known form of capacity limitation in vision is the set-size effect, whereby the time needed to find a target increases in the presence of distractors. The set-size effect implies that inputs from multiple objects interfere with each other, but the loci and mechanisms of this interference are unknown. Here we show that the set-size effect has a neural correlate in competitive visuo-visual interactions in the lateral intraparietal area, an area related to spatial attention and eye movements. Monkeys performed a covert visual search task in which they discriminated the orientation of a visual target surrounded by distractors. Neurons encoded target location, but responses associated with both target and distractors declined as a function of distractor number (set size). Firing rates associated with the target in the receptive field correlated with reaction time both within and across set sizes. The findings suggest that competitive visuo-visual interactions in areas related to spatial attention contribute to capacity limitations in visual searches.     

Neural activities in v1 create a bottom-up saliency map

The bottom-up contribution to the allocation of exogenous attention is a saliency map, whose neural substrate is hard to identify because of possible contamination by top-down signals. We obviated this possibility using stimuli that observers could not perceive, but that nevertheless, through orientation contrast between foreground and background regions, attracted attention to improve a localized visual discrimination. When orientation contrast increased, so did the degree of attraction, and two physiological measures: the amplitude of the earliest (C1) component of the ERP, which is associated with primary visual cortex, and fMRI BOLD signals in areas V1-V4 (but not the intraparietal sulcus). Significantly, across observers, the degree of attraction correlated with the C1 amplitude and just the V1 BOLD signal. These findings strongly support the proposal that a bottom-up saliency map is created in V1, challenging the dominant view that the saliency map is generated in the parietal cortex.     

A Salient and Task-Irrelevant Collinear Structure Hurts Visual Search

Salient distractors draw our attention spontaneously, even when we intentionally want to ignore them. When this occurs, the real targets close to or overlapping with the distractors benefit from attention capture and thus are detected and discriminated more quickly. However, a puzzling opposite effect was observed in a search display with a column of vertical collinear bars presented as a task-irrelevant distractor [6]. In this case, it was harder to discriminate the targets overlapping with the salient distractor. Here we examined whether this effect originated from factors known to modulate attentional capture: (a) low probability—the probability occurrence of target location at the collinear column was much less (14%) than the rest of the display (86%), and observers might strategically direct their attention away from the collinear distractor; (b) attentional control setting—the distractor and target task interfered with each other because they shared the same continuity set in attentional task; and/or (c) lack of time to establish the optional strategy. We tested these hypotheses by (a) increasing to 60% the trials in which targets overlapped with the same collinear distractor columns, (b) replacing the target task to be connectivity-irrelevant (i.e., luminance discrimination), and (c) having our observers practice the same search task for 10 days. Our results speak against all these hypotheses and lead us to conclude that a collinear distractor impairs search at a level that is unaffected by probabilistic information, attentional setting, and learning.     

Decoding seen and attended motion directions from activity in the human visual cortex

Functional neuroimaging has successfully identified brain areas that show greater responses to visual motion and adapted responses to repeated motion directions. However, such methods have been thought to lack the sensitivity and spatial resolution to isolate direction-selective responses to individual motion stimuli. Here, we used functional magnetic resonance imaging (fMRI) and pattern classification methods to show that ensemble activity patterns in human visual cortex contain robust direction-selective information, from which it is possible to decode seen and attended motion directions. Ensemble activity in areas V1-V4 and MT+/V5 allowed us to decode which of eight possible motion directions the subject was viewing on individual stimulus blocks. Moreover, ensemble activity evoked by single motion directions could effectively predict which of two overlapping motion directions was the focus of the subject's attention and presumably dominant in perception. Our results indicate that feature-based attention can bias direction-selective population activity in multiple visual areas, including MT+/V5 and early visual areas (V1-V4), consistent with gain-modulation models of feature-based attention and theories of early attentional selection. Our approach for measuring ensemble direction selectivity may provide new opportunities to investigate relationships between attentional selection, conscious perception, and direction-selective responses in the human brain.     

Attentional load modulates responses of human primary visual cortex to invisible stimuli

Visual neuroscience has long sought to determine the extent to which stimulus-evoked activity in visual cortex depends on attention and awareness. Some influential theories of consciousness maintain that the allocation of attention is restricted to conscious representations [1, 2]. However, in the load theory of attention [3], competition between task-relevant and task-irrelevant stimuli for limited-capacity attention does not depend on conscious perception of the irrelevant stimuli. The critical test is whether the level of attentional load in a relevant task would determine unconscious neural processing of invisible stimuli. Human participants were scanned with high-field fMRI while they performed a foveal task of low or high attentional load. Irrelevant, invisible monocular stimuli were simultaneously presented peripherally and were continuously suppressed by a flashing mask in the other eye [4]. Attentional load in the foveal task strongly modulated retinotopic activity evoked in primary visual cortex (V1) by the invisible stimuli. Contrary to traditional views [1, 2, 5, 6], we found that availability of attentional capacity determines neural representations related to unconscious processing of continuously suppressed stimuli in human primary visual cortex. Spillover of attention to cortical representations of invisible stimuli (under low load) cannot be a sufficient condition for their awareness.     

Electrical Neuroimaging Reveals Timing of Attentional Control Activity in Human Brain

Voluntarily shifting attention to a location of the visual field improves the perception of events that occur there. Regions of frontal cortex are thought to provide the top-down control signal that initiates a shift of attention, but because of the temporal limitations of functional brain imaging, the timing and sequence of attentional-control operations remain unknown. We used a new analytical technique (beamformer spatial filtering) to reconstruct the anatomical sources of low-frequency brain waves in humans associated with attentional control across time. Following a signal to shift attention, control activity was seen in parietal cortex 100–200 ms before activity was seen in frontal cortex. Parietal cortex was then reactivated prior to anticipatory biasing of activity in occipital cortex. The magnitudes of early parietal activations were strongly predictive of the degree of attentional improvement in perceptual performance. These results show that parietal cortex, not frontal cortex, provides the initial signals to shift attention and indicate that top-down attentional control is not purely top down.     

Spatiotemporal Dynamics of High-Gamma Activities during a 3-Stimulus Visual Oddball Task

Although many studies have investigated the neural basis of top-down and bottom-up attention, it still requires refinement in both temporal and spatial terms. We used magnetoencephalography to investigate the spatiotemporal dynamics of high-gamma (52–100 Hz) activities during top-down and bottom-up visual attentional processes, aiming to extend the findings from functional magnetic resonance imaging and event-related potential studies. Fourteen participants performed a 3-stimulus visual oddball task, in which both infrequent non-target and target stimuli were presented. We identified high-gamma event-related synchronization in the left middle frontal gyrus, the left intraparietal sulcus, the left thalamus, and the visual areas in different time windows for the target and non-target conditions. We also found elevated imaginary coherence between the left intraparietal sulcus and the right middle frontal gyrus in the high-gamma band from 300 to 400 ms in the target condition, and between the left thalamus and the left middle frontal gyrus in theta band from 150 to 450 ms. In addition, the strength of high-gamma imaginary coherence between the left middle frontal gyrus and left intraparietal sulcus, between the left middle frontal gyrus and the right middle frontal gyrus, and the high-gamma power in the left thalamus predicted inter-subject variation in target detection response time. This source-level electrophysiological evidence enriches our understanding of bi-directional attention processes: stimulus-driven bottom-up attention orientation to a salient, but irrelevant stimulus; and top-down allocation of attentional resources to stimulus evaluation.     

Different neuroplasticity for task targets and distractors

Adult learning-induced sensory cortex plasticity results in enhanced action potential rates in neurons that have the most relevant information for the task, or those that respond strongly to one sensory stimulus but weakly to its comparison stimulus. Current theories suggest this plasticity is caused when target stimulus evoked activity is enhanced by reward signals from neuromodulatory nuclei. Prior work has found evidence suggestive of nonselective enhancement of neural responses, and suppression of responses to task distractors, but the differences in these effects between detection and discrimination have not been directly tested. Using cortical implants, we defined physiological responses in macaque somatosensory cortex during serial, matched, detection and discrimination tasks. Nonselective increases in neural responsiveness were observed during detection learning. Suppression of responses to task distractors was observed during discrimination learning, and this suppression was specific to cortical locations that sampled responses to the task distractor before learning. Changes in receptive field size were measured as the area of skin that had a significant response to a constant magnitude stimulus, and these areal changes paralleled changes in responsiveness. From before detection learning until after discrimination learning, the enduring changes were selective suppression of cortical locations responsive to task distractors, and nonselective enhancement of responsiveness at cortical locations selective for target and control skin sites. A comparison of observations in prior studies with the observed plasticity effects suggests that the non-selective response enhancement and selective suppression suffice to explain known plasticity phenomena in simple spatial tasks. This work suggests that differential responsiveness to task targets and distractors in primary sensory cortex for a simple spatial detection and discrimination task arise from nonselective increases in response over a broad cortical locus that includes the representation of the task target, and selective suppression of responses to the task distractor within this locus.     

Temporal-Spatial Neural Activation Patterns Linked to Perceptual Encoding of Emotional Salience

It is well known that we continuously filter incoming sensory information, selectively allocating attention to what is important while suppressing distracting or irrelevant information. Yet questions remain about spatiotemporal patterns of neural processes underlying attentional biases toward emotionally significant aspects of the world. One index of affectively biased attention is an emotional variant of an attentional blink (AB) paradigm, which reveals enhanced perceptual encoding for emotionally salient over neutral stimuli under conditions of limited executive attention. The present study took advantage of the high spatial and temporal resolution of magnetoencephalography (MEG) to investigate neural activation related to emotional and neutral targets in an AB task. MEG data were collected while participants performed a rapid stimulus visual presentation task in which two target stimuli were embedded in a stream of distractor words. The first target (T1) was a number and the second (T2) either an emotionally salient or neutral word. Behavioural results replicated previous findings of greater accuracy for emotionally salient than neutral T2 words. MEG source analyses showed that activation in orbitofrontal cortex, characterized by greater power in the theta and alpha bands, and dorsolateral prefrontal activation were associated with successful perceptual encoding of emotionally salient relative to neutral words. These effects were observed between 250 and 550 ms, latencies associated with discrimination of perceived from unperceived stimuli. These data suggest that important nodes of both emotional salience and frontoparietal executive systems are associated with the emotional modulation of the attentional blink.     

Spatiotopic coding of BOLD signal in human visual cortex depends on spatial attention

The neural substrate of the phenomenological experience of a stable visual world remains obscure. One possible mechanism would be to construct spatiotopic neural maps where the response is selective to the position of the stimulus in external space, rather than to retinal eccentricities, but evidence for these maps has been inconsistent. Here we show, with fMRI, that when human subjects perform concomitantly a demanding attentive task on stimuli displayed at the fovea, BOLD responses evoked by moving stimuli irrelevant to the task were mostly tuned in retinotopic coordinates. However, under more unconstrained conditions, where subjects could attend easily to the motion stimuli, BOLD responses were tuned not in retinal but in external coordinates (spatiotopic selectivity) in many visual areas, including MT, MST, LO and V6, agreeing with our previous fMRI study. These results indicate that spatial attention may play an important role in mediating spatiotopic selectivity.