The role of attention in visual processing

Attention to a visual stimulus typically increases the responses of cortical neurons to that stimulus. Because many studies have shown a close relationship between the performance of individual neurons and behavioural performance of animal subjects, it is important to consider how attention affects this relationship. Measurements of behavioural and neuronal performance taken from rhesus monkeys while they performed a motion detection task with two attentional states show that attention alters the relationship between behaviour and neuronal response. Notably, attention affects the relationship differently in different cortical visual areas. This indicates that a close relationship between neuronal and behavioural performance on a given task persists over changes in attentional state only within limited regions of visual cortex.     

The dark side of visual attention

The limited capacity of neural processing restricts the number of objects and locations that can be attended to. Selected events are readily enhanced: the bright side of attention. However, such focal processing comes at a cost, namely, functional blindness for unattended events: the dark side of visual attention. Recent work has advanced our understanding of the neural mechanisms that facilitate visual processing, as well as the neural correlates of unattended, unconscious visual events. Also, new results have revealed how attentional deployment is optimized by non-visual factors such as behavioral set, past experience, and emotional salience.     

Specific contributions of ventromedial, anterior cingulate, and lateral prefrontal cortex for attentional selection and stimulus valuation

Attentional control ensures that neuronal processes prioritize the most relevant stimulus in a given environment. Controlling which stimulus is attended thus originates from neurons encoding the relevance of stimuli, i.e. their expected value, in hand with neurons encoding contextual information about stimulus locations, features, and rules that guide the conditional allocation of attention. Here, we examined how these distinct processes are encoded and integrated in macaque prefrontal cortex (PFC) by mapping their functional topographies at the time of attentional stimulus selection. We find confined clusters of neurons in ventromedial PFC (vmPFC) that predominantly convey stimulus valuation information during attention shifts. These valuation signals were topographically largely separated from neurons predicting the stimulus location to which attention covertly shifted, and which were evident across the complete medial-to-lateral extent of the PFC, encompassing anterior cingulate cortex (ACC), and lateral PFC (LPFC). LPFC responses showed particularly early-onset selectivity and primarily facilitated attention shifts to contralateral targets. Spatial selectivity within ACC was delayed and heterogeneous, with similar proportions of facilitated and suppressed responses during contralateral attention shifts. The integration of spatial and valuation signals about attentional target stimuli was observed in a confined cluster of neurons at the intersection of vmPFC, ACC, and LPFC. These results suggest that valuation processes reflecting stimulus-specific outcome predictions are recruited during covert attentional control. Value predictions and the spatial identification of attentional targets were conveyed by largely separate neuronal populations, but were integrated locally at the intersection of three major prefrontal areas, which may constitute a functional hub within the larger attentional control network.     

The Frontal Eye Fields Limit the Capacity of Visual Short-Term Memory in Rhesus Monkeys

The frontal eye fields (FEF) in rhesus monkeys have been implicated in visual short-term memory (VSTM) as well as control of visual attention. Here we examined the importance of the area in the VSTM capacity and the relationship between VSTM and attention, using the chemical inactivation technique and multi-target saccade tasks with or without the need of target-location memory. During FEF inactivation, serial saccades to targets defined by color contrast were unaffected, but saccades relying on short-term memory were impaired when the target count was at the capacity limit of VSTM. The memory impairment was specific to the FEF-coded retinotopic locations, and subject to competition among targets distributed across visual fields. These results together suggest that the FEF plays a crucial role during the entry of information into VSTM, by enabling attention deployment on targets to be remembered. In this view, the memory capacity results from the limited availability of attentional resources provided by FEF: The FEF can concurrently maintain only a limited number of activations to register the targets into memory. When lesions render part of the area unavailable for activation, the number would decrease, further reducing the capacity of VSTM.     

Computational model of excitatory/inhibitory ratio imbalance role in attention deficit disorders

Impairments in attentional behaviors, including over-selectivity, under-selectivity, distractibility and difficulty in shift of attention, are widely reported in several developmental disorders, including autism. Uncharacteristic inhibitory to excitatory neuronal number ratio (IER) and abnormal synaptic strength levels in the brain are two broadly accepted neurobiological disorders observed in autistic individuals. These neurobiological findings are contrasting and their relation to the atypical attentional behaviors is not clear yet. In this paper, we take a computational approach to investigate the relation of imbalanced IER and abnormal synaptic strength to some well-documented spectrum of attentional impairments. The computational model is based on a modified version of a biologically plausible neural model of two competing minicolumns in IT cortex augmented with a simple model of top-down attention. Top-down attention is assumed to amplify (attenuates) attended (unattended) stimulus. The inhibitory synaptic strength parameter in the model is set such that typical attentional behavior is emerged. Then, according to related findings, the parameter is changed and the model's attentional behavior is considered. The simulation results show that, without any change in top-down attention, the abnormal inhibitory synaptic strength values - and IER imbalance- result in over-selectivity, under-selectivity, distractibility and difficulty in shift of attention in the model. It suggests that the modeled neurobiological abnormalities can be accounted for the attentional deficits. In addition, the atypical attentional behaviors do not necessarily point to impairments in top-down attention. Our simulations suggest that limited changes in the inhibitory synaptic strength and variations in top-down attention signal affect the model's attentional behaviors in the same way. So, limited deficits in the inhibitory strength may be alleviated by appropriate change in top-down attention biasing. Nevertheless, our model proposes that this compensation is not possible for very high and very low values of the inhibitory strength.     

Dynamic Changes in Phase-Amplitude Coupling Facilitate Spatial Attention Control in Fronto-Parietal Cortex

Attention is a core cognitive mechanism that allows the brain to allocate limited resources depending on current task demands. A number of frontal and posterior parietal cortical areas, referred to collectively as the fronto-parietal attentional control network, are engaged during attentional allocation in both humans and non-human primates. Numerous studies have examined this network in the human brain using various neuroimaging and scalp electrophysiological techniques. However, little is known about how these frontal and parietal areas interact dynamically to produce behavior on a fine temporal (sub-second) and spatial (sub-centimeter) scale. We addressed how human fronto-parietal regions control visuospatial attention on a fine spatiotemporal scale by recording electrocorticography (ECoG) signals measured directly from subdural electrode arrays that were implanted in patients undergoing intracranial monitoring for localization of epileptic foci. Subjects (n = 8) performed a spatial-cuing task, in which they allocated visuospatial attention to either the right or left visual field and detected the appearance of a target. We found increases in high gamma (HG) power (70–250 Hz) time-locked to trial onset that remained elevated throughout the attentional allocation period over frontal, parietal, and visual areas. These HG power increases were modulated by the phase of the ongoing delta/theta (2–5 Hz) oscillation during attentional allocation. Critically, we found that the strength of this delta/theta phase-HG amplitude coupling predicted reaction times to detected targets on a trial-by-trial basis. These results highlight the role of delta/theta phase-HG amplitude coupling as a mechanism for sub-second facilitation and coordination within human fronto-parietal cortex that is guided by momentary attentional demands.     

Behavioural and ecological consequences of limited attention

Ecological research in the past few decades has shown that most animals acquire and respond adaptively to information that affects survival and reproduction. At the same time, neurobiological studies have established that the rate of information processing by the brain is much lower than the rate at which information is encountered in the environment, and that attentional mechanisms enable the brain to focus only on the most essential information at any given time. Recent integration of the ecological and neurobiological approaches helps us to understand key behaviours with broad ecological and evolutionary implications. Specifically, current data indicate that limited attention affects diet choice and constrains animals' ability simultaneously to feed and attend to predators. Recent experiments also suggest that limited attention influences social interactions, courtship and mating behaviour.     

A Neurodynamical Model of Visual Attention: Feedback Enhancement of Spatial Resolution in a Hierarchical System

Human beings have the capacity to recognize objects in natural visual scenes with high efficiency despite the complexity of such scenes, which usually contain multiple objects. One possible mechanism for dealing with this problem is selective attention. Psychophysical evidence strongly suggests that selective attention can enhance the spatial resolution in the input region corresponding to the focus of attention. In this work we adopt a computational neuroscience perspective to analyze the attentional enhancement of spatial resolution in the area containing the objects of interest. We extend and apply the computational model of Deco and Schürmann (2000), which consists of several modules with feedforward and feedback interconnections describing the mutual links between different areas of the visual cortex. Each module analyses the visual input with different spatial resolution and can be thought of as a hierarchical predictor at a given level of resolution. Moreover, each hierarchical predictor has a submodule that consists of a group of neurons performing a biologically based 2D Gabor wavelet transformation at a given resolution level. The attention control decides in which local regions the spatial resolution should be enhanced in a serial fashion. In this sense, the scene is first analyzed at a coarse resolution level, and the focus of attention enhances iteratively the resolution at the location of an object until the object is identified. We propose and simulate new psychophysical experiments where the effect of the attentional enhancement of spatial resolution can be demonstrated by predicting different reaction time profiles in visual search experiments where the target and distractors are defined at different levels of resolution.     

A Feedback Model of Attention Explains the Diverse Effects of Attention on Neural Firing Rates and Receptive Field Structure

Visual attention has many effects on neural responses, producing complex changes in firing rates, as well as modifying the structure and size of receptive fields, both in topological and feature space. Several existing models of attention suggest that these effects arise from selective modulation of neural inputs. However, anatomical and physiological observations suggest that attentional modulation targets higher levels of the visual system (such as V4 or MT) rather than input areas (such as V1). Here we propose a simple mechanism that explains how a top-down attentional modulation, falling on higher visual areas, can produce the observed effects of attention on neural responses. Our model requires only the existence of modulatory feedback connections between areas, and short-range lateral inhibition within each area. Feedback connections redistribute the top-down modulation to lower areas, which in turn alters the inputs of other higher-area cells, including those that did not receive the initial modulation. This produces firing rate modulations and receptive field shifts. Simultaneously, short-range lateral inhibition between neighboring cells produce competitive effects that are automatically scaled to receptive field size in any given area. Our model reproduces the observed attentional effects on response rates (response gain, input gain, biased competition automatically scaled to receptive field size) and receptive field structure (shifts and resizing of receptive fields both spatially and in complex feature space), without modifying model parameters. Our model also makes the novel prediction that attentional effects on response curves should shift from response gain to contrast gain as the spatial focus of attention drifts away from the studied cell.     

Separate attentional resources for vision and audition

Current models of attention, typically claim that vision and audition are limited by a common attentional resource which means that visual performance should be adversely affected by a concurrent auditory task and vice versa. Here, we test this implication by measuring auditory (pitch) and visual (contrast) thresholds in conjunction with cross-modal secondary tasks and find that no such interference occurs. Visual contrast discrimination thresholds were unaffected by a concurrent chord or pitch discrimination, and pitch-discrimination thresholds were virtually unaffected by a concurrent visual search or contrast discrimination task. However, if the dual tasks were presented within the same modality, thresholds were raised by a factor of between two (for visual discrimination) and four (for auditory discrimination). These results suggest that at least for low-level tasks such as discriminations of pitch and contrast, each sensory modality is under separate attentional control, rather than being limited by a supramodal attentional resource. This has implications for current theories of attention as well as for the use of multi-sensory media for efficient informational transmission.     

Attentional window set by expected relevance of environmental signals

The existence of an attentional window--a limited region in visual space at which attention is directed--has been invoked to explain why sudden visual onsets may or may not capture overt or covert attention. Here, we test the hypothesis that observers voluntarily control the size of this attentional window to regulate whether or not environmental signals can capture attention. We have used a novel approach to test this: participants eye-movements were tracked while they performed a search task that required dynamic gaze-shifts. During the search task, abrupt onsets were presented that cued the target positions at different levels of congruency. The participant knew these levels. We determined oculomotor capture efficiency for onsets that appeared at different viewing eccentricities. From these, we could derive the participant's attentional window size as a function of onset congruency. We find that the window was small during the presentation of low-congruency onsets, but increased monotonically in size with an increase in the expected congruency of the onsets. This indicates that the attentional window is under voluntary control and is set according to the expected relevance of environmental signals for the observer's momentary behavioral goals. Moreover, our approach provides a new and exciting method to directly measure the size of the attentional window.     

The Dynamics of Attention during Free Looking

Simple methods to study attention dynamics in challenging research and practical applications are limited. We explored the utility of examining attention dynamics during free looking with steady-state visual evoked potentials (SSVEPs), which reflect the effects of attention on early sensory processing. This method can be used with participants who cannot follow verbal instructions and patients without voluntary motor control. In our healthy participants, there were robust fluctuations in the strength of SSVEPs driven by the fixated and non-fixated stimuli (rapidly changing pictures of faces) in the seconds leading up to the moment they chose to shift their gaze to the next stimulus sequence. Furthermore, the amplitude of SSVEPs driven by the fixated stimuli predicted subsequent recognition of individual stimuli. The results illustrate how information about the temporal course of attention during free looking can be obtained with simple methods based on the attentional modulation of SSVEPs.     

Task attention facilitates learning of task-irrelevant stimuli

Attention plays a fundamental role in visual learning and memory. One highly established principle of visual attention is that the harder a central task is, the more attentional resources are used to perform the task and the smaller amount of attention is allocated to peripheral processing because of limited attention capacity. Here we show that this principle holds true in a dual-task setting but not in a paradigm of task-irrelevant perceptual learning. In Experiment 1, eight participants were asked to identify either bright or dim number targets at the screen center and to remember concurrently presented scene backgrounds. Their recognition performances for scenes paired with dim/hard targets were worse than those for scenes paired with bright/easy targets. In Experiment 2, eight participants were asked to identify either bright or dim letter targets at the screen center while a task-irrelevant coherent motion was concurrently presented in the background. After five days of training on letter identification, participants improved their motion sensitivity to the direction paired with hard/dim targets improved but not to the direction paired with easy/bright targets. Taken together, these results suggest that task-irrelevant stimuli are not subject to the attentional control mechanisms that task-relevant stimuli abide.     

Peripheral Attentional Targets under Covert Attention Lead to Paradoxically Enhanced Alpha Desynchronization in Neurofibromatosis Type 1

The limited capacity of the human brain to process the full extent of visual information reaching the visual cortex requires the recruitment of mechanisms of information selection through attention. Neurofibromatosis type-1 (NF1) is a neurodevelopmental disease often exhibiting attentional deficits and learning disabilities, and is considered to model similar impairments common in other neurodevelopmental disorders such as autism. In a previous study, we found that patients with NF1 are more prone to miss targets under overt attention conditions. This finding was interpreted as a result of increased occipito-parietal alpha oscillations. In the present study, we used electroencephalography (EEG) to study alpha power modulations and the performance of patients with NF1 in a covert attention task. Covert attention was required in order to perceive changes (target offset) of a peripherally presented stimulus. Interestingly, alpha oscillations were found to undergo greater desynchronization under this task in the NF1 group compared with control subjects. A similar pattern of desynchronization was found for beta frequencies while no changes in gamma oscillations could be identified. These results are consistent with the notion that different attentional states and task demands generate different patterns of abnormal modulation of alpha oscillatory processes in NF1. Under covert attention conditions and while target offset was reported with relatively high accuracy (over 90% correct responses), excessive desynchronization was found. These findings suggest an abnormal modulation of oscillatory activity and attentional processes in NF1. Given the known role of alpha in modulating attention, we suggest that alpha patterns can show both abnormal increases and decreases that are task and performance dependent, in a way that enhanced alpha desynchronization may reflect a compensatory mechanism to keep performance at normal levels. These results suggest that dysregulation of alpha oscillations may occur in NF1 both in terms of excessive or diminished activation patterns.     

Dissociated deficits in attentional networks in social anxiety and depression

A critical cognitive symptom that is commonly involved in social anxiety and depression is attentional deficit. However, the functional relationship between attentional deficit and these two disorders remains poorly understood. Here, we behaviorally disentangled the three key attentional components(alerting, orienting, and executive control) using the established attentional network task(ANT) to investigate how social anxiety and depression are related to deficits in these attention components. We identified a double dissociation between the symptoms of social anxiety and depression and the attentional component deficits when processing non-emotional stimuli. While individuals vulnerable to social anxiety exhibited deficits in the orienting component, individuals vulnerable to depression were impaired in the executive control component. Our findings showed that social anxiety and depression were associated with deficits in different attentional components, which are not specific to emotional information.     

Learned value magnifies salience-based attentional capture

Visual attention is captured by physically salient stimuli (termed salience-based attentional capture), and by otherwise task-irrelevant stimuli that contain goal-related features (termed contingent attentional capture). Recently, we reported that physically nonsalient stimuli associated with value through reward learning also capture attention involuntarily (Anderson, Laurent, & Yantis, PNAS, 2011). Although it is known that physical salience and goal-relatedness both influence attentional priority, it is unknown whether or how attentional capture by a salient stimulus is modulated by its associated value. Here we show that a physically salient, task-irrelevant distractor previously associated with a large reward slows visual search more than an equally salient distractor previously associated with a smaller reward. This magnification of salience-based attentional capture by learned value extinguishes over several hundred trials. These findings reveal a broad influence of learned value on involuntary attentional capture.     

Attentional load modulates responses of human primary visual cortex to invisible stimuli

Visual neuroscience has long sought to determine the extent to which stimulus-evoked activity in visual cortex depends on attention and awareness. Some influential theories of consciousness maintain that the allocation of attention is restricted to conscious representations [1, 2]. However, in the load theory of attention [3], competition between task-relevant and task-irrelevant stimuli for limited-capacity attention does not depend on conscious perception of the irrelevant stimuli. The critical test is whether the level of attentional load in a relevant task would determine unconscious neural processing of invisible stimuli. Human participants were scanned with high-field fMRI while they performed a foveal task of low or high attentional load. Irrelevant, invisible monocular stimuli were simultaneously presented peripherally and were continuously suppressed by a flashing mask in the other eye [4]. Attentional load in the foveal task strongly modulated retinotopic activity evoked in primary visual cortex (V1) by the invisible stimuli. Contrary to traditional views [1, 2, 5, 6], we found that availability of attentional capacity determines neural representations related to unconscious processing of continuously suppressed stimuli in human primary visual cortex. Spillover of attention to cortical representations of invisible stimuli (under low load) cannot be a sufficient condition for their awareness.     

Spatial Attention Is Attracted in a Sustained Fashion toward Singular Points in the Optic Flow

While a single approaching object is known to attract spatial attention, it is unknown how attention is directed when the background looms towards the observer as s/he moves forward in a quasi-stationary environment. In Experiment 1, we used a cued speeded discrimination task to quantify where and how spatial attention is directed towards the target superimposed onto a cloud of moving dots. We found that when the motion was expansive, attention was attracted towards the singular point of the optic flow (the focus of expansion, FOE) in a sustained fashion. The effects were less pronounced when the motion was contractive. The more ecologically valid the motion features became (e.g., temporal expansion of each dot, spatial depth structure implied by distribution of the size of the dots), the stronger the attentional effects. Further, the attentional effects were sustained over 1000 ms. Experiment 2 quantified these attentional effects using a change detection paradigm by zooming into or out of photographs of natural scenes. Spatial attention was attracted in a sustained manner such that change detection was facilitated or delayed depending on the location of the FOE only when the motion was expansive. Our results suggest that focal attention is strongly attracted towards singular points that signal the direction of forward ego-motion.     

AIM: A network model of attention in auditory cortex

Attentional modulation of cortical networks is critical for the cognitive flexibility required to process complex scenes. Current theoretical frameworks for attention are based almost exclusively on studies in visual cortex, where attentional effects are typically modest and excitatory. In contrast, attentional effects in auditory cortex can be large and suppressive. A theoretical framework for explaining attentional effects in auditory cortex is lacking, preventing a broader understanding of cortical mechanisms underlying attention. Here, we present a cortical network model of attention in primary auditory cortex (A1). A key mechanism in our network is attentional inhibitory modulation (AIM) of cortical inhibitory neurons. In this mechanism, top-down inhibitory neurons disinhibit bottom-up cortical circuits, a prominent circuit motif observed in sensory cortex. Our results reveal that the same underlying mechanisms in the AIM network can explain diverse attentional effects on both spatial and frequency tuning in A1. We find that a dominant effect of disinhibition on cortical tuning is suppressive, consistent with experimental observations. Functionally, the AIM network may play a key role in solving the cocktail party problem. We demonstrate how attention can guide the AIM network to monitor an acoustic scene, select a specific target, or switch to a different target, providing flexible outputs for solving the cocktail party problem.     

Acutely Elevated Cortisol in Response to Stressor Is Associated with Attentional Bias Toward Depression-Related Stimuli but Is Not Associated with Attentional Function

Cortisol induces attentional bias toward a negative stimulus and impaired attentional function. Depressed individuals have high levels of cortisol, and exhibit an attentional bias toward a depression-related stimulus and impaired processing speed and executive attention, which are components of attentional function. Therefore, the study tested the hypotheses that an acute increase in cortisol in response to a stressor is associated with attentional bias toward a depression-related stimulus and impaired processing speed and executive attention. Thirty-six participants were administered the dot-probe task for the measurement of attentional bias toward a depression-related stimulus and the Trail Making Test A and B for the measurement of processing speed and executive attention before and after a mental arithmetic task. It was revealed that attentional bias toward a depression-related stimulus following the stressor was observed only among the responders (i.e., participants with cortisol elevation in response to a stressor). On the other hand, no differences in the performance of processing speed and executive attention were noted between the responders and non-responders. The results indicate that acutely elevated cortisol is related to attentional bias, but is not related to processing speed and executive attention. The results have an implication for the etiology of depression.