Interacting roles of attention and visual salience in V4

Attention increases the contrast gain of V4 neurons, causing them to respond to an attended stimulus as though its contrast had increased. When multiple stimuli appear within a neuron's receptive field (RF), the neuron responds primarily to the attended stimulus. This suggests that cortical cells may be "hard wired" to respond preferentially to the highest-contrast stimulus in their RF, and neural systems for attention capitalize on this mechanism by dynamically increasing the effective contrast of the stimulus that is task relevant. To test this, we varied the relative contrast of two stimuli within the recorded neurons' RFs, while the monkeys attended away to another location. Increasing the physical contrast of one stimulus caused V4 neurons to respond preferentially to that stimulus and reduced their responses to competing stimuli. When attention was directed to the lower-contrast stimulus, it partially overcame the influence of a competing, higher-contrast stimulus.     

The role of attention in visual processing

Attention to a visual stimulus typically increases the responses of cortical neurons to that stimulus. Because many studies have shown a close relationship between the performance of individual neurons and behavioural performance of animal subjects, it is important to consider how attention affects this relationship. Measurements of behavioural and neuronal performance taken from rhesus monkeys while they performed a motion detection task with two attentional states show that attention alters the relationship between behaviour and neuronal response. Notably, attention affects the relationship differently in different cortical visual areas. This indicates that a close relationship between neuronal and behavioural performance on a given task persists over changes in attentional state only within limited regions of visual cortex.     

Feature-based attention in the frontal eye field and area V4 during visual search

When we search for a target in a crowded visual scene, we often use the distinguishing features of the target, such as color or shape, to guide our attention and eye movements. To investigate the neural mechanisms of feature-based attention, we simultaneously recorded neural responses in the frontal eye field (FEF) and area V4 while monkeys performed a visual search task. The responses of cells in both areas were modulated by feature attention, independent of spatial attention, and the magnitude of response enhancement was inversely correlated with the number of saccades needed to find the target. However, an analysis of the latency of sensory and attentional influences on responses suggested that V4 provides bottom-up sensory information about stimulus features, whereas the FEF provides a top-down attentional bias toward target features that modulates sensory processing in V4 and that could be used to guide the eyes to a searched-for target.     

V1 mechanisms and some figure-ground and border effects.

V1 neurons have been observed to respond more strongly to figure than background regions. Within a figure region, the responses are usually stronger near figure boundaries (the border effect), than further inside the boundaries. Sometimes the medial axes of the figures (e.g., the vertical midline of a vertical figure strip) induce secondary, intermediate, response peaks (the medial axis effect). Related is the physiologically elusive "cross-orientation facilitation", the observation that a cell's response to a grating patch can be facilitated by an orthogonally oriented grating in the surround. Higher center feedbacks have been suggested to cause these figure-ground effects. It has been shown, using a V1 model, that the causes could be intra-cortical interactions within V1 that serve pre-attentive visual segmentation, particularly, object boundary detection. Furthermore, whereas the border effect is robust, the figure-ground effects in the interior of a figure, in particular, the medial axis effect, are by-products of the border effect and are predicted to diminish to zero for larger figures. This model prediction (of the figure size dependence) was subsequently confirmed physiologically, and supported by findings that the response modulations by texture surround do not depend on feedbacks from V2. In addition, the model explains the "cross-orientation facilitation" as caused by a dis-inhibition, to the cell responding to the center of the central grating, by the background grating. Furthermore, the elusiveness of this phenomena was accounted for by the insight that it depends critically on the size of the figure grating. The model is applied to understand some figure-ground effects and segmentation in psychophysics: in particular, that contrast discrimination threshold is lower within and at the center of a closed contour than that in the background, and that a very briefly presented vernier target can perceptually shine through a subsequently presented large grating centered at the same location.     

Activation of the human cortex during visual attention and selection

Cortical activation in visual discrimination tasks was estimated by measurement of the CNV (contingent negative variation) and N1-P3 components of visual ERPs in frontal, parietal, occipital and temporal leads recorded in 18 young healthy adults. In all investigated tasks, the maximal values of CNV and ERPa were observed in parietal regions. The estimation of cortical readiness state (CNV) is quite a useful procedure in the attention tasks because amplitude and stability of ERPs depend on preceding cortical excitability. The prevalence of parietal activation in visual attention tasks may be considered as the dominance of occipito-parietal way (stream) in human visual attention system.     

Empirical mode decomposition of field potentials from macaque V4 in visual spatial attention

Empirical mode decomposition (EMD) has recently been introduced as a local and fully data-driven technique for the analysis of non-stationary time-series. It allows the frequency and amplitude of a time-series to be evaluated with excellent time resolution. In this article we consider the application of EMD to the analysis of neuronal activity in visual cortical area V4 of a macaque monkey performing a visual spatial attention task. We show that, by virtue of EMD, field potentials can be resolved into a sum of intrinsic components with different degrees of oscillatory content. Low-frequency components in single-trial recordings contribute to the average visual evoked potential (AVEP), whereas high-frequency components do not, but are identified as gamma-band (30–90 Hz) oscillations. The magnitude of time-varying gamma activity is shown to be enhanced when the monkey attends to a visual stimulus as compared to when it is not attending to the same stimulus. Comparison with Fourier analysis shows that EMD may offer better temporal and frequency resolution. These results support the idea that the magnitude of gamma activity reflects the modulation of V4 neurons by visual spatial attention. EMD, coupled with instantaneous frequency analysis, is demonstrated to be a useful technique for the analysis of neurobiological time-series.     

Feature-based attention modulates orientation-selective responses in human visual cortex

How does feature-based attention modulate neural responses? We used adaptation to quantify the effect of feature-based attention on orientation-selective responses in human visual cortex. Observers were adapted to two superimposed oblique gratings while attending to one grating only. We measured the magnitude of attention-induced orientation-selective adaptation both psychophysically, by the behavioral tilt aftereffect, and physiologically, using fMRI response adaptation. We found evidence for orientation-selective attentional modulation of neuronal responses-a lower fMRI response for the attended than the unattended orientation-in multiple visual areas, and a significant correlation between the magnitude of the tilt aftereffect and that of fMRI response adaptation in V1, the earliest site of orientation coding. These results show that feature-based attention can selectively increase the response of neuronal subpopulations that prefer the attended feature, even when the attended and unattended features are coded in the same visual areas and share the same retinotopic location.     

Increased activity in human visual cortex during directed attention in the absence of visual stimulation

When subjects direct attention to a particular location in a visual scene, responses in the visual cortex to stimuli presented at that location are enhanced, and the suppressive influences of nearby distractors are reduced. What is the top-down signal that modulates the response to an attended versus an unattended stimulus? Here, we demonstrate increased activity related to attention in the absence of visual stimulation in extrastriate cortex when subjects covertly directed attention to a peripheral location expecting the onset of visual stimuli. Frontal and parietal areas showed a stronger signal increase during this expectation than did visual areas. The increased activity in visual cortex in the absence of visual stimulation may reflect a top-down bias of neural signals in favor of the attended location, which derives from a fronto-parietal network.     

Distribution of attention modulates salience signals in early visual cortex

Previous research has shown that the extent to which people spread attention across the visual field plays a crucial role in visual selection and the occurrence of bottom-up driven attentional capture. Consistent with previous findings, we show that when attention was diffusely distributed across the visual field while searching for a shape singleton, an irrelevant salient color singleton captured attention. However, while using the very same displays and task, no capture was observed when observers initially focused their attention at the center of the display. Using event-related fMRI, we examined the modulation of retinotopic activity related to attentional capture in early visual areas. Because the sensory display characteristics were identical in both conditions, we were able to isolate the brain activity associated with exogenous attentional capture. The results show that spreading of attention leads to increased bottom-up exogenous capture and increased activity in visual area V3 but not in V2 and V1.     

Visual attention: spotlight on the primary visual cortex.

Visual search tasks appear to involve spatially selective attention to the target, but evidence for attentional modulation in the visual area with the most precise retinotopic organization V1 has been elusive. Recent imaging studies show that spatial attention can indeed enhance visual responses in human V1.     

The role of visual experience in the development of cat striate cortex

By the third postnatal week, intrinsic developmental programs have established a framework within the cat visual system; this will be used to guide the course of subsequent experience-dependent development. Key elements in this framework are precociously mature cells in visual cortex area 17. These orientation-selective cells are predominantly first-order neurons, they are concentrated in layers IV and VI of area 17, most of them are activated monocularly, many may receive their direct excitatory input from lateral geniculate nucleus X cells, and the distribution of their preferred orientations is biased toward horizontal and vertical. Between the third and the sixth postnatal week, most of the remaining cells in area 17 develop orientation selectivity; this extension of orientation selectivity is blocked or delayed if kittens are deprived of normal patterned visual stimulation. Furthermore, exposure to a limited range of stimulus orientations can lead to an increase in the proportion of orientation-selective cells, and the range of orientation preferences that the cells acquire is restricted by the range of orientations to which the animal is exposed. This occurs with no apparent change in the physiology or morphology of intrinsically selective area 17 cells. Thus selective exposure may have its effect by influencing the connections between the intrinsically selective cells and higher-order neurons in area 17. Experience-dependent changes in the visual system may function to "fine-tune" sensory processing and thus optimize the system's response to the dominant features of the environment. This experience-dependent process could help the young animal to focus its "attention" on those features of its environment that are critical to its survival.     

Interaction between sensory and cognitive processes in visual recognition: the role of the associative areas of the cerebral cortex

Monkeys were taught to differentiate stimuli with different types of information and to perform a spatial choice. Development of Alzheimer's disease in experimental monkeys entailed a deficit of operative memory, a considerable enhancement of entropy related to correct decisions. In control monkeys, no significant changes of these characteristics occurred. In monkeys, following a bilateral removal of the sulcus principalis, the 7th field, or both, the operative memory deficit was also determined by two components. The specifics of disorders in the operative memory due to Alzheimer's disease suggest that cholinergic mechanisms determining the sensory processing differ from those involved in decision-making. The structural-functional organization of interaction between sensory and cognitive processes controlled by the motivation and attention system, is discussed.     

Feature-based attention increases the selectivity of population responses in primate visual cortex

BACKGROUND: Attending to the spatial location or to nonspatial features of visual stimuli can modulate neuronal responses in primate visual cortex. The modulation by spatial attention changes the gain of sensory neurons and strengthens the representation of attended locations without changing neuronal selectivities such as directionality, i.e., the ratio of responses to preferred and anti-preferred directions of motion. Whether feature-based attention acts in a similar manner is unknown. RESULTS: To clarify this issue, we recorded the responses of 135 direction-selective neurons in the middle temporal area (MT) of two macaques to an unattended moving random dot pattern (the distractor) positioned inside a neuron's receptive field while the animals attended to a second moving pattern positioned in the opposite hemifield. Responses to different directions of the distractor were modulated by the same factor (approximately 12%) as long as the attended direction remained unchanged. On the other hand, systematically changing the attended direction from a neuron's preferred to its anti-preferred direction caused a systematic change of the attentional modulation from an enhancement to a suppression, increasing directionality by about 20%. CONCLUSIONS: The results show that (1) feature-based attention exerts a multiplicative modulation upon neuronal responses and that the strength of this modulation depends on the similarity between the attended feature and the cell's preferred feature, in line with the feature-similarity gain model, and (2) at the level of the neuronal population, feature-based attention increases the selectivity for attended features by increasing the responses of neurons preferring this feature value while decreasing responses of neurons tuned to the opposite feature value.     

Transient attention enhances perceptual performance and FMRI response in human visual cortex

When a visual stimulus suddenly appears, it captures attention, producing a transient improvement of performance on basic visual tasks. We investigate the effect of transient attention on stimulus representations in early visual areas using rapid event-related fMRI. Participants discriminated the orientation of one of two gratings preceded or followed by a nonpredictive peripheral cue. Compared to control conditions, precueing the target location improved performance and produced a larger fMRI response in corresponding retinotopic areas. This enhancement progressively increased from striate to extrastriate areas. Control conditions indicated that the enhanced fMRI response was not due to sensory summation of cue and target signals. Thus, an uninformative precue increases both perceptual performance and the concomitant stimulus-evoked activity in early visual areas. These results provide evidence regarding the retinotopically specific neural correlate for the effects of transient attention on early vision.     

A direct projection from area V1 to area V3A of rhesus monkey visual cortex

Small cortical lesions were made in regions of the primary visual cortex (V1) representing different retinal eccentricities. It was found that, whereas all parts of V1 project to visual areas V2, V3 and the motion area of the superior temporal sulcus, only parts of V1 representing peripheral eccentricities (in excess of 30 degrees) project directly to visual area V3A.     

The role of visual attention during the acquisition of differentiation in the northern fur seal

The role of visual attention during elaboration of visual differentiation (VD) of three stimuli, each of them signaled its own instrumental reaction directed to the certain object has been studied in experiments with two males of northern fur seal. In one of the fur seals VD formed by the standard motor and food methods, for the other the "blind" assertion of stimulus field (without stimulus demonstration) was introduced during VD formation in the accidental order. The animal's orientation to the stimulus field and the absence of any reaction to the objects during 15 s was confirmed. It has been shown that in this special training of visual attention mechanism the attainment of learning criteria realizes well quicker--more than twofold.     

Visual attention mediated by biased competition in extrastriate visual cortex.

According to conventional neurobiological accounts of visual attention, attention serves to enhance extrastriate neuronal responses to a stimulus at one spatial location in the visual field. However, recent results from recordings in extrastriate cortex of monkeys suggest that any enhancing effect of attention is best understood in the context of competitive interactions among neurons representing all of the stimuli present in the visual field. These interactions can be biased in favour of behaviourally relevant stimuli as a result of many different processes, both spatial and non-spatial, and both bottom-up and top-down. The resolution of this competition results in the suppression of the neuronal representations of behaviourally irrelevant stimuli in extrastriate cortex. A main source of top-down influence may derive from neuronal systems underlying working memory.     

Color coding in the cortex: a modified approach to bottom-up visual attention

Itti and Koch’s (Vision Research 40:1489–1506, 2000) saliency-based visual attention model is a broadly accepted model that describes how attention processes are deployed in the visual cortex in a pure bottom-up strategy. This work complements their model by modifying the color feature calculation. Evidence suggests that S-cone responses are elicited in the same spatial distribution and have the same sign as responses to M-cone stimuli; these cells are tentatively referred to as red-cyan. For other cells, the S-cone input seems to be aligned with the L-cone input; these cells might be green-magenta cells. To model red-cyan and green-magenta double-opponent cells, we implement a center-surround difference approach of the aforementioned model. The resulting color maps elicited enhanced responses to color salient stimuli when compared to the classic ones at high statistical significance levels. We also show that the modified model improves the prediction of locations attended by human viewers.     

Effects of attention on the reliability of individual neurons in monkey visual cortex.

To determine the physiological mechanisms underlying the enhancement of performance by attention, we examined how attention affects the ability of isolated neurons to discriminate orientation by investigating the reliability of responses with and without attention. Recording from 262 neurons in cortical area V4 while two rhesus macaques did a delayed match-to-sample task with oriented stimuli, we found that attention did not produce detectable changes in the variability of neuronal responses but did improve the orientation discriminability of the neurons. We also found that attention did not change the relationship between burst rate and response rate. Our results are consistent with the idea that attention selects groups of neurons for a multiplicative enhancement in response strength.