A Role of Eye Vergence in Covert Attention

Covert spatial attention produces biases in perceptual and neural responses in the absence of overt orienting movements. The neural mechanism that gives rise to these effects is poorly understood. Here we report the relation between fixational eye movements, namely eye vergence, and covert attention. Visual stimuli modulate the angle of eye vergence as a function of their ability to capture attention. This illustrates the relation between eye vergence and bottom-up attention. In visual and auditory cue/no-cue paradigms, the angle of vergence is greater in the cue condition than in the no-cue condition. This shows a top-down attention component. In conclusion, observations reveal a close link between covert attention and modulation in eye vergence during eye fixation. Our study suggests a basis for the use of eye vergence as a tool for measuring attention and may provide new insights into attention and perceptual disorders.     

Covert shift of attention modulates the ongoing neural activity in a reaching area of the macaque dorsomedial visual stream

Background

Attention is used to enhance neural processing of selected parts of a visual scene. It increases neural responses to stimuli near target locations and is usually coupled to eye movements. Covert attention shifts, however, decouple the attentional focus from gaze, allowing to direct the attention to a peripheral location without moving the eyes. We tested whether covert attention shifts modulate ongoing neuronal activity in cortical area V6A, an area that provides a bridge between visual signals and arm-motor control.

Methodology/Principal Findings

We performed single cell recordings from 3 Macaca Fascicularis trained to fixate straight-head, while shifting attention outward to a peripheral cue and inward again to the fixation point. We found that neurons in V6A are influenced by spatial attention. The attentional modulation occurs without gaze shifts and cannot be explained by visual stimulations. Visual, motor, and attentional responses can occur in combination in single neurons.

Conclusions/Significance

This modulation in an area primarily involved in visuo-motor transformation for reaching may form a neural basis for coupling attention to the preparation of reaching movements. Our results show that cortical processes of attention are related not only to eye-movements, as many studies have shown, but also to arm movements, a finding that has been suggested by some previous behavioral findings. Therefore, the widely-held view that spatial attention is tightly intertwined with—and perhaps directly derived from—motor preparatory processes should be extended to a broader spectrum of motor processes than just eye movements.     

Human cortical mechanisms of visual attention during orienting and search.

Functional anatomical studies indicate that a set of neural signals in parietal and frontal cortex mediates the covert allocation of attention to visual locations across a wide variety of visual tasks. This frontoparietal network includes areas, such as the frontal eye field and supplementary eye field. This anatomical overlap suggests that shifts of attention to visual locations of objects recruit areas involved in oculomotor programming and execution. Finally, the fronto-parietal network may be the source of spatial attentional modulations in the ventral visual system during object recognition or discrimination.     

Exogenous orienting of attention depends upon the ability to execute eye movements

Shifts of attention can be made overtly by moving the eyes or covertly with attention being allocated to a region of space that does not correspond to the current direction of gaze. However, the precise relationship between eye movements and the covert orienting of attention remains controversial. The influential premotor theory proposes that the covert orienting of attention is produced by the programming of (unexecuted) eye movements and thus predicts a strong relationship between the ability to execute eye movements and the operation of spatial attention. Here, we demonstrate for the first time that impaired spatial attention is observed in an individual (AI) who is neurologically healthy but who cannot execute eye movements as a result of a congenital impairment in the elasticity of her eye muscles. This finding provides direct support for the role of the eye-movement system in the covert orienting of attention and suggests that whereas intact cortical structures may be necessary for normal attentional reflexes, they are not sufficient. The ability to move our eyes is essential for the development of normal patterns of spatial attention.     

Neuronal correlates of the set-size effect in monkey lateral intraparietal area

It has long been known that the brain is limited in the amount of sensory information that it can process at any given time. A well-known form of capacity limitation in vision is the set-size effect, whereby the time needed to find a target increases in the presence of distractors. The set-size effect implies that inputs from multiple objects interfere with each other, but the loci and mechanisms of this interference are unknown. Here we show that the set-size effect has a neural correlate in competitive visuo-visual interactions in the lateral intraparietal area, an area related to spatial attention and eye movements. Monkeys performed a covert visual search task in which they discriminated the orientation of a visual target surrounded by distractors. Neurons encoded target location, but responses associated with both target and distractors declined as a function of distractor number (set size). Firing rates associated with the target in the receptive field correlated with reaction time both within and across set sizes. The findings suggest that competitive visuo-visual interactions in areas related to spatial attention contribute to capacity limitations in visual searches.     

The Pupillary Light Response Reveals the Focus of Covert Visual Attention

The pupillary light response is often assumed to be a reflex that is not susceptible to cognitive influences. In line with recent converging evidence, we show that this reflexive view is incomplete, and that the pupillary light response is modulated by covert visual attention: Covertly attending to a bright area causes a pupillary constriction, relative to attending to a dark area under identical visual input. This attention-related modulation of the pupillary light response predicts cuing effects in behavior, and can be used as an index of how strongly participants attend to a particular location. Therefore, we suggest that pupil size may offer a new way to continuously track the focus of covert visual attention, without requiring a manual response from the participant. The theoretical implication of this finding is that the pupillary light response is neither fully reflexive, nor under complete voluntary control, but is instead best characterized as a stereotyped response to a voluntarily selected target. In this sense, the pupillary light response is similar to saccadic and smooth pursuit eye movements. Together, eye movements and the pupillary light response maximize visual acuity, stabilize visual input, and selectively filter visual information as it enters the eye.     

Covert tracking: a combined ERP and fixational eye movement study

Attention can be directed to particular spatial locations, or to objects that appear at anticipated points in time. While most work has focused on spatial or temporal attention in isolation, we investigated covert tracking of smoothly moving objects, which requires continuous coordination of both. We tested two propositions about the neural and cognitive basis of this operation: first that covert tracking is a right hemisphere function, and second that pre-motor components of the oculomotor system are responsible for driving covert spatial attention during tracking. We simultaneously recorded event related potentials (ERPs) and eye position while participants covertly tracked dots that moved leftward or rightward at 12 or 20°/s. ERPs were sensitive to the direction of target motion. Topographic development in the leftward motion was a mirror image of the rightward motion, suggesting that both hemispheres contribute equally to covert tracking. Small shifts in eye position were also lateralized according to the direction of target motion, implying covert activation of the oculomotor system. The data addresses two outstanding questions about the nature of visuospatial tracking. First, covert tracking is reliant upon a symmetrical frontoparietal attentional system, rather than being right lateralized. Second, this same system controls both pursuit eye movements and covert tracking.     

Measurements of simultaneously recorded spiking activity and local field potentials suggest that spatial selection emerges in the frontal eye field

The frontal eye field (FEF) participates in selecting the location of behaviorally relevant stimuli for guiding attention and eye movements. We simultaneously recorded local field potentials (LFPs) and spiking activity in the FEF of monkeys performing memory-guided saccade and covert visual search tasks. We compared visual latencies and the time course of spatially selective responses in LFPs and spiking activity. Consistent with the view that LFPs represent synaptic input, visual responses appeared first in the LFPs followed by visual responses in the spiking activity. However, spatially selective activity identifying the location of the target in the visual search array appeared in the spikes about 30 ms before it appeared in the LFPs. Because LFPs reflect dendritic input and spikes measure neuronal output in a local brain region, this temporal relationship suggests that spatial selection necessary for attention and eye movements is computed locally in FEF from spatially nonselective inputs.     

The neurobiology of visual attention: finding sources

The profusion of progress during the past twenty years in identifying neural correlates of selective attention within the visual system has left open the question of how visual representations are biased to favor target stimuli. Studies aimed at specifying the mechanisms that can be causally implicated in the control of visual selective attention have only recently begun in earnest. Employing both the psychophysical and the neuroanatomical data, recent neurophysiological experiments in monkeys and neuroimaging studies in humans are converging on the neural circuits that provide the source of at least some forms of attentional control signals.     

The scope and limits of top-down attention in unconscious visual processing

Attentional selection plays a critical role in conscious perception. When attention is diverted, even salient stimuli fail to reach visual awareness. Attention can be voluntarily directed to a spatial location or a visual feature for facilitating the processing of information relevant to current goals. In everyday situations, attention and awareness are tightly coupled. This has led some to suggest that attention and awareness might be based on a common neural foundation, whereas others argue that they are mediated by distinct mechanisms. A body of evidence shows that visual stimuli can be processed at multiple stages of the visual-processing streams without evoking visual awareness. To illuminate the relationship between visual attention and conscious perception, we investigated whether top-down attention can target and modulate the neural representations of unconsciously processed visual stimuli. Our experiments show that spatial attention can target only consciously perceived stimuli, whereas feature-based attention can modulate the processing of invisible stimuli. The attentional modulation of unconscious signals implies that attention and awareness can be dissociated, challenging a simplistic view of the boundary between conscious and unconscious visual processing.     

Temporal encoding of spatial information during active visual fixation

Humans and other species continually perform microscopic eye movements, even when attending to a single point. These movements, which include drifts and microsaccades, are under oculomotor control, elicit strong neural responses, and have been thought to serve important functions. The influence of these fixational eye movements on the acquisition and neural processing of visual information remains unclear. Here, we show that during viewing of natural scenes, microscopic eye movements carry out a crucial information-processing step: they remove predictable correlations in natural scenes by equalizing the spatial power of the retinal image within the frequency range of ganglion cells' peak sensitivity. This transformation, which had been attributed to center-surround receptive field organization, occurs prior to any neural processing and reveals a form of matching between the statistics of natural images and those of normal eye movements. We further show that the combined effect of microscopic eye movements and retinal receptive field organization is to convert spatial luminance discontinuities into synchronous firing events, beginning the process of edge detection. Thus, microscopic eye movements are fundamental to two goals of early visual processing: redundancy reduction and feature extraction.     

Maps of space in human frontoparietal cortex

Prefrontal cortex (PFC) and posterior parietal cortex (PPC) are neural substrates for spatial cognition. We here review studies in which we tested the hypothesis that human frontoparietal cortex may function as a priority map. According to priority map theory, objects or locations in the visual world are represented by neural activity that is proportional to their attentional priority. Using functional magnetic resonance imaging (fMRI), we first identified topographic maps in PFC and PPC as candidate priority maps of space. We then measured fMRI activity in candidate priority maps during the delay periods of a covert attention task, a spatial working memory task, and a motor planning task to test whether the activity depended on the particular spatial cognition. Our hypothesis was that some, but not all, candidate priority maps in PFC and PPC would be agnostic with regard to what was being prioritized, in that their activity would reflect the location in space across tasks rather than a particular kind of spatial cognition (e.g., covert attention). To test whether patterns of delay period activity were interchangeable during the spatial cognitive tasks, we used multivariate classifiers. We found that decoders trained to predict the locations on one task (e.g., working memory) cross-predicted the locations on the other tasks (e.g., covert attention and motor planning) in superior precentral sulcus (sPCS) and in a region of intraparietal sulcus (IPS2), suggesting that these patterns of maintenance activity may be interchangeable across the tasks. Such properties make sPCS in frontal cortex and IPS2 in parietal cortex viable priority map candidates, and suggest that these areas may be the human homologs of the monkey frontal eye field (FEF) and lateral intraparietal area (LIP).     

Possible recoding of visual space in covert orienting tasks.

Reaction time to lateralized light targets is longer if targets are preceded by light stimuli in the same visual hemifield compared to when they are preceded by light stimuli in the opposite visual hemifield. The effect is probably caused by interactions between implicit oculomotor tendencies and covert shifts of attention. We show here that a similar, but much smaller, ipsilateral RT inhibition can be observed when all stimuli are presented in a display completely lateralized to one hemifield, where ipsilateral and contralateral are defined with respect to the midpoint of the display. The persistence of ipsilateral inhibition with unilateral stimulus displays can be accounted for by a recoding of visual space predicated on the centering of covert attention on the display midpoint rather than on the fixation point. The recoding seems to affect the control of covert attention and perhaps oculomotor control as well.     

Multimodal integration for the representation of space in the posterior parietal cortex.

The posterior parietal cortex has long been considered an ''association'' area that combines information from different sensory modalities to form a cognitive representation of space. However, until recently little has been known about the neural mechanisms responsible for this important cognitive process. Recent experiments from the author''s laboratory indicate that visual, somatosensory, auditory and vestibular signals are combined in areas LIP and 7a of the posterior parietal cortex. The integration of these signals can represent the locations of stimuli with respect to the observer and within the environment. Area MSTd combines visual motion signals, similar to those generated during an observer''s movement through the environment, with eye-movement and vestibular signals. This integration appears to play a role in specifying the path on which the observer is moving. All three cortical areas combine different modalities into common spatial frames by using a gain-field mechanism. The spatial representations in areas LIP and 7a appear to be important for specifying the locations of targets for actions such as eye movements or reaching; the spatial representation within area MSTd appears to be important for navigation and the perceptual stability of motion signals.     

Visual computation and saccadic eye movements: a theoretical perspective

A simple instance of parallel computation in neural networks occurs when the eye orients to a novel visual target. Consideration of target-elicited saccadic eye movements opens the question of how spatial position is represented in the visual pathways involved in this response. It is argued that a point-for-point retinotopic coding of spatial position (the 'local sign' approach) is inadequate to account for the characteristics of the response. An alternative approach based on distributed coding is developed.     

Attention samples stimuli rhythmically

Overt exploration or sampling behaviors, such as whisking, sniffing, and saccadic eye movements, are often characterized by a rhythm. In addition, the electrophysiologically recorded theta or alpha phase predicts global detection performance. These two observations raise the intriguing possibility that covert selective attention samples from multiple stimuli rhythmically. To investigate this possibility, we measured change detection performance on two simultaneously presented stimuli, after resetting attention to one of them. After a reset flash at one stimulus location, detection performance fluctuated rhythmically. When the flash was presented in the right visual field, a 4 Hz rhythm was directly visible in the time courses of behavioral performance at both stimulus locations, and the two rhythms were in antiphase. A left visual field flash exerted only partial reset on performance and induced rhythmic fluctuation at higher frequencies (6-10 Hz). These findings show that selective attention samples multiple stimuli rhythmically, and they position spatial attention within the family of exploration behaviors.     

Effects of cholinergic enhancement on visual stimulation, spatial attention, and spatial working memory

We compared behavioral and neural effects of cholinergic enhancement between spatial attention, spatial working memory (WM), and visual control tasks, using fMRI and the anticholinesterase physostigmine. Physostigmine speeded responses nonselectively but increased accuracy selectively for attention. Physostigmine also decreased activations to visual stimulation across all tasks within primary visual cortex, increased extrastriate occipital cortex activation selectively during maintained attention and WM encoding, and decreased parietal activation selectively during maintained attention. Finally, lateralization of occipital activation as a function of the visual hemifield toward which attention or memory was directed was decreased under physostigmine. In the case of attention, this effect correlated strongly with a decrease in a behavioral measure of selective spatial processing. Our results suggest that, while cholinergic enhancement facilitates visual attention by increasing activity in extrastriate cortex generally, it accomplishes this in a manner that reduces expectation-driven selective biasing of extrastriate cortex.     

Cell-type-specific synchronization of neural activity in FEF with V4 during attention

Shifts of gaze and shifts of attention are closely linked and it is debated whether they result from the same neural mechanisms. Both processes involve the frontal eye fields (FEF), an area which is also a source of top-down feedback to area V4 during covert attention. To test the relative contributions of oculomotor and attention-related FEF signals to such feedback, we recorded simultaneously from both areas in a covert attention task and in a saccade task. In the attention task, only visual and visuomovement FEF neurons showed enhanced responses, whereas movement cells were unchanged. Importantly, visual, but not movement or visuomovement cells, showed enhanced gamma frequency synchronization with activity in V4 during attention. Within FEF, beta synchronization was increased for movement cells during attention but was suppressed in the saccade task. These findings support the idea that the attentional modulation of visual processing is not mediated by movement neurons.     

Feature-based attention in the frontal eye field and area V4 during visual search

When we search for a target in a crowded visual scene, we often use the distinguishing features of the target, such as color or shape, to guide our attention and eye movements. To investigate the neural mechanisms of feature-based attention, we simultaneously recorded neural responses in the frontal eye field (FEF) and area V4 while monkeys performed a visual search task. The responses of cells in both areas were modulated by feature attention, independent of spatial attention, and the magnitude of response enhancement was inversely correlated with the number of saccades needed to find the target. However, an analysis of the latency of sensory and attentional influences on responses suggested that V4 provides bottom-up sensory information about stimulus features, whereas the FEF provides a top-down attentional bias toward target features that modulates sensory processing in V4 and that could be used to guide the eyes to a searched-for target.     

Motor Inhibition during Overt and Covert Actions: An Electrical Neuroimaging Study

Given ample evidence for shared cortical structures involved in encoding actions, whether or not subsequently executed, a still unsolved problem is the identification of neural mechanisms of motor inhibition, preventing “covert actions” as motor imagery from being performed, in spite of the activation of the motor system. The principal aims of the present study were the evaluation of: 1) the presence in covert actions as motor imagery of putative motor inhibitory mechanisms; 2) their underlying cerebral sources; 3) their differences or similarities with respect to cerebral networks underpinning the inhibition of overt actions during a Go/NoGo task. For these purposes, we performed a high density EEG study evaluating the cerebral microstates and their related sources elicited during two types of Go/NoGo tasks, requiring the execution or withholding of an overt or a covert imagined action, respectively. Our results show for the first time the engagement during motor imagery of key nodes of a putative inhibitory network (including pre-supplementary motor area and right inferior frontal gyrus) partially overlapping with those activated for the inhibition of an overt action during the overt NoGo condition. At the same time, different patterns of temporal recruitment in these shared neural inhibitory substrates are shown, in accord with the intended overt or covert modality of action performance. The evidence that apparently divergent mechanisms such as controlled inhibition of overt actions and contingent automatic inhibition of covert actions do indeed share partially overlapping neural substrates, further challenges the rigid dichotomy between conscious, explicit, flexible and unconscious, implicit, inflexible forms of motor behavioral control.