Visuomotor origins of covert spatial attention

Covert spatial attention produces biases in perceptual performance and neural processing of behaviorally relevant stimuli in the absence of overt orienting movements. The neural mechanism that gives rise to these effects is poorly understood. This paper surveys past evidence of a relationship between oculomotor control and visual spatial attention and more recent evidence of a causal link between the control of saccadic eye movements by frontal cortex and covert visual selection. Both suggest that the mechanism of covert spatial attention emerges as a consequence of the reciprocal interactions between neural circuits primarily involved in specifying the visual properties of potential targets and those involved in specifying the movements needed to fixate them.     

Covert tracking: a combined ERP and fixational eye movement study

Attention can be directed to particular spatial locations, or to objects that appear at anticipated points in time. While most work has focused on spatial or temporal attention in isolation, we investigated covert tracking of smoothly moving objects, which requires continuous coordination of both. We tested two propositions about the neural and cognitive basis of this operation: first that covert tracking is a right hemisphere function, and second that pre-motor components of the oculomotor system are responsible for driving covert spatial attention during tracking. We simultaneously recorded event related potentials (ERPs) and eye position while participants covertly tracked dots that moved leftward or rightward at 12 or 20°/s. ERPs were sensitive to the direction of target motion. Topographic development in the leftward motion was a mirror image of the rightward motion, suggesting that both hemispheres contribute equally to covert tracking. Small shifts in eye position were also lateralized according to the direction of target motion, implying covert activation of the oculomotor system. The data addresses two outstanding questions about the nature of visuospatial tracking. First, covert tracking is reliant upon a symmetrical frontoparietal attentional system, rather than being right lateralized. Second, this same system controls both pursuit eye movements and covert tracking.     

Eye position affects orienting of visuospatial attention

The ability to detect an incoming visual stimulus is enhanced by knowledge of stimulus location (orienting of visuospatial attention). Although the brain mechanisms at the basis of this enhancement are not yet fully clarified, there is evidence that orienting of attention is accompanied by the activation of oculomotor circuits. It remains unclear, however, whether this oculomotor activity is an epiphenomenon or is functionally related to the attentional process. Attentional benefits are usually measured by the classical Posner paradigm. When subjects fixate centrally and are requested to detect a visual stimulus that could appear in an attended or unattended location, they react faster to stimuli appearing in the attended one. Here, we demonstrate that in monocular vision visuospatial attention was significantly modulated by the position of the eye in the orbit. When the screen was placed 40 degrees to the right or to the left of subjects' sagittal plane, attentional benefits for stimuli appearing in subjects' temporal spatial hemifield dramatically decayed, even if the retinal stimulation was exactly the same as in the classical paradigm. The finding that eyes and attention show a common limit stop point supports their close functional coupling.     

Use of backward masking test for the study of visual information processing in healthy subjects and schizophrenic patients

The study of 14 healthy subjects and 15 schizophrenic patients was conducted under visual backward masking conditions. Sensory thresholds were identified using the method of constant stimuli. A special modification of the backward masking technique with lateralized presentation of test and masking stimuli was used to study the lateral characteristics of visual attention. It was found that the thresholds of letter stimulus identification were significantly higher in patients with schizophrenia than in healthy subjects. Only in patients the asymmetry of visual perception was revealed with the higher recognition thresholds in the left visual hemifield. The overall data analysis suggests an association between increased recognition thresholds in schizophrenic patients and changes in the interruption mechanism functioning at the neocortex level.     

Mood modulates auditory laterality of hemodynamic mismatch responses during dichotic listening

Hemodynamic mismatch responses can be elicited by deviant stimuli in a sequence of standard stimuli even during cognitive demanding tasks. Emotional context is known to modulate lateralized processing. Right-hemispheric negative emotion processing may bias attention to the right and enhance processing of right-ear stimuli. The present study examined the influence of induced mood on lateralized pre-attentive auditory processing of dichotic stimuli using functional magnetic resonance imaging (fMRI). Faces expressing emotions (sad/happy/neutral) were presented in a blocked design while a dichotic oddball sequence with consonant-vowel (CV) syllables in an event-related design was simultaneously administered. Twenty healthy participants were instructed to feel the emotion perceived on the images and to ignore the syllables. Deviant sounds reliably activated bilateral auditory cortices and confirmed attention effects by modulation of visual activity. Sad mood induction activated visual, limbic and right prefrontal areas. A lateralization effect of emotion-attention interaction was reflected in a stronger response to right-ear deviants in the right auditory cortex during sad mood. This imbalance of resources may be a neurophysiological correlate of laterality in sad mood and depression. Conceivably, the compensatory right-hemispheric enhancement of resources elicits increased ipsilateral processing.     

The Effect of 10 Hz Repetitive Transcranial Magnetic Stimulation of Posterior Parietal Cortex on Visual Attention

Repetitive transcranial magnetic stimulation (rTMS) of the posterior parietal cortex (PPC) at frequencies lower than 5 Hz transiently inhibits the stimulated area. In healthy participants, such a protocol can induce a transient attentional bias to the visual hemifield ipsilateral to the stimulated hemisphere. This bias might be due to a relatively less active stimulated hemisphere and a relatively more active unstimulated hemisphere. In a previous study, Jin and Hilgetag (2008) tried to switch the attention bias from the hemifield ipsilateral to the hemifield contralateral to the stimulated hemisphere by applying high frequency rTMS. High frequency rTMS has been shown to excite, rather than inhibit, the stimulated brain area. However, the bias to the ipsilateral hemifield was still present. The participants’ performance decreased when stimuli were presented in the hemifield contralateral to the stimulation site. In the present study we tested if this unexpected result was related to the fact that participants were passively resting during stimulation rather than performing a task. Using a fully crossed factorial design, we compared the effects of high frequency rTMS applied during a visual detection task and high frequency rTMS during passive rest on the subsequent offline performance in the same detection task. Our results were mixed. After sham stimulation, performance was better after rest than after task. After active 10 Hz rTMS, participants’ performance was overall better after task than after rest. However, this effect did not reach statistical significance. The comparison of performance after rTMS with task and performance after sham stimulation with task showed that 10 Hz stimulation significantly improved performance in the whole visual field. Thus, although we found a trend to better performance after rTMS with task than after rTMS during rest, we could not reject the hypothesis that high frequency rTMS with task and high frequency rTMS during rest equally affect performance.     

Distractor-target interactions during directed visual attention

The spatial extent of directed visual attention (DVA) was examined in a series of experiments using precuing in a suprathreshold luminance detection (reaction time) paradigm. Previous findings (Hughes, H. C. and Zimba, L. D. J. Exp. Psychol.; Human Percept Perf., 1985, 11, 409-430) indicated that, in an empty visual field, the effects of DVA were primarily manifest as a uniform elevation of response times to all probe targets in the hemifield contralateral to the observer's expectancy. The present experiments were designed to determine whether increased spatial selectivity could be found when luminous markers indicated the exact location of the expected visual target. To maintain equivalent states of adaptation in both hemifields, luminous markers were also present at the same location in the contralateral hemifield. In general, hemifield effects were again obtained, but with two notable exceptions. First, marking locations in the unattended hemifield produced a local increase (enhanced interference) in RTs above the level characteristic of other locations within that hemifield. Second, when multiple locations were indicated with identical luminous markers, graded costs were obtained in both hemifields. However, scaling the markers according to estimates of cortical magnification factor (M) substantially reduced the slope of these inhibitory gradients, and the results once again approached those characteristic of an unstructured visual field. The findings suggest that when attention is directed to a marked location along the horizontal meridian, a transition in performance typically occurs at the vertical meridian. In addition, irrelevant stimuli some distance from the attentional focus interfere with detection times to unexpected targets that appear in the same vicinity. This interference may relate to an enhanced susceptibility to spatial interactions between the distractors and target away from the attentional focus. The interference appears to extend over a constant area of visual cortex, since it is reduced when the markers are M-scaled.     

Effect of Exogenous Cues on Covert Spatial Orienting in Deaf and Normal Hearing Individuals

Deaf individuals have been known to process visual stimuli better at the periphery compared to the normal hearing population. However, very few studies have examined attention orienting in the oculomotor domain in the deaf, particularly when targets appear at variable eccentricity. In this study, we examined if the visual perceptual processing advantage reported in the deaf people also modulates spatial attentional orienting with eye movement responses. We used a spatial cueing task with cued and uncued targets that appeared at two different eccentricities and explored attentional facilitation and inhibition. We elicited both a saccadic and a manual response. The deaf showed a higher cueing effect for the ocular responses than the normal hearing participants. However, there was no group difference for the manual responses. There was also higher facilitation at the periphery for both saccadic and manual responses, irrespective of groups. These results suggest that, owing to their superior visual processing ability, the deaf may orient attention faster to targets. We discuss the results in terms of previous studies on cueing and attentional orienting in deaf.     

Movement in the normal visual hemifield induces a percept in the 'blind' hemifield of a human hemianope.

We have investigated visual responses to moving stimuli presented to the normal hemifield of a hemianope, GY, who exhibits residual visual function in his right, ''blind'' hemifield. Preliminary experiments established that his perception of moving stimuli localized in his ''blind'' hemifield is retained when a similar stimulus is presented simultaneously in the normal hemifield. In response to a grating stimulus moving horizontally towards fixation in the non-foveal region of the normal, left hemifield, he perceives in addition to a normal motion percept in the left hemifield, a sensation of movement localized in the right hemifield. Qualitatively, this latter is indistinguishable from responses elicited by direct stimulation localized within his ''blind'' hemifield by moving stimuli. We have investigated the characteristics of the mechanisms which induce the ''blind'' field component of GY''s responses to stimulation of the normal hemifield. We show that GY''s sensitivity for detection of movement localized within his ''blind'' hemifield is dependent on the direction of movement, the contrast and the velocity of a grating presented to the normal hemifield. No induced effects were recorded in response to colour or to non-moving, flickering stimuli. We examine the possible contribution of scattered light to our observations, and eliminate this factor by consideration of our experimental results. We discuss the neural mechanisms which may be involved in this response.     

Optic Flow Stimuli in and Near the Visual Field Centre: A Group fMRI Study of Motion Sensitive Regions

Motion stimuli in one visual hemifield activate human primary visual areas of the contralateral side, but suppress activity of the corresponding ipsilateral regions. While hemifield motion is rare in everyday life, motion in both hemifields occurs regularly whenever we move. Consequently, during motion primary visual regions should simultaneously receive excitatory and inhibitory inputs. A comparison of primary and higher visual cortex activations induced by bilateral and unilateral motion stimuli is missing up to now. Many motion studies focused on the MT+ complex in the parieto-occipito-temporal cortex. In single human subjects MT+ has been subdivided in area MT, which was activated by motion stimuli in the contralateral visual field, and area MST, which responded to motion in both the contra- and ipsilateral field. In this study we investigated the cortical activation when excitatory and inhibitory inputs interfere with each other in primary visual regions and we present for the first time group results of the MT+ subregions, allowing for comparisons with the group results of other motion processing studies. Using functional magnetic resonance imaging (fMRI), we investigated whole brain activations in a large group of healthy humans by applying optic flow stimuli in and near the visual field centre and performed a second level analysis. Primary visual areas were activated exclusively by motion in the contralateral field but to our surprise not by central flow fields. Inhibitory inputs to primary visual regions appear to cancel simultaneously occurring excitatory inputs during central flow field stimulation. Within MT+ we identified two subregions. Putative area MST (pMST) was activated by ipsi- and contralateral stimulation and located in the anterior part of MT+. The second subregion was located in the more posterior part of MT+ (putative area MT, pMT).     

Sensory competition in the face processing areas of the human brain

The concurrent presentation of multiple stimuli in the visual field may trigger mutually suppressive interactions throughout the ventral visual stream. While several studies have been performed on sensory competition effects among non-face stimuli relatively little is known about the interactions in the human brain for multiple face stimuli. In the present study we analyzed the neuronal basis of sensory competition in an event-related functional magnetic resonance imaging (fMRI) study using multiple face stimuli. We varied the ratio of faces and phase-noise images within a composite display with a constant number of peripheral stimuli, thereby manipulating the competitive interactions between faces. For contralaterally presented stimuli we observed strong competition effects in the fusiform face area (FFA) bilaterally and in the right lateral occipital area (LOC), but not in the occipital face area (OFA), suggesting their different roles in sensory competition. When we increased the spatial distance among pairs of faces the magnitude of suppressive interactions was reduced in the FFA. Surprisingly, the magnitude of competition depended on the visual hemifield of the stimuli: ipsilateral stimulation reduced the competition effects somewhat in the right LOC while it increased them in the left LOC. This suggests a left hemifield dominance of sensory competition. Our results support the sensory competition theory in the processing of multiple faces and suggests that sensory competition occurs in several cortical areas in both cerebral hemispheres.     

Model approach to neurological variants of visuo-spatial neglect

Neglect is a neurological disorder of spatial attention with reduced awareness of visual stimuli in the hemifield contralateral to an acute temporo-parietal lesion mainly of the right hemisphere. There is a close association of multisensory orientation centers (MSO) and vestibular tonus imbalance. A lesion of the dominant right MSO causes a left-sided neglect due to a lack of ipsilateral activation of the visual cortex, which is further enhanced by increasing inhibition from the contralateral visual cortex. The nondominant MSO in the left hemisphere might be involved in the manifestation of the less frequent and more transient right-sided neglect and in the plastic mechanisms of gradual recovery from left-sided neglect or extinction. There is evidence that a vestibular tonus inbalance due to peripheral or central vestibular pathway lesions may also induce a neglect. In a first model approach using an attractor network and assuming that there is only one MSO in the right hemisphere, it is possible to simulate attentional shifts into a visual hemifield and to induce a neglect. The neural network model consists of four layers of neurons: retina, MSO, visual cortex V1, and superior colliculus. The superior colliculus layer is modeled as a recurrent attractor network with one inhibitory interneuron and synaptic weights chosen to implement a winner-take-all network that centers the hill of activity on the strongest input. We are well aware of the simplifications used in the conceptual drawings and the computational model, but nevertheless hope that they will serve as an inspiration for further modeling and clinical studies.     

Transfer of Learning between Hemifields in Multiple Object Tracking: Memory Reduces Constraints of Attention

Many tasks involve tracking multiple moving objects, or stimuli. Some require that individuals adapt to changing or unfamiliar conditions to be able to track well. This study explores processes involved in such adaptation through an investigation of the interaction of attention and memory during tracking. Previous research has shown that during tracking, attention operates independently to some degree in the left and right visual hemifields, due to putative anatomical constraints. It has been suggested that the degree of independence is related to the relative dominance of processes of attention versus processes of memory. Here we show that when individuals are trained to track a unique pattern of movement in one hemifield, that learning can be transferred to the opposite hemifield, without any evidence of hemifield independence. However, learning is not influenced by an explicit strategy of memorisation of brief periods of recognisable movement. The findings lend support to a role for implicit memory in overcoming putative anatomical constraints on the dynamic, distributed spatial allocation of attention involved in tracking multiple objects.     

Interhemisphere differences of extrastriate cortical activation during attention and selection of lateralized visual stimuli in humans

The cortical activation was estimated by event-related potentials (ERPs) methods during selection tasks of lateralized visual stimuli in right and left hemi-fields requiring different forms of attention: 1. Attention of a stimuli form, 2. Attention of a stimuli position, 3. Combined attention of form and position. ERPs were recorded in 15 young healthy adults in 6 leads: P3, P4, T3, T4, T5, T6 and endogenous ERPs components: CNV (contingent negative variation), N1, P3 and complex [N1--P3]. The differences between ERPs at contra- and ipsilateral stimuli in the right and left hemispheres were considered as indices of asymmetry. The asymmetry was revealed in right hemisphere in all kinds of attention forms. The level (amplitude) of right-side asymmetry was depended on the level of attention: The significant relation between the right-side asymmetry and subjects' reaction time was also revealed. It is proposed that such an asymmetry is the evidence of better spatial differentiation of visual stimuli in right hemisphere in humans.     

Cell-type-specific synchronization of neural activity in FEF with V4 during attention

Shifts of gaze and shifts of attention are closely linked and it is debated whether they result from the same neural mechanisms. Both processes involve the frontal eye fields (FEF), an area which is also a source of top-down feedback to area V4 during covert attention. To test the relative contributions of oculomotor and attention-related FEF signals to such feedback, we recorded simultaneously from both areas in a covert attention task and in a saccade task. In the attention task, only visual and visuomovement FEF neurons showed enhanced responses, whereas movement cells were unchanged. Importantly, visual, but not movement or visuomovement cells, showed enhanced gamma frequency synchronization with activity in V4 during attention. Within FEF, beta synchronization was increased for movement cells during attention but was suppressed in the saccade task. These findings support the idea that the attentional modulation of visual processing is not mediated by movement neurons.     

Saccade generation by the frontal eye fields in rhesus monkeys is separable from visual detection and bottom-up attention shift

The frontal eye fields (FEF), originally identified as an oculomotor cortex, have also been implicated in perceptual functions, such as constructing a visual saliency map and shifting visual attention. Further dissecting the area's role in the transformation from visual input to oculomotor command has been difficult because of spatial confounding between stimuli and responses and consequently between intermediate cognitive processes, such as attention shift and saccade preparation. Here we developed two tasks in which the visual stimulus and the saccade response were dissociated in space (the extended memory-guided saccade task), and bottom-up attention shift and saccade target selection were independent (the four-alternative delayed saccade task). Reversible inactivation of the FEF in rhesus monkeys disrupted, as expected, contralateral memory-guided saccades, but visual detection was demonstrated to be intact at the same field. Moreover, saccade behavior was impaired when a bottom-up shift of attention was not a prerequisite for saccade target selection, indicating that the inactivation effect was independent of the previously reported dysfunctions in bottom-up attention control. These findings underscore the motor aspect of the area's functions, especially in situations where saccades are generated by internal cognitive processes, including visual short-term memory and long-term associative memory.     

Effects of Multimodal Load on Spatial Monitoring as Revealed by ERPs

While the role of selective attention in filtering out irrelevant information has been extensively studied, its characteristics and neural underpinnings when multiple environmental stimuli have to be processed in parallel are much less known. Building upon a dual-task paradigm that induced spatial awareness deficits for contralesional hemispace in right hemisphere-damaged patients, we investigated the electrophysiological correlates of multimodal load during spatial monitoring in healthy participants. The position of appearance of briefly presented, lateralized targets had to be reported either in isolation (single task) or together with a concurrent task, visual or auditory, which recruited additional attentional resources (dual-task). This top-down manipulation of attentional load, without any change of the sensory stimulation, modulated the amplitude of the first positive ERP response (P1) and shifted its neural generators, with a suppression of the signal in the early visual areas during both visual and auditory dual tasks. Furthermore, later N2 contralateral components elicited by left targets were particularly influenced by the concurrent visual task and were related to increased activation of the supramarginal gyrus. These results suggest that the right hemisphere is particularly affected by load manipulations, and confirm its crucial role in subtending automatic orienting of spatial attention and in monitoring both hemispaces.     

Human cortical mechanisms of visual attention during orienting and search.

Functional anatomical studies indicate that a set of neural signals in parietal and frontal cortex mediates the covert allocation of attention to visual locations across a wide variety of visual tasks. This frontoparietal network includes areas, such as the frontal eye field and supplementary eye field. This anatomical overlap suggests that shifts of attention to visual locations of objects recruit areas involved in oculomotor programming and execution. Finally, the fronto-parietal network may be the source of spatial attentional modulations in the ventral visual system during object recognition or discrimination.     

Hemispheric Asymmetry in the Auditory Facilitation Effect in Dual-Stream Rapid Serial Visual Presentation Tasks

Even though auditory stimuli do not directly convey information related to visual stimuli, they often improve visual detection and identification performance. Auditory stimuli often alter visual perception depending on the reliability of the sensory input, with visual and auditory information reciprocally compensating for ambiguity in the other sensory domain. Perceptual processing is characterized by hemispheric asymmetry. While the left hemisphere is more involved in linguistic processing, the right hemisphere dominates spatial processing. In this context, we hypothesized that an auditory facilitation effect in the right visual field for the target identification task, and a similar effect would be observed in the left visual field for the target localization task. In the present study, we conducted target identification and localization tasks using a dual-stream rapid serial visual presentation. When two targets are embedded in a rapid serial visual presentation stream, the target detection or discrimination performance for the second target is generally lower than for the first target; this deficit is well known as attentional blink. Our results indicate that auditory stimuli improved target identification performance for the second target within the stream when visual stimuli were presented in the right, but not the left visual field. In contrast, auditory stimuli improved second target localization performance when visual stimuli were presented in the left visual field. An auditory facilitation effect was observed in perceptual processing, depending on the hemispheric specialization. Our results demonstrate a dissociation between the lateral visual hemifield in which a stimulus is projected and the kind of visual judgment that may benefit from the presentation of an auditory cue.     

The Pupillary Light Response Reveals the Focus of Covert Visual Attention

The pupillary light response is often assumed to be a reflex that is not susceptible to cognitive influences. In line with recent converging evidence, we show that this reflexive view is incomplete, and that the pupillary light response is modulated by covert visual attention: Covertly attending to a bright area causes a pupillary constriction, relative to attending to a dark area under identical visual input. This attention-related modulation of the pupillary light response predicts cuing effects in behavior, and can be used as an index of how strongly participants attend to a particular location. Therefore, we suggest that pupil size may offer a new way to continuously track the focus of covert visual attention, without requiring a manual response from the participant. The theoretical implication of this finding is that the pupillary light response is neither fully reflexive, nor under complete voluntary control, but is instead best characterized as a stereotyped response to a voluntarily selected target. In this sense, the pupillary light response is similar to saccadic and smooth pursuit eye movements. Together, eye movements and the pupillary light response maximize visual acuity, stabilize visual input, and selectively filter visual information as it enters the eye.