Express Attentional Re-Engagement but Delayed Entry into Consciousness Following Invalid Spatial Cues in Visual Search

Background

In predictive spatial cueing studies, reaction times (RT) are shorter for targets appearing at cued locations (valid trials) than at other locations (invalid trials). An increase in the amplitude of early P1 and/or N1 event-related potential (ERP) components is also present for items appearing at cued locations, reflecting early attentional sensory gain control mechanisms. However, it is still unknown at which stage in the processing stream these early amplitude effects are translated into latency effects.

Methodology/Principal Findings

Here, we measured the latency of two ERP components, the N2pc and the sustained posterior contralateral negativity (SPCN), to evaluate whether visual selection (as indexed by the N2pc) and visual-short term memory processes (as indexed by the SPCN) are delayed in invalid trials compared to valid trials. The P1 was larger contralateral to the cued side, indicating that attention was deployed to the cued location prior to the target onset. Despite these early amplitude effects, the N2pc onset latency was unaffected by cue validity, indicating an express, quasi-instantaneous re-engagement of attention in invalid trials. In contrast, latency effects were observed for the SPCN, and these were correlated to the RT effect.

Conclusions/Significance

Results show that latency differences that could explain the RT cueing effects must occur after visual selection processes giving rise to the N2pc, but at or before transfer in visual short-term memory, as reflected by the SPCN, at least in discrimination tasks in which the target is presented concurrently with at least one distractor. Given that the SPCN was previously associated to conscious report, these results further show that entry into consciousness is delayed following invalid cues.     

Effects on discrimination performance of selective attention to tactile features

This study examined selective attention to tactile dimensions by combining a selective cueing paradigm with a test of integrality. In Experiment 1, subjects selectively attended to changes in the frequency or duration of pairs of vibrotactile stimuli and identified the higher frequency or longer duration stimulus. In Experiment 2, using surface gratings in an identical experimental procedure, subjects identified the rougher or longer duration stimulus. In both experiments, greater performance accuracy was found on trials where the cue correctly (valid) predicted the changing dimension, vs incorrectly (invalid) cued or no-cue (neutral) trials. More errors on the invalidly vs neutrally cued trials show the cost of focal attention. Increases in performance on validly vs neutrally cued trials show a benefit of filtering irrelevant stimuli in the cued conditions. Results effectively demonstrate focal attention to tactile features. Tests of integrality, in terms of the effects of correlated change in both dimensions, showed no redundancy gain for either vibrotactile or grating tasks, suggesting that frequency and roughness are separable from stimulus duration. Interference of negative correlated change for frequency but not roughness discriminations may be explained by differences in task difficulty.     

Effects on discrimination performance of selective attention to tactile features

This study examined selective attention to tactile dimensions by combining a selective cueing paradigm with a test of integrality. In Experiment 1, subjects selectively attended to changes in the frequency or duration of pairs of vibrotactile stimuli and identified the higher frequency or longer duration stimulus. In Experiment 2, using surface gratings in an identical experimental procedure, subjects identified the rougher or longer duration stimulus. In both experiments, greater performance accuracy was found on trials where the cue correctly (valid) predicted the changing dimension, vs incorrectly (invalid) cued or no-cue (neutral) trials. More errors on the invalidly vs neutrally cued trials show the cost of focal attention. Increases in performance on validly vs neutrally cued trials show a benefit of filtering irrelevant stimuli in the cued conditions. Results effectively demonstrate focal attention to tactile features. Tests of integrality, in terms of the effects of correlated change in both dimensions, showed no redundancy gain for either vibrotactile or grating tasks, suggesting that frequency and roughness are separable from stimulus duration. Interference of negative correlated change for frequency but not roughness discriminations may be explained by differences in task difficulty.     

How Prevalent Is Object-Based Attention?

Previous research suggests that visual attention can be allocated to locations in space (space-based attention) and to objects (object-based attention). The cueing effects associated with space-based attention tend to be large and are found consistently across experiments. Object-based attention effects, however, are small and found less consistently across experiments. In three experiments we address the possibility that variability in object-based attention effects across studies reflects low incidence of such effects at the level of individual subjects. Experiment 1 measured space-based and object-based cueing effects for horizontal and vertical rectangles in 60 subjects comparing commonly used target detection and discrimination tasks. In Experiment 2 we ran another 120 subjects in a target discrimination task in which rectangle orientation varied between subjects. Using parametric statistical methods, we found object-based effects only for horizontal rectangles. Bootstrapping methods were used to measure effects in individual subjects. Significant space-based cueing effects were found in nearly all subjects in both experiments, across tasks and rectangle orientations. However, only a small number of subjects exhibited significant object-based cueing effects. Experiment 3 measured only object-based attention effects using another common paradigm and again, using bootstrapping, we found only a small number of subjects that exhibited significant object-based cueing effects. Our results show that object-based effects are more prevalent for horizontal rectangles, which is in accordance with the theory that attention may be allocated more easily along the horizontal meridian. The fact that so few individuals exhibit a significant object-based cueing effect presumably is why previous studies of this effect might have yielded inconsistent results. The results from the current study highlight the importance of considering individual subject data in addition to commonly used statistical methods.     

Effect of Exogenous Cues on Covert Spatial Orienting in Deaf and Normal Hearing Individuals

Deaf individuals have been known to process visual stimuli better at the periphery compared to the normal hearing population. However, very few studies have examined attention orienting in the oculomotor domain in the deaf, particularly when targets appear at variable eccentricity. In this study, we examined if the visual perceptual processing advantage reported in the deaf people also modulates spatial attentional orienting with eye movement responses. We used a spatial cueing task with cued and uncued targets that appeared at two different eccentricities and explored attentional facilitation and inhibition. We elicited both a saccadic and a manual response. The deaf showed a higher cueing effect for the ocular responses than the normal hearing participants. However, there was no group difference for the manual responses. There was also higher facilitation at the periphery for both saccadic and manual responses, irrespective of groups. These results suggest that, owing to their superior visual processing ability, the deaf may orient attention faster to targets. We discuss the results in terms of previous studies on cueing and attentional orienting in deaf.     

Spatial Attention Is Attracted in a Sustained Fashion toward Singular Points in the Optic Flow

While a single approaching object is known to attract spatial attention, it is unknown how attention is directed when the background looms towards the observer as s/he moves forward in a quasi-stationary environment. In Experiment 1, we used a cued speeded discrimination task to quantify where and how spatial attention is directed towards the target superimposed onto a cloud of moving dots. We found that when the motion was expansive, attention was attracted towards the singular point of the optic flow (the focus of expansion, FOE) in a sustained fashion. The effects were less pronounced when the motion was contractive. The more ecologically valid the motion features became (e.g., temporal expansion of each dot, spatial depth structure implied by distribution of the size of the dots), the stronger the attentional effects. Further, the attentional effects were sustained over 1000 ms. Experiment 2 quantified these attentional effects using a change detection paradigm by zooming into or out of photographs of natural scenes. Spatial attention was attracted in a sustained manner such that change detection was facilitated or delayed depending on the location of the FOE only when the motion was expansive. Our results suggest that focal attention is strongly attracted towards singular points that signal the direction of forward ego-motion.     

Target cueing provides support for target- and resource-based models of the attentional blink

The attentional blink (AB) describes a time-based deficit in processing the second of two masked targets. The AB is attenuated if successive targets appear between the first and final target, or if a cueing target is positioned before the final target. Using various speeds of stimulus presentation, the current study employed successive targets and cueing targets to confirm and extend an understanding of target-target cueing in the AB. In Experiment 1, three targets were presented sequentially at rates of 30 msec/item or 90 msec/item. Successive targets presented at 90 msec improved performance compared with non-successive targets. However, accuracy was equivalently high for successive and non-successive targets presented at 30 msec/item, suggesting that--regardless of whether they occurred consecutively--those items fell within the temporally defined attentional window initiated by the first target. Using four different presentation speeds, Experiment 2 confirmed the time-based definition of the AB and the success of target-cueing at 30 msec/item. This experiment additionally revealed that cueing was most effective when resources were not devoted to the cue, thereby implicating capacity limitations in the AB. Across both experiments, a novel order-error measure suggested that errors tend to decrease with an increasing duration between the targets, but also revealed that certain stimulus conditions result in stable order accuracy. Overall, the results are best encapsulated by target-based and resource-sharing theories of the AB, which collectively value the contributions of capacity limitations and optimizing transient attention in time.     

Visual Benefits in Apparent Motion Displays: Automatically Driven Spatial and Temporal Anticipation Are Partially Dissociated

Many behaviourally relevant sensory events such as motion stimuli and speech have an intrinsic spatio-temporal structure. This will engage intentional and most likely unintentional (automatic) prediction mechanisms enhancing the perception of upcoming stimuli in the event stream. Here we sought to probe the anticipatory processes that are automatically driven by rhythmic input streams in terms of their spatial and temporal components. To this end, we employed an apparent visual motion paradigm testing the effects of pre-target motion on lateralized visual target discrimination. The motion stimuli either moved towards or away from peripheral target positions (valid vs. invalid spatial motion cueing) at a rhythmic or arrhythmic pace (valid vs. invalid temporal motion cueing). Crucially, we emphasized automatic motion-induced anticipatory processes by rendering the motion stimuli non-predictive of upcoming target position (by design) and task-irrelevant (by instruction), and by creating instead endogenous (orthogonal) expectations using symbolic cueing. Our data revealed that the apparent motion cues automatically engaged both spatial and temporal anticipatory processes, but that these processes were dissociated. We further found evidence for lateralisation of anticipatory temporal but not spatial processes. This indicates that distinct mechanisms may drive automatic spatial and temporal extrapolation of upcoming events from rhythmic event streams. This contrasts with previous findings that instead suggest an interaction between spatial and temporal attention processes when endogenously driven. Our results further highlight the need for isolating intentional from unintentional processes for better understanding the various anticipatory mechanisms engaged in processing behaviourally relevant stimuli with predictable spatio-temporal structure such as motion and speech.     

What Happens in Between? Human Oscillatory Brain Activity Related to Crossmodal Spatial Cueing

Previous studies investigated the effects of crossmodal spatial attention by comparing the responses to validly versus invalidly cued target stimuli. Dynamics of cortical rhythms in the time interval between cue and target might contribute to cue effects on performance. Here, we studied the influence of spatial attention on ongoing oscillatory brain activity in the interval between cue and target onset. In a first experiment, subjects underwent periods of tactile stimulation (cue) followed by visual stimulation (target) in a spatial cueing task as well as tactile stimulation as a control. In a second experiment, cue validity was modified to be 50%, 75%, or else 25%, to separate effects of exogenous shifts of attention caused by tactile stimuli from that of endogenous shifts. Tactile stimuli produced: 1) a stronger lateralization of the sensorimotor beta-rhythm rebound (15-22 Hz) after tactile stimuli serving as cues versus not serving as cues; 2) a suppression of the occipital alpha-rhythm (7-13 Hz) appearing only in the cueing task (this suppression was stronger contralateral to the endogenously attended side and was predictive of behavioral success); 3) an increase of prefrontal gamma-activity (25-35 Hz) specifically in the cueing task. We measured cue-related modulations of cortical rhythms which may accompany crossmodal spatial attention, expectation or decision, and therefore contribute to cue validity effects. The clearly lateralized alpha suppression after tactile cues in our data indicates its dependence on endogenous rather than exogenous shifts of visuo-spatial attention following a cue independent of its modality.     

Complex backgrounds delay low-load visual search

Past research has shown, separately, that endogenous location cues and high perceptual load search tasks increase the specificity of attentional deployment to task-relevant regions of the visual field, while complex task-irrelevant backgrounds greatly resembling task-relevant stimuli reduce it. Here, we investigated in the same study whether the perceptual load created by an endogenously cued set of task-relevant stimuli determines whether a surrounding complex background of similar task-irrelevant stimuli would interfere with search. Our results show that high perceptual load protects against interference from a complex background of similar but task-irrelevant stimuli, situated just beyond the boundaries of the task-relevant set. Furthermore, our findings demonstrate that search characteristics do not change when the relevant set is restricted attentionally to a smaller delineated area, even in the presence of a background. Finally, we found that the efficacy of endogenous location cueing is not dependent on the type of search task that occurs in the cued area. Our findings also reveal that alternative attention-directing strategies, such as guided search and signal detection, may be employed in such tasks in the absence of endogenous location cueing.     

Stay Tuned: What Is Special About Not Shifting Attention?

Background

When studying attentional orienting processes, brain activity elicited by symbolic cue is usually compared to a neutral condition in which no information is provided about the upcoming target location. It is generally assumed that when a neutral cue is provided, participants do not shift their attention. The present study sought to validate this assumption. We further investigated whether anticipated task demands had an impact on brain activity related to processing symbolic cues.

Methodology/Principal Findings

Two experiments were conducted, during which event-related potentials were elicited by symbolic cues that instructed participants to shift their attention to a particular location on a computer screen. In Experiment 1, attention shift-inducing cues were compared to non-informative cues, while in both conditions participants were required to detect target stimuli that were subsequently presented at peripheral locations. In Experiment 2, a non-ambiguous “stay-central” cue that explicitly required participants not to shift their attention was used instead. In the latter case, target stimuli that followed a stay-central cue were also presented at a central location. Both experiments revealed enlarged early latency contralateral ERP components to shift-inducing cues compared to those elicited by either non-informative (exp. 1) or stay-central cues (exp. 2). In addition, cueing effects were modulated by the anticipated difficulty of the upcoming target, particularly so in Experiment 2. A positive difference, predominantly over the posterior contralateral scalp areas, could be observed for stay-central cues, especially for those predicting that the upcoming target would be easy. This effect was not present for non-informative cues.

Conclusions/Significance

We interpret our result in terms of a more rapid engagement of attention occurring in the presence of a more predictive instruction (i.e. stay-central easy target). Our results indicate that the human brain is capable of very rapidly identifying the difference between different types of instructions.     

Modulation of backward pattern masking by focal visual attention

The effect of focal visual attention on backward pattern masking was investigated using an orientation discrimination task. The results show that attention reduces primarily the effect of interruption masking, the later component of pattern masking, which occurs when the delay between the target and mask onset is about 50-150 ms. The strongest spatial cueing effect, i.e. the strongest reduction of the orientation discrimination threshold due to focal attention, was observed at intermediate (approximately 100 ms) target-to-mask stimulus onset asynchrony (SOA). There was a weak effect of cueing at shorter SOAs, and no or a very weak attentional effect was present at longer target-to-mask SOAs, where the pattern masking effect is absent. The dynamics of attentional modulation of backward pattern masking correlates closely with the dynamics of the attentional modulation of neuronal responses in the early visual cortex.     

Race Guides Attention in Visual Search

It is known that faces are rapidly and even unconsciously categorized into social groups (black vs. white, male vs. female). Here, I test whether preferences for specific social groups guide attention, using a visual search paradigm. In Experiment 1 participants searched displays of neutral faces for an angry or frightened target face. Black target faces were detected more efficiently than white targets, indicating that black faces attracted more attention. Experiment 2 showed that attention differences between black and white faces were correlated with individual differences in automatic race preference. In Experiment 3, using happy target faces, the attentional preference for black over white faces was eliminated. Taken together, these results suggest that automatic preferences for social groups guide attention to individuals from negatively valenced groups, when people are searching for a negative emotion such as anger or fear.     

Attention to surfaces modulates motion processing in extrastriate area MT

In the visual system, early atomized representations are grouped into higher-level entities through processes of perceptual organization. Here we present neurophysiological evidence that a representation of a simple object, a surface defined by color and motion, can be the unit of attentional selection at an early stage of visual processing. Monkeys were cued by the color of a fixation spot to attend to one of two transparent random-dot surfaces, one red and one green, which occupied the same region of space. Motion of the attended surface drove neurons in the middle temporal (MT) visual area more strongly than physically identical motion of the non-attended surface, even though both occurred within the spotlight of attention. Surface-based effects of attention persisted even without differential surface coloring, but attentional modulation was stronger with color. These results show that attention can select surface representations to modulate visual processing as early as cortical area MT.     

Attentional window set by expected relevance of environmental signals

The existence of an attentional window--a limited region in visual space at which attention is directed--has been invoked to explain why sudden visual onsets may or may not capture overt or covert attention. Here, we test the hypothesis that observers voluntarily control the size of this attentional window to regulate whether or not environmental signals can capture attention. We have used a novel approach to test this: participants eye-movements were tracked while they performed a search task that required dynamic gaze-shifts. During the search task, abrupt onsets were presented that cued the target positions at different levels of congruency. The participant knew these levels. We determined oculomotor capture efficiency for onsets that appeared at different viewing eccentricities. From these, we could derive the participant's attentional window size as a function of onset congruency. We find that the window was small during the presentation of low-congruency onsets, but increased monotonically in size with an increase in the expected congruency of the onsets. This indicates that the attentional window is under voluntary control and is set according to the expected relevance of environmental signals for the observer's momentary behavioral goals. Moreover, our approach provides a new and exciting method to directly measure the size of the attentional window.     

Spatial cueing,sensory gating and selective response preparation: an ERP study on visuo-spatial orienting

Event-related brain potentials (ERPs) were recorded in a visuo-spatial attention task where the position of an imperative stimulus was indicated either validly or invalidly by a central arrow (trial-by-trial cueing). Subjects had to perform choice RT tasks with the response being dependent either on the identity of the target stimulus or on its position. When target identity was relevant for response selection, validly cued stimuli elicited amplitude enhancements of the early, sensory-evoked P1 and N1 components at lateral posterior sites. The N1 validity effect was limited to scalp sites ipsilateral to the visual field of stimulus presentation. Although these effects were found only when the sensory discrimination task was considerably difficult, they are in line with models assuming that modulations of sensory-perceptual processing (“sensory gating”) are induced by spatial cueing. However, when target location was response-relevant, N1 amplitude enhancements were consistently elicited by invalidly cued letters.CNV and LRP measures indicated that the arrow elicited response-related processing in the cue-target interval. Such processes occurred even when the cue contained no information about an upcoming response. Two consecutive lateralization phases were distinguishable in the LRP, with experimentally induced response assignments becoming effective only during the second phase.     

Mislocalization of visual stimuli: independent effects of static and dynamic attention

Shifts of visual attention cause systematic distortions of the perceived locations of visual objects around the focus of attention. In the attention repulsion effect, the perceived location of a visual target is shifted away from an attention-attracting cue when the cue is presented before the target. Recently it has been found that, if the visual cue is presented after the target, the perceived location of the target shifts toward the location of the following cue. One unanswered question is whether a single mechanism underlies both attentional repulsion and attraction effects. We presented participants with two disks at diagonal locations as visual cues and two vertical lines as targets. Participants were asked to perform a forced-choice task to judge targets' positions. The present study examined whether the magnitude of the repulsion effect and the attraction effect would differ (Experiment 1), whether the two effects would interact (Experiment 2), and whether the location or the dynamic shift of attentional focus would determine the distortions effects (Experiment 3). The results showed that the effect size of the attraction effect was slightly larger than the repulsion effect and the preceding and following cues have independent influences on the perceived positions. The repulsion effect was caused by the location of attnetion and the attraction effect was due to the dynamic shift of attentional focus, suggesting that the underlying mechanisms for the retrospective attraction effect might be different from those for the repulsion effect.     

The Impact of Perceived Social Power and Dangerous Context on Social Attention

Past research has shown that position in a social hierarchy modulates one''s social attention, as in the gaze cueing effect. While studies have manipulated the social status of others with whom the participants interact, we believe that a sense of one''s own social power is also a crucial factor affecting gaze following. In two experiments, we primed the social power of participants, using different approaches, to investigate the participants'' performance in a subsequent gaze cueing task. The results of Experiment 1 showed a stronger gaze cueing effect among participants who were primed with low social power, compared to those primed with high social power. Our predicted gender difference (i.e., women showing a stronger gaze cueing effect than men) was confirmed and this effect was found to be dominated by the lower social power condition. Experiment 2 manipulated the level of danger in the context and replicated the joint impact of gender and one''s perceived social power on gaze cueing effect, especially in the low danger context, in comparison to the high danger context. These findings demonstrate that one''s perceived social power has a concerted effect on social attention evoked by gaze, along with other factors such as gender and characteristics of the environment, and suggest the importance of further research on the complex relationship between an individual''s position in the social hierarchy and social attention.     

The Effect of Perspective on Presence and Space Perception

In this paper we report two experiments in which the effect of perspective projection on presence and space perception was investigated. In Experiment 1, participants were asked to score a presence questionnaire when looking at a virtual classroom. We manipulated the vantage point, the viewing mode (binocular versus monocular viewing), the display device/screen size (projector versus TV) and the center of projection. At the end of each session of Experiment 1, participants were asked to set their preferred center of projection such that the image seemed most natural to them. In Experiment 2, participants were asked to draw a floor plan of the virtual classroom. The results show that field of view, viewing mode, the center of projection and display all significantly affect presence and the perceived layout of the virtual environment. We found a significant linear relationship between presence and perceived layout of the virtual classroom, and between the preferred center of projection and perceived layout. The results indicate that the way in which virtual worlds are presented is critical for the level of experienced presence. The results also suggest that people ignore veridicality and they experience a higher level of presence while viewing elongated virtual environments compared to viewing the original intended shape.     

Behavioural dissociation between exogenous and endogenous temporal orienting of attention

BACKGROUND: In the current study we compared the effects of temporal orienting of attention based on predictions carried by the intrinsic temporal structure of events (rhythm) and by instructive symbolic cues; and tested the degree of cognitive, strategic control that could be exerted over each type of temporal expectation. The experiments tested whether the distinction between exogenous and endogenous orienting made in spatial attention may extend to the temporal domain. TASK DESIGN AND MAIN RESULTS: In this task, a ball moved across the screen in discrete steps and disappeared temporarily under an occluding band. Participants were required to make a perceptual discrimination on the target upon its reappearance. The regularity of the speed (rhythmic cue) or colour (symbolic cue) of the moving stimulus could predict the exact time at which a target would reappear after a brief occlusion (valid trials) or provide no temporal information (neutral trials). The predictive nature of rhythmic and symbolic cues was manipulated factorially in a symmetrical and orthogonal fashion. To test for the effects of strategic control over temporal orienting based on rhythmic or symbolic cues, participants were instructed either to "attend-to-speed" (rhythm) or "attend-to-colour". Our results indicated that both rhythmic and symbolic (colour) cues speeded reaction times in an independent fashion. However, whilst the rhythmic cueing effects were impervious to instruction, the effects of symbolic cues were contingent on the instruction to attend to colour. FINAL CONCLUSIONS: Taken together, our results provide evidence for the existence of qualitatively separable types of temporal orienting of attention, akin to exogenous and endogenous mechanisms.