The attentional window modulates capture by audiovisual events

Visual search is markedly improved when a target color change is synchronized with a spatially non-informative auditory signal. This "pip and pop" effect is an automatic process as even a distractor captures attention when accompanied by a tone. Previous studies investigating visual attention have indicated that automatic capture is susceptible to the size of the attentional window. The present study investigated whether the pip and pop effect is modulated by the extent to which participants divide their attention across the visual field We show that participants were better in detecting a synchronized audiovisual event when they divided their attention across the visual field relative to a condition in which they focused their attention. We argue that audiovisual capture is reduced under focused conditions relative to distributed settings.     

Visual search and attention: an overview

This special feature issue is devoted to attention and visual search. Attention is a central topic in psychology and visual search is both a versatile paradigm for the study of visual attention and a topic of study in itself. Visual search depends on sensory, perceptual, and cognitive processes. As a result, the search paradigm has been used to investigate a diverse range of phenomena. Manipulating the search task can vary the demands on attention. In turn, attention modulates visual search by selecting and limiting the information available at various levels of processing. Focusing on the intersection of attention and search provides a relatively structured window into the wide world of attentional phenomena. In particular, the effects of divided attention are illustrated by the effects of set size (the number of stimuli in a display) and the effects of selective attention are illustrated by cueing subsets of stimuli within the display. These two phenomena provide the starting point for the articles in this special issue. The articles are organized into four general topics to help structure the issues of attention and search.     

Size matters: large objects capture attention in visual search

Can objects or events ever capture one''s attention in a purely stimulus-driven manner? A recent review of the literature set out the criteria required to find stimulus-driven attentional capture independent of goal-directed influences, and concluded that no published study has satisfied that criteria. Here visual search experiments assessed whether an irrelevantly large object can capture attention. Capture of attention by this static visual feature was found. The results suggest that a large object can indeed capture attention in a stimulus-driven manner and independent of displaywide features of the task that might encourage a goal-directed bias for large items. It is concluded that these results are either consistent with the stimulus-driven criteria published previously or alternatively consistent with a flexible, goal-directed mechanism of saliency detection.     

Alpha ERD and human visual selective attention

We compared the alpha band EEG depression (event-related desynchnization, ERD) level in two tasks, involving activation of different attentional processes: visual search for a deviant relevant stimulus among many similar ones and visual oddball. Control data for the visual search task consisted of simple viewing of several stimuli being of the same shape as the relevant stimulus in the search trials. Gaze position was verified by eye tracking method. We interpreted alpha band ERD as a correlate of activation of attentional processes. Fixating the target in visual search task caused a significantly larger ERD than fixating the same stimuli in control trials over all leads. We suppose this to be related with task and visual environment complexities. The frontal ERD domination may indicate attentional control over voluntary movements execution (top-down attention). The caudal ERD may be related with updating of visual information as a result of search process (bottom-up attention). Both relevant and irrelevant stimuli in the oddball task also induced alpha band ERD, but it was larger in response to relevant one and reached maximum level over occipital leads. Domination of caudal ERD in oddball task is supposed to indicate bottom-up attention processes.     

Distribution of attention modulates salience signals in early visual cortex

Previous research has shown that the extent to which people spread attention across the visual field plays a crucial role in visual selection and the occurrence of bottom-up driven attentional capture. Consistent with previous findings, we show that when attention was diffusely distributed across the visual field while searching for a shape singleton, an irrelevant salient color singleton captured attention. However, while using the very same displays and task, no capture was observed when observers initially focused their attention at the center of the display. Using event-related fMRI, we examined the modulation of retinotopic activity related to attentional capture in early visual areas. Because the sensory display characteristics were identical in both conditions, we were able to isolate the brain activity associated with exogenous attentional capture. The results show that spreading of attention leads to increased bottom-up exogenous capture and increased activity in visual area V3 but not in V2 and V1.     

A Salient and Task-Irrelevant Collinear Structure Hurts Visual Search

Salient distractors draw our attention spontaneously, even when we intentionally want to ignore them. When this occurs, the real targets close to or overlapping with the distractors benefit from attention capture and thus are detected and discriminated more quickly. However, a puzzling opposite effect was observed in a search display with a column of vertical collinear bars presented as a task-irrelevant distractor [6]. In this case, it was harder to discriminate the targets overlapping with the salient distractor. Here we examined whether this effect originated from factors known to modulate attentional capture: (a) low probability—the probability occurrence of target location at the collinear column was much less (14%) than the rest of the display (86%), and observers might strategically direct their attention away from the collinear distractor; (b) attentional control setting—the distractor and target task interfered with each other because they shared the same continuity set in attentional task; and/or (c) lack of time to establish the optional strategy. We tested these hypotheses by (a) increasing to 60% the trials in which targets overlapped with the same collinear distractor columns, (b) replacing the target task to be connectivity-irrelevant (i.e., luminance discrimination), and (c) having our observers practice the same search task for 10 days. Our results speak against all these hypotheses and lead us to conclude that a collinear distractor impairs search at a level that is unaffected by probabilistic information, attentional setting, and learning.     

Attentional Tuning Resets after Failures of Perceptual Awareness

Key to successfully negotiating our environment is our ability to adapt to current settings based on recent experiences and behaviour. Response conflict paradigms (e.g., the Stroop task) have provided evidence for increases in executive control after errors, leading to slowed responses that are more likely to be correct, and less susceptible to response congruency effects. Here we investigate whether failures of perceptual awareness, rather than failures at decisional or response stages of information processing, lead to similar adjustments in visual attention. We employed an attentional blink task in which subjects often fail to consciously register the second of two targets embedded in a rapid serial visual presentation stream of distractors, and examined how target errors influence performance on subsequent trials. Performance was inferior after Target 2 errors and these inter-trial effects were independent of the temporal lag between the targets and were not due to more global changes in attention across runs of trials. These results shed light on the nature of attentional calibration in response to failures of perceptual consciousness.     

Separate attentional resources for vision and audition

Current models of attention, typically claim that vision and audition are limited by a common attentional resource which means that visual performance should be adversely affected by a concurrent auditory task and vice versa. Here, we test this implication by measuring auditory (pitch) and visual (contrast) thresholds in conjunction with cross-modal secondary tasks and find that no such interference occurs. Visual contrast discrimination thresholds were unaffected by a concurrent chord or pitch discrimination, and pitch-discrimination thresholds were virtually unaffected by a concurrent visual search or contrast discrimination task. However, if the dual tasks were presented within the same modality, thresholds were raised by a factor of between two (for visual discrimination) and four (for auditory discrimination). These results suggest that at least for low-level tasks such as discriminations of pitch and contrast, each sensory modality is under separate attentional control, rather than being limited by a supramodal attentional resource. This has implications for current theories of attention as well as for the use of multi-sensory media for efficient informational transmission.     

The Competitive Influences of Perceptual Load and Working Memory Guidance on Selective Attention

The perceptual load theory in selective attention literature proposes that the interference from task-irrelevant distractor is eliminated when perceptual capacity is fully consumed by task-relevant information. However, the biased competition model suggests that the contents of working memory (WM) can guide attentional selection automatically, even when this guidance is detrimental to visual search. An intriguing but unsolved question is what will happen when selective attention is influenced by both perceptual load and WM guidance. To study this issue, behavioral performances and event-related potentials (ERPs) were recorded when participants were presented with a cue to either identify or hold in memory and had to perform a visual search task subsequently, under conditions of low or high perceptual load. Behavioural data showed that high perceptual load eliminated the attentional capture by WM. The ERP results revealed an obvious WM guidance effect in P1 component with invalid trials eliciting larger P1 than neutral trials, regardless of the level of perceptual load. The interaction between perceptual load and WM guidance was significant for the posterior N1 component. The memory guidance effect on N1 was eliminated by high perceptual load. Standardized Low Resolution Electrical Tomography Analysis (sLORETA) showed that the WM guidance effect and the perceptual load effect on attention can be localized into the occipital area and parietal lobe, respectively. Merely identifying the cue produced no effect on the P1 or N1 component. These results suggest that in selective attention, the information held in WM could capture attention at the early stage of visual processing in the occipital cortex. Interestingly, this initial capture of attention by WM could be modulated by the level of perceptual load and the parietal lobe mediates target selection at the discrimination stage.     

Introduction of a retention interval in a sustained attention task in rats: effects of a visual distracter and increasing the inter-trial interval

The impact of manipulating explicit attentional demands on working memory has not been well studied in rodents. The present experiment was designed to test the effects of incorporating a retention interval in a two-lever sustained attention task that requires discrimination of visual signals and non-signals and that has previously been shown to yield valid measures of attention in the rat. Upon establishing baseline performance, additional manipulations, including presentation of a visual distracter and increasing the length and variability of the inter-trial interval were conducted. During baseline conditions, accurate detection of signals, but not non-signals, decreased as the retention interval was increased. Presentation of a flashing houselight throughout the session eliminated delay-dependent detection of signals. Increasing the inter-trial interval improved detection of signals and decreased detection of non-signals at the longest retention interval. Finally, increasing the variability of the inter-trial interval did not have significant effects on performance above and beyond the effects of increasing the inter-trial interval. The present experiment demonstrates that manipulation of explicit attentional demands can alter working memory performance in the rat. This task may be employed to understand the neuropharmacological and neuroanatomical substrates mediating memory while attentional load is systematically varied.     

Learned value magnifies salience-based attentional capture

Visual attention is captured by physically salient stimuli (termed salience-based attentional capture), and by otherwise task-irrelevant stimuli that contain goal-related features (termed contingent attentional capture). Recently, we reported that physically nonsalient stimuli associated with value through reward learning also capture attention involuntarily (Anderson, Laurent, & Yantis, PNAS, 2011). Although it is known that physical salience and goal-relatedness both influence attentional priority, it is unknown whether or how attentional capture by a salient stimulus is modulated by its associated value. Here we show that a physically salient, task-irrelevant distractor previously associated with a large reward slows visual search more than an equally salient distractor previously associated with a smaller reward. This magnification of salience-based attentional capture by learned value extinguishes over several hundred trials. These findings reveal a broad influence of learned value on involuntary attentional capture.     

Attentional Requirements on Feature Search Are Modulated by Stimulus Properties

We report a series of dual-task experiments, in which a rapid serial visual presentation (RSVP) task was combined with a visual search task. Orientation, motion, and color were used as the defining target features in the search task. Lag between target onsets was manipulated and interference between the two tasks was quantified by measuring detection scores for the search task as a function of lag. While simultaneous performance of an orientation detection task with an RSVP letter identification task resulted in a performance decrease for lags up to 320 ms, no such decrease was detected for highly salient motion- and color-defined targets. Subsequently, detectability of the motion and color feature was matched to that of the orientation-feature resulting in the reintroduction of a (smaller) performance decrease, but only during simultaneous performance (lag 0 ms). The results suggest that there are two causes for the impaired search performance occurring when a feature search task is combined with an RSVP task. The first is short-lasting interference probably due to attentional competition; the second, which plays a role only when targets for both tasks share features, is interference that may be attributed to a central processing bottleneck.     

Top-Down but Not Bottom-Up Visual Scanning is Affected in Hereditary Pure Cerebellar Ataxia

The aim of this study was to clarify the nature of visual processing deficits caused by cerebellar disorders. We studied the performance of two types of visual search (top-down visual scanning and bottom-up visual scanning) in 18 patients with pure cerebellar types of spinocerebellar degeneration (SCA6: 11; SCA31: 7). The gaze fixation position was recorded with an eye-tracking device while the subjects performed two visual search tasks in which they looked for a target Landolt figure among distractors. In the serial search task, the target was similar to the distractors and the subject had to search for the target by processing each item with top-down visual scanning. In the pop-out search task, the target and distractor were clearly discernible and the visual salience of the target allowed the subjects to detect it by bottom-up visual scanning. The saliency maps clearly showed that the serial search task required top-down visual attention and the pop-out search task required bottom-up visual attention. In the serial search task, the search time to detect the target was significantly longer in SCA patients than in normal subjects, whereas the search time in the pop-out search task was comparable between the two groups. These findings suggested that SCA patients cannot efficiently scan a target using a top-down attentional process, whereas scanning with a bottom-up attentional process is not affected. In the serial search task, the amplitude of saccades was significantly smaller in SCA patients than in normal subjects. The variability of saccade amplitude (saccadic dysmetria), number of re-fixations, and unstable fixation (nystagmus) were larger in SCA patients than in normal subjects, accounting for a substantial proportion of scattered fixations around the items. Saccadic dysmetria, re-fixation, and nystagmus may play important roles in the impaired top-down visual scanning in SCA, hampering precise visual processing of individual items.     

Cell-type-specific synchronization of neural activity in FEF with V4 during attention

Shifts of gaze and shifts of attention are closely linked and it is debated whether they result from the same neural mechanisms. Both processes involve the frontal eye fields (FEF), an area which is also a source of top-down feedback to area V4 during covert attention. To test the relative contributions of oculomotor and attention-related FEF signals to such feedback, we recorded simultaneously from both areas in a covert attention task and in a saccade task. In the attention task, only visual and visuomovement FEF neurons showed enhanced responses, whereas movement cells were unchanged. Importantly, visual, but not movement or visuomovement cells, showed enhanced gamma frequency synchronization with activity in V4 during attention. Within FEF, beta synchronization was increased for movement cells during attention but was suppressed in the saccade task. These findings support the idea that the attentional modulation of visual processing is not mediated by movement neurons.     

Individual differences and metacognitive knowledge of visual search strategy

A crucial ability for an organism is to orient toward important objects and to ignore temporarily irrelevant objects. Attention provides the perceptual selectivity necessary to filter an overwhelming input of sensory information to allow for efficient object detection. Although much research has examined visual search and the 'template' of attentional set that allows for target detection, the behavior of individual subjects often reveals the limits of experimental control of attention. Few studies have examined important aspects such as individual differences and metacognitive strategies. The present study analyzes the data from two visual search experiments for a conjunctively defined target (Proulx, 2007). The data revealed attentional capture blindness, individual differences in search strategies, and a significant rate of metacognitive errors for the assessment of the strategies employed. These results highlight a challenge for visual attention studies to account for individual differences in search behavior and distractibility, and participants that do not (or are unable to) follow instructions.     

Attention to stimulus features shifts spectral tuning of V4 neurons during natural vision

Previous neurophysiological studies suggest that attention can alter the baseline or gain of neurons in extrastriate visual areas but that it cannot change tuning. This suggests that neurons in visual cortex function as labeled lines whose meaning does not depend on task demands. To test this common assumption, we used a system identification approach to measure spatial frequency and orientation tuning in area V4 during two attentionally demanding visual search tasks, one that required fixation and one that allowed free viewing during search. We found that spatial attention modulates response baseline and gain but does not alter tuning, consistent with previous reports. In contrast, feature-based attention often shifts neuronal tuning. These tuning shifts are inconsistent with the labeled-line model and tend to enhance responses to stimulus features that distinguish the search target. Our data suggest that V4 neurons behave as matched filters that are dynamically tuned to optimize visual search.     

Controlling attention to nociceptive stimuli with working memory

Background

Because pain often signals the occurrence of potential tissue damage, a nociceptive stimulus has the capacity to involuntarily capture attention and take priority over other sensory inputs. Whether distraction by nociception actually occurs may depend upon the cognitive characteristics of the ongoing activities. The present study tested the role of working memory in controlling the attentional capture by nociception.

Methodology and Principal Findings

Participants performed visual discrimination and matching tasks in which visual targets were shortly preceded by a tactile distracter. The two tasks were chosen because of the different effects the involvement of working memory produces on performance, in order to dissociate the specific role of working memory in the control of attention from the effect of general resource demands. Occasionally (i.e. 17% of the trials), tactile distracters were replaced by a novel nociceptive stimulus in order to distract participants from the visual tasks. Indeed, in the control conditions (no working memory), reaction times to visual targets were increased when the target was preceded by a novel nociceptive distracter as compared to the target preceded by a frequent tactile distracter, suggesting attentional capture by the novel nociceptive stimulus. However, when the task required an active rehearsal of the visual target in working memory, the novel nociceptive stimulus no longer induced a lengthening of reaction times to visual targets, indicating a reduction of the distraction produced by the novel nociceptive stimulus. This effect was independent of the overall task demands.

Conclusion and Significance

Loading working memory with pain-unrelated information may reduce the ability of nociceptive input to involuntarily capture attention, and shields cognitive processing from nociceptive distraction. An efficient control of attention over pain is best guaranteed by the ability to maintain active goal priorities during achievement of cognitive activities and to keep pain-related information out of task settings.     

No Prior Entry for Threat-Related Faces: Evidence from Temporal Order Judgments

Previous research showed that threat-related faces, due to their intrinsic motivational relevance, capture attention more readily than neutral faces. Here we used a standard temporal order judgment (TOJ) task to assess whether negative (either angry or fearful) emotional faces, when competing with neutral faces for attention selection, may lead to a prior entry effect and hence be perceived as appearing first, especially when uncertainty is high regarding the order of the two onsets. We did not find evidence for this conjecture across five different experiments, despite the fact that participants were invariably influenced by asynchronies in the respective onsets of the two competing faces in the pair, and could reliably identify the emotion in the faces. Importantly, by systematically varying task demands across experiments, we could rule out confounds related to suboptimal stimulus presentation or inappropriate task demands. These findings challenge the notion of an early automatic capture of attention by (negative) emotion. Future studies are needed to investigate whether the lack of systematic bias of attention by emotion is imputed to the primacy of a non-emotional cue to resolve the TOJ task, which in turn prevents negative emotion to exert an early bottom-up influence on the guidance of spatial and temporal attention.     

Feature-based attention in the frontal eye field and area V4 during visual search

When we search for a target in a crowded visual scene, we often use the distinguishing features of the target, such as color or shape, to guide our attention and eye movements. To investigate the neural mechanisms of feature-based attention, we simultaneously recorded neural responses in the frontal eye field (FEF) and area V4 while monkeys performed a visual search task. The responses of cells in both areas were modulated by feature attention, independent of spatial attention, and the magnitude of response enhancement was inversely correlated with the number of saccades needed to find the target. However, an analysis of the latency of sensory and attentional influences on responses suggested that V4 provides bottom-up sensory information about stimulus features, whereas the FEF provides a top-down attentional bias toward target features that modulates sensory processing in V4 and that could be used to guide the eyes to a searched-for target.     

Characterizing visual performance fields: effects of transient covert attention, spatial frequency, eccentricity, task and set size

We investigated whether transient covert attention would differentially affect 'performance fields' (shape depicted by percent correct performance at particular locations in the visual field) for orientation discrimination, detection and localization tasks, while manipulating a number of visual factors. We found that although attention improved overall performance, it did not affect performance fields. Two patterns were observed regardless of the presence of a local post-mask, the stimulus orientation, or the task. A horizontal-vertical anisotropy (HVA) became more pronounced as spatial frequency, eccentricity and set size increased. A vertical meridian asymmetry (VMA) became more pronounced as spatial frequency and eccentricity increased. We conclude that performance fields are determined by visual, rather than by transient attentional, constraints.