Behavioural dissociation between exogenous and endogenous temporal orienting of attention

BACKGROUND: In the current study we compared the effects of temporal orienting of attention based on predictions carried by the intrinsic temporal structure of events (rhythm) and by instructive symbolic cues; and tested the degree of cognitive, strategic control that could be exerted over each type of temporal expectation. The experiments tested whether the distinction between exogenous and endogenous orienting made in spatial attention may extend to the temporal domain. TASK DESIGN AND MAIN RESULTS: In this task, a ball moved across the screen in discrete steps and disappeared temporarily under an occluding band. Participants were required to make a perceptual discrimination on the target upon its reappearance. The regularity of the speed (rhythmic cue) or colour (symbolic cue) of the moving stimulus could predict the exact time at which a target would reappear after a brief occlusion (valid trials) or provide no temporal information (neutral trials). The predictive nature of rhythmic and symbolic cues was manipulated factorially in a symmetrical and orthogonal fashion. To test for the effects of strategic control over temporal orienting based on rhythmic or symbolic cues, participants were instructed either to "attend-to-speed" (rhythm) or "attend-to-colour". Our results indicated that both rhythmic and symbolic (colour) cues speeded reaction times in an independent fashion. However, whilst the rhythmic cueing effects were impervious to instruction, the effects of symbolic cues were contingent on the instruction to attend to colour. FINAL CONCLUSIONS: Taken together, our results provide evidence for the existence of qualitatively separable types of temporal orienting of attention, akin to exogenous and endogenous mechanisms.     

Is Attention Based on Spatial Contextual Memory Preferentially Guided by Low Spatial Frequency Signals?

A popular model of visual perception states that coarse information (carried by low spatial frequencies) along the dorsal stream is rapidly transmitted to prefrontal and medial temporal areas, activating contextual information from memory, which can in turn constrain detailed input carried by high spatial frequencies arriving at a slower rate along the ventral visual stream, thus facilitating the processing of ambiguous visual stimuli. We were interested in testing whether this model contributes to memory-guided orienting of attention. In particular, we asked whether global, low-spatial frequency (LSF) inputs play a dominant role in triggering contextual memories in order to facilitate the processing of the upcoming target stimulus. We explored this question over four experiments. The first experiment replicated the LSF advantage reported in perceptual discrimination tasks by showing that participants were faster and more accurate at matching a low spatial frequency version of a scene, compared to a high spatial frequency version, to its original counterpart in a forced-choice task. The subsequent three experiments tested the relative contributions of low versus high spatial frequencies during memory-guided covert spatial attention orienting tasks. Replicating the effects of memory-guided attention, pre-exposure to scenes associated with specific spatial memories for target locations (memory cues) led to higher perceptual discrimination and faster response times to identify targets embedded in the scenes. However, either high or low spatial frequency cues were equally effective; LSF signals did not selectively or preferentially contribute to the memory-driven attention benefits to performance. Our results challenge a generalized model that LSFs activate contextual memories, which in turn bias attention and facilitate perception.     

Spatiotemporal Dynamics of High-Gamma Activities during a 3-Stimulus Visual Oddball Task

Although many studies have investigated the neural basis of top-down and bottom-up attention, it still requires refinement in both temporal and spatial terms. We used magnetoencephalography to investigate the spatiotemporal dynamics of high-gamma (52–100 Hz) activities during top-down and bottom-up visual attentional processes, aiming to extend the findings from functional magnetic resonance imaging and event-related potential studies. Fourteen participants performed a 3-stimulus visual oddball task, in which both infrequent non-target and target stimuli were presented. We identified high-gamma event-related synchronization in the left middle frontal gyrus, the left intraparietal sulcus, the left thalamus, and the visual areas in different time windows for the target and non-target conditions. We also found elevated imaginary coherence between the left intraparietal sulcus and the right middle frontal gyrus in the high-gamma band from 300 to 400 ms in the target condition, and between the left thalamus and the left middle frontal gyrus in theta band from 150 to 450 ms. In addition, the strength of high-gamma imaginary coherence between the left middle frontal gyrus and left intraparietal sulcus, between the left middle frontal gyrus and the right middle frontal gyrus, and the high-gamma power in the left thalamus predicted inter-subject variation in target detection response time. This source-level electrophysiological evidence enriches our understanding of bi-directional attention processes: stimulus-driven bottom-up attention orientation to a salient, but irrelevant stimulus; and top-down allocation of attentional resources to stimulus evaluation.     

Interaural Level Differences Do Not Suffice for Restoring Spatial Release from Masking in Simulated Cochlear Implant Listening

Spatial release from masking refers to a benefit for speech understanding. It occurs when a target talker and a masker talker are spatially separated. In those cases, speech intelligibility for target speech is typically higher than when both talkers are at the same location. In cochlear implant listeners, spatial release from masking is much reduced or absent compared with normal hearing listeners. Perhaps this reduced spatial release occurs because cochlear implant listeners cannot effectively attend to spatial cues. Three experiments examined factors that may interfere with deploying spatial attention to a target talker masked by another talker. To simulate cochlear implant listening, stimuli were vocoded with two unique features. First, we used 50-Hz low-pass filtered speech envelopes and noise carriers, strongly reducing the possibility of temporal pitch cues; second, co-modulation was imposed on target and masker utterances to enhance perceptual fusion between the two sources. Stimuli were presented over headphones. Experiments 1 and 2 presented high-fidelity spatial cues with unprocessed and vocoded speech. Experiment 3 maintained faithful long-term average interaural level differences but presented scrambled interaural time differences with vocoded speech. Results show a robust spatial release from masking in Experiments 1 and 2, and a greatly reduced spatial release in Experiment 3. Faithful long-term average interaural level differences were insufficient for producing spatial release from masking. This suggests that appropriate interaural time differences are necessary for restoring spatial release from masking, at least for a situation where there are few viable alternative segregation cues.     

Inter-trial effects in priming of pop-out: Comparison of computational updating models

In visual search tasks, repeating features or the position of the target results in faster response times. Such inter-trial ‘priming’ effects occur not just for repetitions from the immediately preceding trial but also from trials further back. A paradigm known to produce particularly long-lasting inter-trial effects–of the target-defining feature, target position, and response (feature)–is the ‘priming of pop-out’ (PoP) paradigm, which typically uses sparse search displays and random swapping across trials of target- and distractor-defining features. However, the mechanisms underlying these inter-trial effects are still not well understood. To address this, we applied a modeling framework combining an evidence accumulation (EA) model with different computational updating rules of the model parameters (i.e., the drift rate and starting point of EA) for different aspects of stimulus history, to data from a (previously published) PoP study that had revealed significant inter-trial effects from several trials back for repetitions of the target color, the target position, and (response-critical) target feature. By performing a systematic model comparison, we aimed to determine which EA model parameter and which updating rule for that parameter best accounts for each inter-trial effect and the associated n-back temporal profile. We found that, in general, our modeling framework could accurately predict the n-back temporal profiles. Further, target color- and position-based inter-trial effects were best understood as arising from redistribution of a limited-capacity weight resource which determines the EA rate. In contrast, response-based inter-trial effects were best explained by a bias of the starting point towards the response associated with a previous target; this bias appeared largely tied to the position of the target. These findings elucidate how our cognitive system continually tracks, and updates an internal predictive model of, a number of separable stimulus and response parameters in order to optimize task performance.     

Event-Related Potentials Dissociate Effects of Salience and Space in Biased Competition for Visual Representation

Background

Selective visual attention is the process by which the visual system enhances behaviorally relevant stimuli and filters out others. Visual attention is thought to operate through a cortical mechanism known as biased competition. Representations of stimuli within cortical visual areas compete such that they mutually suppress each others'' neural response. Competition increases with stimulus proximity and can be biased in favor of one stimulus (over another) as a function of stimulus significance, salience, or expectancy. Though there is considerable evidence of biased competition within the human visual system, the dynamics of the process remain unknown.

Methodology/Principal Findings

Here, we used scalp-recorded electroencephalography (EEG) to examine neural correlates of biased competition in the human visual system. In two experiments, subjects performed a task requiring them to either simultaneously identify two targets (Experiment 1) or discriminate one target while ignoring a decoy (Experiment 2). Competition was manipulated by altering the spatial separation between target(s) and/or decoy. Both experimental tasks should induce competition between stimuli. However, only the task of Experiment 2 should invoke a strong bias in favor of the target (over the decoy). The amplitude of two lateralized components of the event-related potential, the N2pc and Ptc, mirrored these predictions. N2pc amplitude increased with increasing stimulus separation in Experiments 1 and 2. However, Ptc amplitude varied only in Experiment 2, becoming more positive with decreased spatial separation.

Conclusions/Significance

These results suggest that N2pc and Ptc components may index distinct processes of biased competition—N2pc reflecting visual competitive interactions and Ptc reflecting a bias in processing necessary to individuate task-relevant stimuli.     

Time course of attention reveals different mechanisms for spatial and feature-based attention in area V4

Attention can facilitate visual processing, emphasizing specific locations and highlighting stimuli containing specific features. To dissociate the mechanisms of spatial and feature-based attention, we compared the time course of visually evoked responses under different attention conditions. We recorded from single neurons in area V4 during a delayed match-to-sample task that controlled both spatial and feature-based attention. Neuronal responses increased when spatial attention was directed toward the receptive field and were modulated by the identity of the target of feature-based attention. Modulation by spatial attention was weaker during the early portion of the visual response and stronger during the later portion of the response. In contrast, modulation by feature-based attention was relatively constant throughout the response. It appears that stimulus onset transients disrupt spatial attention, but not feature attention. We conclude that spatial attention reflects a combination of stimulus-driven and goal-driven processes, while feature-based attention is purely goal driven.     

Dynamics of choice during estimation of subjective value

This study characterized preferential choice in binary trials and investigated intra-session variations in response time (RT). In Experiment 1, participants (N = 77) were asked to choose the preferred of two images of body wash; all unique combinations of 19 images were presented. The results showed: (a) marked and consistent individual preferences for specific stimuli; (b) RT decreased monotonically with increasing exposure to each stimulus; (c) RT decreased exponentially as a function of relative preference ranking of the 2 images in a trial; and (d) a regression model efficiently predicted trial RT as a function of exposure and relative preference. Experiment 2 (N = 112) explored the effect of amount of exposure on RT, and relative preference as a function of the type of choice task (a previously completed vs. a new choice task). The results showed that: (a) within a single choice task, amount of exposure and relative preference between the stimuli predicted the systematic changes in RT observed in Exp. 1; and (b) when the choice task changed, the effects of previous amount of exposure, and relative stimulus preference did not transfer to the new task.     

Prospective timing under dual-task paradigms: attentional and contextual-change mechanisms

The effect of a concurrent memory task on prospective time estimates by human participants was investigated in two experiments. The objective was to isolate task effects from those of participant timing strategy (self-paced counting) and number of contextual changes during the temporal stimulus. Accordingly, self-paced counting was suppressed by requiring participants to perform a word-reading task during the temporal stimuli, while number of stimulus changes presented during temporal stimuli was controlled. Presence versus absence of the concurrent memory task was manipulated in Experiment 1, and instruction to focus on timing or to focus on memory was manipulated in Experiment 2. There was no significant effect of presence versus absence of the concurrent memory task on time estimates; however, time estimates were shorter when participants were instructed to focus on memory versus timing. In both experiments, time estimates were positively correlated with participants' estimates of the number of words presented during the interval, even though number of words presented was invariant. These findings were generally consistent with resource-allocation attentional accounts of concurrent task effects; however, support for a contextual-change model of timing was also obtained.     

Spatial cueing,sensory gating and selective response preparation: an ERP study on visuo-spatial orienting

Event-related brain potentials (ERPs) were recorded in a visuo-spatial attention task where the position of an imperative stimulus was indicated either validly or invalidly by a central arrow (trial-by-trial cueing). Subjects had to perform choice RT tasks with the response being dependent either on the identity of the target stimulus or on its position. When target identity was relevant for response selection, validly cued stimuli elicited amplitude enhancements of the early, sensory-evoked P1 and N1 components at lateral posterior sites. The N1 validity effect was limited to scalp sites ipsilateral to the visual field of stimulus presentation. Although these effects were found only when the sensory discrimination task was considerably difficult, they are in line with models assuming that modulations of sensory-perceptual processing (“sensory gating”) are induced by spatial cueing. However, when target location was response-relevant, N1 amplitude enhancements were consistently elicited by invalidly cued letters.CNV and LRP measures indicated that the arrow elicited response-related processing in the cue-target interval. Such processes occurred even when the cue contained no information about an upcoming response. Two consecutive lateralization phases were distinguishable in the LRP, with experimentally induced response assignments becoming effective only during the second phase.     

Effects of cue information on response production and inhibition measured by event-related potentials

The aim of this study was to investigate how information carried by a cue stimulus modulate event-related potentials (ERPs) to a subsequent target stimulus which either calls for an overt response (Go stimulus) or no response (Nogo stimulus). One of the cues predicted the likely appearance of the Go stimulus (Go cue) whereas the other cue predicted the likely appearance of the Nogo stimulus (Nogo cue). Our results showed that unpredicted Nogo stimuli elicited enlarged N200 component. This finding supports the notion that Nogo N200 reflects response inhibition processes, i.e., the amplitude of the N200 is a function of the difficulty of response inhibition. In other words, increased N200 to Nogo stimuli following Go cues might be related to increased efforts in activating the response inhibition system thereby interrupting preparations to respond.     

What Happens in Between? Human Oscillatory Brain Activity Related to Crossmodal Spatial Cueing

Previous studies investigated the effects of crossmodal spatial attention by comparing the responses to validly versus invalidly cued target stimuli. Dynamics of cortical rhythms in the time interval between cue and target might contribute to cue effects on performance. Here, we studied the influence of spatial attention on ongoing oscillatory brain activity in the interval between cue and target onset. In a first experiment, subjects underwent periods of tactile stimulation (cue) followed by visual stimulation (target) in a spatial cueing task as well as tactile stimulation as a control. In a second experiment, cue validity was modified to be 50%, 75%, or else 25%, to separate effects of exogenous shifts of attention caused by tactile stimuli from that of endogenous shifts. Tactile stimuli produced: 1) a stronger lateralization of the sensorimotor beta-rhythm rebound (15-22 Hz) after tactile stimuli serving as cues versus not serving as cues; 2) a suppression of the occipital alpha-rhythm (7-13 Hz) appearing only in the cueing task (this suppression was stronger contralateral to the endogenously attended side and was predictive of behavioral success); 3) an increase of prefrontal gamma-activity (25-35 Hz) specifically in the cueing task. We measured cue-related modulations of cortical rhythms which may accompany crossmodal spatial attention, expectation or decision, and therefore contribute to cue validity effects. The clearly lateralized alpha suppression after tactile cues in our data indicates its dependence on endogenous rather than exogenous shifts of visuo-spatial attention following a cue independent of its modality.     

The effect of stimulus duration and motor response in hemispatial neglect during a visual search task

Patients with hemispatial neglect exhibit a myriad of profound deficits. A hallmark of this syndrome is the patients' absence of awareness of items located in their contralesional space. Many studies, however, have demonstrated that neglect patients exhibit some level of processing of these neglected items. It has been suggested that unconscious processing of neglected information may manifest as a fast denial. This theory of fast denial proposes that neglected stimuli are detected in the same way as non-neglected stimuli, but without overt awareness. We evaluated the fast denial theory by conducting two separate visual search task experiments, each differing by the duration of stimulus presentation. Specifically, in Experiment 1 each stimulus remained in the participants' visual field until a response was made. In Experiment 2 each stimulus was presented for only a brief duration. We further evaluated the fast denial theory by comparing verbal to motor task responses in each experiment. Overall, our results from both experiments and tasks showed no evidence for the presence of implicit knowledge of neglected stimuli. Instead, patients with neglect responded the same when they neglected stimuli as when they correctly reported stimulus absence. These findings thus cast doubt on the concept of the fast denial theory and its consequent implications for non-conscious processing. Importantly, our study demonstrated that the only behavior affected was during conscious detection of ipsilesional stimuli. Specifically, patients were slower to detect stimuli in Experiment 1 compared to Experiment 2, suggesting a duration effect occurred during conscious processing of information. Additionally, reaction time and accuracy were similar when reporting verbally versus motorically. These results provide new insights into the perceptual deficits associated with neglect and further support other work that falsifies the fast denial account of non-conscious processing in hemispatial visual neglect.     

Effects of Virtual Speaker Density and Room Reverberation on Spatiotemporal Thresholds of Audio-Visual Motion Coherence

The present study examined the effects of spatial sound-source density and reverberation on the spatiotemporal window for audio-visual motion coherence. Three different acoustic stimuli were generated in Virtual Auditory Space: two acoustically “dry” stimuli via the measurement of anechoic head-related impulse responses recorded at either 1° or 5° spatial intervals (Experiment 1), and a reverberant stimulus rendered from binaural room impulse responses recorded at 5° intervals in situ in order to capture reverberant acoustics in addition to head-related cues (Experiment 2). A moving visual stimulus with invariant localization cues was generated by sequentially activating LED''s along the same radial path as the virtual auditory motion. Stimuli were presented at 25°/s, 50°/s and 100°/s with a random spatial offset between audition and vision. In a 2AFC task, subjects made a judgment of the leading modality (auditory or visual). No significant differences were observed in the spatial threshold based on the point of subjective equivalence (PSE) or the slope of psychometric functions (β) across all three acoustic conditions. Additionally, both the PSE and β did not significantly differ across velocity, suggesting a fixed spatial window of audio-visual separation. Findings suggest that there was no loss in spatial information accompanying the reduction in spatial cues and reverberation levels tested, and establish a perceptual measure for assessing the veracity of motion generated from discrete locations and in echoic environments.     

Visual Benefits in Apparent Motion Displays: Automatically Driven Spatial and Temporal Anticipation Are Partially Dissociated

Many behaviourally relevant sensory events such as motion stimuli and speech have an intrinsic spatio-temporal structure. This will engage intentional and most likely unintentional (automatic) prediction mechanisms enhancing the perception of upcoming stimuli in the event stream. Here we sought to probe the anticipatory processes that are automatically driven by rhythmic input streams in terms of their spatial and temporal components. To this end, we employed an apparent visual motion paradigm testing the effects of pre-target motion on lateralized visual target discrimination. The motion stimuli either moved towards or away from peripheral target positions (valid vs. invalid spatial motion cueing) at a rhythmic or arrhythmic pace (valid vs. invalid temporal motion cueing). Crucially, we emphasized automatic motion-induced anticipatory processes by rendering the motion stimuli non-predictive of upcoming target position (by design) and task-irrelevant (by instruction), and by creating instead endogenous (orthogonal) expectations using symbolic cueing. Our data revealed that the apparent motion cues automatically engaged both spatial and temporal anticipatory processes, but that these processes were dissociated. We further found evidence for lateralisation of anticipatory temporal but not spatial processes. This indicates that distinct mechanisms may drive automatic spatial and temporal extrapolation of upcoming events from rhythmic event streams. This contrasts with previous findings that instead suggest an interaction between spatial and temporal attention processes when endogenously driven. Our results further highlight the need for isolating intentional from unintentional processes for better understanding the various anticipatory mechanisms engaged in processing behaviourally relevant stimuli with predictable spatio-temporal structure such as motion and speech.     

Realigning Thunder and Lightning: Temporal Adaptation to Spatiotemporally Distant Events

The brain is able to realign asynchronous signals that approximately coincide in both space and time. Given that many experience-based links between visual and auditory stimuli are established in the absence of spatiotemporal proximity, we investigated whether or not temporal realignment arises in these conditions. Participants received a 3-min exposure to visual and auditory stimuli that were separated by 706 ms and appeared either from the same (Experiment 1) or from different spatial positions (Experiment 2). A simultaneity judgment task (SJ) was administered right afterwards. Temporal realignment between vision and audition was observed, in both Experiment 1 and 2, when comparing the participants’ SJs after this exposure phase with those obtained after a baseline exposure to audiovisual synchrony. However, this effect was present only when the visual stimuli preceded the auditory stimuli during the exposure to asynchrony. A similar pattern of results (temporal realignment after exposure to visual-leading asynchrony but not after exposure to auditory-leading asynchrony) was obtained using temporal order judgments (TOJs) instead of SJs (Experiment 3). Taken together, these results suggest that temporal recalibration still occurs for visual and auditory stimuli that fall clearly outside the so-called temporal window for multisensory integration and appear from different spatial positions. This temporal realignment may be modulated by long-term experience with the kind of asynchrony (vision-leading) that we most frequently encounter in the outside world (e.g., while perceiving distant events).     

Stay Tuned: What Is Special About Not Shifting Attention?

Background

When studying attentional orienting processes, brain activity elicited by symbolic cue is usually compared to a neutral condition in which no information is provided about the upcoming target location. It is generally assumed that when a neutral cue is provided, participants do not shift their attention. The present study sought to validate this assumption. We further investigated whether anticipated task demands had an impact on brain activity related to processing symbolic cues.

Methodology/Principal Findings

Two experiments were conducted, during which event-related potentials were elicited by symbolic cues that instructed participants to shift their attention to a particular location on a computer screen. In Experiment 1, attention shift-inducing cues were compared to non-informative cues, while in both conditions participants were required to detect target stimuli that were subsequently presented at peripheral locations. In Experiment 2, a non-ambiguous “stay-central” cue that explicitly required participants not to shift their attention was used instead. In the latter case, target stimuli that followed a stay-central cue were also presented at a central location. Both experiments revealed enlarged early latency contralateral ERP components to shift-inducing cues compared to those elicited by either non-informative (exp. 1) or stay-central cues (exp. 2). In addition, cueing effects were modulated by the anticipated difficulty of the upcoming target, particularly so in Experiment 2. A positive difference, predominantly over the posterior contralateral scalp areas, could be observed for stay-central cues, especially for those predicting that the upcoming target would be easy. This effect was not present for non-informative cues.

Conclusions/Significance

We interpret our result in terms of a more rapid engagement of attention occurring in the presence of a more predictive instruction (i.e. stay-central easy target). Our results indicate that the human brain is capable of very rapidly identifying the difference between different types of instructions.     

Selective Attention Modulates Human Auditory Brainstem Responses: Relative Contributions of Frequency and Spatial Cues

Selective attention is the mechanism that allows focusing one’s attention on a particular stimulus while filtering out a range of other stimuli, for instance, on a single conversation in a noisy room. Attending to one sound source rather than another changes activity in the human auditory cortex, but it is unclear whether attention to different acoustic features, such as voice pitch and speaker location, modulates subcortical activity. Studies using a dichotic listening paradigm indicated that auditory brainstem processing may be modulated by the direction of attention. We investigated whether endogenous selective attention to one of two speech signals affects amplitude and phase locking in auditory brainstem responses when the signals were either discriminable by frequency content alone, or by frequency content and spatial location. Frequency-following responses to the speech sounds were significantly modulated in both conditions. The modulation was specific to the task-relevant frequency band. The effect was stronger when both frequency and spatial information were available. Patterns of response were variable between participants, and were correlated with psychophysical discriminability of the stimuli, suggesting that the modulation was biologically relevant. Our results demonstrate that auditory brainstem responses are susceptible to efferent modulation related to behavioral goals. Furthermore they suggest that mechanisms of selective attention actively shape activity at early subcortical processing stages according to task relevance and based on frequency and spatial cues.     

Spatial and Temporal Attention Modulate the Early Stages of Face Processing: Behavioural Evidence from a Reaching Paradigm

A presently unresolved question within the face perception literature is whether attending to the location of a face modulates face processing (i.e. spatial attention). Opinions on this matter diverge along methodological lines – where neuroimaging studies have observed that the allocation of spatial attention serves to enhance the neural response to a face, findings from behavioural paradigms suggest face processing is carried out independently of spatial attention. In the present study, we reconcile this divide by using a continuous behavioural response measure that indexes face processing at a temporal resolution not available in discrete behavioural measures (e.g. button press). Using reaching trajectories as our response measure, we observed that although participants were able to process faces both when attended and unattended (as others have found), face processing was not impervious to attentional modulation. Attending to the face conferred clear benefits on sex-classification processes at less than 350ms of stimulus processing time. These findings constitute the first reliable demonstration of the modulatory effects of both spatial and temporal attention on face processing within a behavioural paradigm.