Tracking moving identities: after attending the right location, the identity does not come for free

Although tracking identical moving objects has been studied since the 1980''s, only recently the study into tracking moving objects with distinct identities has started (referred to as Multiple Identity Tracking, MIT). So far, only behavioral studies into MIT have been undertaken. These studies have left a fundamental question regarding MIT unanswered, is MIT a one-stage or a two-stage process? According to the one-stage model, after a location has been attended, the identity is released without effort. However, according to the two-stage model, there are two effortful stages in MIT, attending to a location, and attending to the identity of the object at that location. In the current study we investigated this question by measuring brain activity in response to tracking familiar and unfamiliar targets. Familiarity is known to automate effortful processes, so if attention to identify the object is needed, this should become easier. However, if no such attention is needed, familiarity can only affect other processes (such as memory for the target set). Our results revealed that on unfamiliar trials neural activity was higher in both attentional networks, and visual identification networks. These results suggest that familiarity in MIT automates attentional identification processes, thus suggesting that attentional identification is needed in MIT. This then would imply that MIT is essentially a two-stage process, since after attending the location, the identity does not seem to come for free.     

Brain networks of novelty-driven involuntary and cued voluntary auditory attention shifting

In everyday life, we need a capacity to flexibly shift attention between alternative sound sources. However, relatively little work has been done to elucidate the mechanisms of attention shifting in the auditory domain. Here, we used a mixed event-related/sparse-sampling fMRI approach to investigate this essential cognitive function. In each 10-sec trial, subjects were instructed to wait for an auditory "cue" signaling the location where a subsequent "target" sound was likely to be presented. The target was occasionally replaced by an unexpected "novel" sound in the uncued ear, to trigger involuntary attention shifting. To maximize the attention effects, cues, targets, and novels were embedded within dichotic 800-Hz vs. 1500-Hz pure-tone "standard" trains. The sound of clustered fMRI acquisition (starting at t?=?7.82 sec) served as a controlled trial-end signal. Our approach revealed notable activation differences between the conditions. Cued voluntary attention shifting activated the superior intra--parietal sulcus (IPS), whereas novelty-triggered involuntary orienting activated the inferior IPS and certain subareas of the precuneus. Clearly more widespread activations were observed during voluntary than involuntary orienting in the premotor cortex, including the frontal eye fields. Moreover, we found -evidence for a frontoinsular-cingular attentional control network, consisting of the anterior insula, inferior frontal cortex, and medial frontal cortices, which were activated during both target discrimination and voluntary attention shifting. Finally, novels and targets activated much wider areas of superior temporal auditory cortices than shifting cues.     

The Role of Spatial Configuration in Multiple Identity Tracking

Background

The simultaneous tracking and identification of multiple moving objects encountered in everyday life requires one to correctly bind identities to objects. In the present study, we investigated the role of spatial configuration made by multiple targets when observers are asked to track multiple moving objects with distinct identities.

Methodology/Principal Findings

The overall spatial configuration made by the targets was manipulated: In the constant condition, the configuration remained as a virtual convex polygon throughout the tracking, and in the collapsed condition, one of the moving targets (critical target) crossed over an edge of the virtual polygon during tracking, destroying it. Identification performance was higher when the configuration remained intact than when it collapsed (Experiments 1a, 1b, and 2). Moreover, destroying the configuration affected the allocation of dynamic attention: the critical target captured more attention than did the other targets. However, observers were worse at identifying the critical target and were more likely to confuse it with the targets that formed the virtual crossed edge (Experiments 3–5). Experiment 6 further showed that the visual system constructs an overall configuration only by using the targets (and not the distractors); identification performance was not affected by whether the distractor violated the spatial configuration.

Conclusions/Significance

In sum, these results suggest that the visual system may integrate targets (but not distractors) into a spatial configuration during multiple identity tracking, which affects the distribution of dynamic attention and the updating of identity-location binding.     

Maps of space in human frontoparietal cortex

Prefrontal cortex (PFC) and posterior parietal cortex (PPC) are neural substrates for spatial cognition. We here review studies in which we tested the hypothesis that human frontoparietal cortex may function as a priority map. According to priority map theory, objects or locations in the visual world are represented by neural activity that is proportional to their attentional priority. Using functional magnetic resonance imaging (fMRI), we first identified topographic maps in PFC and PPC as candidate priority maps of space. We then measured fMRI activity in candidate priority maps during the delay periods of a covert attention task, a spatial working memory task, and a motor planning task to test whether the activity depended on the particular spatial cognition. Our hypothesis was that some, but not all, candidate priority maps in PFC and PPC would be agnostic with regard to what was being prioritized, in that their activity would reflect the location in space across tasks rather than a particular kind of spatial cognition (e.g., covert attention). To test whether patterns of delay period activity were interchangeable during the spatial cognitive tasks, we used multivariate classifiers. We found that decoders trained to predict the locations on one task (e.g., working memory) cross-predicted the locations on the other tasks (e.g., covert attention and motor planning) in superior precentral sulcus (sPCS) and in a region of intraparietal sulcus (IPS2), suggesting that these patterns of maintenance activity may be interchangeable across the tasks. Such properties make sPCS in frontal cortex and IPS2 in parietal cortex viable priority map candidates, and suggest that these areas may be the human homologs of the monkey frontal eye field (FEF) and lateral intraparietal area (LIP).     

The Neural Correlates of Identity Faking and Concealment: An fMRI Study

The neural basis of self and identity has received extensive research. However, most of these existing studies have focused on situations where the internal representation of the self is consistent with the external one. The present study used fMRI methodology to examine the neural correlates of two different types of identity conflict: identity faking and concealment. Participants were presented with a sequence of names and asked to either conceal their own identity or fake another one. The results revealed that the right insular cortex and bilaterally inferior frontal gyrus were more active for identity concealment compared to the control condition, whereas identity faking elicited a significantly larger percentage signal increase than the control condition in the right superior frontal gyrus, left calcarine, and right caudate. These results suggest that different neural systems associated with both identity processing and deception were involved in identity concealment and faking.     

Attentional bias to food images associated with elevated weight and future weight gain: an fMRI study

Behavioral studies reveal that obese vs. lean individuals show attentional bias to food stimuli. Yet research has not investigated this relation using objective brain imaging or tested whether attentional bias to food stimuli predicts future weight gain, which are important aims given the prominence of food cues in the environment. We used functional magnetic resonance imaging (fMRI) to examine attentional bias in 35 adolescent girls ranging from lean to obese using an attention network task involving food and neutral stimuli. BMI correlated positively with speed of behavioral response to both appetizing food stimuli and unappetizing food stimuli, but not to neutral stimuli. BMI correlated positively with activation in brain regions related to attention and food reward, including the anterior insula/frontal operculum, lateral orbitofrontal cortex (OFC), ventrolateral prefrontal cortex (vlPFC), and superior parietal lobe, during initial orientation to food cues. BMI also correlated with greater activation in the anterior insula/frontal operculum during reallocation of attention to appetizing food images and with weaker activation in the medial OFC and ventral pallidum during reallocation of attention to unappetizing food images. Greater lateral OFC activation during initial orientation to appetizing food cues predicted future increases in BMI. Results indicate that overweight is related to greater attentional bias to food cues and that youth who show elevated reward circuitry responsivity during food cue exposure are at increased risk for weight gain.     

Attention response functions: characterizing brain areas using fMRI activation during parametric variations of attentional load.

We derived attention response functions for different cortical areas by plotting neural activity (measured by fMRI) as a function of attentional load in a visual tracking task. In many parietal and frontal cortical areas, activation increased with load over the entire range of loads tested, suggesting that these areas are directly involved in attentional processes. However, in other areas (FEF and parietal area 7), strong activation was observed even at the lowest attentional load (compared to a passive baseline using identical stimuli), but little or no additional activation was seen with increasing load. These latter areas appear to play a different role, perhaps supporting task-relevant functions that do not vary with load, such as the suppression of eye movements.     

Neural correlates of the attentional blink

Attending to a visual event can lead to functional blindness for other events in the visual field. This limit in our attentional capacities is exemplified by the attentional blink (AB), which refers to the transient but severe impairment in perceiving the second of two temporally neighboring targets. Using functional magnetic resonance imaging (fMRI), we observed predominantly right intraparietal and frontal cortex activations associated with the AB. We further demonstrate that an AB can be elicited by both temporal and spatial distractor interference on an attended target and that both of these interference mechanisms activate the same neural circuit. These results suggest that a (right) parietofrontal network previously implicated in attentional control and enhancement is also a locus of capacity-limited processing of visual information.     

Attention governs action in the primate frontal eye field

While the motor and attentional roles of the frontal eye field (FEF) are well documented, the relationship between them is unknown. We exploited the known influence of visual motion on the apparent positions of targets, and measured how this illusion affects saccadic eye movements during FEF microstimulation. Without microstimulation, saccades to a moving grating are biased in the direction of motion, consistent with the apparent position illusion. Here we show that microstimulation of spatially aligned FEF representations increases the influence of this illusion on saccades. Rather than simply impose a fixed-vector signal, subthreshold stimulation directed saccades away from the FEF movement field, and instead more strongly in the direction of visual motion. These results demonstrate that the attentional effects of FEF stimulation govern visually guided saccades, and suggest that the two roles of the FEF work together to select both the features of a target and the appropriate movement to foveate it.     

The Frontal Eye Fields Limit the Capacity of Visual Short-Term Memory in Rhesus Monkeys

The frontal eye fields (FEF) in rhesus monkeys have been implicated in visual short-term memory (VSTM) as well as control of visual attention. Here we examined the importance of the area in the VSTM capacity and the relationship between VSTM and attention, using the chemical inactivation technique and multi-target saccade tasks with or without the need of target-location memory. During FEF inactivation, serial saccades to targets defined by color contrast were unaffected, but saccades relying on short-term memory were impaired when the target count was at the capacity limit of VSTM. The memory impairment was specific to the FEF-coded retinotopic locations, and subject to competition among targets distributed across visual fields. These results together suggest that the FEF plays a crucial role during the entry of information into VSTM, by enabling attention deployment on targets to be remembered. In this view, the memory capacity results from the limited availability of attentional resources provided by FEF: The FEF can concurrently maintain only a limited number of activations to register the targets into memory. When lesions render part of the area unavailable for activation, the number would decrease, further reducing the capacity of VSTM.     

The Importance of Encoding-Related Neural Dynamics in the Prediction of Inter-Individual Differences in Verbal Working Memory Performance

Studies of brain-behaviour interactions in the field of working memory (WM) have associated WM success with activation of a fronto-parietal network during the maintenance stage, and this mainly for visuo-spatial WM. Using an inter-individual differences approach, we demonstrate here the equal importance of neural dynamics during the encoding stage, and this in the context of verbal WM tasks which are characterized by encoding phases of long duration and sustained attentional demands. Participants encoded and maintained 5-word lists, half of them containing an unexpected word intended to disturb WM encoding and associated task-related attention processes. We observed that inter-individual differences in WM performance for lists containing disturbing stimuli were related to activation levels in a region previously associated with task-related attentional processing, the left intraparietal sulcus (IPS), and this during stimulus encoding but not maintenance; functional connectivity strength between the left IPS and lateral prefrontal cortex (PFC) further predicted WM performance. This study highlights the critical role, during WM encoding, of neural substrates involved in task-related attentional processes for predicting inter-individual differences in verbal WM performance, and, more generally, provides support for attention-based models of WM.     

Visuospatial Attention to Single and Multiple Objects Is Independently Impaired in Parkinson's Disease

Parkinson’s disease (PD) is associated with deficits in visuospatial attention. It is as yet unknown whether these attentional deficits begin at a perceptual level or instead reflect disruptions in oculomotor or higher-order processes. In the present study, non-demented individuals with PD and matched normal control adults (NC) participated in two tasks requiring sustained visuospatial attention, both based on a multiple object tracking paradigm. Eye tracking was used to ensure central fixation. In Experiment 1 (26 PD, 21 NC), a pair of identical red dots (one target, one distractor) rotated randomly for three seconds at varied speeds. The task was to maintain the identity of the sole target, which was labeled prior to each trial. PD were less accurate than NC overall (p = .049). When considering only trials where fixation was maintained, however, there was no significant group difference, suggesting that the deficit’s origin is closely related to oculomotor processing. To determine whether PD had additional impairment in multifocal attention, in Experiment 2 (25 PD, 15 NC), two targets were presented along with distractors at a moderate speed, along with a control condition in which dots remained stationary. PD were less accurate than NC for moving (p = 0.02) but not stationary targets. This group difference remained significant when considering only trials where fixation was maintained, suggesting the source of the PD deficit was independent from oculomotor processing. Taken together, the results implicate separate mechanisms for single vs. multiple object tracking deficits in PD.     

Cell-type-specific synchronization of neural activity in FEF with V4 during attention

Shifts of gaze and shifts of attention are closely linked and it is debated whether they result from the same neural mechanisms. Both processes involve the frontal eye fields (FEF), an area which is also a source of top-down feedback to area V4 during covert attention. To test the relative contributions of oculomotor and attention-related FEF signals to such feedback, we recorded simultaneously from both areas in a covert attention task and in a saccade task. In the attention task, only visual and visuomovement FEF neurons showed enhanced responses, whereas movement cells were unchanged. Importantly, visual, but not movement or visuomovement cells, showed enhanced gamma frequency synchronization with activity in V4 during attention. Within FEF, beta synchronization was increased for movement cells during attention but was suppressed in the saccade task. These findings support the idea that the attentional modulation of visual processing is not mediated by movement neurons.     

Effects of Attention to Auditory Motion on Cortical Activations during Smooth Pursuit Eye Tracking

Background

In contrast to traditional views that consider smooth pursuit as a relatively automatic process, evidence has been reported for the importance of attention for accurate pursuit performance. However, the exact role that attention might play in the maintenance of pursuit remains unclear.

Methodology/Principal Findings

We analysed the neuronal activity associated with healthy subjects executing smooth pursuit eye movements (SPEM) during concurrent attentive tracking of a moving sound source, which was either in-phase or in antiphase to the executed eye movements. Assuming that attentional resources must be allocated to the moving sound source, the simultaneous execution of SPEM and auditory tracking in diverging directions should result in increased load on common attentional resources. By using an auditory stimulus as a distractor rather then a visual stimulus we guaranteed that cortical activity cannot be caused by conflicts between two simultaneous visual motion stimuli. Our results revealed that the smooth pursuit task with divided attention led to significantly higher activations bilaterally in the posterior parietal cortex and lateral and medial frontal cortex, presumably containing the parietal, frontal and supplementary eye fields respectively.

Conclusions

The additional cortical activation in these areas is apparently due to the process of dividing attention between the execution of SPEM and the covert tracking of the auditory target. On the other hand, even though attention had to be divided the attentional resources did not seem to be exhausted, since the identification of the direction of the auditory target and the quality of SPEM were unaffected by the congruence between visual and auditory motion stimuli. Finally, we found that this form of task-related attention modulated not only the cortical pursuit network in general but also affected modality specific and supramodal attention regions.     

Human cortical mechanisms of visual attention during orienting and search.

Functional anatomical studies indicate that a set of neural signals in parietal and frontal cortex mediates the covert allocation of attention to visual locations across a wide variety of visual tasks. This frontoparietal network includes areas, such as the frontal eye field and supplementary eye field. This anatomical overlap suggests that shifts of attention to visual locations of objects recruit areas involved in oculomotor programming and execution. Finally, the fronto-parietal network may be the source of spatial attentional modulations in the ventral visual system during object recognition or discrimination.     

Feature-based attention in the frontal eye field and area V4 during visual search

When we search for a target in a crowded visual scene, we often use the distinguishing features of the target, such as color or shape, to guide our attention and eye movements. To investigate the neural mechanisms of feature-based attention, we simultaneously recorded neural responses in the frontal eye field (FEF) and area V4 while monkeys performed a visual search task. The responses of cells in both areas were modulated by feature attention, independent of spatial attention, and the magnitude of response enhancement was inversely correlated with the number of saccades needed to find the target. However, an analysis of the latency of sensory and attentional influences on responses suggested that V4 provides bottom-up sensory information about stimulus features, whereas the FEF provides a top-down attentional bias toward target features that modulates sensory processing in V4 and that could be used to guide the eyes to a searched-for target.     

Electrical Neuroimaging Reveals Timing of Attentional Control Activity in Human Brain

Voluntarily shifting attention to a location of the visual field improves the perception of events that occur there. Regions of frontal cortex are thought to provide the top-down control signal that initiates a shift of attention, but because of the temporal limitations of functional brain imaging, the timing and sequence of attentional-control operations remain unknown. We used a new analytical technique (beamformer spatial filtering) to reconstruct the anatomical sources of low-frequency brain waves in humans associated with attentional control across time. Following a signal to shift attention, control activity was seen in parietal cortex 100–200 ms before activity was seen in frontal cortex. Parietal cortex was then reactivated prior to anticipatory biasing of activity in occipital cortex. The magnitudes of early parietal activations were strongly predictive of the degree of attentional improvement in perceptual performance. These results show that parietal cortex, not frontal cortex, provides the initial signals to shift attention and indicate that top-down attentional control is not purely top down.     

Decoding successive computational stages of saliency processing

An important requirement for vision is to identify interesting and relevant regions of the environment for further processing. Some models assume that salient locations from a visual scene are encoded in a dedicated spatial saliency map [1, 2]. Then, a winner-take-all (WTA) mechanism [1, 2] is often believed to threshold the graded saliency representation and identify the most salient position in the visual field. Here we aimed to assess whether neural representations of graded saliency and the subsequent WTA mechanism can be dissociated. We presented images of natural scenes while subjects were in a scanner performing a demanding fixation task, and thus their attention was directed away. Signals in early visual cortex and posterior intraparietal sulcus (IPS) correlated with graded saliency as defined by a computational saliency model. Multivariate pattern classification [3, 4] revealed that the most salient position in the visual field was encoded in anterior IPS and frontal eye fields (FEF), thus reflecting a potential WTA stage. Our results thus confirm that graded saliency and WTA-thresholded saliency are encoded in distinct neural structures. This could provide the neural representation required for rapid and automatic orientation toward salient events in natural environments.     

Timing and sequence of brain activity in top-down control of visual-spatial attention

Recent brain imaging studies using functional magnetic resonance imaging (fMRI) have implicated a frontal-parietal network in the top-down control of attention. However, little is known about the timing and sequence of activations within this network. To investigate these timing questions, we used event-related electrical brain potentials (ERPs) and a specially designed visual-spatial attentional-cueing paradigm, which were applied as part of a multi-methodological approach that included a closely corresponding event-related fMRI study using an identical paradigm. In the first 400 ms post cue, attention-directing and control cues elicited similar general cue-processing activity, corresponding to the more lateral subregions of the frontal-parietal network identified with the fMRI. Following this, the attention-directing cues elicited a sustained negative-polarity brain wave that was absent for control cues. This activity could be linked to the more medial frontal–parietal subregions similarly identified in the fMRI as specifically involved in attentional orienting. Critically, both the scalp ERPs and the fMRI-seeded source modeling for this orienting-related activity indicated an earlier onset of frontal versus parietal contribution (∼400 versus ∼700 ms). This was then followed (∼800–900 ms) by pretarget biasing activity in the region-specific visual-sensory occipital cortex. These results indicate an activation sequence of key components of the attentional-control brain network, providing insight into their functional roles. More specifically, these results suggest that voluntary attentional orienting is initiated by medial portions of frontal cortex, which then recruit medial parietal areas. Together, these areas then implement biasing of region-specific visual-sensory cortex to facilitate the processing of upcoming visual stimuli.     

Electrophysiological correlates of object location and object identity processing in spatial scenes

The ability to quickly detect changes in our surroundings has been crucial to human adaption and survival. In everyday life we often need to identify whether an object is new and if an object has changed its location. In the current event-related potential (ERP) study we investigated the electrophysiological correlates and the time course in detecting different types of changes of an objecṫs location and identity. In a delayed match-to-sample task participants had to indicate whether two consecutive scenes containing a road, a house, and two objects, were either the same or different. In six randomly intermixed conditions the second scene was identical, one of the objects had changed its identity, one of the objects had changed its location, or the objects had switched locations. The results reveal different time courses for the processing of identity and location changes in spatial scenes. Whereas location changes elicited a posterior N2 effect, indicating early mismatch detection, followed by a P3 effect reflecting post-perceptual processing, identity changes elicited an anterior N3 effect, which was delayed and functionally distinct from the N2 effect found for the location changes. The condition in which two objects switched position elicited a late ERP effect, reflected by a P3 effect similar to that obtained for the location changes. In sum, this study is the first to cohesively show different time courses for the processing of location changes, identity changes, and object switches in spatial scenes, which manifest themselves in different electrophysiological correlates.