The peri-saccadic perception of objects and space

Eye movements affect object localization and object recognition. Around saccade onset, briefly flashed stimuli appear compressed towards the saccade target, receptive fields dynamically change position, and the recognition of objects near the saccade target is improved. These effects have been attributed to different mechanisms. We provide a unifying account of peri-saccadic perception explaining all three phenomena by a quantitative computational approach simulating cortical cell responses on the population level. Contrary to the common view of spatial attention as a spotlight, our model suggests that oculomotor feedback alters the receptive field structure in multiple visual areas at an intermediate level of the cortical hierarchy to dynamically recruit cells for processing a relevant part of the visual field. The compression of visual space occurs at the expense of this locally enhanced processing capacity.     

Dissociable effects of reward on attentional learning: from passive associations to active monitoring

Visual selective attention (VSA) is the cognitive function that regulates ongoing processing of retinal input in order for selected representations to gain privileged access to perceptual awareness and guide behavior, facilitating analysis of currently relevant information while suppressing the less relevant input. Recent findings indicate that the deployment of VSA is shaped according to past outcomes. Targets whose selection has led to rewarding outcomes become relatively easier to select in the future, and distracters that have been ignored with higher gains are more easily discarded. Although outcomes (monetary rewards) were completely predetermined in our prior studies, participants were told that higher rewards would follow more efficient responses. In a new experiment we have eliminated the illusory link between performance and outcomes by informing subjects that rewards were randomly assigned. This trivial yet crucial manipulation led to strikingly different results. Items that were associated more frequently with higher gains became more difficult to ignore, regardless of the role (target or distracter) they played when differential rewards were delivered. Therefore, VSA is shaped by two distinct reward-related learning mechanisms: one requiring active monitoring of performance and outcome, and a second one detecting the sheer association between objects in the environment (whether attended or ignored) and the more-or-less rewarding events that accompany them.     

Strength of response suppression to distracter stimuli determines attentional-filtering performance in primate prefrontal neurons

Neurons in the primate dorsolateral prefrontal cortex (dlPFC) filter attended [corrected] targets distinctly from distracters through their response rates. The extent to which this ability correlates with the organism's performance, and the neural processes underlying it, remain unclear. We trained monkeys to attend to a visual target that differed in rank along a color-ordinal scale from that of a distracter. The animals' performance at focusing attention on the target and filtering out the distracter improved as ordinal distance between the stimuli increased. Importantly, dlPFC neurons also improved their filtering performance with increasing ordinal target-distracter distance; they built up their response rate in anticipation of the target-distracter onset, and then units encoding target representations increased their firing rate by similar amounts, whereas units encoding distracter representations gradually suppressed their rates as the interstimulus ordinal distance increased. These results suggest that attentional-filtering performance in primates relies upon dlPFC neurons' ability to suppress distracter representations.     

Temporal brain dynamics of multiple object processing: the flexibility of individuation

The ability to process concurrently multiple visual objects is fundamental for a coherent perception of the world. A core component of this ability is the simultaneous individuation of multiple objects. Many studies have addressed the mechanism of object individuation but it remains unknown whether the visual system mandatorily individuates all relevant elements in the visual field, or whether object indexing depends on task demands. We used a neural measure of visual selection, the N2pc component, to evaluate the flexibility of multiple object individuation. In three ERP experiments, participants saw a variable number of target elements among homogenous distracters and performed either an enumeration task (Experiment 1) or a detection task, reporting whether at least one (Experiment 2) or a specified number of target elements (Experiment 3) was present. While in the enumeration task the N2pc response increased as a function of the number of targets, no such modulation was found in Experiment 2, indicating that individuation of multiple targets is not mandatory. However, a modulation of the N2pc similar to the enumeration task was visible in Experiment 3, further highlighting that object individuation is a flexible mechanism that binds indexes to object properties and locations as needed for further object processing.     

Interacting roles of attention and visual salience in V4

Attention increases the contrast gain of V4 neurons, causing them to respond to an attended stimulus as though its contrast had increased. When multiple stimuli appear within a neuron's receptive field (RF), the neuron responds primarily to the attended stimulus. This suggests that cortical cells may be "hard wired" to respond preferentially to the highest-contrast stimulus in their RF, and neural systems for attention capitalize on this mechanism by dynamically increasing the effective contrast of the stimulus that is task relevant. To test this, we varied the relative contrast of two stimuli within the recorded neurons' RFs, while the monkeys attended away to another location. Increasing the physical contrast of one stimulus caused V4 neurons to respond preferentially to that stimulus and reduced their responses to competing stimuli. When attention was directed to the lower-contrast stimulus, it partially overcame the influence of a competing, higher-contrast stimulus.     

Coherent interaction of dynamical attractors for object-based selective attention

I investigate essential neuronal mechanisms of visual attention based on object-based theory and a biased-competition scheme. A neural network model is proposed that consists of two feature networks, FI and FII, and one object network, OJ. The FI and FII networks send feedforward projections to the OJ network and receive feedback projections from the OJ network in a convergent/divergent manner. The OJ network integrates information about sensory features originated from the FI and FII networks into information about objects. I let the feature networks and the object network memorize individual features and objects according to the Hebbian learning rule and create the point attractors corresponding to these features and objects as long-term memories in the network dynamics. When the model tries to attend to objects that are superimposed, the point attractors relevant to the two objects emerge in each network. After a short interval (hundreds of milliseconds), the point attractors relevant to one of the two objects are selected and the other point attractors are completely suppressed. I suggest that coherent interactions of dynamical attractors relevant to the selected object may be the neuronal substrate for object-based selective attention. Bottom-up (FI-to-OJ and FI-to-OJ) neuronal mechanisms separate candidate objects from the background, and top-down (OJ-to-FI and OJ-to-FII) mechanisms resolve object-competition by which one relevant object is selected from candidate objects.     

Feature-based attention increases the selectivity of population responses in primate visual cortex

BACKGROUND: Attending to the spatial location or to nonspatial features of visual stimuli can modulate neuronal responses in primate visual cortex. The modulation by spatial attention changes the gain of sensory neurons and strengthens the representation of attended locations without changing neuronal selectivities such as directionality, i.e., the ratio of responses to preferred and anti-preferred directions of motion. Whether feature-based attention acts in a similar manner is unknown. RESULTS: To clarify this issue, we recorded the responses of 135 direction-selective neurons in the middle temporal area (MT) of two macaques to an unattended moving random dot pattern (the distractor) positioned inside a neuron's receptive field while the animals attended to a second moving pattern positioned in the opposite hemifield. Responses to different directions of the distractor were modulated by the same factor (approximately 12%) as long as the attended direction remained unchanged. On the other hand, systematically changing the attended direction from a neuron's preferred to its anti-preferred direction caused a systematic change of the attentional modulation from an enhancement to a suppression, increasing directionality by about 20%. CONCLUSIONS: The results show that (1) feature-based attention exerts a multiplicative modulation upon neuronal responses and that the strength of this modulation depends on the similarity between the attended feature and the cell's preferred feature, in line with the feature-similarity gain model, and (2) at the level of the neuronal population, feature-based attention increases the selectivity for attended features by increasing the responses of neurons preferring this feature value while decreasing responses of neurons tuned to the opposite feature value.     

Investigating saccade programming in the praying mantis Tenodera aridifolia using distracter interference paradigms

To investigate the saccadic system in the mantis, I applied distracter interference paradigms. These involved presenting the mantis with a fixation target and one or several distracters supposed to affect saccades towards the target. When a single target was presented, a medium-sized target located in its lower visual field elicited higher rates of saccade response. This preference for target size and position was also observed when a target and a distracter were presented simultaneously. That is, the mantis chose and fixated the target rather than a distracter that was much smaller or larger than the target, or was located above the target. Furthermore, the mantis' preference was not affected by increasing the number of distracters. However, the presence of the distracter decreased the occurrence rate of saccade and increased the response time to saccade. I conclude that distracter interference paradigms are an effective way of investigating the visual processing underlying saccade generation in the mantis. Possible mechanisms of saccade generation in the mantis are discussed.     

Exploring BOLD Changes during Spatial Attention in Non-Stimulated Visual Cortex

Blood oxygen level-dependent (BOLD) responses were measured in parts of primary visual cortex that represented unstimulated visual field regions at different distances from a stimulated central target location. The composition of the visual scene varied by the presence or absence of additional peripheral distracter stimuli. Bottom-up effects were assessed by comparing peripheral activity during central stimulation vs. no stimulation. Top-down effects were assessed by comparing active vs. passive conditions. In passive conditions subjects simply watched the central letter stimuli and in active conditions they had to report occurrence of pre-defined targets in a rapid serial letter stream. Onset of the central letter stream enhanced activity in V1 representations of the stimulated region. Within representations of the periphery activation decreased and finally turned into deactivation with increasing distance from the stimulated location. This pattern was most pronounced in the active conditions and during the presence of peripheral stimuli. Active search for a target did not lead to additional enhancement at areas representing the attentional focus but to a stronger deactivation in the vicinity. Suppressed neuronal activity was also found in the non distracter condition suggesting a top-down attention driven effect. Our observations suggest that BOLD signal decreases in primary visual cortex are modulated by bottom-up sensory-driven factors such as the presence of distracters in the visual field as well as by top-down attentional processes.     

Spatial interactions in rapid pattern discrimination

We measured reaction times (RTs) for identification of a target among distracters under stabilized image conditions in which the positions of the target and the distracters were constant within a single experimental session. Under these conditions, the observer need not search for the target because its position is known. We nevertheless found that the presence of even a single distracter could elevate RTs. The magnitude of this effect depended on the distance of the distracter from the target and, for some observers, the distance of the distracter from the fovea. When we added not one but six background elements in a ring around the target, RT increased even more. If, apart from these neighboring distracters, the target was surrounded by more distracters located beyond the nearest neighbors, RT was, in general, not increased further. These findings suggest that adding background elements in a search task can elevate RTs in ways that are not dependent on the positional uncertainty of the target.     

Can Attention Be Confined to Just Part of a Moving Object? Revisiting Target-Distractor Merging in Multiple Object Tracking

While it was initially thought that attention was space-based, more recent work has shown that attention can also be object-based, in that observers find it easier to attend to different parts of the same object than to different parts of different objects. Such studies have shown that attention more easily spreads throughout an object than between objects. However, it is not known to what extent attention can be confined to just part of an object and to what extent attending to part of an object necessarily causes the entire object to be attended. We have investigated this question in the context of the multiple object tracking paradigm in which subjects are shown a scene containing a number of identical moving objects and asked to mentally track a subset of them, the targets, while not tracking the remainder, the distractors. Previous work has shown that joining each target to a distractor by a solid connector so that each target-distractor pair forms a single physical object, a technique known as target-distractor merging, makes it hard to track the targets, suggesting that attention cannot be restricted to just parts of objects. However, in that study the target-distractor pairs continuously changed length, which in itself would have made tracking difficult. Here we show that it remains difficult to track the targets even when the target-distractor pairs do not change length and even when the targets can be differentiated from the connectors that join them to the distractors. Our experiments suggest that it is hard to confine attention to just parts of objects, at least in the case of moving objects.     

Feature-based attention modulates orientation-selective responses in human visual cortex

How does feature-based attention modulate neural responses? We used adaptation to quantify the effect of feature-based attention on orientation-selective responses in human visual cortex. Observers were adapted to two superimposed oblique gratings while attending to one grating only. We measured the magnitude of attention-induced orientation-selective adaptation both psychophysically, by the behavioral tilt aftereffect, and physiologically, using fMRI response adaptation. We found evidence for orientation-selective attentional modulation of neuronal responses-a lower fMRI response for the attended than the unattended orientation-in multiple visual areas, and a significant correlation between the magnitude of the tilt aftereffect and that of fMRI response adaptation in V1, the earliest site of orientation coding. These results show that feature-based attention can selectively increase the response of neuronal subpopulations that prefer the attended feature, even when the attended and unattended features are coded in the same visual areas and share the same retinotopic location.     

Time sharing in rats: A peak-interval procedure with gaps and distracters

Four hypotheses (switch, instructional-ambiguity, memory decay, and time sharing) were evaluated in a reversed peak-interval procedure with gaps by presenting distracter stimuli during the uninterrupted timed signal. The switch, instructional-ambiguity, and memory-decay hypotheses predict that subjects should time through the distracter and delay responding during gaps. The time-sharing hypothesis assumes that the internal clock shares attentional and working-memory resources with other processes, so that both gaps and distracters delay timing by causing working memory to decay. We found that response functions were displaced both by gaps and by distracters. Computer simulations show that when combined, the memory-decay and time-sharing hypotheses can mechanistically address present data, suggesting that these two hypotheses may reflect different levels of analysis of the same phenomenon.     

Object segmentation model: analytical results and biological implications

 A simple, biologically motivated neural network for segmentation of a moving object from a visual scene is presented. The model consists of two parts: an object selection model which employs a scaling approach for receptive field sizes, and a subsequent network implementing a spotlight by means of multiplicative synapses. The network selects one object out of several, segments the rough contour of the object, and encodes the winner object's position with high accuracy. Analytical equations for the performance level of the network, e.g., for the critical distance of two objects above which they are perceived as separate, are derived. The network preferentially chooses the object with the largest angular velocity and the largest angular width. An equation for the velocity and width preferences is presented. Additionally it is shown that for certain neurons of the model, flat receptive fields are more favourable than Gaussian ones. The network exhibits performances similar to those known from amphibians. Various electrophysiological and behavioral results – e.g., the distribution of the diameters of the receptive fields of tectal neurons, of the tongue-projecting salamander Hydromantes italicus and the range of optimal prey velocities for prey catching – can be understood on the basis of the model. Received: 7 December 2000 / Accepted: 13 February 2001     

Attentive mechanisms in visual search

Selective attention can be employed to a restricted region in space or to specific objects. Many properties of this attentional window or spotlight are not well understood. In the present study, we examined the question whether the putative shape of the attentional spotlight can be determined by endogenous cueing within a visual search paradigm. Participants searched for a target among distractors, which were arranged within a vertical or horizontal rectangle. The shape of this rectangle was cued endogenously in a valid or invalid way. Response times (RTs) to correct identification of target orientation were recorded. In Experiment 1, the difference between valid and invalid RTs demonstrated that cueing resulted in elongated attentional areas. This was true only for a group of experienced psychophysical participants, whereas a group of inexperienced participants were not able to use cueing in this way. In Experiment 2, the line motion illusion was used to examine the spatial properties of the attended area. The results confirmed for both experienced and inexperienced participants that attention was confined to the cued elongated area only. We present converging evidence for an attentional spotlight whose shape can be adjusted flexibly by appropriate endogenous cueing.     

Landmark recognition in Alzheimer's dementia: spared implicit memory for objects relevant for navigation

Background

In spatial navigation, landmark recognition is crucial. Specifically, memory for objects placed at decision points on a route is relevant. Previous fMRI research in healthy adults showed higher medial-temporal lobe (MTL) activation for objects placed at decision points compared to non-decision points, even at an implicit level. Since there is evidence that implicit learning is intact in amnesic patients, the current study examined memory for objects relevant for navigation in patients with Alzheimer’s dementia (AD).

Methodology/Principal Findings

21 AD patients participated with MTL atrophy assessed on MRI (mean MMSE = 21.2, SD = 4.0), as well as 20 age- and education-matched non-demented controls. All participants watched a 5-min video showing a route through a virtual museum with 20 objects placed at intersections (decision points) and 20 at simple turns (non-decision points). The instruction was to pay attention to the toys (half of the objects) for which they were supposedly tested later. Subsequently, a recognition test followed with the 40 previously presented objects among 40 distracter items (both toys and non-toys). Results showed a better performance for the non-toy objects placed at decision points than non-decision points, both for AD patients and controls.

Conclusion/Significance

Our findings indicate that AD patients with MTL damage have implicit memory for object information relevant for navigation. No decision point effect was found for the attended items. Possibly, focusing attention on the items occurred at the cost of the context information in AD, whereas the controls performed at an optimal level due to intact memory function.     

Occipital Alpha Activity during Stimulus Processing Gates the Information Flow to Object-Selective Cortex

Given the limited processing capabilities of the sensory system, it is essential that attended information is gated to downstream areas, whereas unattended information is blocked. While it has been proposed that alpha band (8–13 Hz) activity serves to route information to downstream regions by inhibiting neuronal processing in task-irrelevant regions, this hypothesis remains untested. Here we investigate how neuronal oscillations detected by electroencephalography in visual areas during working memory encoding serve to gate information reflected in the simultaneously recorded blood-oxygenation-level-dependent (BOLD) signals recorded by functional magnetic resonance imaging in downstream ventral regions. We used a paradigm in which 16 participants were presented with faces and landscapes in the right and left hemifields; one hemifield was attended and the other unattended. We observed that decreased alpha power contralateral to the attended object predicted the BOLD signal representing the attended object in ventral object-selective regions. Furthermore, increased alpha power ipsilateral to the attended object predicted a decrease in the BOLD signal representing the unattended object. We also found that the BOLD signal in the dorsal attention network inversely correlated with visual alpha power. This is the first demonstration, to our knowledge, that oscillations in the alpha band are implicated in the gating of information from the visual cortex to the ventral stream, as reflected in the representationally specific BOLD signal. This link of sensory alpha to downstream activity provides a neurophysiological substrate for the mechanism of selective attention during stimulus processing, which not only boosts the attended information but also suppresses distraction. Although previous studies have shown a relation between the BOLD signal from the dorsal attention network and the alpha band at rest, we demonstrate such a relation during a visuospatial task, indicating that the dorsal attention network exercises top-down control of visual alpha activity.     

Feature-based attentional modulations in the absence of direct visual stimulation

When faced with a crowded visual scene, observers must selectively attend to behaviorally relevant objects to avoid sensory overload. Often this selection process is guided by prior knowledge of a target-defining feature (e.g., the color red when looking for an apple), which enhances the firing rate of visual neurons that are selective for the attended feature. Here, we used functional magnetic resonance imaging and a pattern classification algorithm to predict the attentional state of human observers as they monitored a visual feature (one of two directions of motion). We find that feature-specific attention effects spread across the visual field-even to regions of the scene that do not contain a stimulus. This spread of feature-based attention to empty regions of space may facilitate the perception of behaviorally relevant stimuli by increasing sensitivity to attended features at all locations in the visual field.     

Fixation Strategy Influences the Ability to Focus Attention on Two Spatially Separate Objects

The ability to devote attention simultaneously to multiple visual objects plays an important role in domains ranging from everyday activities to the workplace. Yet, no studies have systematically explored the fixation strategies that optimize attention to two spatially distinct objects. Assuming the two objects require attention nearly simultaneously, subjects either could fixate one object or they could fixate between the objects. Studies measuring the breadth of attention have focused almost exclusively on the former strategy, by having subjects simultaneously perform one attention-demanding task at fixation and another in the periphery. We compared performance when one object was at fixation and the other was in the periphery to a condition in which both objects were in the periphery and subjects fixated between them. Performance was better with two peripheral stimuli than with one central and one peripheral stimulus, meaning that a strategy of fixating between stimuli permitted greater attention breadth. Consistent with the idea that both measures tap attention breadth, sport experts consistently outperformed novices with both fixation strategies. Our findings suggest a way to improve performance when observers must pay attention to multiple objects across spatial regions. We discuss possible explanations for this performance advantage.     

Spatial and Feature-Based Attention in a Layered Cortical Microcircuit Model

Directing attention to the spatial location or the distinguishing feature of a visual object modulates neuronal responses in the visual cortex and the stimulus discriminability of subjects. However, the spatial and feature-based modes of attention differently influence visual processing by changing the tuning properties of neurons. Intriguingly, neurons'' tuning curves are modulated similarly across different visual areas under both these modes of attention. Here, we explored the mechanism underlying the effects of these two modes of visual attention on the orientation selectivity of visual cortical neurons. To do this, we developed a layered microcircuit model. This model describes multiple orientation-specific microcircuits sharing their receptive fields and consisting of layers 2/3, 4, 5, and 6. These microcircuits represent a functional grouping of cortical neurons and mutually interact via lateral inhibition and excitatory connections between groups with similar selectivity. The individual microcircuits receive bottom-up visual stimuli and top-down attention in different layers. A crucial assumption of the model is that feature-based attention activates orientation-specific microcircuits for the relevant feature selectively, whereas spatial attention activates all microcircuits homogeneously, irrespective of their orientation selectivity. Consequently, our model simultaneously accounts for the multiplicative scaling of neuronal responses in spatial attention and the additive modulations of orientation tuning curves in feature-based attention, which have been observed widely in various visual cortical areas. Simulations of the model predict contrasting differences between excitatory and inhibitory neurons in the two modes of attentional modulations. Furthermore, the model replicates the modulation of the psychophysical discriminability of visual stimuli in the presence of external noise. Our layered model with a biologically suggested laminar structure describes the basic circuit mechanism underlying the attention-mode specific modulations of neuronal responses and visual perception.