A Normalization Model of Attentional Modulation of Single Unit Responses

Although many studies have shown that attention to a stimulus can enhance the responses of individual cortical sensory neurons, little is known about how attention accomplishes this change in response. Here, we propose that attention-based changes in neuronal responses depend on the same response normalization mechanism that adjusts sensory responses whenever multiple stimuli are present. We have implemented a model of attention that assumes that attention works only through this normalization mechanism, and show that it can replicate key effects of attention. The model successfully explains how attention changes the gain of responses to individual stimuli and also why modulation by attention is more robust and not a simple gain change when multiple stimuli are present inside a neuron''s receptive field. Additionally, the model accounts well for physiological data that measure separately attentional modulation and sensory normalization of the responses of individual neurons in area MT in visual cortex. The proposal that attention works through a normalization mechanism sheds new light a broad range of observations on how attention alters the representation of sensory information in cerebral cortex.     

A hypothetical role of cortico-basal ganglia-thalamocortical loops in visual processing

The goal of the present work was to define the mechanisms underlying the contribution of sensory and limbic cortico-basal ganglia-thalamocortical loops to visual processing and its attentional modulation. We proposed that visual processing is promoted by dopamine-dependent long-term modifications of synaptic transmission in the basal ganglia that favour a selection of neocortical patterns representing a visual stimulus. This selection is the result of the opposite sign of modulation of strong and weak cortico-basal ganglia inputs and subsequent activity reorganization in each loop. Reorganization leads to disinhibition/inhibition of cortical neurons strongly/weakly excited by stimulus during dopamine release. Recruitment of the thalamo-basal ganglia-collicular pathway is proposed to be necessary for stimulus-evoked dopamine release that underlies bottom-up attentional effects. Visual excitation of the prefrontal cortex and hippocampus (via the thalamus), their cooperation in control of the basal ganglia and dopaminergic cell firing, and simultaneous modulation of activity in diverse cortico-basal ganglia-thalamocortical loops is proposed to underlie top-down attentional effects. It follows from our model that only those components of cortical responses can be modulated by attention, whose onset exceeds the latency of visual responses of dopaminergic cells (50-110 ms). This and other consequences of the model are in accordance with known experimental data.     

Cellular mechanisms underlying stimulus-dependent gain modulation in primary visual cortex neurons in vivo

Gain modulation is a widespread neuronal phenomenon that modifies response amplitude without changing selectivity. Computational and in vitro studies have proposed cellular mechanisms of gain modulation based on the postsynaptic effects of background synaptic activation, but these mechanisms have not been studied in vivo. Here, we used intracellular recordings from cat primary visual cortex to measure neuronal gain while changing background synaptic activity with visual stimulation. We found that increases in the membrane fluctuations associated with increases in synaptic input do not obligatorily result in gain modulation in vivo. However, visual stimuli that evoked sustained changes in resting membrane potential, input resistance, and membrane fluctuations robustly modulated neuronal gain. The magnitude of gain modulation depended critically on the spatiotemporal properties of the visual stimulus. Gain modulation in vivo may thus be determined on a moment-to-moment basis by sensory context and the consequent dynamics of synaptic activation.     

How do we select perceptions and actions? Human brain imaging studies.

The selective nature of human perception and action implies a modulatory interaction between sensorimotor processes and attentional processes. This paper explores the use of functional imaging in humans to explore the mechanisms of perceptual selection and the fate of irrelevant stimuli that are not selected. Experiments with positron emission tomography show that two qualitatively different patterns of modulation of cerebral blood flow can be observed in experiments where non-spatial visual attention and auditory attention are manipulated. These patterns of modulation of cerebral blood flow modulation can be described as gain control and bias signal mechanisms. In visual and auditory cortex, the dominant change in cerebral blood flow associated with attention to either modality is related to a bias signal. The relation of these patterns of modulation to attentional effects that have been observed in single neurons is discussed. The existence of mechanisms for selective perception raises the more general question of whether irrelevant ignored stimuli are nevertheless perceived. Lavie''s theory of attention proposes that the degree to which ignored stimuli are processed varies depending on the perceptual load of the current task. Evidence from behavioural and functional magnetic resonance imaging studies of ignored visual motion processing is presented in support of this proposal.     

Color and luminance contrasts attract independent attention

Paying attention can improve vision in many ways, including some very basic functions such as contrast discrimination, a task that probably reflects very early levels of visual processing. Electrophysiological, psychophysical, and imaging studies on humans as well as single recordings in monkey show that attention can modulate the neuronal response at an early stage of visual processing, probably by acting on the response gain. Here, we measure incremental contrast thresholds for luminance and color stimuli to derive the contrast response of early neural mechanisms and their modulation by attention. We show that, for both cases, attention improves contrast discrimination, probably by multiplicatively increasing the gain of the neuronal response to contrast. However, the effects of attention are highly specific to the visual modality: concurrent attention to a competing luminance, but not chromatic pattern, greatly impedes luminance contrast discrimination; and attending to a competing chromatic, but not luminance, task impedes color contrast discrimination. Thus, the effects of attention are highly modality specific, implying separate attentional resources for different fundamental visual attributes at early stages of visual processing.     

Feature-based attention increases the selectivity of population responses in primate visual cortex

BACKGROUND: Attending to the spatial location or to nonspatial features of visual stimuli can modulate neuronal responses in primate visual cortex. The modulation by spatial attention changes the gain of sensory neurons and strengthens the representation of attended locations without changing neuronal selectivities such as directionality, i.e., the ratio of responses to preferred and anti-preferred directions of motion. Whether feature-based attention acts in a similar manner is unknown. RESULTS: To clarify this issue, we recorded the responses of 135 direction-selective neurons in the middle temporal area (MT) of two macaques to an unattended moving random dot pattern (the distractor) positioned inside a neuron's receptive field while the animals attended to a second moving pattern positioned in the opposite hemifield. Responses to different directions of the distractor were modulated by the same factor (approximately 12%) as long as the attended direction remained unchanged. On the other hand, systematically changing the attended direction from a neuron's preferred to its anti-preferred direction caused a systematic change of the attentional modulation from an enhancement to a suppression, increasing directionality by about 20%. CONCLUSIONS: The results show that (1) feature-based attention exerts a multiplicative modulation upon neuronal responses and that the strength of this modulation depends on the similarity between the attended feature and the cell's preferred feature, in line with the feature-similarity gain model, and (2) at the level of the neuronal population, feature-based attention increases the selectivity for attended features by increasing the responses of neurons preferring this feature value while decreasing responses of neurons tuned to the opposite feature value.     

Rapid dynamics of contrast responses in the cat primary visual cortex

The visual information we receive during natural vision changes rapidly and continuously. The visual system must adapt to the spatiotemporal contents of the environment in order to efficiently process the dynamic signals. However, neuronal responses to luminance contrast are usually measured using drifting or stationary gratings presented for a prolonged duration. Since motion in our visual field is continuous, the signals received by the visual system contain an abundance of transient components in the contrast domain. Here using a modified reverse correlation method, we studied the properties of responses of neurons in the cat primary visual cortex to different contrasts of grating stimuli presented statically and transiently for 40 ms, and showed that neurons can effectively discriminate the rapidly changing contrasts. The change in the contrast response function (CRF) over time mainly consisted of an increment in contrast gain (CRF shifts to left) in the developing phase of temporal responses and a decrement in response gain (CRF shifts downward) in the decay phase. When the distribution range of stimulus contrasts was increased, neurons demonstrated decrement in contrast gain and response gain. Our results suggest that contrast gain control (contrast adaptation) and response gain control mechanisms are well established during the first tens of milliseconds after stimulus onset and may cooperatively mediate the rapid dynamic responses of visual cortical neurons to the continuously changing contrast. This fast contrast adaptation may play a role in detecting contrast contours in the context of visual scenes that are varying rapidly.     

AIM: A network model of attention in auditory cortex

Attentional modulation of cortical networks is critical for the cognitive flexibility required to process complex scenes. Current theoretical frameworks for attention are based almost exclusively on studies in visual cortex, where attentional effects are typically modest and excitatory. In contrast, attentional effects in auditory cortex can be large and suppressive. A theoretical framework for explaining attentional effects in auditory cortex is lacking, preventing a broader understanding of cortical mechanisms underlying attention. Here, we present a cortical network model of attention in primary auditory cortex (A1). A key mechanism in our network is attentional inhibitory modulation (AIM) of cortical inhibitory neurons. In this mechanism, top-down inhibitory neurons disinhibit bottom-up cortical circuits, a prominent circuit motif observed in sensory cortex. Our results reveal that the same underlying mechanisms in the AIM network can explain diverse attentional effects on both spatial and frequency tuning in A1. We find that a dominant effect of disinhibition on cortical tuning is suppressive, consistent with experimental observations. Functionally, the AIM network may play a key role in solving the cocktail party problem. We demonstrate how attention can guide the AIM network to monitor an acoustic scene, select a specific target, or switch to a different target, providing flexible outputs for solving the cocktail party problem.     

A Feedback Model of Attention Explains the Diverse Effects of Attention on Neural Firing Rates and Receptive Field Structure

Visual attention has many effects on neural responses, producing complex changes in firing rates, as well as modifying the structure and size of receptive fields, both in topological and feature space. Several existing models of attention suggest that these effects arise from selective modulation of neural inputs. However, anatomical and physiological observations suggest that attentional modulation targets higher levels of the visual system (such as V4 or MT) rather than input areas (such as V1). Here we propose a simple mechanism that explains how a top-down attentional modulation, falling on higher visual areas, can produce the observed effects of attention on neural responses. Our model requires only the existence of modulatory feedback connections between areas, and short-range lateral inhibition within each area. Feedback connections redistribute the top-down modulation to lower areas, which in turn alters the inputs of other higher-area cells, including those that did not receive the initial modulation. This produces firing rate modulations and receptive field shifts. Simultaneously, short-range lateral inhibition between neighboring cells produce competitive effects that are automatically scaled to receptive field size in any given area. Our model reproduces the observed attentional effects on response rates (response gain, input gain, biased competition automatically scaled to receptive field size) and receptive field structure (shifts and resizing of receptive fields both spatially and in complex feature space), without modifying model parameters. Our model also makes the novel prediction that attentional effects on response curves should shift from response gain to contrast gain as the spatial focus of attention drifts away from the studied cell.     

Context-dependent changes in functional circuitry in visual area MT

Animals can flexibly change their behavior in response to a particular sensory stimulus; the mapping between sensory and motor representations in the brain must therefore be flexible as well. Changes in the correlated firing of pairs of neurons may provide a metric of changes in functional circuitry during behavior. We studied dynamic changes in functional circuitry by analyzing the noise correlations of simultaneously recorded MT neurons in two behavioral contexts: one that promotes cooperative interactions between the two neurons and another that promotes competitive interactions. We found that identical visual stimuli give rise to differences in noise correlation in the two contexts, suggesting that MT neurons receive inputs of central origin whose strength changes with the task structure. The data are consistent with a mixed feature-based attentional strategy model in which the animal sometimes alternates attention between opposite directions of motion and sometimes attends to the two directions simultaneously.     

Neurotrophin-3 is required for appropriate establishment of thalamocortical connections

Ca2+-permeable AMPARs are inwardly rectifying due to block by intracellular polyamines. Neuronal activity regulates polyamine synthesis, yet whether this affects Ca2+-AMPAR-mediated synaptic transmission is unknown. We test whether 4 hr of increased visual stimulation regulates glutamatergic retino-tectal synapses in Xenopus tadpoles. Tectal neurons containing Ca2+-AMPARs form a gradient along the rostro-caudal developmental axis. These neurons had inwardly rectifying AMPAR-mediated EPSCs. Four hours of visual stimulation or addition of intracellular spermine increased rectification in immature neurons. Polyamine synthesis inhibitors blocked the effect of visual stimulation, suggesting that visual activity regulates AMPARs via the polyamine synthesis pathway. This modulation resulted in changes in the integrative properties of tectal neurons. Regulation of polyamine synthesis by physiological stimuli is a novel form of modulation of synaptic transmission important for understanding the short-term effects of enhanced sensory experience during development.     

Parvalbumin-expressing interneurons linearly transform cortical responses to visual stimuli

The response of cortical neurons to a sensory stimulus is shaped by the network in which they are embedded. Here we establish a role of parvalbumin (PV)-expressing cells, a large class of inhibitory neurons that target the soma and perisomatic compartments of pyramidal cells, in controlling cortical responses. By bidirectionally manipulating PV cell activity in visual cortex we show that these neurons strongly modulate layer 2/3 pyramidal cell spiking responses to visual stimuli while only modestly affecting their tuning properties. PV cells' impact on pyramidal cells is captured by a linear transformation, both additive and multiplicative, with a threshold. These results indicate that PV cells are ideally suited to modulate cortical gain and establish a causal relationship between a select neuron type and specific computations performed by the cortex during sensory processing.     

The temporal resolution of neural codes: does response latency have a unique role?

This article reviews the nature of the neural code in non-human primate cortex and assesses the potential for neurons to carry two or more signals simultaneously. Neurophysiological recordings from visual and motor systems indicate that the evidence for a role for precisely timed spikes relative to other spike times (ca. 1-10 ms resolution) is inconclusive. This indicates that the visual system does not carry a signal that identifies whether the responses were elicited when the stimulus was attended or not. Simulations show that the absence of such a signal reduces, but does not eliminate, the increased discrimination between stimuli that are attended compared with when the stimuli are unattended. The increased accuracy asymptotes with increased gain control, indicating limited benefit from increasing attention. The absence of a signal identifying the attentional state under which stimuli were viewed can produce the greatest discrimination between attended and unattended stimuli. Furthermore, the greatest reduction in discrimination errors occurs for a limited range of gain control, again indicating that attention effects are limited. By contrast to precisely timed patterns of spikes where the timing is relative to other spikes, response latency provides a fine temporal resolution signal (ca. 10 ms resolution) that carries information that is unavailable from coarse temporal response measures. Changes in response latency and changes in response magnitude can give rise to different predictions for the patterns of reaction times. The predictions are verified, and it is shown that the standard method for distinguishing executive and slave processes is only valid if the representations of interest, as evidenced by the neural code, are known. Overall, the data indicate that the signalling evident in neural signals is restricted to the spike count and the precise times of spikes relative to stimulus onset (response latency). These coding issues have implications for our understanding of cognitive models of attention and the roles of executive and slave systems.     

Contrast discrimination,non-uniform patterns and change blindness.

Change blindness--our inability to detect large changes in natural scenes when saccades, blinks and other transients interrupt visual input--seems to contradict psychophysical evidence for our exquisite sensitivity to contrast changes. Can the type of effects described as ''change blindness'' be observed with simple, multi-element stimuli, amenable to psychophysical analysis? Such stimuli, composed of five mixed contrast elements, elicited a striking increase in contrast increment thresholds compared to those for an isolated element. Cue presentation prior to the stimulus substantially reduced thresholds, as for change blindness with natural scenes. On one hand, explanations for change blindness based on abstract and sketchy representations in short-term visual memory seem inappropriate for this low-level image property of contrast where there is ample evidence for exquisite performance on memory tasks. On the other hand, the highly increased thresholds for mixed contrast elements, and the decreased thresholds when a cue is present, argue against any simple early attentional or sensory explanation for change blindness. Thus, psychophysical results for very simple patterns cannot straightforwardly predict results even for the slightly more complicated patterns studied here.     

Adaptation accentuates responses of fly motion-sensitive visual neurons to sudden stimulus changes

Adaptation in sensory and neuronal systems usually leads to reduced responses to persistent or frequently presented stimuli. In contrast to simple fatigue, adapted neurons often retain their ability to encode changes in stimulus intensity and to respond when novel stimuli appear. We investigated how the level of adaptation of a fly visual motion-sensitive neuron affects its responses to discontinuities in the stimulus, i.e. sudden brief changes in one of the stimulus parameters (velocity, contrast, grating orientation and spatial frequency). Although the neuron''s overall response decreased gradually during ongoing motion stimulation, the response transients elicited by stimulus discontinuities were preserved or even enhanced with adaptation. Moreover, the enhanced sensitivity to velocity changes by adaptation was not restricted to a certain velocity range, but was present regardless of whether the neuron was adapted to a baseline velocity below or above its steady-state velocity optimum. Our results suggest that motion adaptation helps motion-sensitive neurons to preserve their sensitivity to novel stimuli even in the presence of strong tonic stimulation, for example during self-motion.     

Learning strengthens the response of primary visual cortex to simple patterns

Training can significantly improve performance on even the most basic visual tasks, such as detecting a faint patch of light or determining the orientation of a bar (for reviews, see ). The neural mechanisms of visual learning, however, remain controversial. One simple way to improve behavior is to increase the overall neural response to the trained stimulus by increasing the number or gain of responsive neurons. Learning of this type has been observed in other sensory modalities, where training increases the number of receptive fields that cover the trained stimulus. Here, we show that visual learning can selectively increase the overall response to trained stimuli in primary visual cortex (V1). We used functional magnetic resonance imaging (fMRI) to measure neural signals before and after one month of practice at detecting very low-contrast oriented patterns. Training increased V1 response for practiced orientations relative to control orientations by an average of 39%, and the magnitude of the change in V1 correlated moderately well with the magnitude of changes in detection performance. The elevation of V1 activity by training likely results from an increase in the number of neurons responding to the trained stimulus or an increase in response gain.     

Functional specialization of mouse higher visual cortical areas

The mouse is emerging as an important model for understanding how sensory neocortex extracts cues to guide behavior, yet little is known about how these cues are processed beyond primary cortical areas. Here, we used two-photon calcium imaging in awake mice to compare visual responses in primary visual cortex (V1) and in two downstream target areas, AL and PM. Neighboring V1 neurons had diverse stimulus preferences spanning five octaves in spatial and temporal frequency. By contrast, AL and PM neurons responded best to distinct ranges of stimulus parameters. Most strikingly, AL neurons preferred fast-moving stimuli while PM neurons preferred slow-moving stimuli. By contrast, neurons in V1, AL, and PM demonstrated similar selectivity for stimulus orientation but not for stimulus direction. Based on these findings, we predict that area AL helps guide behaviors involving fast-moving stimuli (e.g., optic flow), while area PM?helps guide behaviors involving slow-moving objects.     

Feature-based attentional modulations in the absence of direct visual stimulation

When faced with a crowded visual scene, observers must selectively attend to behaviorally relevant objects to avoid sensory overload. Often this selection process is guided by prior knowledge of a target-defining feature (e.g., the color red when looking for an apple), which enhances the firing rate of visual neurons that are selective for the attended feature. Here, we used functional magnetic resonance imaging and a pattern classification algorithm to predict the attentional state of human observers as they monitored a visual feature (one of two directions of motion). We find that feature-specific attention effects spread across the visual field-even to regions of the scene that do not contain a stimulus. This spread of feature-based attention to empty regions of space may facilitate the perception of behaviorally relevant stimuli by increasing sensitivity to attended features at all locations in the visual field.     

Adaptation to stimulus contrast and correlations during natural visual stimulation

In this study, we characterize the adaptation of neurons in the cat lateral geniculate nucleus to changes in stimulus contrast and correlations. By comparing responses to high- and low-contrast natural scene movie and white noise stimuli, we show that an increase in contrast or correlations results in receptive fields with faster temporal dynamics and stronger antagonistic surrounds, as well as decreases in gain and selectivity. We also observe contrast- and correlation-induced changes in the reliability and sparseness of neural responses. We find that reliability is determined primarily by processing in the receptive field (the effective contrast of the stimulus), while sparseness is determined by the interactions between several functional properties. These results reveal a number of adaptive phenomena and suggest that adaptation to stimulus contrast and correlations may play an important role in visual coding in a dynamic natural environment.