How behavioral constraints may determine optimal sensory representations

The sensory-triggered activity of a neuron is typically characterized in terms of a tuning curve, which describes the neuron's average response as a function of a parameter that characterizes a physical stimulus. What determines the shapes of tuning curves in a neuronal population? Previous theoretical studies and related experiments suggest that many response characteristics of sensory neurons are optimal for encoding stimulus-related information. This notion, however, does not explain the two general types of tuning profiles that are commonly observed: unimodal and monotonic. Here I quantify the efficacy of a set of tuning curves according to the possible downstream motor responses that can be constructed from them. Curves that are optimal in this sense may have monotonic or nonmonotonic profiles, where the proportion of monotonic curves and the optimal tuning-curve width depend on the general properties of the target downstream functions. This dependence explains intriguing features of visual cells that are sensitive to binocular disparity and of neurons tuned to echo delay in bats. The numerical results suggest that optimal sensory tuning curves are shaped not only by stimulus statistics and signal-to-noise properties but also according to their impact on downstream neural circuits and, ultimately, on behavior.     

Functional clustering drives encoding improvement in a developing brain network during awake visual learning

Sensory experience drives dramatic structural and functional plasticity in developing neurons. However, for single-neuron plasticity to optimally improve whole-network encoding of sensory information, changes must be coordinated between neurons to ensure a full range of stimuli is efficiently represented. Using two-photon calcium imaging to monitor evoked activity in over 100 neurons simultaneously, we investigate network-level changes in the developing Xenopus laevis tectum during visual training with motion stimuli. Training causes stimulus-specific changes in neuronal responses and interactions, resulting in improved population encoding. This plasticity is spatially structured, increasing tuning curve similarity and interactions among nearby neurons, and decreasing interactions among distant neurons. Training does not improve encoding by single clusters of similarly responding neurons, but improves encoding across clusters, indicating coordinated plasticity across the network. NMDA receptor blockade prevents coordinated plasticity, reduces clustering, and abolishes whole-network encoding improvement. We conclude that NMDA receptors support experience-dependent network self-organization, allowing efficient population coding of a diverse range of stimuli.     

Neural Coding with Graded Membrane Potential Changes and Spikes

The neural encoding of sensory stimuli is usually investigated for spike responses, although many neurons are known to convey information by graded membrane potential changes. We compare by model simulations how well different dynamical stimuli can be discriminated on the basis of spiking or graded responses. Although a continuously varying membrane potential contains more information than binary spike trains, we find situations where different stimuli can be better discriminated on the basis of spike responses than on the basis of graded responses. Spikes can be superior to graded membrane potential fluctuations if spikes sharpen the temporal structure of neuronal responses by amplifying fast transients of the membrane potential. Such fast membrane potential changes can be induced deterministically by the stimulus or can be due to membrane potential noise that is influenced in its statistical properties by the stimulus. The graded response mode is superior for discrimination between stimuli on a fine time scale.     

A generalized linear model for estimating spectrotemporal receptive fields from responses to natural sounds

In the auditory system, the stimulus-response properties of single neurons are often described in terms of the spectrotemporal receptive field (STRF), a linear kernel relating the spectrogram of the sound stimulus to the instantaneous firing rate of the neuron. Several algorithms have been used to estimate STRFs from responses to natural stimuli; these algorithms differ in their functional models, cost functions, and regularization methods. Here, we characterize the stimulus-response function of auditory neurons using a generalized linear model (GLM). In this model, each cell's input is described by: 1) a stimulus filter (STRF); and 2) a post-spike filter, which captures dependencies on the neuron's spiking history. The output of the model is given by a series of spike trains rather than instantaneous firing rate, allowing the prediction of spike train responses to novel stimuli. We fit the model by maximum penalized likelihood to the spiking activity of zebra finch auditory midbrain neurons in response to conspecific vocalizations (songs) and modulation limited (ml) noise. We compare this model to normalized reverse correlation (NRC), the traditional method for STRF estimation, in terms of predictive power and the basic tuning properties of the estimated STRFs. We find that a GLM with a sparse prior predicts novel responses to both stimulus classes significantly better than NRC. Importantly, we find that STRFs from the two models derived from the same responses can differ substantially and that GLM STRFs are more consistent between stimulus classes than NRC STRFs. These results suggest that a GLM with a sparse prior provides a more accurate characterization of spectrotemporal tuning than does the NRC method when responses to complex sounds are studied in these neurons.     

Responses of Neurons of the Extrastriate Area 21b of the Cat Brain Cortex to Changes in Orientation of Moving Visual Stimuli

We studied the responses of neurons of the extrastriate cortical area 21b of the cat to changes in orientation of the movements of visual stimuli within the receptive field (RF) of the neuron under study. Our experiments demonstrated that 24 of 108 cells (22%) responded differentially to a certain extent to orientation of the movements of visual stimuli. As a whole, neurons of the area 21b did not demonstrate fine tuning on the optimum angle of orientation. In many cases, neuronal responses to different orientations of the movement of visual stimulus depended significantly on specific parameters of this stimulus (its shape, dimensions, and contrast). Some directionally sensitive neurons responded to a change in orientation of the movement of visual stimuli by modification of the index of directionality. We also studied spatial organization of the RF of neurons with the presentation of stationary visual stimuli. Comparison of the neuronal responses to a change in orientation of the movements of stimuli and to presentation of stationary stimuli showed that the correlation between the orientation sensitivity of the neuron under study and the stationary functional organization of its RF was insignificant. We hypothesize that inhibitory processes and subthreshold influences from a space surrounding the RF play a special role in the formation of the neuronal responses generated in the associative visual cortical regions to visual stimulation.     

Tuned normalization explains the size of attention modulations

The effect of attention on firing rates varies considerably within a single cortical area. The firing rate of some neurons is greatly modulated by attention while others are hardly affected. The reason for this variability across neurons is unknown. We found that the variability in attention modulation across neurons in area MT of macaques can be well explained by variability in the strength of tuned normalization across neurons. The presence of tuned normalization also explains a striking asymmetry in attention effects within neurons: when two stimuli are in a neuron's receptive field, directing attention to the preferred stimulus modulates firing rates more than directing attention to the nonpreferred stimulus. These findings show that much of the neuron-to-neuron variability in modulation of responses by attention depends on variability in the way the neurons process multiple stimuli, rather than differences in the influence of top-down signals related to attention.     

Predicting human perceptual decisions by decoding neuronal information profiles

Perception relies on the response of populations of neurons in sensory cortex. How the response profile of a neuronal population gives rise to perception and perceptual discrimination has been conceptualized in various ways. Here we suggest that neuronal population responses represent information about our environment explicitly as Fisher information (FI), which is a local measure of the variance estimate of the sensory input. We show how this sensory information can be read out and combined to infer from the available information profile which stimulus value is perceived during a fine discrimination task. In particular, we propose that the perceived stimulus corresponds to the stimulus value that leads to the same information for each of the alternative directions, and compare the model prediction to standard models considered in the literature (population vector, maximum likelihood, maximum-a-posteriori Bayesian inference). The models are applied to human performance in a motion discrimination task that induces perceptual misjudgements of a target direction of motion by task irrelevant motion in the spatial surround of the target stimulus (motion repulsion). By using the neurophysiological insight that surround motion suppresses neuronal responses to the target motion in the center, all models predicted the pattern of perceptual misjudgements. The variation of discrimination thresholds (error on the perceived value) was also explained through the changes of the total FI content with varying surround motion directions. The proposed FI decoding scheme incorporates recent neurophysiological evidence from macaque visual cortex showing that perceptual decisions do not rely on the most active neurons, but rather on the most informative neuronal responses. We statistically compare the prediction capability of the FI decoding approach and the standard decoding models. Notably, all models reproduced the variation of the perceived stimulus values for different surrounds, but with different neuronal tuning characteristics underlying perception. Compared to the FI approach the prediction power of the standard models was based on neurons with far wider tuning width and stronger surround suppression. Our study demonstrates that perceptual misjudgements can be based on neuronal populations encoding explicitly the available sensory information, and provides testable neurophysiological predictions on neuronal tuning characteristics underlying human perceptual decisions.     

Coding of time-dependent stimuli in homogeneous and heterogeneous neural populations

We compare the information transmission of a time-dependent signal by two types of uncoupled neuron populations that differ in their sources of variability: i) a homogeneous population whose units receive independent noise and ii) a deterministic heterogeneous population, where each unit exhibits a different baseline firing rate (’disorder’). Our criterion for making both sources of variability quantitatively comparable is that the interspike-interval distributions are identical for both systems. Numerical simulations using leaky integrate-and-fire neurons unveil that a non-zero amount of both noise or disorder maximizes the encoding efficiency of the homogeneous and heterogeneous system, respectively, as a particular case of suprathreshold stochastic resonance. Our findings thus illustrate that heterogeneity can render similarly profitable effects for neuronal populations as dynamic noise. The optimal noise/disorder depends on the system size and the properties of the stimulus such as its intensity or cutoff frequency. We find that weak stimuli are better encoded by a noiseless heterogeneous population, whereas for strong stimuli a homogeneous population outperforms an equivalent heterogeneous system up to a moderate noise level. Furthermore, we derive analytical expressions of the coherence function for the cases of very strong noise and of vanishing intrinsic noise or heterogeneity, which predict the existence of an optimal noise intensity. Our results show that, depending on the type of signal, noise as well as heterogeneity can enhance the encoding performance of neuronal populations.     

Feature-based attention increases the selectivity of population responses in primate visual cortex

BACKGROUND: Attending to the spatial location or to nonspatial features of visual stimuli can modulate neuronal responses in primate visual cortex. The modulation by spatial attention changes the gain of sensory neurons and strengthens the representation of attended locations without changing neuronal selectivities such as directionality, i.e., the ratio of responses to preferred and anti-preferred directions of motion. Whether feature-based attention acts in a similar manner is unknown. RESULTS: To clarify this issue, we recorded the responses of 135 direction-selective neurons in the middle temporal area (MT) of two macaques to an unattended moving random dot pattern (the distractor) positioned inside a neuron's receptive field while the animals attended to a second moving pattern positioned in the opposite hemifield. Responses to different directions of the distractor were modulated by the same factor (approximately 12%) as long as the attended direction remained unchanged. On the other hand, systematically changing the attended direction from a neuron's preferred to its anti-preferred direction caused a systematic change of the attentional modulation from an enhancement to a suppression, increasing directionality by about 20%. CONCLUSIONS: The results show that (1) feature-based attention exerts a multiplicative modulation upon neuronal responses and that the strength of this modulation depends on the similarity between the attended feature and the cell's preferred feature, in line with the feature-similarity gain model, and (2) at the level of the neuronal population, feature-based attention increases the selectivity for attended features by increasing the responses of neurons preferring this feature value while decreasing responses of neurons tuned to the opposite feature value.     

Sparsity and Compressed Coding in Sensory Systems

Considering that many natural stimuli are sparse, can a sensory system evolve to take advantage of this sparsity? We explore this question and show that significant downstream reductions in the numbers of neurons transmitting stimuli observed in early sensory pathways might be a consequence of this sparsity. First, we model an early sensory pathway using an idealized neuronal network comprised of receptors and downstream sensory neurons. Then, by revealing a linear structure intrinsic to neuronal network dynamics, our work points to a potential mechanism for transmitting sparse stimuli, related to compressed-sensing (CS) type data acquisition. Through simulation, we examine the characteristics of networks that are optimal in sparsity encoding, and the impact of localized receptive fields beyond conventional CS theory. The results of this work suggest a new network framework of signal sparsity, freeing the notion from any dependence on specific component-space representations. We expect our CS network mechanism to provide guidance for studying sparse stimulus transmission along realistic sensory pathways as well as engineering network designs that utilize sparsity encoding.     

Microfluidics for in vivo imaging of neuronal and behavioral activity in Caenorhabditis elegans

The nematode C. elegans is an excellent model organism for studying behavior at the neuronal level. Because of the organism's small size, it is challenging to deliver stimuli to C. elegans and monitor neuronal activity in a controlled environment. To address this problem, we developed two microfluidic chips, the 'behavior' chip and the 'olfactory' chip for imaging of neuronal and behavioral responses in C. elegans. We used the behavior chip to correlate the activity of AVA command interneurons with the worm locomotion pattern. We used the olfactory chip to record responses from ASH sensory neurons exposed to high-osmotic-strength stimulus. Observation of neuronal responses in these devices revealed previously unknown properties of AVA and ASH neurons. The use of these chips can be extended to correlate the activity of sensory neurons, interneurons and motor neurons with the worm's behavior.     

Specific contributions of ventromedial, anterior cingulate, and lateral prefrontal cortex for attentional selection and stimulus valuation

Attentional control ensures that neuronal processes prioritize the most relevant stimulus in a given environment. Controlling which stimulus is attended thus originates from neurons encoding the relevance of stimuli, i.e. their expected value, in hand with neurons encoding contextual information about stimulus locations, features, and rules that guide the conditional allocation of attention. Here, we examined how these distinct processes are encoded and integrated in macaque prefrontal cortex (PFC) by mapping their functional topographies at the time of attentional stimulus selection. We find confined clusters of neurons in ventromedial PFC (vmPFC) that predominantly convey stimulus valuation information during attention shifts. These valuation signals were topographically largely separated from neurons predicting the stimulus location to which attention covertly shifted, and which were evident across the complete medial-to-lateral extent of the PFC, encompassing anterior cingulate cortex (ACC), and lateral PFC (LPFC). LPFC responses showed particularly early-onset selectivity and primarily facilitated attention shifts to contralateral targets. Spatial selectivity within ACC was delayed and heterogeneous, with similar proportions of facilitated and suppressed responses during contralateral attention shifts. The integration of spatial and valuation signals about attentional target stimuli was observed in a confined cluster of neurons at the intersection of vmPFC, ACC, and LPFC. These results suggest that valuation processes reflecting stimulus-specific outcome predictions are recruited during covert attentional control. Value predictions and the spatial identification of attentional targets were conveyed by largely separate neuronal populations, but were integrated locally at the intersection of three major prefrontal areas, which may constitute a functional hub within the larger attentional control network.     

Parvalbumin-expressing interneurons linearly transform cortical responses to visual stimuli

The response of cortical neurons to a sensory stimulus is shaped by the network in which they are embedded. Here we establish a role of parvalbumin (PV)-expressing cells, a large class of inhibitory neurons that target the soma and perisomatic compartments of pyramidal cells, in controlling cortical responses. By bidirectionally manipulating PV cell activity in visual cortex we show that these neurons strongly modulate layer 2/3 pyramidal cell spiking responses to visual stimuli while only modestly affecting their tuning properties. PV cells' impact on pyramidal cells is captured by a linear transformation, both additive and multiplicative, with a threshold. These results indicate that PV cells are ideally suited to modulate cortical gain and establish a causal relationship between a select neuron type and specific computations performed by the cortex during sensory processing.     

The Effect of Correlated Neuronal Firing and Neuronal Heterogeneity on Population Coding Accuracy in Guinea Pig Inferior Colliculus

It has been suggested that the considerable noise in single-cell responses to a stimulus can be overcome by pooling information from a large population. Theoretical studies indicated that correlations in trial-to-trial fluctuations in the responses of different neurons may limit the improvement due to pooling. Subsequent theoretical studies have suggested that inherent neuronal diversity, i.e., the heterogeneity of tuning curves and other response properties of neurons preferentially tuned to the same stimulus, can provide a means to overcome this limit. Here we study the effect of spike-count correlations and the inherent neuronal heterogeneity on the ability to extract information from large neural populations. We use electrophysiological data from the guinea pig Inferior-Colliculus to capture inherent neuronal heterogeneity and single cell statistics, and introduce response correlations artificially. To this end, we generate pseudo-population responses, based on single-cell recording of neurons responding to auditory stimuli with varying binaural correlations. Typically, when pseudo-populations are generated from single cell data, the responses within the population are statistically independent. As a result, the information content of the population will increase indefinitely with its size. In contrast, here we apply a simple algorithm that enables us to generate pseudo-population responses with variable spike-count correlations. This enables us to study the effect of neuronal correlations on the accuracy of conventional rate codes. We show that in a homogenous population, in the presence of even low-level correlations, information content is bounded. In contrast, utilizing a simple linear readout, that takes into account the natural heterogeneity, even of neurons preferentially tuned to the same stimulus, within the neural population, one can overcome the correlated noise and obtain a readout whose accuracy grows linearly with the size of the population.     

Shifts in coding properties and maintenance of information transmission during adaptation in barrel cortex

Neuronal responses to ongoing stimulation in many systems change over time, or “adapt.” Despite the ubiquity of adaptation, its effects on the stimulus information carried by neurons are often unknown. Here we examine how adaptation affects sensory coding in barrel cortex. We used spike-triggered covariance analysis of single-neuron responses to continuous, rapidly varying vibrissa motion stimuli, recorded in anesthetized rats. Changes in stimulus statistics induced spike rate adaptation over hundreds of milliseconds. Vibrissa motion encoding changed with adaptation as follows. In every neuron that showed rate adaptation, the input–output tuning function scaled with the changes in stimulus distribution, allowing the neurons to maintain the quantity of information conveyed about stimulus features. A single neuron that did not show rate adaptation also lacked input–output rescaling and did not maintain information across changes in stimulus statistics. Therefore, in barrel cortex, rate adaptation occurs on a slow timescale relative to the features driving spikes and is associated with gain rescaling matched to the stimulus distribution. Our results suggest that adaptation enhances tactile representations in primary somatosensory cortex, where they could directly influence perceptual decisions.     

Neural correlates of knowledge: stable representation of stimulus associations across variations in behavioral performance

Behavioral responses to a sensory stimulus are often guided by associative memories. These associations remain intact even when other factors determine behavior. The substrates of associative memory should therefore be identifiable by neuronal responses that are independent of behavioral choices. We tested this hypothesis using a paired-associates task in which monkeys learned arbitrary associations between pairs of visual stimuli. We examined the activity of neurons in inferior temporal cortex as the animals prepared to choose a remembered stimulus from a visual display. The activity of some neurons (22%) depended on the monkey's behavioral choice; but for a novel class of neurons (54%), activity reflected the stimulus that the monkey was instructed to choose, regardless of the behavioral response. These neurons appear to represent memorized stimulus associations that are stable across variations in behavioral performance. In addition, many neurons (74%) were modulated by the spatial arrangement of the stimuli in the display.     

Spatial and Feature-Based Attention in a Layered Cortical Microcircuit Model

Directing attention to the spatial location or the distinguishing feature of a visual object modulates neuronal responses in the visual cortex and the stimulus discriminability of subjects. However, the spatial and feature-based modes of attention differently influence visual processing by changing the tuning properties of neurons. Intriguingly, neurons'' tuning curves are modulated similarly across different visual areas under both these modes of attention. Here, we explored the mechanism underlying the effects of these two modes of visual attention on the orientation selectivity of visual cortical neurons. To do this, we developed a layered microcircuit model. This model describes multiple orientation-specific microcircuits sharing their receptive fields and consisting of layers 2/3, 4, 5, and 6. These microcircuits represent a functional grouping of cortical neurons and mutually interact via lateral inhibition and excitatory connections between groups with similar selectivity. The individual microcircuits receive bottom-up visual stimuli and top-down attention in different layers. A crucial assumption of the model is that feature-based attention activates orientation-specific microcircuits for the relevant feature selectively, whereas spatial attention activates all microcircuits homogeneously, irrespective of their orientation selectivity. Consequently, our model simultaneously accounts for the multiplicative scaling of neuronal responses in spatial attention and the additive modulations of orientation tuning curves in feature-based attention, which have been observed widely in various visual cortical areas. Simulations of the model predict contrasting differences between excitatory and inhibitory neurons in the two modes of attentional modulations. Furthermore, the model replicates the modulation of the psychophysical discriminability of visual stimuli in the presence of external noise. Our layered model with a biologically suggested laminar structure describes the basic circuit mechanism underlying the attention-mode specific modulations of neuronal responses and visual perception.     

Dependence of the mouse inferior colliculus neurons activity on position and direction of movement of the spectral contrast

Response variability of the single neurons of the inferior colliculus of mouse (Mus musculus) to series of noise bands and of notch noises with regular 1/12 octave steps of the band/notch center frequency and width of noise band/notch 1/3 octave, was studied. Neurons with strong inhibitory influence in excitatory response area (inhibitory-dominated) show low impulse activity when noise band exceeded excitatory response area. Spectral contrasts crossing the center of excitatory response area (at CF or nearly CF) were found to be the most efficient stimuli for such neurons. Neuron responses to spectral contrasts derived both from noise band and noise notch were identical. Approaching of inhibitory and excitatory inputs is expected to sharpen the auditory neurons frequency tuning to position of spectral contrasts, similar to neuronal processing in visual system. Neuron selectivity to the direction of spectral contrasts movement was determined in neuron response differences when the noise band or notch shifted from excitatory area to inhibitory areas as compared with shift in the opposite direction. Functional role of contrast mechanism for sound localization on the base spectral cues related to external ear transfer characteristics is discussed.     

Visual cells remember earlier applied target: plasticity of orientation selectivity

Background

A canonical proposition states that, in mature brain, neurons responsive to sensory stimuli are tuned to specific properties installed shortly after birth. It is amply demonstrated that that neurons in adult visual cortex of cats are orientation-selective that is they respond with the highest firing rates to preferred oriented stimuli.

Methodology/Principal Findings

In anesthetized cats, prepared in a conventional fashion for single cell recordings, the present investigation shows that presenting a stimulus uninterruptedly at a non-preferred orientation for twelve minutes induces changes in orientation preference. Across all conditions orientation tuning curves were investigated using a trial by trial method. Contrary to what has been previously reported with shorter adaptation duration, twelve minutes of adaptation induces mostly attractive shifts, i.e. toward the adapter. After a recovery period allowing neurons to restore their original orientation tuning curves, we carried out a second adaptation which produced three major results: (1) more frequent attractive shifts, (2) an increase of their magnitude, and (3) an additional enhancement of responses at the new or acquired preferred orientation. Additionally, we also show that the direction of shifts depends on the duration of the adaptation: shorter adaptation in most cases produces repulsive shifts, whereas adaptation exceeding nine minutes results in attractive shifts, in the same unit. Consequently, shifts in preferred orientation depend on the duration of adaptation.

Conclusion/Significance

The supplementary response improvements indicate that neurons in area 17 keep a memory trace of the previous stimulus properties, thereby upgrading cellular performance. It also highlights the dynamic nature of basic neuronal properties in adult cortex since repeated adaptations modified both the orientation tuning selectivity and the response strength to the preferred orientation. These enhanced neuronal responses suggest that the range of neuronal plasticity available to the visual system is broader than anticipated.