Neuronal selectivity,population sparseness,and ergodicity in the inferior temporal visual cortex

The sparseness of the encoding of stimuli by single neurons and by populations of neurons is fundamental to understanding the efficiency and capacity of representations in the brain, and was addressed as follows. The selectivity and sparseness of firing to visual stimuli of single neurons in the primate inferior temporal visual cortex were measured to a set of 20 visual stimuli including objects and faces in macaques performing a visual fixation task. Neurons were analysed with significantly different responses to the stimuli. The firing rate distribution of 36% of the neurons was exponential. Twenty-nine percent of the neurons had too few low rates to be fitted by an exponential distribution, and were fitted by a gamma distribution. Interestingly, the raw firing rate distribution taken across all neurons fitted an exponential distribution very closely. The sparseness a ^s or selectivity of the representation of the set of 20 stimuli provided by each of these neurons (which takes a maximal value of 1.0) had an average across all neurons of 0.77, indicating a rather distributed representation. The sparseness of the representation of a given stimulus by the whole population of neurons, the population sparseness a ^p, also had an average value of 0.77. The similarity of the average single neuron selectivity a ^s and population sparseness for any one stimulus taken at any one time a ^p shows that the representation is weakly ergodic. For this to occur, the different neurons must have uncorrelated tuning profiles to the set of stimuli.     

Stimulus-Response-Outcome Coding in the Pigeon Nidopallium Caudolaterale

A prerequisite for adaptive goal-directed behavior is that animals constantly evaluate action outcomes and relate them to both their antecedent behavior and to stimuli predictive of reward or non-reward. Here, we investigate whether single neurons in the avian nidopallium caudolaterale (NCL), a multimodal associative forebrain structure and a presumed analogue of mammalian prefrontal cortex, represent information useful for goal-directed behavior. We subjected pigeons to a go-nogo task, in which responding to one visual stimulus (S+) was partially reinforced, responding to another stimulus (S–) was punished, and responding to test stimuli from the same physical dimension (spatial frequency) was inconsequential. The birds responded most intensely to S+, and their response rates decreased monotonically as stimuli became progressively dissimilar to S+; thereby, response rates provided a behavioral index of reward expectancy. We found that many NCL neurons'' responses were modulated in the stimulus discrimination phase, the outcome phase, or both. A substantial fraction of neurons increased firing for cues predicting non-reward or decreased firing for cues predicting reward. Interestingly, the same neurons also responded when reward was expected but not delivered, and could thus provide a negative reward prediction error or, alternatively, signal negative value. In addition, many cells showed motor-related response modulation. In summary, NCL neurons represent information about the reward value of specific stimuli, instrumental actions as well as action outcomes, and therefore provide signals useful for adaptive behavior in dynamically changing environments.     

Modulation of V1 Spike Response by Temporal Interval of Spatiotemporal Stimulus Sequence

The spike activity of single neurons of the primary visual cortex (V1) becomes more selective and reliable in response to wide-field natural scenes compared to smaller stimuli confined to the classical receptive field (RF). However, it is largely unknown what aspects of natural scenes increase the selectivity of V1 neurons. One hypothesis is that modulation by surround interaction is highly sensitive to small changes in spatiotemporal aspects of RF surround. Such a fine-tuned modulation would enable single neurons to hold information about spatiotemporal sequences of oriented stimuli, which extends the role of V1 neurons as a simple spatiotemporal filter confined to the RF. In the current study, we examined the hypothesis in the V1 of awake behaving monkeys, by testing whether the spike response of single V1 neurons is modulated by temporal interval of spatiotemporal stimulus sequence encompassing inside and outside the RF. We used two identical Gabor stimuli that were sequentially presented with a variable stimulus onset asynchrony (SOA): the preceding one (S1) outside the RF and the following one (S2) in the RF. This stimulus configuration enabled us to examine the spatiotemporal selectivity of response modulation from a focal surround region. Although S1 alone did not evoke spike responses, visual response to S2 was modulated for SOA in the range of tens of milliseconds. These results suggest that V1 neurons participate in processing spatiotemporal sequences of oriented stimuli extending outside the RF.     

Foraging strategy switching in an antlion larva

Prepulse inhibition (PPI) refers to the process wherein startle responses to salient stimuli (e.g., startling sound pulses) are attenuated by the presentation of another stimulus (e.g., a brief pre-pulse) immediately before the startling stimulus. Accordingly, deficits in PPI reflect atypical sensorimotor gating that is linked to neurobehavioral systems underlying responsivity to emotionally evocative cues. Little is known about the effects of changes in visual contextual information in PPI among humans. In this study, the effects of introducing unexpected changes in the visual scenes presented on a computer monitor on the human auditory startle response and PPI were assessed in young adults. Based on our animal data showing that unexpected transitions from a dark to a light environment reduce the startle response and PPI in rats after the illumination transition, it was hypothesized that novel changes in visual scenes would produce similar effects in humans. Results show that PPI decreased when elements were added to or removed from visual scenes, and that this effect declined after repeated presentations of the modified scene, supporting the interpretation that the PPI reduction was due to novel information being processed. These findings are the first to demonstrate that novel visual stimuli can impair sensorimotor gating of auditory stimuli in humans.     

Reduction of information redundancy in the ascending auditory pathway

Information processing by a sensory system is reflected in the changes in stimulus representation along its successive processing stages. We measured information content and stimulus-induced redundancy in the neural responses to a set of natural sounds in three successive stations of the auditory pathway-inferior colliculus (IC), auditory thalamus (MGB), and primary auditory cortex (A1). Information about stimulus identity was somewhat reduced in single A1 and MGB neurons relative to single IC neurons, when information is measured using spike counts, latency, or temporal spiking patterns. However, most of this difference was due to differences in firing rates. On the other hand, IC neurons were substantially more redundant than A1 and MGB neurons. IC redundancy was largely related to frequency selectivity. Redundancy reduction may be a generic organization principle of neural systems, allowing for easier readout of the identity of complex stimuli in A1 relative to IC.     

Neurophysiological mechanisms underlying face processing within and beyond the temporal cortical visual areas.

The ways in which information about faces is represented and stored in the temporal lobe visual areas of primates, as shown by recordings from single neurons in macaques, are considered. Some neurons that respond primarily to faces are found in the cortex in the anterior part of the superior temporal sulcus (in which neurons are especially likely to be tuned to facial expression and to face movement involved in gesture), and in the TE areas more ventrally forming the inferior temporal gyrus (in which neurons are more likely to have responses related to the identity of faces). Quantitative studies of the responses of the neurons that respond differently to the faces of different individuals show that information about the identity of the individual is represented by the responses of a population of neurons, that is, ensemble encoding rather than 'grandmother cell' encoding is used. It is argued that this type of tuning is a delicate compromise between very fine tuning, which has the advantage of low interference in neuronal network operations but the disadvantage of losing the useful properties (such as generalization, completion and graceful degradation) of storage in neuronal networks, and broad tuning, which has the advantage of allowing these properties of neuronal networks to be realized but the disadvantage of leading to interference between the different memories stored in an associative network. There is evidence that the responses of some of these neurons are altered by experience so that new stimuli become incorporated in the network. It is shown that the representation that is built in temporal cortical areas shows considerable invariance for size, contrast, spatial frequency and translation. Thus the representation is in a form which is particularly useful for storage and as an output from the visual system. It is also shown that one of the representations that is built is object based, which is suitable for recognition and as an input to associative memory, and that another is viewer centred, which is appropriate for conveying information about gesture. Ways are considered in which such cortical representations might be built by competitive self-organization aided by back projections in the multi-stage cortical processing hierarchy which has convergence from stage to stage.     

Spectral Characteristics of Phase Sensitivity and Discharge Rate of Neurons in the Ascending Tectofugal Visual System

Drifting gratings can modulate the activity of visual neurons at the temporal frequency of the stimulus. In order to characterize the temporal frequency modulation in the cat’s ascending tectofugal visual system, we recorded the activity of single neurons in the superior colliculus, the suprageniculate nucleus, and the anterior ectosylvian cortex during visual stimulation with drifting sine-wave gratings. In response to such stimuli, neurons in each structure showed an increase in firing rate and/or oscillatory modulated firing at the temporal frequency of the stimulus (phase sensitivity). To obtain a more complete characterization of the neural responses in spatiotemporal frequency domain, we analyzed the mean firing rate and the strength of the oscillatory modulations measured by the standardized Fourier component of the response at the temporal frequency of the stimulus. We show that the spatiotemporal stimulus parameters that elicit maximal oscillations often differ from those that elicit a maximal discharge rate. Furthermore, the temporal modulation and discharge-rate spectral receptive fields often do not overlap, suggesting that the detection range for visual stimuli provided jointly by modulated and unmodulated response components is larger than the range provided by a one response component.     

Distributed Fading Memory for Stimulus Properties in the Primary Visual Cortex

It is currently not known how distributed neuronal responses in early visual areas carry stimulus-related information. We made multielectrode recordings from cat primary visual cortex and applied methods from machine learning in order to analyze the temporal evolution of stimulus-related information in the spiking activity of large ensembles of around 100 neurons. We used sequences of up to three different visual stimuli (letters of the alphabet) presented for 100 ms and with intervals of 100 ms or larger. Most of the information about visual stimuli extractable by sophisticated methods of machine learning, i.e., support vector machines with nonlinear kernel functions, was also extractable by simple linear classification such as can be achieved by individual neurons. New stimuli did not erase information about previous stimuli. The responses to the most recent stimulus contained about equal amounts of information about both this and the preceding stimulus. This information was encoded both in the discharge rates (response amplitudes) of the ensemble of neurons and, when using short time constants for integration (e.g., 20 ms), in the precise timing of individual spikes (≤∼20 ms), and persisted for several 100 ms beyond the offset of stimuli. The results indicate that the network from which we recorded is endowed with fading memory and is capable of performing online computations utilizing information about temporally sequential stimuli. This result challenges models assuming frame-by-frame analyses of sequential inputs.     

Visual Responses of Crayfish Ocular Motoneurons: An Information Theoretical Analysis

Motoneuron responses were elicited by global visual motion and stepwise displacements of an illuminated stripe. Stimulus protocols were identical to those used in previous behavioral studies of compensatory eyestalk reflexes. The firing rates and directional selectivity of the motoneuron responses were measured with respect to four stimulus dimensions (spatial frequency, contrast, angular displacement and velocity). The directional selectivity of the motoneuron response was correlated to the previously measured gain of the reflex for each stimulus dimension. The information theoretical analysis is based upon Kullback-Leibler (K-L) distances which measure the dissimilarity of responses to different stimuli. K-L distances for single neurons are strongly influenced by the mean rate difference of the responses to any pair of stimuli. Because of redundancy, the joint K-L distances of pairs of neurons were less than the sum of the K-L distances of the individual neurons. Furthermore, the joint K-L distances were only weakly influenced by correlations among coactivated neurons. For most of the stimulus dimensions, the K-L distances of single motoneurons were not sufficient to account for the stimulus discriminations exhibited by the eyestalk reflex which typically required the summed output of 2 to 5 motoneurons. Thus the behaviorally relevant information is encoded in the motoneuron ensemble. The minimum time required to discriminate the direction of motion (the encoding window) for a single motoneuron is about 380 to 480 ms (including a 175 ms response latency) for stepwise displacements and up to 1.0 s for global motion. During this period a motoneuron fires 2 to 3 impulses.     

A Normalization Model of Attentional Modulation of Single Unit Responses

Although many studies have shown that attention to a stimulus can enhance the responses of individual cortical sensory neurons, little is known about how attention accomplishes this change in response. Here, we propose that attention-based changes in neuronal responses depend on the same response normalization mechanism that adjusts sensory responses whenever multiple stimuli are present. We have implemented a model of attention that assumes that attention works only through this normalization mechanism, and show that it can replicate key effects of attention. The model successfully explains how attention changes the gain of responses to individual stimuli and also why modulation by attention is more robust and not a simple gain change when multiple stimuli are present inside a neuron''s receptive field. Additionally, the model accounts well for physiological data that measure separately attentional modulation and sensory normalization of the responses of individual neurons in area MT in visual cortex. The proposal that attention works through a normalization mechanism sheds new light a broad range of observations on how attention alters the representation of sensory information in cerebral cortex.     

Rapid dynamics of contrast responses in the cat primary visual cortex

The visual information we receive during natural vision changes rapidly and continuously. The visual system must adapt to the spatiotemporal contents of the environment in order to efficiently process the dynamic signals. However, neuronal responses to luminance contrast are usually measured using drifting or stationary gratings presented for a prolonged duration. Since motion in our visual field is continuous, the signals received by the visual system contain an abundance of transient components in the contrast domain. Here using a modified reverse correlation method, we studied the properties of responses of neurons in the cat primary visual cortex to different contrasts of grating stimuli presented statically and transiently for 40 ms, and showed that neurons can effectively discriminate the rapidly changing contrasts. The change in the contrast response function (CRF) over time mainly consisted of an increment in contrast gain (CRF shifts to left) in the developing phase of temporal responses and a decrement in response gain (CRF shifts downward) in the decay phase. When the distribution range of stimulus contrasts was increased, neurons demonstrated decrement in contrast gain and response gain. Our results suggest that contrast gain control (contrast adaptation) and response gain control mechanisms are well established during the first tens of milliseconds after stimulus onset and may cooperatively mediate the rapid dynamic responses of visual cortical neurons to the continuously changing contrast. This fast contrast adaptation may play a role in detecting contrast contours in the context of visual scenes that are varying rapidly.     

Attentional modulation strength in cortical area MT depends on stimulus contrast

The attentional modulation of sensory information processing in the visual system is the result of top-down influences, which can cause a multiplicative modulation of the firing rate of sensory neurons in extrastriate visual cortex, an effect reminiscent of the bottom-up effect of changes in stimulus contrast. This similarity could simply reflect the multiplicity of both effects. But, here we show that in direction-selective neurons in monkey visual cortical area MT, stimulus and attentional effects share a nonlinearity. These neurons show higher response gain for both contrast and attentional changes for intermediate contrast stimuli and smaller gain for low- and high-contrast stimuli. This finding suggests a close relationship between the neural encoding of stimulus contrast and the modulating effect of the behavioral relevance of stimuli.     

To Burst or Not to Burst?

It is well known that some neurons tend to fire packets of action potentials followed by periods of quiescence (bursts) while others within the same stage of sensory processing fire in a tonic manner. However, the respective computational advantages of bursting and tonic neurons for encoding time varying signals largely remain a mystery. Weakly electric fish use cutaneous electroreceptors to convey information about sensory stimuli and it has been shown that some electroreceptors exhibit bursting dynamics while others do not. In this study, we compare the neural coding capabilities of tonically firing and bursting electroreceptor model neurons using information theoretic measures. We find that both bursting and tonically firing model neurons efficiently transmit information about the stimulus. However, the decoding mechanisms that must be used for each differ greatly: a non-linear decoder would be required to extract all the available information transmitted by the bursting model neuron whereas a linear one might suffice for the tonically firing model neuron. Further investigations using stimulus reconstruction techniques reveal that, unlike the tonically firing model neuron, the bursting model neuron does not encode the detailed time course of the stimulus. A novel measure of feature detection reveals that the bursting neuron signals certain stimulus features. Finally, we show that feature extraction and stimulus estimation are mutually exclusive computations occurring in bursting and tonically firing model neurons, respectively. Our results therefore suggest that stimulus estimation and feature extraction might be parallel computations in certain sensory systems rather than being sequential as has been previously proposed.     

Phantoms in the brain: Ambiguous representations of stimulus amplitude and timing in weakly electric fish

In wave-type weakly electric fish, two distinct types of primary afferent fibers are specialized for separately encoding modulations in the amplitude and phase (timing) of electrosensory stimuli. Time-coding afferents phase lock to periodic stimuli and respond to changes in stimulus phase with shifts in spike timing. Amplitude-coding afferents fire sporadically to periodic stimuli. Their probability of firing in a given cycle, and therefore their firing rate, is proportional to stimulus amplitude. However, the spike times of time-coding afferents are also affected by changes in amplitude; similarly, the firing rates of amplitude-coding afferents are also affected by changes in phase. Because identical changes in the activity of an individual primary afferent can be caused by modulations in either the amplitude or phase of stimuli, there is ambiguity regarding the information content of primary afferent responses that can result in ‘phantom’ modulations not present in an actual stimulus. Central electrosensory neurons in the hindbrain and midbrain respond to these phantom modulations. Phantom modulations can also elicit behavioral responses, indicating that ambiguity in the encoding of amplitude and timing information ultimately distorts electrosensory perception. A lack of independence in the encoding of multiple stimulus attributes can therefore result in perceptual illusions. Similar effects may occur in other sensory systems as well. In particular, the vertebrate auditory system is thought to be phylogenetically related to the electrosensory system and it encodes information about amplitude and timing in similar ways. It has been well established that pitch perception and loudness perception are both affected by the frequency and intensity of sounds, raising the intriguing possibility that auditory perception may also be affected by ambiguity in the encoding of sound amplitude and timing.     

Response dynamics of bullfrog ON-OFF RGCs to different stimulus durations

Stimulus duration is an important feature of visual stimulation. In the present study, response properties of bullfrog ON-OFF retinal ganglion cells (RGCs) in exposure to different visual stimulus durations were studied. By using a multi-electrode recording system, spike discharges from ON-OFF RGCs were simultaneously recorded, and the cells’ ON and OFF responses were analyzed. It was found that the ON response characteristics, including response latency, spike count, as well as correlated activity and relative latency between pair-wise cells, were modulated by different light OFF intervals, while the OFF response characteristics were modulated by different light ON durations. Stimulus information carried by the ON and OFF responses was then analyzed, and it was found that information about different light ON durations was more carried by transient OFF response, whereas information about different light OFF intervals were more carried by transient ON response. Meanwhile, more than 80 % information about stimulus durations was carried by firing rate. These results suggest that ON-OFF RGCs are sensitive to different stimulus durations, and they can efficiently encode the information about visual stimulus duration by firing rate.     

Representation of well-learned information in the monkey hippocampus

In the neocortex, extensive training results in enhanced neuronal selectivity for learned stimuli relative to novel stimuli. This enhanced selectivity has been taken as evidence for learning-related plasticity. Much less is known, in contrast, about the representation of well-learned information in the hippocampus. In this study, we examined the responses of individual hippocampal neurons to well-learned and novel stimuli presented in the context of an associative learning task. There was no difference in the response magnitude or visual response latency of hippocampal neurons to the well-learned and novel stimuli. In contrast, hippocampal neurons responded significantly more selectively to the well-learned stimuli relative to the novel stimuli. These findings show that hippocampal cells, like neocortical cells, show greater selectivity to well-learned stimuli compared to novel stimuli.     

Orientation sensitive properties of visually driven neurons in extrastriate area 21a of cat cortex

Orientation sensitive properties of extrastriate area 21a neurons were investigated. Special attention was paid to the qualitative characteristics of neuron responses to the different orientations of visual stimulus motion across neuron classical receptive fields (CRF). The results of experiments have shown that a group of neurons (31%) in area 21a with specialized responses to moving visual stimuli changed their direction selective (DS) characteristics depending on the orientation of the stimulus movement. Some neurons reveal an abrupt drop of the direction sensitivity index (DI) to certain orientation (58%), and some show significant increase of DI at one of applied orientations of stimulus motion (22%). Detailed investigation of response patterns of non-directional neurons to different orientations of stimulus motion have revealed clear-cut qualitative differences, such as different regularities in the distribution of inter-peak inhibitory intervals in the response pattern in dependence of the orientation of stimulus motion. The investigation of neuron CRF stationary functional organization did not reveal correlations between RF's spatial functional organization, and that of qualitative modulations of neuron response patterns. A suggestion was put forward, that visual information central processing of orientation discrimination is a complex integrative process that includes quantitative as well as qualitative transformations of neuron activity.     

Tuned normalization explains the size of attention modulations

The effect of attention on firing rates varies considerably within a single cortical area. The firing rate of some neurons is greatly modulated by attention while others are hardly affected. The reason for this variability across neurons is unknown. We found that the variability in attention modulation across neurons in area MT of macaques can be well explained by variability in the strength of tuned normalization across neurons. The presence of tuned normalization also explains a striking asymmetry in attention effects within neurons: when two stimuli are in a neuron's receptive field, directing attention to the preferred stimulus modulates firing rates more than directing attention to the nonpreferred stimulus. These findings show that much of the neuron-to-neuron variability in modulation of responses by attention depends on variability in the way the neurons process multiple stimuli, rather than differences in the influence of top-down signals related to attention.     

Encoding Stimulus Information by Spike Numbers and Mean Response Time in Primary Auditory Cortex

Neurons can transmit information about sensory stimuli via their firing rate, spike latency, or by the occurrence of complex spike patterns. Identifying which aspects of the neural responses actually encode sensory information remains a fundamental question in neuroscience. Here we compared various approaches for estimating the information transmitted by neurons in auditory cortex in two very different experimental paradigms, one measuring spatial tuning and the other responses to complex natural stimuli. We demonstrate that, in both cases, spike counts and mean response times jointly carry essentially all the available information about the stimuli. Thus, in auditory cortex, whereas spike counts carry only partial information about stimulus identity or location, the additional availability of relatively coarse temporal information is sufficient in order to extract essentially all the sensory information available in the spike discharge pattern, at least for the relatively short stimuli (< ∼ 100 ms) commonly used in auditory research.