Information in the Neuronal Representation of Individual Stimuli in the Primate Temporal Visual Cortex

To analyze the information provided about individual visual stimuliin the responses of single neurons in the primate temporal lobevisual cortex, neuronal responses to a set of 65 visual stimuli wererecorded in macaques performing a visual fixation task and analyzedusing information theoretical measures. The population of neuronsanalyzed responded primarily to faces. The stimuli included 23 facesand 42 nonface images of real-world scenes, so that the function ofthis brain region could be analyzed when it was processing relativelynatural scenes.It was found that for the majority of the neurons significantamounts of information were reflected about which of several of the23 faces had been seen. Thus the representation was not local, forin a local representation almost all the information available canbe obtained when the single stimulus to which the neuron respondsbest is shown. It is shown that the information available about anyone stimulus depended on how different (for example, how manystandard deviations) the response to that stimulus was from theaverage response to all stimuli. This was the case for responsesbelow the average response as well as above.It is shown that the fraction of information carried by the lowfiring rates of a cell was large—much larger than that carried bythe high firing rates. Part of the reason for this is that theprobability distribution of different firing rates is biased towardlow values (though with fewer very low values than would bepredicted by an exponential distribution). Another factor is thatthe variability of the response is large at intermediate and highfiring rates.Another finding is that at short sampling intervals (such as 20 ms)the neurons code information efficiently, by effectively acting asbinary variables and behaving less noisily than would be expectedof a Poisson process.     

Timescales of multineuronal activity patterns reflect temporal structure of visual stimuli

The investigation of distributed coding across multiple neurons in the cortex remains to this date a challenge. Our current understanding of collective encoding of information and the relevant timescales is still limited. Most results are restricted to disparate timescales, focused on either very fast, e.g., spike-synchrony, or slow timescales, e.g., firing rate. Here, we investigated systematically multineuronal activity patterns evolving on different timescales, spanning the whole range from spike-synchrony to mean firing rate. Using multi-electrode recordings from cat visual cortex, we show that cortical responses can be described as trajectories in a high-dimensional pattern space. Patterns evolve on a continuum of coexisting timescales that strongly relate to the temporal properties of stimuli. Timescales consistent with the time constants of neuronal membranes and fast synaptic transmission (5-20 ms) play a particularly salient role in encoding a large amount of stimulus-related information. Thus, to faithfully encode the properties of visual stimuli the brain engages multiple neurons into activity patterns evolving on multiple timescales.     

Encoding Stimulus Information by Spike Numbers and Mean Response Time in Primary Auditory Cortex

Neurons can transmit information about sensory stimuli via their firing rate, spike latency, or by the occurrence of complex spike patterns. Identifying which aspects of the neural responses actually encode sensory information remains a fundamental question in neuroscience. Here we compared various approaches for estimating the information transmitted by neurons in auditory cortex in two very different experimental paradigms, one measuring spatial tuning and the other responses to complex natural stimuli. We demonstrate that, in both cases, spike counts and mean response times jointly carry essentially all the available information about the stimuli. Thus, in auditory cortex, whereas spike counts carry only partial information about stimulus identity or location, the additional availability of relatively coarse temporal information is sufficient in order to extract essentially all the sensory information available in the spike discharge pattern, at least for the relatively short stimuli (< ∼ 100 ms) commonly used in auditory research.     

Visual Responses of Crayfish Ocular Motoneurons: An Information Theoretical Analysis

Motoneuron responses were elicited by global visual motion and stepwise displacements of an illuminated stripe. Stimulus protocols were identical to those used in previous behavioral studies of compensatory eyestalk reflexes. The firing rates and directional selectivity of the motoneuron responses were measured with respect to four stimulus dimensions (spatial frequency, contrast, angular displacement and velocity). The directional selectivity of the motoneuron response was correlated to the previously measured gain of the reflex for each stimulus dimension. The information theoretical analysis is based upon Kullback-Leibler (K-L) distances which measure the dissimilarity of responses to different stimuli. K-L distances for single neurons are strongly influenced by the mean rate difference of the responses to any pair of stimuli. Because of redundancy, the joint K-L distances of pairs of neurons were less than the sum of the K-L distances of the individual neurons. Furthermore, the joint K-L distances were only weakly influenced by correlations among coactivated neurons. For most of the stimulus dimensions, the K-L distances of single motoneurons were not sufficient to account for the stimulus discriminations exhibited by the eyestalk reflex which typically required the summed output of 2 to 5 motoneurons. Thus the behaviorally relevant information is encoded in the motoneuron ensemble. The minimum time required to discriminate the direction of motion (the encoding window) for a single motoneuron is about 380 to 480 ms (including a 175 ms response latency) for stepwise displacements and up to 1.0 s for global motion. During this period a motoneuron fires 2 to 3 impulses.     

Effects of Sound Frequency on Audiovisual Integration: An Event-Related Potential Study

A combination of signals across modalities can facilitate sensory perception. The audiovisual facilitative effect strongly depends on the features of the stimulus. Here, we investigated how sound frequency, which is one of basic features of an auditory signal, modulates audiovisual integration. In this study, the task of the participant was to respond to a visual target stimulus by pressing a key while ignoring auditory stimuli, comprising of tones of different frequencies (0.5, 1, 2.5 and 5 kHz). A significant facilitation of reaction times was obtained following audiovisual stimulation, irrespective of whether the task-irrelevant sounds were low or high frequency. Using event-related potential (ERP), audiovisual integration was found over the occipital area for 0.5 kHz auditory stimuli from 190–210 ms, for 1 kHz stimuli from 170–200 ms, for 2.5 kHz stimuli from 140–200 ms, 5 kHz stimuli from 100–200 ms. These findings suggest that a higher frequency sound signal paired with visual stimuli might be early processed or integrated despite the auditory stimuli being task-irrelevant information. Furthermore, audiovisual integration in late latency (300–340 ms) ERPs with fronto-central topography was found for auditory stimuli of lower frequencies (0.5, 1 and 2.5 kHz). Our results confirmed that audiovisual integration is affected by the frequency of an auditory stimulus. Taken together, the neurophysiological results provide unique insight into how the brain processes a multisensory visual signal and auditory stimuli of different frequencies.     

Neural coding of natural stimuli: information at sub-millisecond resolution

Sensory information about the outside world is encoded by neurons in sequences of discrete, identical pulses termed action potentials or spikes. There is persistent controversy about the extent to which the precise timing of these spikes is relevant to the function of the brain. We revisit this issue, using the motion-sensitive neurons of the fly visual system as a test case. Our experimental methods allow us to deliver more nearly natural visual stimuli, comparable to those which flies encounter in free, acrobatic flight. New mathematical methods allow us to draw more reliable conclusions about the information content of neural responses even when the set of possible responses is very large. We find that significant amounts of visual information are represented by details of the spike train at millisecond and sub-millisecond precision, even though the sensory input has a correlation time of ~55 ms; different patterns of spike timing represent distinct motion trajectories, and the absolute timing of spikes points to particular features of these trajectories with high precision. Finally, the efficiency of our entropy estimator makes it possible to uncover features of neural coding relevant for natural visual stimuli: first, the system's information transmission rate varies with natural fluctuations in light intensity, resulting from varying cloud cover, such that marginal increases in information rate thus occur even when the individual photoreceptors are counting on the order of one million photons per second. Secondly, we see that the system exploits the relatively slow dynamics of the stimulus to remove coding redundancy and so generate a more efficient neural code.     

Encoding of Naturalistic Stimuli by Local Field Potential Spectra in Networks of Excitatory and Inhibitory Neurons

Recordings of local field potentials (LFPs) reveal that the sensory cortex displays rhythmic activity and fluctuations over a wide range of frequencies and amplitudes. Yet, the role of this kind of activity in encoding sensory information remains largely unknown. To understand the rules of translation between the structure of sensory stimuli and the fluctuations of cortical responses, we simulated a sparsely connected network of excitatory and inhibitory neurons modeling a local cortical population, and we determined how the LFPs generated by the network encode information about input stimuli. We first considered simple static and periodic stimuli and then naturalistic input stimuli based on electrophysiological recordings from the thalamus of anesthetized monkeys watching natural movie scenes. We found that the simulated network produced stimulus-related LFP changes that were in striking agreement with the LFPs obtained from the primary visual cortex. Moreover, our results demonstrate that the network encoded static input spike rates into gamma-range oscillations generated by inhibitory–excitatory neural interactions and encoded slow dynamic features of the input into slow LFP fluctuations mediated by stimulus–neural interactions. The model cortical network processed dynamic stimuli with naturalistic temporal structure by using low and high response frequencies as independent communication channels, again in agreement with recent reports from visual cortex responses to naturalistic movies. One potential function of this frequency decomposition into independent information channels operated by the cortical network may be that of enhancing the capacity of the cortical column to encode our complex sensory environment.     

Delayed striate cortical activation during spatial attention

Recordings of event-related potentials (ERPs) and event-related magnetic fields (ERMFs) were combined with functional magnetic resonance imaging (fMRI) to study visual cortical activity in humans during spatial attention. While subjects attended selectively to stimulus arrays in one visual field, fMRI revealed stimulus-related activations in the contralateral primary visual cortex and in multiple extrastriate areas. ERP and ERMF recordings showed that attention did not affect the initial evoked response at 60-90 ms poststimulus that was localized to primary cortex, but a similarly localized late response at 140-250 ms was enhanced to attended stimuli. These findings provide evidence that the primary visual cortex participates in the selective processing of attended stimuli by means of delayed feedback from higher visual-cortical areas.     

Representation of lateral line and electrosensory systems in the midbrain of the axolotl,Ambystoma mexicanum

Summary The study focussed on the representation of the electrosensory and lateral line units in the midbrain of the axolotl Ambystoma mexicanum. In addition, the responses to photic and acoustic/vibrational stimuli were determined. Unit properties were characterized with respect to baseline activity, sensitivity, latency, directional specificity and number of input modalities. The anatomical arrangement of the units was determined using stereotactic and histological measurements of the electrode positions.Of 106 units recorded, 29 units were unimodal, 77 units responded to more than one modality. Most units discharged only in response to stimuli. Thresholds of electrosensory units were about 100 V/cm field strength; lateral line units had thresholds below 5 m pp amplitude. The shortest latencies (8–17 ms) were found for responses to visual stimuli. Lateral line and vestibular units responded after 35–58 ms, electroreceptive units after 79–150 ms. All electrosensory and about 50% of the lateral line units were sharply tuned to definite stimulus directions.Electrosensory and lateral line units formed topographical maps in the tectum. The map in each tectal hemisphere contained information about the contralateral surroundings. The electrosensory, lateral line and visual representations were only partly in register; especially in the caudal areas of the midbrain the alignment was poor.     

A Normalization Model of Attentional Modulation of Single Unit Responses

Although many studies have shown that attention to a stimulus can enhance the responses of individual cortical sensory neurons, little is known about how attention accomplishes this change in response. Here, we propose that attention-based changes in neuronal responses depend on the same response normalization mechanism that adjusts sensory responses whenever multiple stimuli are present. We have implemented a model of attention that assumes that attention works only through this normalization mechanism, and show that it can replicate key effects of attention. The model successfully explains how attention changes the gain of responses to individual stimuli and also why modulation by attention is more robust and not a simple gain change when multiple stimuli are present inside a neuron''s receptive field. Additionally, the model accounts well for physiological data that measure separately attentional modulation and sensory normalization of the responses of individual neurons in area MT in visual cortex. The proposal that attention works through a normalization mechanism sheds new light a broad range of observations on how attention alters the representation of sensory information in cerebral cortex.     

Long-term Retention of Many Visual Patterns by Pigeons

Using a simultaneous discrimination procedure it was shown that pigeons were capable of learning to discriminate 100 different black and white visual patterns from a further 625 similar stimuli, where responses to the former were rewarded and responses to the latter were not rewarded. Tests in which novel stimuli replaced either the rewarded or nonrewarded stimuli showed that the pigeons had not only learned about the 100 positive stimuli but also about the 625 negative stimuli. The fact that novel stimuli enhanced discrimination performance when they replaced the many negative stimuli indicated that the pigeons had categorized the stimuli into two classes, familiar and less familiar. Long-term retention was examined after a 6-month interval. To begin with it seemed poor but a recognition test performed after the subjects had been retrained with a subset of the stimuli after an interval of 7 months confirmed that pigeons are capable of retaining in memory several 100 visual items over an extended period. It is proposed that the initial retrieval weakness was due to a forgetting of the contingencies between stimulus categories and response outcomes. Further tests involving variously modified stimuli indicated that while stimulus size variations had a negative effect on performance, orientation changes did not interfere with recognition, supporting the view that small visual stimuli are memorized by pigeons largely free of orientation labels. The experiment generally confirms that pigeons have the capacity of storing information about a large number of visual stimuli over long periods of time.     

Functional specialization of mouse higher visual cortical areas

The mouse is emerging as an important model for understanding how sensory neocortex extracts cues to guide behavior, yet little is known about how these cues are processed beyond primary cortical areas. Here, we used two-photon calcium imaging in awake mice to compare visual responses in primary visual cortex (V1) and in two downstream target areas, AL and PM. Neighboring V1 neurons had diverse stimulus preferences spanning five octaves in spatial and temporal frequency. By contrast, AL and PM neurons responded best to distinct ranges of stimulus parameters. Most strikingly, AL neurons preferred fast-moving stimuli while PM neurons preferred slow-moving stimuli. By contrast, neurons in V1, AL, and PM demonstrated similar selectivity for stimulus orientation but not for stimulus direction. Based on these findings, we predict that area AL helps guide behaviors involving fast-moving stimuli (e.g., optic flow), while area PM?helps guide behaviors involving slow-moving objects.     

Relating Information,Encoding and Adaptation: Decoding the Population Firing Rate in Visual Areas 17/18 in Response to a Stimulus Transition

Neurons in the primary visual cortex typically reach their highest firing rate after an abrupt image transition. Since the mutual information between the firing rate and the currently presented image is largest during this early firing period it is tempting to conclude this early firing encodes the current image. This view is, however, made more complicated by the fact that the response to the current image is dependent on the preceding image. Therefore we hypothesize that neurons encode a combination of current and previous images, and that the strength of the current image relative to the previous image changes over time. The temporal encoding is interesting, first, because neurons are, at different time points, sensitive to different features such as luminance, edges and textures; second, because the temporal evolution provides temporal constraints for deciphering the instantaneous population activity. To study the temporal evolution of the encoding we presented a sequence of 250 ms stimulus patterns during multiunit recordings in areas 17 and 18 of the anaesthetized ferret. Using a novel method we decoded the pattern given the instantaneous population-firing rate. Following a stimulus transition from stimulus A to B the decoded stimulus during the first 90ms was more correlated with the difference between A and B (B-A) than with B alone. After 90ms the decoded stimulus was more correlated with stimulus B than with B-A. Finally we related our results to information measures of previous (B) and current stimulus (A). Despite that the initial transient conveys the majority of the stimulus-related information; we show that it actually encodes a difference image which can be independent of the stimulus. Only later on, spikes gradually encode the stimulus more exclusively.     

Neuronal plasticity and multisensory integration in filial imprinting

Many organisms sample their environment through multiple sensory systems and the integration of multisensory information enhances learning. However, the mechanisms underlying multisensory memory formation and their similarity to unisensory mechanisms remain unclear. Filial imprinting is one example in which experience is multisensory, and the mechanisms of unisensory neuronal plasticity are well established. We investigated the storage of audiovisual information through experience by comparing the activity of neurons in the intermediate and medial mesopallium of imprinted and naïve domestic chicks (Gallus gallus domesticus) in response to an audiovisual imprinting stimulus and novel object and their auditory and visual components. We find that imprinting enhanced the mean response magnitude of neurons to unisensory but not multisensory stimuli. Furthermore, imprinting enhanced responses to incongruent audiovisual stimuli comprised of mismatched auditory and visual components. Our results suggest that the effects of imprinting on the unisensory and multisensory responsiveness of IMM neurons differ and that IMM neurons may function to detect unexpected deviations from the audiovisual imprinting stimulus.     

Visual processing levels revealed by response latencies to changes in different visual attributes.

Visual latencies, and their variation with stimulus attributes, can provide information about the level in the visual system at which different attributes of the image are analysed, and decisions about them made. A change in the colour, structure or movement of a visual stimulus brings about a highly reproducible transient constriction of the pupil that probably depends on visual cortical mechanisms. We measured this transient response to changes in several attributes of visual stimuli, and also measured manual reaction times to the same stimulus changes. Through analysis of latencies, we hoped to establish whether changes in different stimulus attributes were processed by mechanisms at the same or different levels in the visual pathway. Pupil responses to a change in spatial structure or colour are almost identical, but both are ca. 40 ms slower than those to a change in light flux, which are thought to depend largely on subcortical pathways. Manual reaction times to a change in spatial structure or colour, or to the onset of coherent movement, differ reliably, and all are longer than the reaction time to a change in light flux. On average, observers take 184 ms to detect a change in light flux, 6 ms more to detect the onset of a grating, 30 ms more to detect a change in colour, and 37 ms more to detect the onset of coherent motion. The pattern of latency variation for pupil responses and reaction times suggests that the mechanisms that trigger the responses lie at different levels in cortex. Given our present knowledge of visual cortical organization, the long reaction time to the change in motion is surprising. The range of reaction times across different stimuli is consistent with decisions about the onset of a grating being made in V1 and decisions about the change in colour or change in motion being made in V4.     

Receptive field dynamics of neurons in the cat visual cortex and lateral geniculate body

Spike responses of single neurons in the primary visual cortex and lateral geniculate body to random presentation of local photic stimuli in different parts of the receptive field of the cell were studied in acute experiments on curarized cats. Series of maps of receptive fields with time interval of 20 msec obtained by computer enabled the dynamics of the excitatory and inhibitory zones of the field to be assessed during development of on- and off-responses to flashes. Receptive fields of all cortical and lateral geniculate body neurons tested were found to undergo regular dynamic reorganization both after the beginning and after the end of action of the photic stimulus. During the latent period of the response no receptive field was found in the part of the visual field tested, but later a small zone of weak responses appeared only in the center of the field. Gradually (most commonly toward 60–100 msec after application of the stimulus) the zone of the responses widened to its limit, after which the recorded field began to shrink, ending with complete disappearance or disintegration into separate fragments. If two bursts of spikes were generated in response to stimulation, during the second burst the receptive field of the neuron changed in the same way. The effects described were clearly exhibited if the level of background illumination, the intensity of the test bars, their contrast with the background, duration, angles subtended, and orientation were varied, although the rate and degree of reorganization of the receptive field in this case changed significantly. The functional importance of the effect for coding of information about the features of a signal by visual cortical neurons is discussed.Institute of Higher Nervous Activity and Neurophysiology, Academy of Sciences of the USSR, Moscow. Translated from Neirofiziologiya, Vol. 14, No. 6, pp. 622–630, November–December, 1982.     

Representation of well-learned information in the monkey hippocampus

In the neocortex, extensive training results in enhanced neuronal selectivity for learned stimuli relative to novel stimuli. This enhanced selectivity has been taken as evidence for learning-related plasticity. Much less is known, in contrast, about the representation of well-learned information in the hippocampus. In this study, we examined the responses of individual hippocampal neurons to well-learned and novel stimuli presented in the context of an associative learning task. There was no difference in the response magnitude or visual response latency of hippocampal neurons to the well-learned and novel stimuli. In contrast, hippocampal neurons responded significantly more selectively to the well-learned stimuli relative to the novel stimuli. These findings show that hippocampal cells, like neocortical cells, show greater selectivity to well-learned stimuli compared to novel stimuli.     

Olfactory coding: when smells collide

Brain responses can significantly outlast sensory stimuli leading to potential ambiguity when responses overlap. Recent studies of locust olfaction found that the responses of individual second order projection neurons depend markedly on the previous few seconds' stimulus history; the population response, however, still conveys information about both temporal structure and odour identity.     

Responses of neurons of the extrastriate cortex of the cat brain to moving stimuli of different forms

We examined responses of neurons of the field 21b of the cat brain cortex to presentation of moving visual stimuli of different forms. Characteristics of the responses of about 54% of the studied neurons showed that in these cases configurations of the contours of moving stimuli were to a certain extent discriminated. Most neurons selectively reacting to changes in the form of the stimulus were dark-sensitive units (they generated optimum responses to presentation of dark visual stimuli on the light background). Detailed examination of the spatial infrastructure of receptive fields (RFs) of the neurons and comparison of this structure with the selectivity of neuronal responses showed that there is no significant correlation between static organization of the RF and responses of the neuron to the movements of stimuli of different forms. We hypothesize that the dynamic infrastructure of the RF and the combined activity of functional groups of neurons, whose RFs spatially overlap the RF of the neuron under study, play a definite role in the mechanisms responsible for neuronal discrimination of the form of the visual stimulus. Neirofiziologiya/Neurophysiology, Vol. 38, No. 1, pp. 61–71, January–February, 2006.     

Stimulus-Response-Outcome Coding in the Pigeon Nidopallium Caudolaterale

A prerequisite for adaptive goal-directed behavior is that animals constantly evaluate action outcomes and relate them to both their antecedent behavior and to stimuli predictive of reward or non-reward. Here, we investigate whether single neurons in the avian nidopallium caudolaterale (NCL), a multimodal associative forebrain structure and a presumed analogue of mammalian prefrontal cortex, represent information useful for goal-directed behavior. We subjected pigeons to a go-nogo task, in which responding to one visual stimulus (S+) was partially reinforced, responding to another stimulus (S–) was punished, and responding to test stimuli from the same physical dimension (spatial frequency) was inconsequential. The birds responded most intensely to S+, and their response rates decreased monotonically as stimuli became progressively dissimilar to S+; thereby, response rates provided a behavioral index of reward expectancy. We found that many NCL neurons'' responses were modulated in the stimulus discrimination phase, the outcome phase, or both. A substantial fraction of neurons increased firing for cues predicting non-reward or decreased firing for cues predicting reward. Interestingly, the same neurons also responded when reward was expected but not delivered, and could thus provide a negative reward prediction error or, alternatively, signal negative value. In addition, many cells showed motor-related response modulation. In summary, NCL neurons represent information about the reward value of specific stimuli, instrumental actions as well as action outcomes, and therefore provide signals useful for adaptive behavior in dynamically changing environments.