Spike train metrics

Quantifying similarity and dissimilarity of spike trains is an important requisite for understanding neural codes. Spike metrics constitute a class of approaches to this problem. In contrast to most signal-processing methods, spike metrics operate on time series of all-or-none events, and are, thus, particularly appropriate for extracellularly recorded neural signals. The spike metric approach can be extended to multineuronal recordings, mitigating the 'curse of dimensionality' typically associated with analyses of multivariate data. Spike metrics have been usefully applied to the analysis of neural coding in a variety of systems, including vision, audition, olfaction, taste and electric sense.     

Different Stimuli,Different Spatial Codes: A Visual Map and an Auditory Rate Code for Oculomotor Space in the Primate Superior Colliculus

Maps are a mainstay of visual, somatosensory, and motor coding in many species. However, auditory maps of space have not been reported in the primate brain. Instead, recent studies have suggested that sound location may be encoded via broadly responsive neurons whose firing rates vary roughly proportionately with sound azimuth. Within frontal space, maps and such rate codes involve different response patterns at the level of individual neurons. Maps consist of neurons exhibiting circumscribed receptive fields, whereas rate codes involve open-ended response patterns that peak in the periphery. This coding format discrepancy therefore poses a potential problem for brain regions responsible for representing both visual and auditory information. Here, we investigated the coding of auditory space in the primate superior colliculus(SC), a structure known to contain visual and oculomotor maps for guiding saccades. We report that, for visual stimuli, neurons showed circumscribed receptive fields consistent with a map, but for auditory stimuli, they had open-ended response patterns consistent with a rate or level-of-activity code for location. The discrepant response patterns were not segregated into different neural populations but occurred in the same neurons. We show that a read-out algorithm in which the site and level of SC activity both contribute to the computation of stimulus location is successful at evaluating the discrepant visual and auditory codes, and can account for subtle but systematic differences in the accuracy of auditory compared to visual saccades. This suggests that a given population of neurons can use different codes to support appropriate multimodal behavior.     

Maps of interaural time difference in the chicken’s brainstem nucleus laminaris

Animals, including humans, use interaural time differences (ITDs) that arise from different sound path lengths to the two ears as a cue of horizontal sound source location. The nature of the neural code for ITD is still controversial. Current models differentiate between two population codes: either a map-like rate-place code of ITD along an array of neurons, consistent with a large body of data in the barn owl, or a population rate code, consistent with data from small mammals. Recently, it was proposed that these different codes reflect optimal coding strategies that depend on head size and sound frequency. The chicken makes an excellent test case of this proposal because its physical prerequisites are similar to small mammals, yet it shares a more recent common ancestry with the owl. We show here that, like in the barn owl, the brainstem nucleus laminaris in mature chickens displayed the major features of a place code of ITD. ITD was topographically represented in the maximal responses of neurons along each isofrequency band, covering approximately the contralateral acoustic hemisphere. Furthermore, the represented ITD range appeared to change with frequency, consistent with a pressure gradient receiver mechanism in the avian middle ear. At very low frequencies, below 400 Hz, maximal neural responses were symmetrically distributed around zero ITD and it remained unclear whether there was a topographic representation. These findings do not agree with the above predictions for optimal coding and thus revive the discussion as to what determines the neural coding strategies for ITDs.     

Information processing with population codes

Information is encoded in the brain by populations or clusters of cells, rather than by single cells. This encoding strategy is known as population coding. Here we review the standard use of population codes for encoding and decoding information, and consider how population codes can be used to support neural computations such as noise removal and nonlinear mapping. More radical ideas about how population codes may directly represent information about stimulus uncertainty are also discussed.     

Oscillation and coding in a formal neural network considered as a guide for plausible simulations of the insect olfactory system

For the analysis of coding mechanisms in the insect olfactory system, a fully connected network of synchronously updated McCulloch and Pitts neurons (MC-P type) was developed [Quenet, B., Horn, D., 2003. The dynamic neural filter: a binary model of spatio-temporal coding. Neural Comput. 15 (2), 309-329]. Considering the update time as an intrinsic clock, this "Dynamic Neural Filter" (DNF), which maps regions of input space into spatio-temporal sequences of neuronal activity, is able to produce exact binary codes extracted from the synchronized activities recorded at the level of projection neurons (PN) in the locust antennal lobe (AL) in response to different odors [Wehr, M., Laurent, G., 1996. Odor encoding by temporal sequences of firing in oscillating neural assemblies. Nature 384, 162-166]. Here, in a first step, we separate the populations of PN and local inhibitory neurons (LN) and use the DNF as a guide for simulations based on biological plausible neurons (Hodgkin-Huxley: H-H type). We show that a parsimonious network of 10 H-H neurons generates action potentials whose timing represents the required codes. In a second step, we construct a new type of DNF in order to study the population dynamics when different delays are taken into account. We find synaptic matrices which lead to both the emergence of robust oscillations and spatio-temporal patterns, using a formal criterion, based on a Normalized Euclidian Distance (NED), in order to measure the use of the temporal dimension as a coding dimension by the DNF. Similarly to biological PN, the activity of excitatory neurons in the model can be both phase-locked to different cycles of oscillations which remind local field potential (LFP), and nevertheless exhibit dynamic behavior complex enough to be the basis of spatio-temporal codes.     

Receiver operating characteristic (ROC) analysis of neural code efficacies

 Nerve cell signals are different in form from the stimuli that evoke them and they exhibit complex spatio-temporal characteristics. This defines a neural coding problem which is addressed by two current theories: Multiple Meaning Theory holds that neural signals contain patterns that make statements about combinations of stimulus properties; the Task Dependence Hypothesis suggests that different features of identical neural signals mediate performance in different behavioral tasks. These coding issues were addressed by investigating the representation of sensory information in the distal nervous system after transduction of visual stimuli into bio-electric signals. The objects of study were light-evoked neural responses which had been intracellularly recorded from single retinula (photoreceptor) cells in Limulus lateral eyes. The efficacies with which sensory information was represented by various candidate neural codes were calculated using receiver operating characteristic (ROC) analyses to provide objective indices. The specific visual problem under investigation was discrimination between light flashes whose intensities differed by a very small amount. A wide range of light adaptation states and relative stimulus intensities were explored. Extremely stringent data quality standards were applied which restricted the investigation to cells whose potentials did not exhibit any statistically significant drift during the hours required for data collection. Seven cellular characterizations were simultaneously monitored to detect drift in a given cell’s potentials; these characterizations included the value of the membrane potential and the values of six candidate codes. These codes were: the area under the light-evoked receptor potential (RP), the mean value of the RP, the peak height of the RP, the slope of the onset of the RP, the duration required for the RP to drop from its peak by a given amount, and the duration required for the RP to end. The results were: (1) Light adaptation increases efficacy. (2) Thus, light adaptation trades sensitivity for acuity (as characterized by ROC discriminations). (3) Increasing relative light flash intensity also increases efficacy. (4) The efficacies of the various codes are significantly different and fall in the following order: area?peak=mean?duration-end=slope= duration-drop. These findings further demonstrate that arbitrary characterizations of stimulus-response relationships are very likely to be incomplete. They particularly indicate that many commonly used and quite conventional neural analysis strategies may substantially underestimate system performance. Received: 21 August 1995/Accepted in revised form: 19 April 1996     

Encoding of Temporal Information by Timing,Rate, and Place in Cat Auditory Cortex

A central goal in auditory neuroscience is to understand the neural coding of species-specific communication and human speech sounds. Low-rate repetitive sounds are elemental features of communication sounds, and core auditory cortical regions have been implicated in processing these information-bearing elements. Repetitive sounds could be encoded by at least three neural response properties: 1) the event-locked spike-timing precision, 2) the mean firing rate, and 3) the interspike interval (ISI). To determine how well these response aspects capture information about the repetition rate stimulus, we measured local group responses of cortical neurons in cat anterior auditory field (AAF) to click trains and calculated their mutual information based on these different codes. ISIs of the multiunit responses carried substantially higher information about low repetition rates than either spike-timing precision or firing rate. Combining firing rate and ISI codes was synergistic and captured modestly more repetition information. Spatial distribution analyses showed distinct local clustering properties for each encoding scheme for repetition information indicative of a place code. Diversity in local processing emphasis and distribution of different repetition rate codes across AAF may give rise to concurrent feed-forward processing streams that contribute differently to higher-order sound analysis.     

The Efficient Coding of Speech: Cross-Linguistic Differences

Neural coding in the auditory system has been shown to obey the principle of efficient neural coding. The statistical properties of speech appear to be particularly well matched to the auditory neural code. However, only English has so far been analyzed from an efficient coding perspective. It thus remains unknown whether such an approach is able to capture differences between the sound patterns of different languages. Here, we use independent component analysis to derive information theoretically optimal, non-redundant codes (filter populations) for seven typologically distinct languages (Dutch, English, Japanese, Marathi, Polish, Spanish and Turkish) and relate the statistical properties of these filter populations to documented differences in the speech rhythms (Analysis 1) and consonant inventories (Analysis 2) of these languages. We show that consonant class membership plays a particularly important role in shaping the statistical structure of speech in different languages, suggesting that acoustic transience, a property that discriminates consonant classes from one another, is highly relevant for efficient coding.     

Identifying temporal codes in spontaneously active sensory neurons

The manner in which information is encoded in neural signals is a major issue in Neuroscience. A common distinction is between rate codes, where information in neural responses is encoded as the number of spikes within a specified time frame (encoding window), and temporal codes, where the position of spikes within the encoding window carries some or all of the information about the stimulus. One test for the existence of a temporal code in neural responses is to add artificial time jitter to each spike in the response, and then assess whether or not information in the response has been degraded. If so, temporal encoding might be inferred, on the assumption that the jitter is small enough to alter the position, but not the number, of spikes within the encoding window. Here, the effects of artificial jitter on various spike train and information metrics were derived analytically, and this theory was validated using data from afferent neurons of the turtle vestibular and paddlefish electrosensory systems, and from model neurons. We demonstrate that the jitter procedure will degrade information content even when coding is known to be entirely by rate. For this and additional reasons, we conclude that the jitter procedure by itself is not sufficient to establish the presence of a temporal code.     

Neural coding of categories: information efficiency and optimal population codes

This paper deals with the analytical study of coding a discrete set of categories by a large assembly of neurons. We consider population coding schemes, which can also be seen as instances of exemplar models proposed in the literature to account for phenomena in the psychophysics of categorization. We quantify the coding efficiency by the mutual information between the set of categories and the neural code, and we characterize the properties of the most efficient codes, considering different regimes corresponding essentially to different signal-to-noise ratio. One main outcome is to find that, in a high signal-to-noise ratio limit, the Fisher information at the population level should be the greatest between categories, which is achieved by having many cells with the stimulus-discriminating parts (steepest slope) of their tuning curves placed in the transition regions between categories in stimulus space. We show that these properties are in good agreement with both psychophysical data and with the neurophysiology of the inferotemporal cortex in the monkey, a cortex area known to be specifically involved in classification tasks.     

Optimal Stimulus Coding by Neural Populations Using Rate Codes

We create a framework based on Fisher information for determining the most effective population coding scheme for representing a continuous-valued stimulus attribute over its entire range. Using this scheme, we derive optimal single- and multi-neuron rate codes for homogeneous populations using several statistical models frequently used to describe neural data. We show that each neuron's discharge rate should increase quadratically with the stimulus and that statistically independent neural outputs provides optimal coding. Only cooperative populations can achieve this condition in an informationally effective way.     

Functional impact of transposable elements using bioinformatic analysis and a comparative genomic approach

A dual coding event, which is the translation of different isoforms from a single gene, is one of the special patterns among the alternative splicing events. This is an important mechanism for the regulation of protein diversity in human and mouse genomes. Although the regulation for dual coding events has been characterized in a few genes, the individual mechanism remains unclear. Numerous studies have described the exonization of transposable elements, which is the splicing mediated insertion of transposable element sequence fragments into mature mRNAs. Therefore, in this study, we investigated the number of transposable element (TE)-derived dual coding genes in human, chimpanzee and mouse genomes. TE fusion exons appeared in the dual coding regions of 309 human genes. Functional protein domain alterations by TE-derived dual coding events were observed in 129 human genes. Comparative TE-derived dual coding events were also analyzed in chimpanzee and mouse orthologs. Seventy chimpanzee orthologs had TE-derived dual coding events, but mouse orthologs did not have any TE-derived dual coding events. Taken together, our analyses listed the number of TE-derived dual coding genes which could be investigated by experimental analysis and suggested that TE-derived dual coding events were major sources for the functional diversity of human genes, but not mouse genes.     

Information theoretic approaches to understanding circuit function

The analysis of stimulus/response patterns using information theoretic approaches requires the full probability distribution of stimuli and response. Recent progress in using information-based tools to understand circuit function has advanced understanding of neural coding at the single cell and population level. In advances over traditional reverse correlation approaches, the determination of receptive fields using information as a metric has allowed novel insights into stimulus representation and transformation. The application of maximum entropy methods to population codes has opened a rich exploration of the internal structure of these codes, revealing stimulus-driven functional connectivity. We speculate about the prospects and limitations of information as a general tool for dissecting neural circuits and relating their structure and function.     

Cracking the code of oscillatory activity

Neural oscillations are ubiquitous measurements of cognitive processes and dynamic routing and gating of information. The fundamental and so far unresolved problem for neuroscience remains to understand how oscillatory activity in the brain codes information for human cognition. In a biologically relevant cognitive task, we instructed six human observers to categorize facial expressions of emotion while we measured the observers' EEG. We combined state-of-the-art stimulus control with statistical information theory analysis to quantify how the three parameters of oscillations (i.e., power, phase, and frequency) code the visual information relevant for behavior in a cognitive task. We make three points: First, we demonstrate that phase codes considerably more information (2.4 times) relating to the cognitive task than power. Second, we show that the conjunction of power and phase coding reflects detailed visual features relevant for behavioral response--that is, features of facial expressions predicted by behavior. Third, we demonstrate, in analogy to communication technology, that oscillatory frequencies in the brain multiplex the coding of visual features, increasing coding capacity. Together, our findings about the fundamental coding properties of neural oscillations will redirect the research agenda in neuroscience by establishing the differential role of frequency, phase, and amplitude in coding behaviorally relevant information in the brain.     

神经信息学的原理与展望

神经信息学是研究神经系统信息的载体形式,神经信息的产生、传输、加工、编码、存储与提取机理,以及建立神经数据库系统的科学。它是脑科学,信息科学和计算机科学相互交叉的边缘学科。神经信息学可分为分子神经信息学和系统神经信息学两个层次。神经信息编码可分为神经元脉冲序列的数字编码和突触联结权重编码两种编码方式。对21世纪神经信息学可能取得的新进展进行分析和预测,并论证开展人类神经组计划（HuNP）和建立神经数据库系统的必要性与可行性。对人类神经计划与人类脑计划的异同步,进行比较和讨论。     

Encoding of Time-varying Stimuli in Populations of Cultured Neurons

We wondered whether random populations of dissociated cultured cortical neurons, despite of their lack of structure and/or regional specialization, are capable of modulating their neural activity as the effect of a time-varying stimulation – a simulated ‘sensory’ afference. More specifically, we used localized low-frequency, non-periodic trains of stimuli to simulate sensory afferences, and asked how much information about the original trains of stimuli could be extracted from the neural activity recorded at the different sites. Furthermore, motivated by the results of studies performed both in vivo and in vitro on different preparations, which suggested that isolated spikes and bursts may play different roles in coding time-varying signals, we explored the amount of such ‘sensory’ information that could be associated to these different firing modes. Finally, we asked whether and how such ‘sensory’ information is transferred from the sites of stimulation (i.e., the ‘sensory’ areas), to the other regions of the neural populations. To do this we applied stimulus reconstruction techniques and information theoretic concepts that are typically used to investigate neural coding in sensory systems. Our main results are that (1) slow variations of the rate of stimulation are coded into isolated spikes and in the time of occurrence of bursts (but not in the bursts’ temporal structure); (2) increasing the rate of stimulation has the effect of increasing the proportion of isolated spikes in the average evoked response and their importance in coding for the stimuli; and, (3) the ability to recover the time course of the pattern of stimulation is strongly related to the degree of functional connectivity between stimulation and recording sites. These observations parallel similar findings in intact nervous systems regarding the complementary roles of bursts and tonic spikes in encoding sensory information. Our results also have interesting implications in the field of neuro-robotic interfaces. In fact, the ability of populations of neurons to code information is a prerequisite for obtaining hybrid systems, in which neuronal populations are used to control external devices.     

Block structure and stability of the genetic code

It is known that different codons may be unified into larger groups related to the hierarchical structure, approximate hidden symmetries, and evolutionary origin of the universal genetic code. Using a simplified evolutionary motivated two-letter version of genetic code, the general principles of the most stable coding are discussed. By the complete enumeration in such a reduced code it is strictly proved that the maximum stability with respect to point mutations and shifts in the reading frame needs the fixation of the middle letters within codons in groups with different physico-chemical properties, thus, explaining a key feature of the universal genetic code. The translational stability of the genetic code is studied by the mapping of code onto de Bruijn graph providing both the compact visual representation of mutual relationships between different codons as well as between codons and protein coding DNA sequence and a powerful tool for the investigation of stability of protein coding. Then, the results are extended to four-letter codes. As is shown, the universal genetic code obeys mainly the principles of optimal coding. These results demonstrate the hierarchical character of optimization of universal genetic code with strictly optimal coding being evolved at the earliest stages of molecular evolution. Finally, the universal genetic code is compared with the other natural variants of genetic codes.     

Efficient sparse coding in early sensory processing: lessons from signal recovery

Sensory representations are not only sparse, but often overcomplete: coding units significantly outnumber the input units. For models of neural coding this overcompleteness poses a computational challenge for shaping the signal processing channels as well as for using the large and sparse representations in an efficient way. We argue that higher level overcompleteness becomes computationally tractable by imposing sparsity on synaptic activity and we also show that such structural sparsity can be facilitated by statistics based decomposition of the stimuli into typical and atypical parts prior to sparse coding. Typical parts represent large-scale correlations, thus they can be significantly compressed. Atypical parts, on the other hand, represent local features and are the subjects of actual sparse coding. When applied on natural images, our decomposition based sparse coding model can efficiently form overcomplete codes and both center-surround and oriented filters are obtained similar to those observed in the retina and the primary visual cortex, respectively. Therefore we hypothesize that the proposed computational architecture can be seen as a coherent functional model of the first stages of sensory coding in early vision.     

Ion channel noise can explain firing correlation in auditory nerves

Sensory neurons code information about stimuli in their sequence of action potentials (spikes). Intuitively, the spikes should represent stimuli with high fidelity. However, generating and propagating spikes is a metabolically expensive process. It is therefore likely that neural codes have been selected to balance energy expenditure against encoding error. Our recently proposed optimal, energy-constrained neural coder (Jones et al. Frontiers in Computational Neuroscience, 9, 61 2015) postulates that neurons time spikes to minimize the trade-off between stimulus reconstruction error and expended energy by adjusting the spike threshold using a simple dynamic threshold. Here, we show that this proposed coding scheme is related to existing coding schemes, such as rate and temporal codes. We derive an instantaneous rate coder and show that the spike-rate depends on the signal and its derivative. In the limit of high spike rates the spike train maximizes fidelity given an energy constraint (average spike-rate), and the predicted interspike intervals are identical to those generated by our existing optimal coding neuron. The instantaneous rate coder is shown to closely match the spike-rates recorded from P-type primary afferents in weakly electric fish. In particular, the coder is a predictor of the peristimulus time histogram (PSTH). When tested against in vitro cortical pyramidal neuron recordings, the instantaneous spike-rate approximates DC step inputs, matching both the average spike-rate and the time-to-first-spike (a simple temporal code). Overall, the instantaneous rate coder relates optimal, energy-constrained encoding to the concepts of rate-coding and temporal-coding, suggesting a possible unifying principle of neural encoding of sensory signals.