Measuring Fisher Information Accurately in Correlated Neural Populations

Neural responses are known to be variable. In order to understand how this neural variability constrains behavioral performance, we need to be able to measure the reliability with which a sensory stimulus is encoded in a given population. However, such measures are challenging for two reasons: First, they must take into account noise correlations which can have a large influence on reliability. Second, they need to be as efficient as possible, since the number of trials available in a set of neural recording is usually limited by experimental constraints. Traditionally, cross-validated decoding has been used as a reliability measure, but it only provides a lower bound on reliability and underestimates reliability substantially in small datasets. We show that, if the number of trials per condition is larger than the number of neurons, there is an alternative, direct estimate of reliability which consistently leads to smaller errors and is much faster to compute. The superior performance of the direct estimator is evident both for simulated data and for neuronal population recordings from macaque primary visual cortex. Furthermore we propose generalizations of the direct estimator which measure changes in stimulus encoding across conditions and the impact of correlations on encoding and decoding, typically denoted by I_shuffle and I_diag respectively.     

Predicting human perceptual decisions by decoding neuronal information profiles

Perception relies on the response of populations of neurons in sensory cortex. How the response profile of a neuronal population gives rise to perception and perceptual discrimination has been conceptualized in various ways. Here we suggest that neuronal population responses represent information about our environment explicitly as Fisher information (FI), which is a local measure of the variance estimate of the sensory input. We show how this sensory information can be read out and combined to infer from the available information profile which stimulus value is perceived during a fine discrimination task. In particular, we propose that the perceived stimulus corresponds to the stimulus value that leads to the same information for each of the alternative directions, and compare the model prediction to standard models considered in the literature (population vector, maximum likelihood, maximum-a-posteriori Bayesian inference). The models are applied to human performance in a motion discrimination task that induces perceptual misjudgements of a target direction of motion by task irrelevant motion in the spatial surround of the target stimulus (motion repulsion). By using the neurophysiological insight that surround motion suppresses neuronal responses to the target motion in the center, all models predicted the pattern of perceptual misjudgements. The variation of discrimination thresholds (error on the perceived value) was also explained through the changes of the total FI content with varying surround motion directions. The proposed FI decoding scheme incorporates recent neurophysiological evidence from macaque visual cortex showing that perceptual decisions do not rely on the most active neurons, but rather on the most informative neuronal responses. We statistically compare the prediction capability of the FI decoding approach and the standard decoding models. Notably, all models reproduced the variation of the perceived stimulus values for different surrounds, but with different neuronal tuning characteristics underlying perception. Compared to the FI approach the prediction power of the standard models was based on neurons with far wider tuning width and stronger surround suppression. Our study demonstrates that perceptual misjudgements can be based on neuronal populations encoding explicitly the available sensory information, and provides testable neurophysiological predictions on neuronal tuning characteristics underlying human perceptual decisions.     

Decoding Hindlimb Movement for a Brain Machine Interface after a Complete Spinal Transection

Stereotypical locomotor movements can be made without input from the brain after a complete spinal transection. However, the restoration of functional gait requires descending modulation of spinal circuits to independently control the movement of each limb. To evaluate whether a brain-machine interface (BMI) could be used to regain conscious control over the hindlimb, rats were trained to press a pedal and the encoding of hindlimb movement was assessed using a BMI paradigm. Off-line, information encoded by neurons in the hindlimb sensorimotor cortex was assessed. Next neural population functions, or weighted representations of the neuronal activity, were used to replace the hindlimb movement as a trigger for reward in real-time (on-line decoding) in three conditions: while the animal could still press the pedal, after the pedal was removed and after a complete spinal transection. A novel representation of the motor program was learned when the animals used neural control to achieve water reward (e.g. more information was conveyed faster). After complete spinal transection, the ability of these neurons to convey information was reduced by more than 40%. However, this BMI representation was relearned over time despite a persistent reduction in the neuronal firing rate during the task. Therefore, neural control is a general feature of the motor cortex, not restricted to forelimb movements, and can be regained after spinal injury.     

A maximum entropy criterion of filtering and coding for stationary autoregressive signals: Its physical interpretations and suggestions for its application to neural information transmission

The operations of encoding and decoding in communication agree with filtering operations of convolution and deconvolution for Gaussian signal processing. In an analogy with power transmission in thermodynamics, an autoregressive model of information transmission is proposed for representing a continuous communication system which requires a pair of an internal noise source and a signal source to encode or decode a message. In this model transinformation (informational entropy) equals the increase in stationary nonequilibrium organization formed through the amplification of white noise by a positive feedback system. The channel capacity is finite due to the existence of inherent noise in the system. The maximum entropy criterion in information dynamics corresponds to the 2^nd law of thermodynamics. If the process is stationary, the communication system is invertible, and has the maximum efficiency of transformation. The total variation in informational entropy is zero in the cycle of the invertible system, while in the noninvertible system the entropy of decoding is less than that of encoding. A noisy autoregressive coding which maximizes transinformation is optimum, but is also ideal.     

Distinct neuronal types contribute to hybrid temporal encoding strategies in primate auditory cortex

Studies of the encoding of sensory stimuli by the brain often consider recorded neurons as a pool of identical units. Here, we report divergence in stimulus-encoding properties between subpopulations of cortical neurons that are classified based on spike timing and waveform features. Neurons in auditory cortex of the awake marmoset (Callithrix jacchus) encode temporal information with either stimulus-synchronized or nonsynchronized responses. When we classified single-unit recordings using either a criteria-based or an unsupervised classification method into regular-spiking, fast-spiking, and bursting units, a subset of intrinsically bursting neurons formed the most highly synchronized group, with strong phase-locking to sinusoidal amplitude modulation (SAM) that extended well above 20 Hz. In contrast with other unit types, these bursting neurons fired primarily on the rising phase of SAM or the onset of unmodulated stimuli, and preferred rapid stimulus onset rates. Such differentiating behavior has been previously reported in bursting neuron models and may reflect specializations for detection of acoustic edges. These units responded to natural stimuli (vocalizations) with brief and precise spiking at particular time points that could be decoded with high temporal stringency. Regular-spiking units better reflected the shape of slow modulations and responded more selectively to vocalizations with overall firing rate increases. Population decoding using time-binned neural activity found that decoding behavior differed substantially between regular-spiking and bursting units. A relatively small pool of bursting units was sufficient to identify the stimulus with high accuracy in a manner that relied on the temporal pattern of responses. These unit type differences may contribute to parallel and complementary neural codes.

Neurons in auditory cortex show highly diverse responses to sounds. This study suggests that neuronal type inferred from baseline firing properties accounts for much of this diversity, with a subpopulation of bursting units being specialized for precise temporal encoding.     

A Dendritic Mechanism for Decoding Traveling Waves: Principles and Applications to Motor Cortex

Traveling waves of neuronal oscillations have been observed in many cortical regions, including the motor and sensory cortex. Such waves are often modulated in a task-dependent fashion although their precise functional role remains a matter of debate. Here we conjecture that the cortex can utilize the direction and wavelength of traveling waves to encode information. We present a novel neural mechanism by which such information may be decoded by the spatial arrangement of receptors within the dendritic receptor field. In particular, we show how the density distributions of excitatory and inhibitory receptors can combine to act as a spatial filter of wave patterns. The proposed dendritic mechanism ensures that the neuron selectively responds to specific wave patterns, thus constituting a neural basis of pattern decoding. We validate this proposal in the descending motor system, where we model the large receptor fields of the pyramidal tract neurons — the principle outputs of the motor cortex — decoding motor commands encoded in the direction of traveling wave patterns in motor cortex. We use an existing model of field oscillations in motor cortex to investigate how the topology of the pyramidal cell receptor field acts to tune the cells responses to specific oscillatory wave patterns, even when those patterns are highly degraded. The model replicates key findings of the descending motor system during simple motor tasks, including variable interspike intervals and weak corticospinal coherence. By additionally showing how the nature of the wave patterns can be controlled by modulating the topology of local intra-cortical connections, we hence propose a novel integrated neuronal model of encoding and decoding motor commands.     

The influence of cortical feature maps on the encoding of the orientation of a short line

The inhomogeneous distribution of the receptive fields of cortical neurons influences the cortical representation of the orientation of short lines seen in visual images. We construct a model of the response of populations of neurons in the human primary visual cortex by combining realistic response properties of individual neurons and cortical maps of orientation and location preferences. The encoding error, which characterizes the difference between the parameters of a visual stimulus and their cortical representation, is calculated using Fisher information as the square root of the variance of a statistically efficient estimator. The error of encoding orientation varies considerably with the location and orientation of the short line stimulus as modulated by the underlying orientation preference map. The average encoding error depends only weakly on the structure of the orientation preference map and is much smaller than the human error of estimating orientation measured psychophysically. From this comparison we conclude that the actual mechanism of orientation perception does not make efficient use of all the information available in the neuronal responses and that it is the decoding of visual information from neuronal responses that limits psychophysical performance. Action Editor: Terrence Sejnowski     

Species-specific codon context rules unveil non-neutrality effects of synonymous mutations

BackgroundCodon pair usage (codon context) is a species specific gene primary structure feature whose evolutionary and functional roles are poorly understood. The data available show that codon-context has direct impact on both translation accuracy and efficiency, but one does not yet understand how it affects these two translation variables or whether context biases shape gene evolution.ConclusionsSince in vivo studies provide evidence for a role of codon context on decoding fidelity in E. coli and for decoding efficiency in mammalian cells, our data support the hypothesis that, like codon usage, codon context modulates the evolution of gene primary structure and fine tunes the structure of open reading frames for high genome translational fidelity and efficiency in the 3 domains of life.     

Comparative context analysis of codon pairs on an ORFeome scale

Codon context is an important feature of gene primary structure that modulates mRNA decoding accuracy. We have developed an analytical software package and a graphical interface for comparative codon context analysis of all the open reading frames in a genome (the ORFeome). Using the complete ORFeome sequences of Saccharomyces cerevisiae, Schizosaccharomyces pombe, Candida albicans and Escherichia coli, we show that this methodology permits large-scale codon context comparisons and provides new insight on the rules that govern the evolution of codon-pair context.     

A critical assessment of different measures of the information carried by correlated neuronal firing

Information theoretic measures have been proposed as a quantitative framework to clarify the role of correlated neuronal activity in the brain. In this paper we review some recent methods that allow precise assessments of the role of correlation in stimulus coding and decoding by the nervous system. We present new results that make explicit links between types of encoding and decoding mechanisms based on correlations. We illustrate the concepts by showing that the spike trains of pairs of neurons in rat somatosensory cortex can be decoded almost perfectly without including knowledge of correlation in the read-out model, although in this neural system correlations between spike times contribute appreciably to stimulus encoding.     

Adaptive Spike Threshold Enables Robust and Temporally Precise Neuronal Encoding

Neural processing rests on the intracellular transformation of information as synaptic inputs are translated into action potentials. This transformation is governed by the spike threshold, which depends on the history of the membrane potential on many temporal scales. While the adaptation of the threshold after spiking activity has been addressed before both theoretically and experimentally, it has only recently been demonstrated that the subthreshold membrane state also influences the effective spike threshold. The consequences for neural computation are not well understood yet. We address this question here using neural simulations and whole cell intracellular recordings in combination with information theoretic analysis. We show that an adaptive spike threshold leads to better stimulus discrimination for tight input correlations than would be achieved otherwise, independent from whether the stimulus is encoded in the rate or pattern of action potentials. The time scales of input selectivity are jointly governed by membrane and threshold dynamics. Encoding information using adaptive thresholds further ensures robust information transmission across cortical states i.e. decoding from different states is less state dependent in the adaptive threshold case, if the decoding is performed in reference to the timing of the population response. Results from in vitro neural recordings were consistent with simulations from adaptive threshold neurons. In summary, the adaptive spike threshold reduces information loss during intracellular information transfer, improves stimulus discriminability and ensures robust decoding across membrane states in a regime of highly correlated inputs, similar to those seen in sensory nuclei during the encoding of sensory information.     

Coding of time-dependent stimuli in homogeneous and heterogeneous neural populations

We compare the information transmission of a time-dependent signal by two types of uncoupled neuron populations that differ in their sources of variability: i) a homogeneous population whose units receive independent noise and ii) a deterministic heterogeneous population, where each unit exhibits a different baseline firing rate (’disorder’). Our criterion for making both sources of variability quantitatively comparable is that the interspike-interval distributions are identical for both systems. Numerical simulations using leaky integrate-and-fire neurons unveil that a non-zero amount of both noise or disorder maximizes the encoding efficiency of the homogeneous and heterogeneous system, respectively, as a particular case of suprathreshold stochastic resonance. Our findings thus illustrate that heterogeneity can render similarly profitable effects for neuronal populations as dynamic noise. The optimal noise/disorder depends on the system size and the properties of the stimulus such as its intensity or cutoff frequency. We find that weak stimuli are better encoded by a noiseless heterogeneous population, whereas for strong stimuli a homogeneous population outperforms an equivalent heterogeneous system up to a moderate noise level. Furthermore, we derive analytical expressions of the coherence function for the cases of very strong noise and of vanishing intrinsic noise or heterogeneity, which predict the existence of an optimal noise intensity. Our results show that, depending on the type of signal, noise as well as heterogeneity can enhance the encoding performance of neuronal populations.     

Differentiation of human ES cell-derived neural progenitors to neuronal cells with regional specific identity by co-culturing of notochord and somite

Limitations to the in vivo study of human nervous system development make it necessary to design an in vitro model to evaluate the in vivo effects of surrounding tissues on neurogenesis and regional identity of the human neural plate. Rostral neural progenitors (NPs) were initially generated from adherent human embryonic stem cells (hESCs) in a defined condition and characterized. Then, to find the role of somites (S) and notochords (N) in rostro-caudal (RC) and dorso-ventral (DV) patterning of neuronal cells, NPs were co-cultured with microencapsulated chicken S or N in alginate beads. In this study, N induced more neurogenesis as evaluated by expression of TUJ1 and MAP2-positive cells. Additionally, N induced spinal cord ventral brachiothoracic identity as well as NPs proliferation. We observed a synergic effect on motoneuron induction when S and N were used together. Moreover, S induced hindbrain identity in differentiated neuronal cells from NPs. These results indicate that highly enriched NPs can be generated in an adherent and defined system from hESCs. Moreover, S and N tissues highly influenced neuronal differentiation in point of proliferation, neurogenesis, and RC and DV regional identity. These results indicate a very simple and efficient protocol to mimic in vivo events of human neural development in vitro which is important in the context of developmental neuroscience and cellular replacement therapies.     

Rhythmic modulation of theta oscillations supports encoding of spatial and behavioral information in the rat hippocampus

Oscillatory patterns of activity in various frequency ranges are ubiquitously expressed in cortical circuits. While recent studies in humans emphasized rhythmic modulations of neuronal oscillations ("second-order" rhythms), their potential involvement in information coding remains an open question. Here, we show that a rhythmic (～0.7?Hz) modulation of hippocampal theta power, unraveled by second-order spectral analysis, supports encoding of spatial and behavioral information. The phase preference of neuronal discharge within this slow rhythm significantly increases the amount of information carried by action potentials in various motor/cognitive behaviors by (1) distinguishing between the spikes fired within versus outside the place field of hippocampal place cells, (2) disambiguating place firing of neurons having multiple place fields, and (3) predicting between alternative future spatial trajectories. This finding demonstrates the relevance of second-order spectral components of brain rhythms for decoding neuronal information.     

Bias-free estimation of information content in temporally sparse neuronal activity

Applying information theoretic measures to neuronal activity data enables the quantification of neuronal encoding quality. However, when the sample size is limited, a naïve estimation of the information content typically contains a systematic overestimation (upward bias), which may lead to misinterpretation of coding characteristics. This bias is exacerbated in Ca²⁺ imaging because of the temporal sparsity of elevated Ca²⁺ signals. Here, we introduce methods to correct for the bias in the naïve estimation of information content from limited sample sizes and temporally sparse neuronal activity. We demonstrate the higher accuracy of our methods over previous ones, when applied to Ca²⁺ imaging data recorded from the mouse hippocampus and primary visual cortex, as well as to simulated data with matching tuning properties and firing statistics. Our bias-correction methods allowed an accurate estimation of the information place cells carry about the animal’s position (spatial information) and uncovered the spatial resolution of hippocampal coding. Furthermore, using our methods, we found that cells with higher peak firing rates carry higher spatial information per spike and exposed differences between distinct hippocampal subfields in the long-term evolution of the spatial code. These results could be masked by the bias when applying the commonly used naïve calculation of information content. Thus, a bias-free estimation of information content can uncover otherwise overlooked properties of the neural code.     

关于耦合神经元活动时的能量原理

最近美国耶鲁大学的神经科学家们用实验数据表明,哺乳动物大脑皮层中神经信号的传递是一个代价昂贵的能量支出过程,而神经信号的编码是与能量代谢紧密地耦合在一起的,但是到目前为止还无法定量给出神经元活动时的能量函数。在这篇文章中,能量原理被用于神经活动和神经信息处理机制的研究,在电生理实验数据的基础上,建立神经元活动的用能量函数表示的运动方程。结果表明用能量函数表达耦合神经元的阈下电活动和动作电位,数值计算结果与用Hodgkin-Huxley方程所描述的动作电位一致。从而有可能依据能量原理从脑信息处理的角度揭示和理解大脑神经网络系统的信息表现规律。