STOCHASTIC RESONANCE MEASURED BY THEMUTUAL INFORMATION IN THE NEURONSTHAT TRANSMIT CHAOTIC SPIKE TRAINS

１ＩｎｔｒｏｄｕｃｔｉｏｎＩｔｉｓｗｅｌｌｋｎｏｗｎｔｈａｔｎｅｒｖｅｃｅｌｌｓｗｏｒｋｉｎｎｏｉｓｙｅｎｖｉｒｏｎｍｅｎｔ,ａｎｄｎｏｉｓｅｓｏｕｒｃｅｓｒａｎｇｉｎｇｆｒｏｍｉｎｔｅｒｎａｌｔｈｅｒｍａｌｎｏｉｓｅｔｏｅｘｔｅｒｎａｌｐｅｒｔｕｒｂａｔｉｏｎ．Ｏｎｅｐｕｚｚｌｉｎｇｐｒｏｂｌｅｍｉｓｈｏｗｄｏｎｅｒｖｅｃｅｌｌｓａｃｃｏｍｍｏｄａｔｅｎｏｉｓｅｉｎｃｏｄｉｎｇａｎｄｔｒａｎｓｆｏｒｍｉｎｇｉｎｆｏｒｍａｔｉｏｎ,ｒｅｃｅｎｔｒｅｓｅａｒｃｈｓｈｏｗｓｔｈａｔｎｏｉｓｅｍａｙｐ…     

Variability and coding efficiency of noisy neural spike encoders

Encoding synaptic inputs as a train of action potentials is a fundamental function of nerve cells. Although spike trains recorded in vivo have been shown to be highly variable, it is unclear whether variability in spike timing represents faithful encoding of temporally varying synaptic inputs or noise inherent in the spike encoding mechanism. It has been reported that spike timing variability is more pronounced for constant, unvarying inputs than for inputs with rich temporal structure. This could have significant implications for the nature of neural coding, particularly if precise timing of spikes and temporal synchrony between neurons is used to represent information in the nervous system. To study the potential functional role of spike timing variability, we estimate the fraction of spike timing variability which conveys information about the input for two types of noisy spike encoders--an integrate and fire model with randomly chosen thresholds and a model of a patch of neuronal membrane containing stochastic Na(+) and K(+) channels obeying Hodgkin-Huxley kinetics. The quality of signal encoding is assessed by reconstructing the input stimuli from the output spike trains using optimal linear mean square estimation. A comparison of the estimation performance of noisy neuronal models of spike generation enables us to assess the impact of neuronal noise on the efficacy of neural coding. The results for both models suggest that spike timing variability reduces the ability of spike trains to encode rapid time-varying stimuli. Moreover, contrary to expectations based on earlier studies, we find that the noisy spike encoding models encode slowly varying stimuli more effectively than rapidly varying ones.     

大鼠初级传入纤维与脊髓背角神经元间的动作电序列的突触传递

外周感觉神经元通过动作电位序列对信号进行编码,这些动作电位序列经过突触传递最终到达脑部。但是各种脉冲序列如何通过神经元之间的化学突触进行传递依然是一个悬而未决的问题。研究了初级传入A6纤维与背角神经元之间各种动作电位序列的突触传递过程。用于刺激的规则,周期、随机脉冲序列由短簇脉冲或单个脉冲构成。定义“事件”(event)为峰峰问期(intefspike interval)小于或等于规定阈值的最长动作电位串,然后从脉冲序列中提取事件间间期(interevent interval,IEI)。用时间,IEI图与回归映射的方法分析IEI序列,结果表明在突触后输出脉冲序列中可以检测到突触前脉冲序列的主要时间结构特征,特别是在短簇脉冲作为刺激单位时。通过计算输入与输出脉冲序列的互信息,发现短簇脉冲可以更可靠地跨突触传递由输入序列携带的神经信息。这些结果表明外周输入脉冲序列的主要时间结构特征可以跨突触传递,在突触传递神经信息的过程中短簇脉冲更为有效。这一研究在从突触传递角度探索神经信息编码方面迈出了一步。     

Reconstruction of Underlying Nonlinear Deterministic Dynamics Embedded in Noisy Spike Trains

An experimentally recorded time series formed by the exact times of occurrence of the neuronal spikes (spike train) is likely to be affected by observational noise that provokes events mistakenly confused with neuronal discharges, as well as missed detection of genuine neuronal discharges. The points of the spike train may also suffer a slight jitter in time due to stochastic processes in synaptic transmission and to delays in the detecting devices. This study presents a procedure aimed at filtering the embedded noise (denoising the spike trains) the spike trains based on the hypothesis that recurrent temporal patterns of spikes are likely to represent the robust expression of a dynamic process associated with the information carried by the spike train. The rationale of this approach is tested on simulated spike trains generated by several nonlinear deterministic dynamical systems with embedded observational noise. The application of the pattern grouping algorithm (PGA) to the noisy time series allows us to extract a set of points that form the reconstructed time series. Three new indices are defined for assessment of the performance of the denoising procedure. The results show that this procedure may indeed retrieve the most relevant temporal features of the original dynamics. Moreover, we observe that additional spurious events affect the performance to a larger extent than the missing of original points. Thus, a strict criterion for the detection of spikes under experimental conditions, thus reducing the number of spurious spikes, may raise the possibility to apply PGA to detect endogenous deterministic dynamics in the spike train otherwise masked by the observational noise.     

Estimating Temporal Causal Interaction between Spike Trains with Permutation and Transfer Entropy

Estimating the causal interaction between neurons is very important for better understanding the functional connectivity in neuronal networks. We propose a method called normalized permutation transfer entropy (NPTE) to evaluate the temporal causal interaction between spike trains, which quantifies the fraction of ordinal information in a neuron that has presented in another one. The performance of this method is evaluated with the spike trains generated by an Izhikevich’s neuronal model. Results show that the NPTE method can effectively estimate the causal interaction between two neurons without influence of data length. Considering both the precision of time delay estimated and the robustness of information flow estimated against neuronal firing rate, the NPTE method is superior to other information theoretic method including normalized transfer entropy, symbolic transfer entropy and permutation conditional mutual information. To test the performance of NPTE on analyzing simulated biophysically realistic synapses, an Izhikevich’s cortical network that based on the neuronal model is employed. It is found that the NPTE method is able to characterize mutual interactions and identify spurious causality in a network of three neurons exactly. We conclude that the proposed method can obtain more reliable comparison of interactions between different pairs of neurons and is a promising tool to uncover more details on the neural coding.     

Power-law inter-spike interval distributions infer a conditional maximization of entropy in cortical neurons

The brain is considered to use a relatively small amount of energy for its efficient information processing. Under a severe restriction on the energy consumption, the maximization of mutual information (MMI), which is adequate for designing artificial processing machines, may not suit for the brain. The MMI attempts to send information as accurate as possible and this usually requires a sufficient energy supply for establishing clearly discretized communication bands. Here, we derive an alternative hypothesis for neural code from the neuronal activities recorded juxtacellularly in the sensorimotor cortex of behaving rats. Our hypothesis states that in vivo cortical neurons maximize the entropy of neuronal firing under two constraints, one limiting the energy consumption (as assumed previously) and one restricting the uncertainty in output spike sequences at given firing rate. Thus, the conditional maximization of firing-rate entropy (CMFE) solves a tradeoff between the energy cost and noise in neuronal response. In short, the CMFE sends a rich variety of information through broader communication bands (i.e., widely distributed firing rates) at the cost of accuracy. We demonstrate that the CMFE is reflected in the long-tailed, typically power law, distributions of inter-spike intervals obtained for the majority of recorded neurons. In other words, the power-law tails are more consistent with the CMFE rather than the MMI. Thus, we propose the mathematical principle by which cortical neurons may represent information about synaptic input into their output spike trains.     

Emergence of network structure due to spike-timing-dependent plasticity in recurrent neuronal networks IV

In neuronal networks, the changes of synaptic strength (or weight) performed by spike-timing-dependent plasticity (STDP) are hypothesized to give rise to functional network structure. This article investigates how this phenomenon occurs for the excitatory recurrent connections of a network with fixed input weights that is stimulated by external spike trains. We develop a theoretical framework based on the Poisson neuron model to analyze the interplay between the neuronal activity (firing rates and the spike-time correlations) and the learning dynamics, when the network is stimulated by correlated pools of homogeneous Poisson spike trains. STDP can lead to both a stabilization of all the neuron firing rates (homeostatic equilibrium) and a robust weight specialization. The pattern of specialization for the recurrent weights is determined by a relationship between the input firing-rate and correlation structures, the network topology, the STDP parameters and the synaptic response properties. We find conditions for feed-forward pathways or areas with strengthened self-feedback to emerge in an initially homogeneous recurrent network.     

Hindmarsh-Rose神经模型的混沌控制

应用稳定性准则的混沌控制方法控制单个Hindmarsh-Rose神经元模型的混沌发放峰序列和混沌爆发运动。通过对膜电压的非线性连续-时间反馈干扰的输入,将混沌运动控制到5峰／爆发（5spikes/burst）轨道上,该轨道嵌入在混沌吸引子内。数值模拟结果显示该方法在控制HR神经元模型方面是有效的。     

Model based decoding of spike trains

Reliably decoding neuronal responses requires knowing what aspects of neuronal responses are stimulus related, and which aspects act as noise. Recent work shows that spike trains can be viewed as stochastic samples from the rate variation function, as estimated by the time dependent spike density function (or normalized peristimulus time histogram). Such spike trains are exactly described by order statistics, and can be decoded millisecond-by-millisecond by iterative application of order statistics.     

Measures of transinformation for multiple input/single output neuronal systems

This paper presents a method for the calculation of the information transfer, or transinformation, in multiple input/single output neuronal systems. Our approach is an extension of an approach introduced by Eckhorn and Poepel in 1974. These authors computed the transinformation in single input/single output neuronal channels by regarding the spike (or stimulus) trains involved as finite Markov chains. The expressions for multiple input systems presented here are derived in close analogy to formulae in linear systems theory which show explicity the correlations between the different input channels. A number of equivalent forms for the transinformation are discussed.     

Using interspike intervals to quantify noise effects on spike trains in temperature encoding neurons

This paper examines how noise interacts with the non-linear dynamical mechanisms of neuronal stimulus. We study the spike trains generated by a minimal Hodgkin-Huxley type model of a cold receptor neuron. The distributions of interspike intervals(ISIs) of purely deterministic simulations exhibit considerable differences compared to the noisy ones. We quantify the effect of noise using ISI return plots and the ISI-distance recently proposed by Kreuz et al. (J Neurosci Meth, 165:151–161, 2007). It is shown that the spike trains of a cold receptor neuron are more strongly affected by noise for low temperatures than for high temperatures. This trend is also observed in both regimes of cold receptors: tonic firing(which occurs for low and high temperatures) and bursting (which occurs for intermediate temperatures).     

Studying spike trains using a van Rossum metric with a synapse-like filter

Spike trains are unreliable. For example, in the primary sensory areas, spike patterns and precise spike times will vary between responses to the same stimulus. Nonetheless, information about sensory inputs is communicated in the form of spike trains. A challenge in understanding spike trains is to assess the significance of individual spikes in encoding information. One approach is to define a spike train metric, allowing a distance to be calculated between pairs of spike trains. In a good metric, this distance will depend on the information the spike trains encode. This method has been used previously to calculate the timescale over which the precision of spike times is significant. Here, a new metric is constructed based on a simple model of synaptic conductances which includes binding site depletion. Including binding site depletion in the metric means that a given individual spike has a smaller effect on the distance if it occurs soon after other spikes. The metric proves effective at classifying neuronal responses by stimuli in the sample data set of electro-physiological recordings from the primary auditory area of the zebra finch fore-brain. This shows that this is an effective metric for these spike trains suggesting that in these spike trains the significance of a spike is modulated by its proximity to previous spikes. This modulation is a putative information-coding property of spike trains.     

Recurrent Network Models for Perfect Temporal Integration of Fluctuating Correlated Inputs

Temporal integration of input is essential to the accumulation of information in various cognitive and behavioral processes, and gradually increasing neuronal activity, typically occurring within a range of seconds, is considered to reflect such computation by the brain. Some psychological evidence suggests that temporal integration by the brain is nearly perfect, that is, the integration is non-leaky, and the output of a neural integrator is accurately proportional to the strength of input. Neural mechanisms of perfect temporal integration, however, remain largely unknown. Here, we propose a recurrent network model of cortical neurons that perfectly integrates partially correlated, irregular input spike trains. We demonstrate that the rate of this temporal integration changes proportionately to the probability of spike coincidences in synaptic inputs. We analytically prove that this highly accurate integration of synaptic inputs emerges from integration of the variance of the fluctuating synaptic inputs, when their mean component is kept constant. Highly irregular neuronal firing and spike coincidences are the major features of cortical activity, but they have been separately addressed so far. Our results suggest that the efficient protocol of information integration by cortical networks essentially requires both features and hence is heterotic.     

The chronotron: a neuron that learns to fire temporally precise spike patterns

In many cases, neurons process information carried by the precise timings of spikes. Here we show how neurons can learn to generate specific temporally precise output spikes in response to input patterns of spikes having precise timings, thus processing and memorizing information that is entirely temporally coded, both as input and as output. We introduce two new supervised learning rules for spiking neurons with temporal coding of information (chronotrons), one that provides high memory capacity (E-learning), and one that has a higher biological plausibility (I-learning). With I-learning, the neuron learns to fire the target spike trains through synaptic changes that are proportional to the synaptic currents at the timings of real and target output spikes. We study these learning rules in computer simulations where we train integrate-and-fire neurons. Both learning rules allow neurons to fire at the desired timings, with sub-millisecond precision. We show how chronotrons can learn to classify their inputs, by firing identical, temporally precise spike trains for different inputs belonging to the same class. When the input is noisy, the classification also leads to noise reduction. We compute lower bounds for the memory capacity of chronotrons and explore the influence of various parameters on chronotrons' performance. The chronotrons can model neurons that encode information in the time of the first spike relative to the onset of salient stimuli or neurons in oscillatory networks that encode information in the phases of spikes relative to the background oscillation. Our results show that firing one spike per cycle optimizes memory capacity in neurons encoding information in the phase of firing relative to a background rhythm.     

Membrane Potential Fluctuations Determine the Precision of Spike Timing and Synchronous Activity: A Model Study

It is much debated on what time scale information is encoded by neuronal spike activity. With a phenomenological model that transforms time-dependent membrane potential fluctuations into spike trains, we investigate constraints for the timing of spikes and for synchronous activity of neurons with common input. The model of spike generation has a variable threshold that depends on the time elapsed since the previous action potential and on the preceding membrane potential changes. To ensure that the model operates in a biologically meaningful range, the model was adjusted to fit the responses of a fly visual interneuron to motion stimuli. The dependence of spike timing on the membrane potential dynamics was analyzed. Fast membrane potential fluctuations are needed to trigger spikes with a high temporal precision. Slow fluctuations lead to spike activity with a rate about proportional to the membrane potential. Thus, for a given level of stochastic input, the frequency range of membrane potential fluctuations induced by a stimulus determines whether a neuron can use a rate code or a temporal code. The relationship between the steepness of membrane potential fluctuations and the timing of spikes has also implications for synchronous activity in neurons with common input. Fast membrane potential changes must be shared by the neurons to produce synchronous activity.     

Regulation of spike timing in visual cortical circuits

A train of action potentials (a spike train) can carry information in both the average firing rate and the pattern of spikes in the train. But can such a spike-pattern code be supported by cortical circuits? Neurons in vitro produce a spike pattern in response to the injection of a fluctuating current. However, cortical neurons in vivo are modulated by local oscillatory neuronal activity and by top-down inputs. In a cortical circuit, precise spike patterns thus reflect the interaction between internally generated activity and sensory information encoded by input spike trains. We review the evidence for precise and reliable spike timing in the cortex and discuss its computational role.     

Reliability of spike and burst firing in thalamocortical relay cells

The reliability and precision of the timing of spikes in a spike train is an important aspect of neuronal coding. We investigated reliability in thalamocortical relay (TCR) cells in the acute slice and also in a Morris-Lecar model with several extensions. A frozen Gaussian noise current, superimposed on a DC current, was injected into the TCR cell soma. The neuron responded with spike trains that showed trial-to-trial variability, due to amongst others slow changes in its internal state and the experimental setup. The DC current allowed to bring the neuron in different states, characterized by a well defined membrane voltage (between ?80 and ?50 mV) and by a specific firing regime that on depolarization gradually shifted from a predominantly bursting regime to a tonic spiking regime. The filtered frozen white noise generated a spike pattern output with a broad spike interval distribution. The coincidence factor and the Hunter and Milton measure were used as reliability measures of the output spike train. In the experimental TCR cell as well as the Morris-Lecar model cell the reliability depends on the shape (steepness) of the current input versus spike frequency output curve. The model also allowed to study the contribution of three relevant ionic membrane currents to reliability: a T-type calcium current, a cation selective h-current and a calcium dependent potassium current in order to allow bursting, investigate the consequences of a more complex current-frequency relation and produce realistic firing rates. The reliability of the output of the TCR cell increases with depolarization. In hyperpolarized states bursts are more reliable than single spikes. The analytically derived relations were capable to predict several of the experimentally recorded spike features.     

Predicting the synaptic information efficacy in cortical layer 5 pyramidal neurons using a minimal integrate-and-fire model

Synaptic information efficacy (SIE) is a statistical measure to quantify the efficacy of a synapse. It measures how much information is gained, on the average, about the output spike train of a postsynaptic neuron if the input spike train is known. It is a particularly appropriate measure for assessing the input–output relationship of neurons receiving dynamic stimuli. Here, we compare the SIE of simulated synaptic inputs measured experimentally in layer 5 cortical pyramidal neurons in vitro with the SIE computed from a minimal model constructed to fit the recorded data. We show that even with a simple model that is far from perfect in predicting the precise timing of the output spikes of the real neuron, the SIE can still be accurately predicted. This arises from the ability of the model to predict output spikes influenced by the input more accurately than those driven by the background current. This indicates that in this context, some spikes may be more important than others. Lastly we demonstrate another aspect where using mutual information could be beneficial in evaluating the quality of a model, by measuring the mutual information between the model’s output and the neuron’s output. The SIE, thus, could be a useful tool for assessing the quality of models of single neurons in preserving input–output relationship, a property that becomes crucial when we start connecting these reduced models to construct complex realistic neuronal networks.     

Neural Coding with Graded Membrane Potential Changes and Spikes

The neural encoding of sensory stimuli is usually investigated for spike responses, although many neurons are known to convey information by graded membrane potential changes. We compare by model simulations how well different dynamical stimuli can be discriminated on the basis of spiking or graded responses. Although a continuously varying membrane potential contains more information than binary spike trains, we find situations where different stimuli can be better discriminated on the basis of spike responses than on the basis of graded responses. Spikes can be superior to graded membrane potential fluctuations if spikes sharpen the temporal structure of neuronal responses by amplifying fast transients of the membrane potential. Such fast membrane potential changes can be induced deterministically by the stimulus or can be due to membrane potential noise that is influenced in its statistical properties by the stimulus. The graded response mode is superior for discrimination between stimuli on a fine time scale.