The chronotron: a neuron that learns to fire temporally precise spike patterns

In many cases, neurons process information carried by the precise timings of spikes. Here we show how neurons can learn to generate specific temporally precise output spikes in response to input patterns of spikes having precise timings, thus processing and memorizing information that is entirely temporally coded, both as input and as output. We introduce two new supervised learning rules for spiking neurons with temporal coding of information (chronotrons), one that provides high memory capacity (E-learning), and one that has a higher biological plausibility (I-learning). With I-learning, the neuron learns to fire the target spike trains through synaptic changes that are proportional to the synaptic currents at the timings of real and target output spikes. We study these learning rules in computer simulations where we train integrate-and-fire neurons. Both learning rules allow neurons to fire at the desired timings, with sub-millisecond precision. We show how chronotrons can learn to classify their inputs, by firing identical, temporally precise spike trains for different inputs belonging to the same class. When the input is noisy, the classification also leads to noise reduction. We compute lower bounds for the memory capacity of chronotrons and explore the influence of various parameters on chronotrons' performance. The chronotrons can model neurons that encode information in the time of the first spike relative to the onset of salient stimuli or neurons in oscillatory networks that encode information in the phases of spikes relative to the background oscillation. Our results show that firing one spike per cycle optimizes memory capacity in neurons encoding information in the phase of firing relative to a background rhythm.     

Single neuron dynamics and computation

At the single neuron level, information processing involves the transformation of input spike trains into an appropriate output spike train. Building upon the classical view of a neuron as a threshold device, models have been developed in recent years that take into account the diverse electrophysiological make-up of neurons and accurately describe their input-output relations. Here, we review these recent advances and survey the computational roles that they have uncovered for various electrophysiological properties, for dendritic arbor anatomy as well as for short-term synaptic plasticity.     

Mathematical analysis of the possibility of detecting correlation between spike trains of weakly interacting neurons

The number of spikes which must be recorded in order to detect significant correlation between spike trains of two synaptically connected neurons was estimated by a mathematical model. Dependence of this number of spikes on importance of interneuronal connection (measured as the amplitude of the EPSP evoked by a single spike of the input neuron in the output cell) and on the intensity of total spontaneous excitatory influences on the output neuron and on its own parameters was studied. For cells which corresponded in the weight of connections between them, their intrinsic parameters, and characteristics of spontaneous activity to real spinal neurons, the necessary number of spikes was 10⁷–10⁸. An increase in amplitude of the single EPSP and also a decrease in the intensity of the input spontaneous spike train and parameters of after-hyperpolarization of the postsynaptic neuron led to a decrease in the number of spikes necessary for the detection of significant correlation. On the basis of the results of this and previous investigations the possible principles for construction of a spinal locomotor generator are discussed.A. A. Bogomolets Institute of Physiology, Academy of Sciences of the Ukrainian SSR, Kiev. Translated from Neirofiziologiya, Vol. 12, No. 3, pp. 290–296, May–June, 1980.     

STOCHASTIC RESONANCE MEASURED BY THEMUTUAL INFORMATION IN THE NEURONSTHAT TRANSMIT CHAOTIC SPIKE TRAINS

１ＩｎｔｒｏｄｕｃｔｉｏｎＩｔｉｓｗｅｌｌｋｎｏｗｎｔｈａｔｎｅｒｖｅｃｅｌｌｓｗｏｒｋｉｎｎｏｉｓｙｅｎｖｉｒｏｎｍｅｎｔ,ａｎｄｎｏｉｓｅｓｏｕｒｃｅｓｒａｎｇｉｎｇｆｒｏｍｉｎｔｅｒｎａｌｔｈｅｒｍａｌｎｏｉｓｅｔｏｅｘｔｅｒｎａｌｐｅｒｔｕｒｂａｔｉｏｎ．Ｏｎｅｐｕｚｚｌｉｎｇｐｒｏｂｌｅｍｉｓｈｏｗｄｏｎｅｒｖｅｃｅｌｌｓａｃｃｏｍｍｏｄａｔｅｎｏｉｓｅｉｎｃｏｄｉｎｇａｎｄｔｒａｎｓｆｏｒｍｉｎｇｉｎｆｏｒｍａｔｉｏｎ,ｒｅｃｅｎｔｒｅｓｅａｒｃｈｓｈｏｗｓｔｈａｔｎｏｉｓｅｍａｙｐ…     

STOCHASTIC RESONANCE MEASURED BY THEMUTUAL INFORMATION IN THE NEURONSTHAT TRANSMIT CHAOTIC SPIKE TRAINS

The spike trains generated by a neuron model are studied by the methods of nonlinear time series analysis. The results show that the spike trains are chaotic. To investigate effect of noise on transmission of chaotic spike trains, this chaotic spike trains are used as a discrete subthreshold input signal to the integrate-and-fire neuronal model and the FitzHugh-Nagumo(FHN) neuronal model working in noisy environment. The mutual information between the input spike trains and the output spike trains is calculated, the result shows that the transformation of information encoded by the chaotic spike trains is optimized by some level of noise, and stochastic resonance(SR) measured by mutual information is a property available for neurons to transmit chaotic spike trains.     

大鼠初级传入纤维与脊髓背角神经元间的动作电序列的突触传递

外周感觉神经元通过动作电位序列对信号进行编码,这些动作电位序列经过突触传递最终到达脑部。但是各种脉冲序列如何通过神经元之间的化学突触进行传递依然是一个悬而未决的问题。研究了初级传入A6纤维与背角神经元之间各种动作电位序列的突触传递过程。用于刺激的规则,周期、随机脉冲序列由短簇脉冲或单个脉冲构成。定义“事件”(event)为峰峰问期(intefspike interval)小于或等于规定阈值的最长动作电位串,然后从脉冲序列中提取事件间间期(interevent interval,IEI)。用时间,IEI图与回归映射的方法分析IEI序列,结果表明在突触后输出脉冲序列中可以检测到突触前脉冲序列的主要时间结构特征,特别是在短簇脉冲作为刺激单位时。通过计算输入与输出脉冲序列的互信息,发现短簇脉冲可以更可靠地跨突触传递由输入序列携带的神经信息。这些结果表明外周输入脉冲序列的主要时间结构特征可以跨突触传递,在突触传递神经信息的过程中短簇脉冲更为有效。这一研究在从突触传递角度探索神经信息编码方面迈出了一步。     

Reliability of spike and burst firing in thalamocortical relay cells

The reliability and precision of the timing of spikes in a spike train is an important aspect of neuronal coding. We investigated reliability in thalamocortical relay (TCR) cells in the acute slice and also in a Morris-Lecar model with several extensions. A frozen Gaussian noise current, superimposed on a DC current, was injected into the TCR cell soma. The neuron responded with spike trains that showed trial-to-trial variability, due to amongst others slow changes in its internal state and the experimental setup. The DC current allowed to bring the neuron in different states, characterized by a well defined membrane voltage (between ?80 and ?50 mV) and by a specific firing regime that on depolarization gradually shifted from a predominantly bursting regime to a tonic spiking regime. The filtered frozen white noise generated a spike pattern output with a broad spike interval distribution. The coincidence factor and the Hunter and Milton measure were used as reliability measures of the output spike train. In the experimental TCR cell as well as the Morris-Lecar model cell the reliability depends on the shape (steepness) of the current input versus spike frequency output curve. The model also allowed to study the contribution of three relevant ionic membrane currents to reliability: a T-type calcium current, a cation selective h-current and a calcium dependent potassium current in order to allow bursting, investigate the consequences of a more complex current-frequency relation and produce realistic firing rates. The reliability of the output of the TCR cell increases with depolarization. In hyperpolarized states bursts are more reliable than single spikes. The analytically derived relations were capable to predict several of the experimentally recorded spike features.     

A proposed mechanism for multiplication of neural signals

The probability of the joint occurrence of two statistically independent events is the product of the probabilities of the individual events. This fact is used to show that a neuron which detects coincident arrivals of spikes from two input neurons can function as a multiplier, i.e. its average output spike frequency is proportional to the product of the average input spike frequencies. The theoretical analysis is checked in two ways: (a) Computer simulations confirm the derived expressions for the output frequency and show that increasing the jitter in the input spike trains improves the operation of the multiplier by making the output spike train more regular (b) Experimentally recorded spike trains are used to demonstrate that the type and amount of jitter present in real spike trains is adequate for satisfactory operation of the proposed scheme for multiplication. The operating characteristics of the proposed multiplier make it an attractive candidate for the multiplicative mechanism that is involved in the optomotor response of insects.     

Membrane Potential Fluctuations Determine the Precision of Spike Timing and Synchronous Activity: A Model Study

It is much debated on what time scale information is encoded by neuronal spike activity. With a phenomenological model that transforms time-dependent membrane potential fluctuations into spike trains, we investigate constraints for the timing of spikes and for synchronous activity of neurons with common input. The model of spike generation has a variable threshold that depends on the time elapsed since the previous action potential and on the preceding membrane potential changes. To ensure that the model operates in a biologically meaningful range, the model was adjusted to fit the responses of a fly visual interneuron to motion stimuli. The dependence of spike timing on the membrane potential dynamics was analyzed. Fast membrane potential fluctuations are needed to trigger spikes with a high temporal precision. Slow fluctuations lead to spike activity with a rate about proportional to the membrane potential. Thus, for a given level of stochastic input, the frequency range of membrane potential fluctuations induced by a stimulus determines whether a neuron can use a rate code or a temporal code. The relationship between the steepness of membrane potential fluctuations and the timing of spikes has also implications for synchronous activity in neurons with common input. Fast membrane potential changes must be shared by the neurons to produce synchronous activity.     

Stochastic automaton models for interaction of excitatory and inhibitory impulse sequences in neurons

The mechanisms by which excitatory and inhibitory input impulse sequences interact in changing the spike probability in neurons are examined in the two mathematical neuron models; one is a real-time neuron model which is close to physiological reality, and the other a stochastic automaton model for the temporal pattern discrimination proposed in the previous paper (Tsukada et al., 1976), which is developed in this paper as neuron models for interaction of excitatory and inhibitory input impulse sequences. The interval distributions of the output spike train from these models tend to be multimodal and are compared with those used for experimental data, reported by Bishop et al. (1964) for geniculate neuron activity and Poisson process deleting model analyzed by Ten Hoopen et al. (1966). Special attention, moreover, should be paid to how different forms of inhibitory input are transformed into the output interval distributions through these neuron models. These results exhibit a clear correlation between inhibitory input form and output interval distribution. More detailed information on this mechanism is obtained from the computations of recurrence-time under the stationary condition to go from active state to itself for the first time, each of which is influenced by the inhibitory input forms. In addition to these facts, some resultant characteristics on interval histogram and serial correlation are discussed in relation to physiological data from the literature.     

Variability and coding efficiency of noisy neural spike encoders

Encoding synaptic inputs as a train of action potentials is a fundamental function of nerve cells. Although spike trains recorded in vivo have been shown to be highly variable, it is unclear whether variability in spike timing represents faithful encoding of temporally varying synaptic inputs or noise inherent in the spike encoding mechanism. It has been reported that spike timing variability is more pronounced for constant, unvarying inputs than for inputs with rich temporal structure. This could have significant implications for the nature of neural coding, particularly if precise timing of spikes and temporal synchrony between neurons is used to represent information in the nervous system. To study the potential functional role of spike timing variability, we estimate the fraction of spike timing variability which conveys information about the input for two types of noisy spike encoders--an integrate and fire model with randomly chosen thresholds and a model of a patch of neuronal membrane containing stochastic Na(+) and K(+) channels obeying Hodgkin-Huxley kinetics. The quality of signal encoding is assessed by reconstructing the input stimuli from the output spike trains using optimal linear mean square estimation. A comparison of the estimation performance of noisy neuronal models of spike generation enables us to assess the impact of neuronal noise on the efficacy of neural coding. The results for both models suggest that spike timing variability reduces the ability of spike trains to encode rapid time-varying stimuli. Moreover, contrary to expectations based on earlier studies, we find that the noisy spike encoding models encode slowly varying stimuli more effectively than rapidly varying ones.     

Stochastically Gating Ion Channels Enable Patterned Spike Firing through Activity-Dependent Modulation of Spike Probability

The transformation of synaptic input into patterns of spike output is a fundamental operation that is determined by the particular complement of ion channels that a neuron expresses. Although it is well established that individual ion channel proteins make stochastic transitions between conducting and non-conducting states, most models of synaptic integration are deterministic, and relatively little is known about the functional consequences of interactions between stochastically gating ion channels. Here, we show that a model of stellate neurons from layer II of the medial entorhinal cortex implemented with either stochastic or deterministically gating ion channels can reproduce the resting membrane properties of stellate neurons, but only the stochastic version of the model can fully account for perithreshold membrane potential fluctuations and clustered patterns of spike output that are recorded from stellate neurons during depolarized states. We demonstrate that the stochastic model implements an example of a general mechanism for patterning of neuronal output through activity-dependent changes in the probability of spike firing. Unlike deterministic mechanisms that generate spike patterns through slow changes in the state of model parameters, this general stochastic mechanism does not require retention of information beyond the duration of a single spike and its associated afterhyperpolarization. Instead, clustered patterns of spikes emerge in the stochastic model of stellate neurons as a result of a transient increase in firing probability driven by activation of HCN channels during recovery from the spike afterhyperpolarization. Using this model, we infer conditions in which stochastic ion channel gating may influence firing patterns in vivo and predict consequences of modifications of HCN channel function for in vivo firing patterns.     

Cross-intensity functions and the estimate of spike-time jitter

Correlation measures are important tools for the analysis of simultaneously recorded spike trains. A well-known measure with probabilistic interpretation is the cross-intensity function (CIF), which is an estimate of the conditional probability that a neuron spikes as a function of the time lag to spikes in another neuron. The non-commutative nature of the CIF is particularly useful when different neuron classes are studied that can be distinguished based on their anatomy or physiology. Here we explore the utility of the CIF for estimating spike-time jitter in synaptic interactions between neuron pairs of connected classes. When applied to spike train pairs from sleeping songbirds, we are able to distinguish fast synaptic interactions mediated primarily by AMPA receptors from slower interactions mediated by NMDA receptors. We also find that spike jitter increases with the time lag between spikes, reflecting the accumulation of noise in neural activity sequences, such as in synfire chains. In conclusion, we demonstrate some new utility of the CIF as a spike-train measure.     

Bursting as an Effective Relay Mode in a Minimal Thalamic Model

In recent years, accumulating evidence indicates that thalamic bursts are present during wakefulness and participate in information transmission as an effective relay mode with distinctive properties from the tonic activity. Thalamic bursts originate from activation of the low threshold calcium cannels via a local feedback inhibition, exerted by the thalamic reticular neurons upon the relay neurons. This article, examines if this simple mechanism is sufficient to explain the distinctive properties of thalamic bursting as an effective relay mode. A minimal model of thalamic circuit composed of a retinal spike train, a relay neuron and a reticular neuron is simulated to generate the tonic and burst firing modes. The integrate-and-fire-or-burst model is used to simulate the neurons. After discriminating the burst events with criteria based on inter-spike-intervals, statistical indices show that the bursts of the minimal model are stereotypic events. The relation between the rate of bursts and the parameters of the input spike train demonstrates marked nonlinearities. Burst response is shown to be selective to spike-silence-spike sequences in the input spike train. Moreover, burst events represent the input more reliably than the tonic spike in a considerable range of the parameters of the model. In conclusion, many of the distinctive properties of thalamic bursts such as stereotypy, nonlinear dependence on the sensory stimulus, feature selectivity and reliability are reproducible in the minimal model. Furthermore, the minimal model predicts that while the bursts are more frequent in the spike train of the off-center X relay neurons (corresponding to off-center X retinal ganglion cells), they are more reliable when generated by the on-center ones (corresponding to on-center X ganglion cells).     

Cerebellar Nuclear Neurons Use Time and Rate Coding to Transmit Purkinje Neuron Pauses

Neurons of the cerebellar nuclei convey the final output of the cerebellum to their targets in various parts of the brain. Within the cerebellum their direct upstream connections originate from inhibitory Purkinje neurons. Purkinje neurons have a complex firing pattern of regular spikes interrupted by intermittent pauses of variable length. How can the cerebellar nucleus process this complex input pattern? In this modeling study, we investigate different forms of Purkinje neuron simple spike pause synchrony and its influence on candidate coding strategies in the cerebellar nuclei. That is, we investigate how different alignments of synchronous pauses in synthetic Purkinje neuron spike trains affect either time-locking or rate-changes in the downstream nuclei. We find that Purkinje neuron synchrony is mainly represented by changes in the firing rate of cerebellar nuclei neurons. Pause beginning synchronization produced a unique effect on nuclei neuron firing, while the effect of pause ending and pause overlapping synchronization could not be distinguished from each other. Pause beginning synchronization produced better time-locking of nuclear neurons for short length pauses. We also characterize the effect of pause length and spike jitter on the nuclear neuron firing. Additionally, we find that the rate of rebound responses in nuclear neurons after a synchronous pause is controlled by the firing rate of Purkinje neurons preceding it.     

Influence of temporal correlation of synaptic input on the rate and variability of firing in neurons

The spike trains that transmit information between neurons are stochastic. We used the theory of random point processes and simulation methods to investigate the influence of temporal correlation of synaptic input current on firing statistics. The theory accounts for two sources for temporal correlation: synchrony between spikes in presynaptic input trains and the unitary synaptic current time course. Simulations show that slow temporal correlation of synaptic input leads to high variability in firing. In a leaky integrate-and-fire neuron model with spike afterhyperpolarization the theory accurately predicts the firing rate when the spike threshold is higher than two standard deviations of the membrane potential fluctuations. For lower thresholds the spike afterhyperpolarization reduces the firing rate below the theory's predicted level when the synaptic correlation decays rapidly. If the synaptic correlation decays slower than the spike afterhyperpolarization, spike bursts can occur during single broad peaks of input fluctuations, increasing the firing rate over the prediction. Spike bursts lead to a coefficient of variation for the interspike intervals that can exceed one, suggesting an explanation of high coefficient of variation for interspike intervals observed in vivo.     

Gamma oscillations as a mechanism for selective information transmission

In the past decades, many studies have focussed on the relation between the input and output of neurons with the aim to understand information processing by neurons. A particular aspect of neuronal information, which has not received much attention so far, concerns the problem of information transfer when a neuron or a population of neurons receives input from two or more (populations of) neurons, in particular when these (populations of) neurons carry different types of information. The aim of the present study is to investigate the responses of neurons to multiple inputs modulated in the gamma frequency range. By a combination of theoretical approaches and computer simulations, we test the hypothesis that enhanced modulation of synchronized excitatory neuronal activity in the gamma frequency range provides an advantage over a less synchronized input for various types of neurons. The results of this study show that the spike output of various types of neurons [i.e. the leaky integrate and fire neuron, the quadratic integrate and fire neuron and the Hodgkin–Huxley (HH) neuron] and that of excitatory–inhibitory coupled pairs of neurons, like the Pyramidal Interneuronal Network Gamma (PING) model, is highly phase-locked to the larger of two gamma-modulated input signals. This implies that the neuron selectively responds to the input with the larger gamma modulation if the amplitude of the gamma modulation exceeds that of the other signals by a certain amount. In that case, the output of the neuron is entrained by one of multiple inputs and that other inputs are not represented in the output. This mechanism for selective information transmission is enhanced for short membrane time constants of the neuron.     

Conversion of Phase Information into a Spike-Count Code by Bursting Neurons

Single neurons in the cerebral cortex are immersed in a fluctuating electric field, the local field potential (LFP), which mainly originates from synchronous synaptic input into the local neural neighborhood. As shown by recent studies in visual and auditory cortices, the angular phase of the LFP at the time of spike generation adds significant extra information about the external world, beyond the one contained in the firing rate alone. However, no biologically plausible mechanism has yet been suggested that allows downstream neurons to infer the phase of the LFP at the soma of their pre-synaptic afferents. Therefore, so far there is no evidence that the nervous system can process phase information. Here we study a model of a bursting pyramidal neuron, driven by a time-dependent stimulus. We show that the number of spikes per burst varies systematically with the phase of the fluctuating input at the time of burst onset. The mapping between input phase and number of spikes per burst is a robust response feature for a broad range of stimulus statistics. Our results suggest that cortical bursting neurons could play a crucial role in translating LFP phase information into an easily decodable spike count code.     

Spatial and temporal correlations of spike trains in frog retinal ganglion cells

For a neuron, firing activity can be in synchrony with that of others, which results in spatial correlation; on the other hand, spike events within each individual spike train may also correlate with each other, which results in temporal correlation. In order to investigate the relationship between these two phenomena, population neurons’ activities of frog retinal ganglion cells in response to binary pseudo-random checker-board flickering were recorded via a multi-electrode recording system. The spatial correlation index (SCI) and temporal correlation index (TCI) were calculated for the investigated neurons. Statistical results showed that, for a single neuron, the SCI and TCI values were highly related—a neuron with a high SCI value generally had a high TCI value, and these two indices were both associated with burst activities in spike train of the investigated neuron. These results may suggest that spatial and temporal correlations of single neuron’s spiking activities could be mutually modulated; and that burst activities could play a role in the modulation. We also applied models to test the contribution of spatial and temporal correlations for visual information processing. We show that a model considering spatial and temporal correlations could predict spikes more accurately than a model does not include any correlation.     

Spike-Threshold Adaptation Predicted by Membrane Potential Dynamics In Vivo

Neurons encode information in sequences of spikes, which are triggered when their membrane potential crosses a threshold. In vivo, the spiking threshold displays large variability suggesting that threshold dynamics have a profound influence on how the combined input of a neuron is encoded in the spiking. Threshold variability could be explained by adaptation to the membrane potential. However, it could also be the case that most threshold variability reflects noise and processes other than threshold adaptation. Here, we investigated threshold variation in auditory neurons responses recorded in vivo in barn owls. We found that spike threshold is quantitatively predicted by a model in which the threshold adapts, tracking the membrane potential at a short timescale. As a result, in these neurons, slow voltage fluctuations do not contribute to spiking because they are filtered by threshold adaptation. More importantly, these neurons can only respond to input spikes arriving together on a millisecond timescale. These results demonstrate that fast adaptation to the membrane potential captures spike threshold variability in vivo.