Linear and quadratic models of point process systems: Contributions of patterned input to output

In the 1880's Volterra characterised a nonlinear system using a functional series connecting continuous input and continuous output. Norbert Wiener, in the 1940's, circumvented problems associated with the application of Volterra series to physical problems by deriving from it a new series of terms that are mutually uncorrelated with respect to Gaussian processes. Subsequently, Brillinger, in the 1970's, introduced a point-process analogue of Volterra's series connecting point-process inputs to the instantaneous rate of point-process output. We derive here a new series from this analogue in which its terms are mutually uncorrelated with respect to Poisson processes. This new series expresses how patterned input in a spike train, represented by third-order cross-cumulants, is converted into the instantaneous rate of an output point-process. Given experimental records of suitable duration, the contribution of arbitrary patterned input to an output process can, in principle, be determined. Solutions for linear and quadratic point-process models with one and two inputs and a single output are investigated. Our theoretical results are applied to isolated muscle spindle data in which the spike trains from the primary and secondary endings from the same muscle spindle are recorded in response to stimulation of one and then two static fusimotor axons in the absence and presence of a random length change imposed on the parent muscle. For a fixed mean rate of input spikes, the analysis of the experimental data makes explicit which patterns of two input spikes contribute to an output spike.     

The chronotron: a neuron that learns to fire temporally precise spike patterns

In many cases, neurons process information carried by the precise timings of spikes. Here we show how neurons can learn to generate specific temporally precise output spikes in response to input patterns of spikes having precise timings, thus processing and memorizing information that is entirely temporally coded, both as input and as output. We introduce two new supervised learning rules for spiking neurons with temporal coding of information (chronotrons), one that provides high memory capacity (E-learning), and one that has a higher biological plausibility (I-learning). With I-learning, the neuron learns to fire the target spike trains through synaptic changes that are proportional to the synaptic currents at the timings of real and target output spikes. We study these learning rules in computer simulations where we train integrate-and-fire neurons. Both learning rules allow neurons to fire at the desired timings, with sub-millisecond precision. We show how chronotrons can learn to classify their inputs, by firing identical, temporally precise spike trains for different inputs belonging to the same class. When the input is noisy, the classification also leads to noise reduction. We compute lower bounds for the memory capacity of chronotrons and explore the influence of various parameters on chronotrons' performance. The chronotrons can model neurons that encode information in the time of the first spike relative to the onset of salient stimuli or neurons in oscillatory networks that encode information in the phases of spikes relative to the background oscillation. Our results show that firing one spike per cycle optimizes memory capacity in neurons encoding information in the phase of firing relative to a background rhythm.     

Temperature compensation in the nervous system of the grasshopper

Abstract The wind-sensitive head hair neurones of the grasshopper Schistocerca americana (Drury) are influenced by temperature, increasing the number of spikes fired in response to a given hair deflection as temperature increases. Because these neurones show similar increases in spike output for greater hair deflections, an interneurone which receives their input would not be able to distinguish changes in stimulus strength from changes in temperature, unless the effects of temperature were compensated or independently measured. This study examines the effects of temperature on the output of the tritocerebral commissure giant (TCG), an interneurone that receives wind hair input. Some wind hairs provide excitatory input to the TCG, while others are inhibitory (Bacon & Möhl, 1983). Temperature variations similar to those measured in freely moving animals were applied to the wind hairs and TCG while the interneurone's spike output was recorded. Two manipulations resulted in temperature compensated outputs from the TCG: (1) When both excitatory and inhibitory hair fields were stimulated simultaneously, the temperature sensitivity of the interneurone's spike output was significantly lower than when the excitatory hairs alone were stimulated. (2) The spike output of the TCG showed very little sensitivity to temperature changes which occurred only at its wind hair inputs, the temperature of the interneurone itself remaining constant. It is therefore possible for the output of a neural circuit to be temperature compensated even though the circuit itself may be composed of temperature-sensitive units. Possible mechanisms by which temperature compensation may be produced in the TCG are discussed, and the behavioural relevance of the conditions under which TCG output is temperature compensated is considered.     

Computer simulations of synchrony and oscillations evoked by two coherent inputs

Coherent oscillations have been reported in multiple cortical areas. This study examines the characteristics of output spikes through computer simulations when the neural network model receives periodic/aperiodic spatiotemporal spikes with modulated/constant populational activity from two pathways. Synchronous oscillations which have the same period as the input are observed in response to periodic input patterns regardless of populational activity. The results confirm that the output frequency of synchrony is essentially determined by the period of the repeated input patterns. On the other hand, weak periodic outputs are observed when aperiodic spikes are input with modulated populational activity. In this case, higher firing rates are necessary to input for higher frequency oscillations. The spike-timing-dependent plasticity suppresses the spikes which do not contribute to the synchrony for periodic inputs. This effect corresponds to the experimental reports that learning sharpens the synchrony in the motor cortex. These results suggest that spatiotemporal spike patterns should be entrained on modulated populational activity to transmit oscillatory information effectively in the convergent pathway.     

大鼠初级传入纤维与脊髓背角神经元间的动作电序列的突触传递

外周感觉神经元通过动作电位序列对信号进行编码,这些动作电位序列经过突触传递最终到达脑部。但是各种脉冲序列如何通过神经元之间的化学突触进行传递依然是一个悬而未决的问题。研究了初级传入A6纤维与背角神经元之间各种动作电位序列的突触传递过程。用于刺激的规则,周期、随机脉冲序列由短簇脉冲或单个脉冲构成。定义“事件”(event)为峰峰问期(intefspike interval)小于或等于规定阈值的最长动作电位串,然后从脉冲序列中提取事件间间期(interevent interval,IEI)。用时间,IEI图与回归映射的方法分析IEI序列,结果表明在突触后输出脉冲序列中可以检测到突触前脉冲序列的主要时间结构特征,特别是在短簇脉冲作为刺激单位时。通过计算输入与输出脉冲序列的互信息,发现短簇脉冲可以更可靠地跨突触传递由输入序列携带的神经信息。这些结果表明外周输入脉冲序列的主要时间结构特征可以跨突触传递,在突触传递神经信息的过程中短簇脉冲更为有效。这一研究在从突触传递角度探索神经信息编码方面迈出了一步。     

Statistical characteristics of climbing fiber spikes necessary for efficient cerebellar learning

 Mean firing rates (MFRs), with analogue values, have thus far been used as information carriers of neurons in most brain theories of learning. However, the neurons transmit the signal by spikes, which are discrete events. The climbing fibers (CFs), which are known to be essential for cerebellar motor learning, fire at the ultra-low firing rates (around 1 Hz), and it is not yet understood theoretically how high-frequency information can be conveyed and how learning of smooth and fast movements can be achieved. Here we address whether cerebellar learning can be achieved by CF spikes instead of conventional MFR in an eye movement task, such as the ocular following response (OFR), and an arm movement task. There are two major afferents into cerebellar Purkinje cells: parallel fiber (PF) and CF, and the synaptic weights between PFs and Purkinje cells have been shown to be modulated by the stimulation of both types of fiber. The modulation of the synaptic weights is regulated by the cerebellar synaptic plasticity. In this study we simulated cerebellar learning using CF signals as spikes instead of conventional MFR. To generate the spikes we used the following four spike generation models: (1) a Poisson model in which the spike interval probability follows a Poisson distribution, (2) a gamma model in which the spike interval probability follows the gamma distribution, (3) a max model in which a spike is generated when a synaptic input reaches maximum, and (4) a threshold model in which a spike is generated when the input crosses a certain small threshold. We found that, in an OFR task with a constant visual velocity, learning was successful with stochastic models, such as Poisson and gamma models, but not in the deterministic models, such as max and threshold models. In an OFR with a stepwise velocity change and an arm movement task, learning could be achieved only in the Poisson model. In addition, for efficient cerebellar learning, the distribution of CF spike-occurrence time after stimulus onset must capture at least the first, second and third moments of the temporal distribution of error signals. Received: 28 January 2000 / Accepted in revised form: 2 August 2000     

A proposed mechanism for multiplication of neural signals

The probability of the joint occurrence of two statistically independent events is the product of the probabilities of the individual events. This fact is used to show that a neuron which detects coincident arrivals of spikes from two input neurons can function as a multiplier, i.e. its average output spike frequency is proportional to the product of the average input spike frequencies. The theoretical analysis is checked in two ways: (a) Computer simulations confirm the derived expressions for the output frequency and show that increasing the jitter in the input spike trains improves the operation of the multiplier by making the output spike train more regular (b) Experimentally recorded spike trains are used to demonstrate that the type and amount of jitter present in real spike trains is adequate for satisfactory operation of the proposed scheme for multiplication. The operating characteristics of the proposed multiplier make it an attractive candidate for the multiplicative mechanism that is involved in the optomotor response of insects.     

Predicting the synaptic information efficacy in cortical layer 5 pyramidal neurons using a minimal integrate-and-fire model

Synaptic information efficacy (SIE) is a statistical measure to quantify the efficacy of a synapse. It measures how much information is gained, on the average, about the output spike train of a postsynaptic neuron if the input spike train is known. It is a particularly appropriate measure for assessing the input–output relationship of neurons receiving dynamic stimuli. Here, we compare the SIE of simulated synaptic inputs measured experimentally in layer 5 cortical pyramidal neurons in vitro with the SIE computed from a minimal model constructed to fit the recorded data. We show that even with a simple model that is far from perfect in predicting the precise timing of the output spikes of the real neuron, the SIE can still be accurately predicted. This arises from the ability of the model to predict output spikes influenced by the input more accurately than those driven by the background current. This indicates that in this context, some spikes may be more important than others. Lastly we demonstrate another aspect where using mutual information could be beneficial in evaluating the quality of a model, by measuring the mutual information between the model’s output and the neuron’s output. The SIE, thus, could be a useful tool for assessing the quality of models of single neurons in preserving input–output relationship, a property that becomes crucial when we start connecting these reduced models to construct complex realistic neuronal networks.     

Conversion of Phase Information into a Spike-Count Code by Bursting Neurons

Single neurons in the cerebral cortex are immersed in a fluctuating electric field, the local field potential (LFP), which mainly originates from synchronous synaptic input into the local neural neighborhood. As shown by recent studies in visual and auditory cortices, the angular phase of the LFP at the time of spike generation adds significant extra information about the external world, beyond the one contained in the firing rate alone. However, no biologically plausible mechanism has yet been suggested that allows downstream neurons to infer the phase of the LFP at the soma of their pre-synaptic afferents. Therefore, so far there is no evidence that the nervous system can process phase information. Here we study a model of a bursting pyramidal neuron, driven by a time-dependent stimulus. We show that the number of spikes per burst varies systematically with the phase of the fluctuating input at the time of burst onset. The mapping between input phase and number of spikes per burst is a robust response feature for a broad range of stimulus statistics. Our results suggest that cortical bursting neurons could play a crucial role in translating LFP phase information into an easily decodable spike count code.     

Membrane Potential Fluctuations Determine the Precision of Spike Timing and Synchronous Activity: A Model Study

It is much debated on what time scale information is encoded by neuronal spike activity. With a phenomenological model that transforms time-dependent membrane potential fluctuations into spike trains, we investigate constraints for the timing of spikes and for synchronous activity of neurons with common input. The model of spike generation has a variable threshold that depends on the time elapsed since the previous action potential and on the preceding membrane potential changes. To ensure that the model operates in a biologically meaningful range, the model was adjusted to fit the responses of a fly visual interneuron to motion stimuli. The dependence of spike timing on the membrane potential dynamics was analyzed. Fast membrane potential fluctuations are needed to trigger spikes with a high temporal precision. Slow fluctuations lead to spike activity with a rate about proportional to the membrane potential. Thus, for a given level of stochastic input, the frequency range of membrane potential fluctuations induced by a stimulus determines whether a neuron can use a rate code or a temporal code. The relationship between the steepness of membrane potential fluctuations and the timing of spikes has also implications for synchronous activity in neurons with common input. Fast membrane potential changes must be shared by the neurons to produce synchronous activity.     

Efficient inhibition of bursts by bursts in the auditory system of crickets

In crickets, auditory information about ultrasound is carried bilaterally to the brain by the AN2 neurons. The ON1 neuron provides contralateral inhibitory input to AN2, thereby enhancing bilateral contrast between the left and right AN2s, an important cue for sound localization. We examine how the structures of the spike trains of these neurons affect this inhibitory interaction. As previously shown for AN2, ON1 responds to salient peaks in stimulus amplitude with bursts of spikes. Spike bursts, but not isolated spikes, reliably signal the occurrence of specific features of the stimulus. ON1 and AN2 burst at similar times relative to the amplitude envelope of the stimulus, and bursts are more tightly time-locked to stimulus feature than the isolated spikes. As a consequence, spikes that, in the absence of contralateral inhibition, would occur within AN2 bursts are more likely to be preceded by spikes in ON1 (mainly also in bursts) than are isolated AN2 spikes. This leads to a large decrease in the burst rate of the inhibited AN2. We conclude that the match in coding properties of ON1 and AN2 allows contralateral inhibition to be most efficient for those portions of the response that carry the behaviourally relevant information, i.e. for bursts. Electronic supplementary material The online version of this article (doi:) contains supplementary material, which is available to authorized users.     

The emergence of contrast-invariant orientation tuning in simple cells of cat visual cortex

Simple cells in primary visual cortex exhibit contrast-invariant orientation tuning, in seeming contradiction to feed-forward models that rely on lateral geniculate nucleus (LGN) input alone. Contrast invariance has therefore been thought to depend on the presence of intracortical lateral inhibition. In vivo intracellular recordings instead suggest that contrast invariance can be explained by three properties of the excitatory pathway. (1) Depolarizations evoked by orthogonal stimuli are determined by the amount of excitation a cell receives from the LGN, relative to the excitation it receives from other cortical cells. (2) Depolarizations evoked by preferred stimuli saturate at lower contrasts than the spike output of LGN relay cells. (3) Visual stimuli evoke contrast-dependent changes in trial-to-trial variability, which lead to contrast-dependent changes in the relationship between membrane potential and spike rate. Thus, high-contrast, orthogonally oriented stimuli that evoke significant depolarizations evoke few spikes. Together these mechanisms, without lateral inhibition, can account for contrast-invariant stimulus selectivity.     

Multiplying with neurons: Compensation for irregular input spike trains by using time-dependent synaptic efficiencies

A leaky integrate-and-fire (LIF) neurons can act as multipliers by detecting coincidences of input spikes. However, in case of input spike trains with irregular interspike delays, false coincidences are also detected and the operation as a multiplier is degraded. This problem can be solved by using time dependent synaptic weights which are set to zero after each input spike and recover with the same time constant as the decay time of the corresponding excitatory postsynaptic potentials (EPSP). Such a mechanism results in EPSP's with amplitudes independent on the input interspike delays. Neuronal computation is then performed without frequency decoding.     

Temporal sub units in dendritic trees

This simulation study examines the possibility that dendritic sub units can be defined according to temporal aspects in the timing of populations of synaptic inputs. A two cell model with passive dendritic trees is used, which is subject to both common and independent synaptic inputs, the presence of common synaptic input results in a tendency for correlated firing in the two cell model. The strength of this correlation is used to measure the efficacy of the common synaptic inputs in modulating the output discharge of each neurone. Our results suggest that a small fraction of the total synaptic input can effectively modulate the timing of output spikes, this phenomenon is not dependent on the physical location of the inputs on the dendritic tree. This phenomenon depends on the presence of temporal correlation between the pre-synaptic spike trains that provide the common input. We propose to refer to these as temporal sub units.     

Studying spike trains using a van Rossum metric with a synapse-like filter

Spike trains are unreliable. For example, in the primary sensory areas, spike patterns and precise spike times will vary between responses to the same stimulus. Nonetheless, information about sensory inputs is communicated in the form of spike trains. A challenge in understanding spike trains is to assess the significance of individual spikes in encoding information. One approach is to define a spike train metric, allowing a distance to be calculated between pairs of spike trains. In a good metric, this distance will depend on the information the spike trains encode. This method has been used previously to calculate the timescale over which the precision of spike times is significant. Here, a new metric is constructed based on a simple model of synaptic conductances which includes binding site depletion. Including binding site depletion in the metric means that a given individual spike has a smaller effect on the distance if it occurs soon after other spikes. The metric proves effective at classifying neuronal responses by stimuli in the sample data set of electro-physiological recordings from the primary auditory area of the zebra finch fore-brain. This shows that this is an effective metric for these spike trains suggesting that in these spike trains the significance of a spike is modulated by its proximity to previous spikes. This modulation is a putative information-coding property of spike trains.     

Spike sequences and their consequences

Spatio-temporal patterns of spikes have an advantage of representing information by their spike composition similar to words of languages. First we review the models of neuronal coding, then we discuss technical aspects of detecting spatio-temporal spike patterns. We argue by presenting data from rat hippocampus that spike trains recorded simultaneously from multiple pyramidal cells are not independent. Their hidden dependency structure can be revealed by spike 'sequences', defined as a set of neurons which fire in a specific temporal order with certain delay between successive spikes. The only way to prove their existence in vivo is to show that they recur with higher than by-chance frequency. We observed that 'sequences' possess 'compositional' features and that a given spike composition is time scale invariant. We illustrate that the same neuron can be a part of different 'sequences' and 'sequences' recur in a temporally compressed fashion during slow wave sleep. The statistical significance of 'sequences' is testable. Their biological significance has been implicated by experiments where recurrence rate of the sequences during different behavioral sessions were compared. As consistent with the 'replay hypothesis' of memory consolidation, new sequences generated during the wake state are persistent during the subsequent sleep. Thus, information acquired during the wake state and represented by spatio-temporal patterns of spikes may transfer to the neocortex during sleep. Our results suggest that 'sequences' reflect the activation of specific but configurable circuitries during exploratory behavior, followed by spontaneous re-activation of the same circuitry during sleep. Whether the delay structure of spikes as a combination is an effective input to single neurons downstream or 'sequence' components are being processed in parallel pathways and evaluated independently is an open question.     

Coding with spike shapes and graded potentials in cortical networks

In cortical neurones, analogue dendritic potentials are thought to be encoded into patterns of digital spikes. According to this view, neuronal codes and computations are based on the temporal patterns of spikes: spike times, bursts or spike rates. Recently, we proposed an 'action potential waveform code' for cortical pyramidal neurones in which the spike shape carries information. Broader somatic action potentials are reliably produced in response to higher conductance input, allowing for four times more information transfer than spike times alone. This information is preserved during synaptic integration in a single neurone, as back-propagating action potentials of diverse shapes differentially shunt incoming postsynaptic potentials and so participate in the next round of spike generation. An open question has been whether the information in action potential waveforms can also survive axonal conduction and directly influence synaptic transmission to neighbouring neurones. Several new findings have now brought new light to this subject, showing cortical information processing that transcends the classical models.     

Multiple Spike Time Patterns Occur at Bifurcation Points of Membrane Potential Dynamics

The response of a neuron to repeated somatic fluctuating current injections in vitro can elicit a reliable and precisely timed sequence of action potentials. The set of responses obtained across trials can also be interpreted as the response of an ensemble of similar neurons receiving the same input, with the precise spike times representing synchronous volleys that would be effective in driving postsynaptic neurons. To study the reproducibility of the output spike times for different conditions that might occur in vivo, we somatically injected aperiodic current waveforms into cortical neurons in vitro and systematically varied the amplitude and DC offset of the fluctuations. As the amplitude of the fluctuations was increased, reliability increased and the spike times remained stable over a wide range of values. However, at specific values called bifurcation points, large shifts in the spike times were obtained in response to small changes in the stimulus, resulting in multiple spike patterns that were revealed using an unsupervised classification method. Increasing the DC offset, which mimicked an overall increase in network background activity, also revealed bifurcation points and increased the reliability. Furthermore, the spike times shifted earlier with increasing offset. Although the reliability was reduced at bifurcation points, a theoretical analysis showed that the information about the stimulus time course was increased because each of the spike time patterns contained different information about the input.     

Predicting spike timing of neocortical pyramidal neurons by simple threshold models

Neurons generate spikes reliably with millisecond precision if driven by a fluctuating current—is it then possible to predict the spike timing knowing the input? We determined parameters of an adapting threshold model using data recorded in vitro from 24 layer 5 pyramidal neurons from rat somatosensory cortex, stimulated intracellularly by a fluctuating current simulating synaptic bombardment in vivo. The model generates output spikes whenever the membrane voltage (a filtered version of the input current) reaches a dynamic threshold. We find that for input currents with large fluctuation amplitude, up to 75% of the spike times can be predicted with a precision of ±2 ms. Some of the intrinsic neuronal unreliability can be accounted for by a noisy threshold mechanism. Our results suggest that, under random current injection into the soma, (i) neuronal behavior in the subthreshold regime can be well approximated by a simple linear filter; and (ii) most of the nonlinearities are captured by a simple threshold process.     

Ephaptic coupling in white matter fibre bundles modulates axonal transmission delays

Axonal connections are widely regarded as faithful transmitters of neuronal signals with fixed delays. The reasoning behind this is that extracellular potentials caused by spikes travelling along axons are too small to have an effect on other axons. Here we devise a computational framework that allows us to study the effect of extracellular potentials generated by spike volleys in axonal fibre bundles on axonal transmission delays. We demonstrate that, although the extracellular potentials generated by single spikes are of the order of microvolts, the collective extracellular potential generated by spike volleys can reach several millivolts. As a consequence, the resulting depolarisation of the axonal membranes increases the velocity of spikes, and therefore reduces axonal delays between brain areas. Driving a neural mass model with such spike volleys, we further demonstrate that only ephaptic coupling can explain the reduction of stimulus latencies with increased stimulus intensities, as observed in many psychological experiments.