The spatiotemporal learning rule and its efficiency in separating spatiotemporal patterns

The hippocampus plays an important role in the course of establishing long-term memory, i.e., to make short-term memory of spatially and temporally associated input information. In 1996 (Tsukada et al. 1996), the spatiotemporal learning rule was proposed based on differences observed in hippocampal long-term potentiation (LTP) induced by various spatiotemporal pattern stimuli. One essential point of this learning rule is that the change of synaptic weight depends on both spatial coincidence and the temporal summation of input pulses. We applied this rule to a single-layered neural network and compared its ability to separate spatiotemporal patterns with that of other rules, including the Hebbian learning rule and its extended rules. The simulated results showed that the spatiotemporal learning rule had the highest efficiency in discriminating spatiotemporal pattern sequences, while the Hebbian learning rule (including its extended rules) was sensitive to differences in spatial patterns.     

A computational framework for cortical learning

Recent physiological findings have revealed that long-term adaptation of the synaptic strengths between cortical pyramidal neurons depends on the temporal order of presynaptic and postsynaptic spikes, which is called spike-timing-dependent plasticity (STDP) or temporally asymmetric Hebbian (TAH) learning. Here I prove by analytical means that a physiologically plausible variant of STDP adapts synaptic strengths such that the presynaptic spikes predict the postsynaptic spikes with minimal error. This prediction error model of STDP implies a mechanism for cortical memory: cortical tissue learns temporal spike patterns if these spike patterns are repeatedly elicited in a set of pyramidal neurons. The trained network finishes these patterns if their beginnings are presented, thereby recalling the memory. Implementations of the proposed algorithms may be useful for applications in voice recognition and computer vision.     

The chronotron: a neuron that learns to fire temporally precise spike patterns

In many cases, neurons process information carried by the precise timings of spikes. Here we show how neurons can learn to generate specific temporally precise output spikes in response to input patterns of spikes having precise timings, thus processing and memorizing information that is entirely temporally coded, both as input and as output. We introduce two new supervised learning rules for spiking neurons with temporal coding of information (chronotrons), one that provides high memory capacity (E-learning), and one that has a higher biological plausibility (I-learning). With I-learning, the neuron learns to fire the target spike trains through synaptic changes that are proportional to the synaptic currents at the timings of real and target output spikes. We study these learning rules in computer simulations where we train integrate-and-fire neurons. Both learning rules allow neurons to fire at the desired timings, with sub-millisecond precision. We show how chronotrons can learn to classify their inputs, by firing identical, temporally precise spike trains for different inputs belonging to the same class. When the input is noisy, the classification also leads to noise reduction. We compute lower bounds for the memory capacity of chronotrons and explore the influence of various parameters on chronotrons' performance. The chronotrons can model neurons that encode information in the time of the first spike relative to the onset of salient stimuli or neurons in oscillatory networks that encode information in the phases of spikes relative to the background oscillation. Our results show that firing one spike per cycle optimizes memory capacity in neurons encoding information in the phase of firing relative to a background rhythm.     

Regulation of spike timing in visual cortical circuits

A train of action potentials (a spike train) can carry information in both the average firing rate and the pattern of spikes in the train. But can such a spike-pattern code be supported by cortical circuits? Neurons in vitro produce a spike pattern in response to the injection of a fluctuating current. However, cortical neurons in vivo are modulated by local oscillatory neuronal activity and by top-down inputs. In a cortical circuit, precise spike patterns thus reflect the interaction between internally generated activity and sensory information encoded by input spike trains. We review the evidence for precise and reliable spike timing in the cortex and discuss its computational role.     

An unsupervised automatic method for sorting neuronal spike waveforms in awake and freely moving animals

The present study introduces an approach to automatic classification of extracellularly recorded action potentials of neurons. The classification of spike waveform is considered a pattern recognition problem of special segments of signal that correspond to the appearance of spikes. The spikes generated by one neuron should be recognized as members of the same class. The spike waveforms are described by the nonlinear oscillating model as an ordinary differential equation with perturbation, thus characterizing the signal distortions in both amplitude and phase. It is shown that the use of local variables reduces the problem of spike recognition to the separation of a mixture of normal distributions in the transformed feature space. We have developed an unsupervised iteration-learning algorithm that estimates the number of classes and their centers according to the distance between spike trajectories in phase space. This algorithm scans the learning set to evaluate spike trajectories with maximal probability density in their neighborhood. Following the learning, the procedure of minimal distance is used to perform spike recognition. Estimation of trajectories in phase space requires calculation of the first- and second-order derivatives, and integral operators with piecewise polynomial kernels were used. This provided the computational efficiency of the developed approach for real-time application as required by recordings in behaving animals and in human neurosurgical operations. The new method of spike sorting was tested on simulated and real data and performed better than other approaches currently used in neurophysiology.     

Predicting the synaptic information efficacy in cortical layer 5 pyramidal neurons using a minimal integrate-and-fire model

Synaptic information efficacy (SIE) is a statistical measure to quantify the efficacy of a synapse. It measures how much information is gained, on the average, about the output spike train of a postsynaptic neuron if the input spike train is known. It is a particularly appropriate measure for assessing the input–output relationship of neurons receiving dynamic stimuli. Here, we compare the SIE of simulated synaptic inputs measured experimentally in layer 5 cortical pyramidal neurons in vitro with the SIE computed from a minimal model constructed to fit the recorded data. We show that even with a simple model that is far from perfect in predicting the precise timing of the output spikes of the real neuron, the SIE can still be accurately predicted. This arises from the ability of the model to predict output spikes influenced by the input more accurately than those driven by the background current. This indicates that in this context, some spikes may be more important than others. Lastly we demonstrate another aspect where using mutual information could be beneficial in evaluating the quality of a model, by measuring the mutual information between the model’s output and the neuron’s output. The SIE, thus, could be a useful tool for assessing the quality of models of single neurons in preserving input–output relationship, a property that becomes crucial when we start connecting these reduced models to construct complex realistic neuronal networks.     

Extra spike formation in sensory neurons and the disruption of afferent spike patterning

The peculiar pseudounipolar geometry of primary sensory neurons can lead to ectopic generation of "extra spikes" in the region of the dorsal root ganglion potentially disrupting the fidelity of afferent signaling. We have used an explicit model of myelinated vertebrate sensory neurons to investigate the location and mechanism of extra spike formation, and its consequences for distortion of afferent impulse patterning. Extra spikes originate in the initial segment axon under conditions in which the soma spike becomes delayed and broadened. The broadened soma spike then re-excites membrane it has just passed over, initiating an extra spike which propagates outwards into the main conducting axon. Extra spike formation depends on cell geometry, electrical excitability, and the recent history of impulse activity. Extra spikes add to the impulse barrage traveling toward the spinal cord, but they also travel antidromically in the peripheral nerve colliding with and occluding normal orthodromic spikes. As a result there is no net increase in afferent spike number. However, extra spikes render firing more staccato by increasing the number of short and long interspike intervals in the train at the expense of intermediate intervals. There may also be more complex changes in the pattern of afferent spike trains, and hence in afferent signaling.     

Improved measures of phase-coupling between spikes and the Local Field Potential

An important tool to study rhythmic neuronal synchronization is provided by relating spiking activity to the Local Field Potential (LFP). Two types of interdependent spike-LFP measures exist. The first approach is to directly quantify the consistency of single spike-LFP phases across spikes, referred to here as point-field phase synchronization measures. We show that conventional point-field phase synchronization measures are sensitive not only to the consistency of spike-LFP phases, but are also affected by statistical dependencies between spike-LFP phases, caused by e.g. non-Poissonian history-effects within spike trains such as bursting and refractoriness. To solve this problem, we develop a new pairwise measure that is not biased by the number of spikes and not affected by statistical dependencies between spike-LFP phases. The second approach is to quantify, similar to EEG-EEG coherence, the consistency of the relative phase between spike train and LFP signals across trials instead of across spikes, referred to here as spike train to field phase synchronization measures. We demonstrate an analytical relationship between point-field and spike train to field phase synchronization measures. Based on this relationship, we prove that the spike train to field pairwise phase consistency (PPC), a quantity closely related to the squared spike-field coherence, is a monotonically increasing function of the number of spikes per trial. This derived relationship is exact and analytic, and takes a linear form for weak phase-coupling. To solve this problem, we introduce a corrected version of the spike train to field PPC that is independent of the number of spikes per trial. Finally, we address the problem that dependencies between spike-LFP phase and the number of spikes per trial can cause spike-LFP phase synchronization measures to be biased by the number of trials. We show how to modify the developed point-field and spike train to field phase synchronization measures in order to make them unbiased by the number of trials.     

Learning of Precise Spike Times with Homeostatic Membrane Potential Dependent Synaptic Plasticity

Precise spatio-temporal patterns of neuronal action potentials underly e.g. sensory representations and control of muscle activities. However, it is not known how the synaptic efficacies in the neuronal networks of the brain adapt such that they can reliably generate spikes at specific points in time. Existing activity-dependent plasticity rules like Spike-Timing-Dependent Plasticity are agnostic to the goal of learning spike times. On the other hand, the existing formal and supervised learning algorithms perform a temporally precise comparison of projected activity with the target, but there is no known biologically plausible implementation of this comparison. Here, we propose a simple and local unsupervised synaptic plasticity mechanism that is derived from the requirement of a balanced membrane potential. Since the relevant signal for synaptic change is the postsynaptic voltage rather than spike times, we call the plasticity rule Membrane Potential Dependent Plasticity (MPDP). Combining our plasticity mechanism with spike after-hyperpolarization causes a sensitivity of synaptic change to pre- and postsynaptic spike times which can reproduce Hebbian spike timing dependent plasticity for inhibitory synapses as was found in experiments. In addition, the sensitivity of MPDP to the time course of the voltage when generating a spike allows MPDP to distinguish between weak (spurious) and strong (teacher) spikes, which therefore provides a neuronal basis for the comparison of actual and target activity. For spatio-temporal input spike patterns our conceptually simple plasticity rule achieves a surprisingly high storage capacity for spike associations. The sensitivity of the MPDP to the subthreshold membrane potential during training allows robust memory retrieval after learning even in the presence of activity corrupted by noise. We propose that MPDP represents a biophysically plausible mechanism to learn temporal target activity patterns.     

Reconstruction of Underlying Nonlinear Deterministic Dynamics Embedded in Noisy Spike Trains

An experimentally recorded time series formed by the exact times of occurrence of the neuronal spikes (spike train) is likely to be affected by observational noise that provokes events mistakenly confused with neuronal discharges, as well as missed detection of genuine neuronal discharges. The points of the spike train may also suffer a slight jitter in time due to stochastic processes in synaptic transmission and to delays in the detecting devices. This study presents a procedure aimed at filtering the embedded noise (denoising the spike trains) the spike trains based on the hypothesis that recurrent temporal patterns of spikes are likely to represent the robust expression of a dynamic process associated with the information carried by the spike train. The rationale of this approach is tested on simulated spike trains generated by several nonlinear deterministic dynamical systems with embedded observational noise. The application of the pattern grouping algorithm (PGA) to the noisy time series allows us to extract a set of points that form the reconstructed time series. Three new indices are defined for assessment of the performance of the denoising procedure. The results show that this procedure may indeed retrieve the most relevant temporal features of the original dynamics. Moreover, we observe that additional spurious events affect the performance to a larger extent than the missing of original points. Thus, a strict criterion for the detection of spikes under experimental conditions, thus reducing the number of spurious spikes, may raise the possibility to apply PGA to detect endogenous deterministic dynamics in the spike train otherwise masked by the observational noise.     

Computational Consequences of Temporally Asymmetric Learning Rules: I. Differential Hebbian Learning

Temporally asymetric learning rules governing plastic changes in synaptic efficacy have recently been identified in physiological studies. In these rules, the exact timing of pre- and postsynaptic spikes is critical to the induced change of synaptic efficacy. The temporal learning rules treated in this article are approximately antisymmetric; the synaptic efficacy is enhanced if the postsynaptic spike follows the presynaptic spike by a few milliseconds, but the efficacy is depressed if the postsynaptic spike precedes the presynaptic spike. The learning dynamics of this rule are studied using a stochastic model neuron receiving a set of serially delayed inputs. The average change of synaptic efficacy due to the temporally antisymmetric learning rule is shown to yield differential Hebbian learning. These results are demonstrated with both mathematical analyses and computer simulations, and connections with theories of classical conditioning are discussed.     

Unsupervised learning of visual features through spike timing dependent plasticity

Spike timing dependent plasticity (STDP) is a learning rule that modifies synaptic strength as a function of the relative timing of pre- and postsynaptic spikes. When a neuron is repeatedly presented with similar inputs, STDP is known to have the effect of concentrating high synaptic weights on afferents that systematically fire early, while postsynaptic spike latencies decrease. Here we use this learning rule in an asynchronous feedforward spiking neural network that mimics the ventral visual pathway and shows that when the network is presented with natural images, selectivity to intermediate-complexity visual features emerges. Those features, which correspond to prototypical patterns that are both salient and consistently present in the images, are highly informative and enable robust object recognition, as demonstrated on various classification tasks. Taken together, these results show that temporal codes may be a key to understanding the phenomenal processing speed achieved by the visual system and that STDP can lead to fast and selective responses.     

Computer simulations of synchrony and oscillations evoked by two coherent inputs

Coherent oscillations have been reported in multiple cortical areas. This study examines the characteristics of output spikes through computer simulations when the neural network model receives periodic/aperiodic spatiotemporal spikes with modulated/constant populational activity from two pathways. Synchronous oscillations which have the same period as the input are observed in response to periodic input patterns regardless of populational activity. The results confirm that the output frequency of synchrony is essentially determined by the period of the repeated input patterns. On the other hand, weak periodic outputs are observed when aperiodic spikes are input with modulated populational activity. In this case, higher firing rates are necessary to input for higher frequency oscillations. The spike-timing-dependent plasticity suppresses the spikes which do not contribute to the synchrony for periodic inputs. This effect corresponds to the experimental reports that learning sharpens the synchrony in the motor cortex. These results suggest that spatiotemporal spike patterns should be entrained on modulated populational activity to transmit oscillatory information effectively in the convergent pathway.     

Span: spike pattern association neuron for learning spatio-temporal spike patterns

Spiking Neural Networks (SNN) were shown to be suitable tools for the processing of spatio-temporal information. However, due to their inherent complexity, the formulation of efficient supervised learning algorithms for SNN is difficult and remains an important problem in the research area. This article presents SPAN - a spiking neuron that is able to learn associations of arbitrary spike trains in a supervised fashion allowing the processing of spatio-temporal information encoded in the precise timing of spikes. The idea of the proposed algorithm is to transform spike trains during the learning phase into analog signals so that common mathematical operations can be performed on them. Using this conversion, it is possible to apply the well-known Widrow-Hoff rule directly to the transformed spike trains in order to adjust the synaptic weights and to achieve a desired input/output spike behavior of the neuron. In the presented experimental analysis, the proposed learning algorithm is evaluated regarding its learning capabilities, its memory capacity, its robustness to noisy stimuli and its classification performance. Differences and similarities of SPAN regarding two related algorithms, ReSuMe and Chronotron, are discussed.     

Activity-dependent suppression of spontaneous spike generation in the Retzius neurons of the leech Hirudo medicinalis L.

We report on factors affecting the spontaneous firing pattern of the identified serotonin-containing Retzius neurons of the medicinal leech. Increased firing activity induced by intracellular current injection is followed by a ‘post-stimulus-depression’ (PSD) without spiking for up to 23 s. PSD duration depends both on the duration and the amplitude of the injected current and correlates inversely with the spontaneous spiking activity. In contrast to serotonin-containing neurons in mammals, serotonin release from the Retzius cells presumably does not mediate the observed spike suppression in a self-inhibitory manner since robust PSD persists after synaptic isolation. Moreover, single additional spikes elicited at specific delays after spontaneously occurring action potentials are sufficient to significantly alter the firing pattern. Since sub-threshold current injections do not affect the ongoing spiking pattern and PSD persists in synaptically isolated preparations our data suggest that PSD reflects an endogenous and ‘spike-dependent’ mechanism controlling the spiking activity of Retzius cells in a use-dependent way.     

Interaction between the Spatiotemporal Learning Rule (STLR) and Hebb type (HEBB) in single pyramidal cells in the hippocampal CA1 Area

The spatiotemporal learning rule (STLR), proposed as a non-Hebb type by Tsukada et al. (Neural Networks 9 (1996) 1357 and Tsukada and Pan (Biol. cyberm 92 (2005) 139), 2005), consists of two distinctive factors; “cooperative plasticity without a cell spike,” and “its temporal summation”. On the other hand, Hebb (The organization of behavior. John Wiley, New York, 1949) proposed the idea (HEBB) that synaptic modification is strengthened only if the pre- and post-cell are activated simultaneously. We have shown, experimentally, that both STLR and HEBB coexist in single pyramidal cells of the hippocampal CA1 area. The functional differences between STLR and HEBB in dendrite (local)-soma (global) interactions in single pyramidal cells of CA1 and the possibility of pattern separation, pattern completion and reinforcement learning were discussed.     

Computing Complex Visual Features with Retinal Spike Times

Neurons in sensory systems can represent information not only by their firing rate, but also by the precise timing of individual spikes. For example, certain retinal ganglion cells, first identified in the salamander, encode the spatial structure of a new image by their first-spike latencies. Here we explore how this temporal code can be used by downstream neural circuits for computing complex features of the image that are not available from the signals of individual ganglion cells. To this end, we feed the experimentally observed spike trains from a population of retinal ganglion cells to an integrate-and-fire model of post-synaptic integration. The synaptic weights of this integration are tuned according to the recently introduced tempotron learning rule. We find that this model neuron can perform complex visual detection tasks in a single synaptic stage that would require multiple stages for neurons operating instead on neural spike counts. Furthermore, the model computes rapidly, using only a single spike per afferent, and can signal its decision in turn by just a single spike. Extending these analyses to large ensembles of simulated retinal signals, we show that the model can detect the orientation of a visual pattern independent of its phase, an operation thought to be one of the primitives in early visual processing. We analyze how these computations work and compare the performance of this model to other schemes for reading out spike-timing information. These results demonstrate that the retina formats spatial information into temporal spike sequences in a way that favors computation in the time domain. Moreover, complex image analysis can be achieved already by a simple integrate-and-fire model neuron, emphasizing the power and plausibility of rapid neural computing with spike times.     

Reliability of spike and burst firing in thalamocortical relay cells

The reliability and precision of the timing of spikes in a spike train is an important aspect of neuronal coding. We investigated reliability in thalamocortical relay (TCR) cells in the acute slice and also in a Morris-Lecar model with several extensions. A frozen Gaussian noise current, superimposed on a DC current, was injected into the TCR cell soma. The neuron responded with spike trains that showed trial-to-trial variability, due to amongst others slow changes in its internal state and the experimental setup. The DC current allowed to bring the neuron in different states, characterized by a well defined membrane voltage (between ?80 and ?50 mV) and by a specific firing regime that on depolarization gradually shifted from a predominantly bursting regime to a tonic spiking regime. The filtered frozen white noise generated a spike pattern output with a broad spike interval distribution. The coincidence factor and the Hunter and Milton measure were used as reliability measures of the output spike train. In the experimental TCR cell as well as the Morris-Lecar model cell the reliability depends on the shape (steepness) of the current input versus spike frequency output curve. The model also allowed to study the contribution of three relevant ionic membrane currents to reliability: a T-type calcium current, a cation selective h-current and a calcium dependent potassium current in order to allow bursting, investigate the consequences of a more complex current-frequency relation and produce realistic firing rates. The reliability of the output of the TCR cell increases with depolarization. In hyperpolarized states bursts are more reliable than single spikes. The analytically derived relations were capable to predict several of the experimentally recorded spike features.     

Statistical characteristics of climbing fiber spikes necessary for efficient cerebellar learning

 Mean firing rates (MFRs), with analogue values, have thus far been used as information carriers of neurons in most brain theories of learning. However, the neurons transmit the signal by spikes, which are discrete events. The climbing fibers (CFs), which are known to be essential for cerebellar motor learning, fire at the ultra-low firing rates (around 1 Hz), and it is not yet understood theoretically how high-frequency information can be conveyed and how learning of smooth and fast movements can be achieved. Here we address whether cerebellar learning can be achieved by CF spikes instead of conventional MFR in an eye movement task, such as the ocular following response (OFR), and an arm movement task. There are two major afferents into cerebellar Purkinje cells: parallel fiber (PF) and CF, and the synaptic weights between PFs and Purkinje cells have been shown to be modulated by the stimulation of both types of fiber. The modulation of the synaptic weights is regulated by the cerebellar synaptic plasticity. In this study we simulated cerebellar learning using CF signals as spikes instead of conventional MFR. To generate the spikes we used the following four spike generation models: (1) a Poisson model in which the spike interval probability follows a Poisson distribution, (2) a gamma model in which the spike interval probability follows the gamma distribution, (3) a max model in which a spike is generated when a synaptic input reaches maximum, and (4) a threshold model in which a spike is generated when the input crosses a certain small threshold. We found that, in an OFR task with a constant visual velocity, learning was successful with stochastic models, such as Poisson and gamma models, but not in the deterministic models, such as max and threshold models. In an OFR with a stepwise velocity change and an arm movement task, learning could be achieved only in the Poisson model. In addition, for efficient cerebellar learning, the distribution of CF spike-occurrence time after stimulus onset must capture at least the first, second and third moments of the temporal distribution of error signals. Received: 28 January 2000 / Accepted in revised form: 2 August 2000     

Multiprotein complex signaling and the plasticity problem

Synaptic transmission of distinct patterns of spikes, or 'neural code', leads to plastic changes in synapses and other parts of the neuron, as well as learning in animals. Recent findings indicate that specialized multiprotein structures associated with neurotransmitter receptors and cell-adhesion proteins function as molecular devices that both read the neural code and initiate long-term changes in synaptic structure and function.