Biophysical and phenomenological models of multiple spike interactions in spike-timing dependent plasticity

Spike-timing dependent plasticity (STDP) is a form of associative synaptic modification which depends on the respective timing of pre- and post-synaptic spikes. The biophysical mechanisms underlying this form of plasticity are currently not known. We present here a biophysical model which captures the characteristics of STDP, such as its frequency dependency, and the effects of spike pair or spike triplet interactions. We also make links with other well-known plasticity rules. A simplified phenomenological model is also derived, which should be useful for fast numerical simulation and analytical investigation of the impact of STDP at the network level.     

Bursts shape the NMDA-R mediated spike timing dependent plasticity curve: role of burst interspike interval and GABAergic inhibition

Spike timing dependent plasticity (STDP) is a synaptic learning rule where the relative timing between the presynaptic and postsynaptic action potentials determines the sign and strength of synaptic plasticity. In its basic form STDP has an asymmetric form which incorporates both persistent increases and persistent decreases in synaptic strength. The basic form of STDP, however, is not a fixed property and depends on the dendritic location. An asymmetric curve is observed in the distal dendrites, whereas a symmetrical one is observed in the proximal ones. A recent computational study has shown that the transition from the asymmetry to symmetry is due to inhibition under certain conditions. Synapses have also been observed to be unreliable at generating plasticity when excitatory postsynaptic potentials and single spikes are paired at low frequencies. Bursts of spikes, however, are reliably signaled because transmitter release is facilitated. This article presents a two-compartment model of the CA1 pyramidal cell. The model is neurophysiologically plausible with its dynamics resulting from the interplay of many ionic and synaptic currents. Plasticity is measured by a deterministic Ca²⁺ dynamics model which measures the instantaneous calcium level and its time course in the dendrite and change the strength of the synapse accordingly. The model is validated to match the asymmetrical form of STDP from the pairing of a presynaptic (dendritic) and postsynaptic (somatic) spikes as observed experimentally. With the parameter set unchanged the model investigates how pairing of bursts with single spikes and bursts in the presence or absence of inhibition shapes the STDP curve. The model predicts that inhibition strength and frequency are not the only factors of the asymmetry-to-symmetry switch of the STDP curve. Burst interspike interval is another factor. This study is an important first step towards understanding how STDP is affected under natural firing patterns in vivo.     

Local learning rules: predicted influence of dendritic location on synaptic modification in spike-timing-dependent plasticity

Recent indirect experimental evidence suggests that synaptic plasticity changes along the dendrites of a neuron. Here we present a synaptic plasticity rule which is controlled by the properties of the pre- and postsynaptic signals. Using recorded membrane traces of back-propagating and dendritic spikes we demonstrate that LTP and LTD will depend specifically on the shape of the postsynaptic depolarization at a given dendritic site. We find that asymmetrical spike-timing-dependent plasticity (STDP) can be replaced by temporally symmetrical plasticity within physiologically relevant time windows if the postsynaptic depolarization rises shallow. Presynaptically the rule depends on the NMDA channel characteristic, and the model predicts that an increase in Mg²⁺ will attenuate the STDP curve without changing its shape. Furthermore, the model suggests that the profile of LTD should be governed by the postsynaptic signal while that of LTP mainly depends on the presynaptic signal shape.     

Computational consequences of experimentally derived spike-time and weight dependent plasticity rules

We present two weight- and spike-time dependent synaptic plasticity rules consistent with the physiological data of Bi and Poo (J Neurosci 18:10464–10472, 1998). One rule assumes synaptic saturation, while the other is scale free. We extend previous analyses of the asymptotic consequences of weight-dependent STDP to the case of strongly correlated pre- and post-synaptic spiking, more closely resembling associative learning. We further provide a general formula for the contribution of any number of spikes to synaptic drift. Asymptotic weights are shown to principally depend on the correlation and rate of pre- and post-synaptic activity, decreasing with increasing rate under correlated activity, and increasing with rate under uncorrelated activity. Spike train statistics reveal a quantitative effect only in the pre-asymptotic regime, and we provide a new interpretation of the relation between BCM and STDP data.     

Adaptive and phase selective spike timing dependent plasticity in synaptically coupled neuronal oscillators

We consider and analyze the influence of spike-timing dependent plasticity (STDP) on homeostatic states in synaptically coupled neuronal oscillators. In contrast to conventional models of STDP in which spike-timing affects weights of synaptic connections, we consider a model of STDP in which the time lags between pre- and/or post-synaptic spikes change internal state of pre- and/or post-synaptic neurons respectively. The analysis reveals that STDP processes of this type, modeled by a single ordinary differential equation, may ensure efficient, yet coarse, phase-locking of spikes in the system to a given reference phase. Precision of the phase locking, i.e. the amplitude of relative phase deviations from the reference, depends on the values of natural frequencies of oscillators and, additionally, on parameters of the STDP law. These deviations can be optimized by appropriate tuning of gains (i.e. sensitivity to spike-timing mismatches) of the STDP mechanism. However, as we demonstrate, such deviations can not be made arbitrarily small neither by mere tuning of STDP gains nor by adjusting synaptic weights. Thus if accurate phase-locking in the system is required then an additional tuning mechanism is generally needed. We found that adding a very simple adaptation dynamics in the form of slow fluctuations of the base line in the STDP mechanism enables accurate phase tuning in the system with arbitrary high precision. Adaptation operating at a slow time scale may be associated with extracellular matter such as matrix and glia. Thus the findings may suggest a possible role of the latter in regulating synaptic transmission in neuronal circuits.     

Spike-timing dependent synaptic plasticity: a phenomenological framework

 In this paper a phenomenological model of spike-timing dependent synaptic plasticity (STDP) is developed that is based on a Volterra series-like expansion. Synaptic weight changes as a function of the relative timing of pre- and postsynaptic spikes are described by integral kernels that can easily be inferred from experimental data. The resulting weight dynamics can be stated in terms of statistical properties of pre- and postsynaptic spike trains. Generalizations to neurons that fire two different types of action potentials, such as cerebellar Purkinje cells where synaptic plasticity depends on correlations in two distinct presynaptic fibers, are discussed. We show that synaptic plasticity, together with strictly local bounds for the weights, can result in synaptic competition that is required for any form of pattern formation. This is illustrated by a concrete example where a single neuron equipped with STDP can selectively strengthen those synapses with presynaptic neurons that reliably deliver precisely timed spikes at the expense of other synapses which transmit spikes with a broad temporal distribution. Such a mechanism may be of vital importance for any neuronal system where information is coded in the timing of individual action potentials. Received: 23 January 2002 / Accepted: 28 March 2002 Correspondence to: W.M. Kistler (e-mail: kistler@anat.fgg.eur.nl Fax: +31 10 408 5459)     

Intrinsic stability of temporally shifted spike-timing dependent plasticity

Spike-timing dependent plasticity (STDP), a widespread synaptic modification mechanism, is sensitive to correlations between presynaptic spike trains and it generates competition among synapses. However, STDP has an inherent instability because strong synapses are more likely to be strengthened than weak ones, causing them to grow in strength until some biophysical limit is reached. Through simulations and analytic calculations, we show that a small temporal shift in the STDP window that causes synchronous, or nearly synchronous, pre- and postsynaptic action potentials to induce long-term depression can stabilize synaptic strengths. Shifted STDP also stabilizes the postsynaptic firing rate and can implement both Hebbian and anti-Hebbian forms of competitive synaptic plasticity. Interestingly, the overall level of inhibition determines whether plasticity is Hebbian or anti-Hebbian. Even a random symmetric jitter of a few milliseconds in the STDP window can stabilize synaptic strengths while retaining these features. The same results hold for a shifted version of the more recent "triplet" model of STDP. Our results indicate that the detailed shape of the STDP window function near the transition from depression to potentiation is of the utmost importance in determining the consequences of STDP, suggesting that this region warrants further experimental study.     

Calcium-Dependent Calcium Decay Explains STDP in a Dynamic Model of Hippocampal Synapses

It is widely accepted that the direction and magnitude of synaptic plasticity depends on post-synaptic calcium flux, where high levels of calcium lead to long-term potentiation and moderate levels lead to long-term depression. At synapses onto neurons in region CA1 of the hippocampus (and many other synapses), NMDA receptors provide the relevant source of calcium. In this regard, post-synaptic calcium captures the coincidence of pre- and post-synaptic activity, due to the blockage of these receptors at low voltage. Previous studies show that under spike timing dependent plasticity (STDP) protocols, potentiation at CA1 synapses requires post-synaptic bursting and an inter-pairing frequency in the range of the hippocampal theta rhythm. We hypothesize that these requirements reflect the saturation of the mechanisms of calcium extrusion from the post-synaptic spine. We test this hypothesis with a minimal model of NMDA receptor-dependent plasticity, simulating slow extrusion with a calcium-dependent calcium time constant. In simulations of STDP experiments, the model accounts for latency-dependent depression with either post-synaptic bursting or theta-frequency pairing (or neither) and accounts for latency-dependent potentiation when both of these requirements are met. The model makes testable predictions for STDP experiments and our simple implementation is tractable at the network level, demonstrating associative learning in a biophysical network model with realistic synaptic dynamics.     

Self-influencing synaptic plasticity: Recurrent changes of synaptic weights can lead to specific functional properties

Recent experimental results suggest that dendritic and back-propagating spikes can influence synaptic plasticity in different ways (Holthoff, 2004; Holthoff et al., 2005). In this study we investigate how these signals could interact at dendrites in space and time leading to changing plasticity properties at local synapse clusters. Similar to a previous study (Saudargiene et al., 2004) we employ a differential Hebbian learning rule to emulate spike-timing dependent plasticity and investigate how the interaction of dendritic and back-propagating spikes, as the post-synaptic signals, could influence plasticity. Specifically, we will show that local synaptic plasticity driven by spatially confined dendritic spikes can lead to the emergence of synaptic clusters with different properties. If one of these clusters can drive the neuron into spiking, plasticity may change and the now arising global influence of a back-propagating spike can lead to a further segregation of the clusters and possibly the dying-off of some of them leading to more functional specificity. These results suggest that through plasticity being a spatial and temporal local process, the computational properties of dendrites or complete neurons can be substantially augmented. Action Editor: Wulfram Gerstner     

Unsupervised learning of visual features through spike timing dependent plasticity

Spike timing dependent plasticity (STDP) is a learning rule that modifies synaptic strength as a function of the relative timing of pre- and postsynaptic spikes. When a neuron is repeatedly presented with similar inputs, STDP is known to have the effect of concentrating high synaptic weights on afferents that systematically fire early, while postsynaptic spike latencies decrease. Here we use this learning rule in an asynchronous feedforward spiking neural network that mimics the ventral visual pathway and shows that when the network is presented with natural images, selectivity to intermediate-complexity visual features emerges. Those features, which correspond to prototypical patterns that are both salient and consistently present in the images, are highly informative and enable robust object recognition, as demonstrated on various classification tasks. Taken together, these results show that temporal codes may be a key to understanding the phenomenal processing speed achieved by the visual system and that STDP can lead to fast and selective responses.     

Emergence of network structure due to spike-timing-dependent plasticity in recurrent neuronal networks. I. Input selectivity–strengthening correlated input pathways

Spike-timing-dependent plasticity (STDP) determines the evolution of the synaptic weights according to their pre- and post-synaptic activity, which in turn changes the neuronal activity. In this paper, we extend previous studies of input selectivity induced by (STDP) for single neurons to the biologically interesting case of a neuronal network with fixed recurrent connections and plastic connections from external pools of input neurons. We use a theoretical framework based on the Poisson neuron model to analytically describe the network dynamics (firing rates and spike-time correlations) and thus the evolution of the synaptic weights. This framework incorporates the time course of the post-synaptic potentials and synaptic delays. Our analysis focuses on the asymptotic states of a network stimulated by two homogeneous pools of “steady” inputs, namely Poisson spike trains which have fixed firing rates and spike-time correlations. The (STDP) model extends rate-based learning in that it can implement, at the same time, both a stabilization of the individual neuron firing rates and a slower weight specialization depending on the input spike-time correlations. When one input pathway has stronger within-pool correlations, the resulting synaptic dynamics induced by (STDP) are shown to be similar to those arising in the case of a purely feed-forward network: the weights from the more correlated inputs are potentiated at the expense of the remaining input connections.     

Depression-biased reverse plasticity rule is required for stable learning at top-down connections

Top-down synapses are ubiquitous throughout neocortex and play a central role in cognition, yet little is known about their development and specificity. During sensory experience, lower neocortical areas are activated before higher ones, causing top-down synapses to experience a preponderance of post-synaptic activity preceding pre-synaptic activity. This timing pattern is the opposite of that experienced by bottom-up synapses, which suggests that different versions of spike-timing dependent synaptic plasticity (STDP) rules may be required at top-down synapses. We consider a two-layer neural network model and investigate which STDP rules can lead to a distribution of top-down synaptic weights that is stable, diverse and avoids strong loops. We introduce a temporally reversed rule (rSTDP) where top-down synapses are potentiated if post-synaptic activity precedes pre-synaptic activity. Combining analytical work and integrate-and-fire simulations, we show that only depression-biased rSTDP (and not classical STDP) produces stable and diverse top-down weights. The conclusions did not change upon addition of homeostatic mechanisms, multiplicative STDP rules or weak external input to the top neurons. Our prediction for rSTDP at top-down synapses, which are distally located, is supported by recent neurophysiological evidence showing the existence of temporally reversed STDP in synapses that are distal to the post-synaptic cell body.     

LTD windows of the STDP learning rule and synaptic connections having a large transmission delay enable robust sequence learning amid background noise

Spike-timing-dependent synaptic plasticity (STDP) is a simple and effective learning rule for sequence learning. However, synapses being subject to STDP rules are readily influenced in noisy circumstances because synaptic conductances are modified by pre- and postsynaptic spikes elicited within a few tens of milliseconds, regardless of whether those spikes convey information or not. Noisy firing existing everywhere in the brain may induce irrelevant enhancement of synaptic connections through STDP rules and would result in uncertain memory encoding and obscure memory patterns. We will here show that the LTD windows of the STDP rules enable robust sequence learning amid background noise in cooperation with a large signal transmission delay between neurons and a theta rhythm, using a network model of the entorhinal cortex layer II with entorhinal-hippocampal loop connections. The important element of the present model for robust sequence learning amid background noise is the symmetric STDP rule having LTD windows on both sides of the LTP window, in addition to the loop connections having a large signal transmission delay and the theta rhythm pacing activities of stellate cells. Above all, the LTD window in the range of positive spike-timing is important to prevent influences of noise with the progress of sequence learning.     

Calcium control of triphasic hippocampal STDP

Synaptic plasticity is believed to represent the neural correlate of mammalian learning and memory function. It has been demonstrated that changes in synaptic conductance can be induced by approximately synchronous pairings of pre- and post- synaptic action potentials delivered at low frequencies. It has also been established that NMDAr-dependent calcium influx into dendritic spines represents a critical signal for plasticity induction, and can account for this spike-timing dependent plasticity (STDP) as well as experimental data obtained using other stimulation protocols. However, subsequent empirical studies have delineated a more complex relationship between spike-timing, firing rate, stimulus duration and post-synaptic bursting in dictating changes in the conductance of hippocampal excitatory synapses. Here, we present a detailed biophysical model of single dendritic spines on a CA1 pyramidal neuron, describe the NMDAr-dependent calcium influx generated by different stimulation protocols, and construct a parsimonious model of calcium driven kinase and phosphatase dynamics that dictate the probability of stochastic transitions between binary synaptic weight states in a Markov model. We subsequently demonstrate that this approach can account for a range of empirical observations regarding the dynamics of synaptic plasticity induced by different stimulation protocols, under regimes of pharmacological blockade and metaplasticity. Finally, we highlight the strengths and weaknesses of this parsimonious, unified computational synaptic plasticity model, discuss differences between the properties of cortical and hippocampal plasticity highlighted by the experimental literature, and the manner in which further empirical and theoretical research might elucidate the cellular basis of mammalian learning and memory function.     

The effects of NMDA subunit composition on calcium influx and spike timing-dependent plasticity in striatal medium spiny neurons

Calcium through NMDA receptors (NMDARs) is necessary for the long-term potentiation (LTP) of synaptic strength; however, NMDARs differ in several properties that can influence the amount of calcium influx into the spine. These properties, such as sensitivity to magnesium block and conductance decay kinetics, change the receptor's response to spike timing dependent plasticity (STDP) protocols, and thereby shape synaptic integration and information processing. This study investigates the role of GluN2 subunit differences on spine calcium concentration during several STDP protocols in a model of a striatal medium spiny projection neuron (MSPN). The multi-compartment, multi-channel model exhibits firing frequency, spike width, and latency to first spike similar to current clamp data from mouse dorsal striatum MSPN. We find that NMDAR-mediated calcium is dependent on GluN2 subunit type, action potential timing, duration of somatic depolarization, and number of action potentials. Furthermore, the model demonstrates that in MSPNs, GluN2A and GluN2B control which STDP intervals allow for substantial calcium elevation in spines. The model predicts that blocking GluN2B subunits would modulate the range of intervals that cause long term potentiation. We confirmed this prediction experimentally, demonstrating that blocking GluN2B in the striatum, narrows the range of STDP intervals that cause long term potentiation. This ability of the GluN2 subunit to modulate the shape of the STDP curve could underlie the role that GluN2 subunits play in learning and development.     

A Biophysical Basis for the Inter-spike Interaction of Spike-timing-dependent Plasticity

Although spike-timing-dependent plasticity (STDP) is well characterized when pre- and postsynaptic spikes are paired with a given time lag, how this generalizes for more complex spike-trains is unclear. Recent experiments demonstrate that contributions to synaptic plasticity from different spike pairs within a spike train do not add linearly. In the visual cortex conditioning with spike triplets shows that the effect of the first spike pair dominates over the second. Using a previously proposed calcium-dependent plasticity model, we show that short-term synaptic dynamics and interaction between successive back-propagating action potentials (BPAP) may jointly account for the nonlinearities observed. Paired-pulse depression and attenuation of BPAPs are incorporated into the model through the use-dependent depletion of pre- and postsynaptic resources, respectively. Simulations suggest that these processes may play critical roles in determining how STDP operates in the context of natural spike-trains.     

A neuromorphic architecture for object recognition and motion anticipation using burst-STDP

In this work we investigate the possibilities offered by a minimal framework of artificial spiking neurons to be deployed in silico. Here we introduce a hierarchical network architecture of spiking neurons which learns to recognize moving objects in a visual environment and determine the correct motor output for each object. These tasks are learned through both supervised and unsupervised spike timing dependent plasticity (STDP). STDP is responsible for the strengthening (or weakening) of synapses in relation to pre- and post-synaptic spike times and has been described as a Hebbian paradigm taking place both in vitro and in vivo. We utilize a variation of STDP learning, called burst-STDP, which is based on the notion that, since spikes are expensive in terms of energy consumption, then strong bursting activity carries more information than single (sparse) spikes. Furthermore, this learning algorithm takes advantage of homeostatic renormalization, which has been hypothesized to promote memory consolidation during NREM sleep. Using this learning rule, we design a spiking neural network architecture capable of object recognition, motion detection, attention towards important objects, and motor control outputs. We demonstrate the abilities of our design in a simple environment with distractor objects, multiple objects moving concurrently, and in the presence of noise. Most importantly, we show how this neural network is capable of performing these tasks using a simple leaky-integrate-and-fire (LIF) neuron model with binary synapses, making it fully compatible with state-of-the-art digital neuromorphic hardware designs. As such, the building blocks and learning rules presented in this paper appear promising for scalable fully neuromorphic systems to be implemented in hardware chips.     

Messages in spike timing-dependent plasticity: pros and cons

Spike-timing dependent plasticity (STDP), a synaptic modification depending on a relative timing of presynaptic and postsynaptic spikes, has fascinated researchers in the fields of neurophysiology and computational neuroscience, because it is not only conceptually simple or biologically reasonable but is also versatile in neural network simulations. The STDP rule may be valid only under specific conditions, however. We propose herein a method that could find more natural and potent rules of synaptic plasticity.     

A computational framework for cortical learning

Recent physiological findings have revealed that long-term adaptation of the synaptic strengths between cortical pyramidal neurons depends on the temporal order of presynaptic and postsynaptic spikes, which is called spike-timing-dependent plasticity (STDP) or temporally asymmetric Hebbian (TAH) learning. Here I prove by analytical means that a physiologically plausible variant of STDP adapts synaptic strengths such that the presynaptic spikes predict the postsynaptic spikes with minimal error. This prediction error model of STDP implies a mechanism for cortical memory: cortical tissue learns temporal spike patterns if these spike patterns are repeatedly elicited in a set of pyramidal neurons. The trained network finishes these patterns if their beginnings are presented, thereby recalling the memory. Implementations of the proposed algorithms may be useful for applications in voice recognition and computer vision.     

The Effect of STDP Temporal Kernel Structure on the Learning Dynamics of Single Excitatory and Inhibitory Synapses

Spike-Timing Dependent Plasticity (STDP) is characterized by a wide range of temporal kernels. However, much of the theoretical work has focused on a specific kernel – the “temporally asymmetric Hebbian” learning rules. Previous studies linked excitatory STDP to positive feedback that can account for the emergence of response selectivity. Inhibitory plasticity was associated with negative feedback that can balance the excitatory and inhibitory inputs. Here we study the possible computational role of the temporal structure of the STDP. We represent the STDP as a superposition of two processes: potentiation and depression. This allows us to model a wide range of experimentally observed STDP kernels, from Hebbian to anti-Hebbian, by varying a single parameter. We investigate STDP dynamics of a single excitatory or inhibitory synapse in purely feed-forward architecture. We derive a mean-field-Fokker-Planck dynamics for the synaptic weight and analyze the effect of STDP structure on the fixed points of the mean field dynamics. We find a phase transition along the Hebbian to anti-Hebbian parameter from a phase that is characterized by a unimodal distribution of the synaptic weight, in which the STDP dynamics is governed by negative feedback, to a phase with positive feedback characterized by a bimodal distribution. The critical point of this transition depends on general properties of the STDP dynamics and not on the fine details. Namely, the dynamics is affected by the pre-post correlations only via a single number that quantifies its overlap with the STDP kernel. We find that by manipulating the STDP temporal kernel, negative feedback can be induced in excitatory synapses and positive feedback in inhibitory. Moreover, there is an exact symmetry between inhibitory and excitatory plasticity, i.e., for every STDP rule of inhibitory synapse there exists an STDP rule for excitatory synapse, such that their dynamics is identical.