Mechanisms and significance of spike-timing dependent plasticity

Hebb's original postulate left two important issues unaddressed: (i) what is the effective time window between pre- and postsynaptic activity that will result in potentiation? and (ii) what is the learning rule that underlies decreases in synaptic strength? While research over the past 2 decades has addressed these questions, several studies within the past 5 years have shown that synapses undergo long-term depression (LTD) or long-term potentiation (LTP) depending on the order of activity in the pre- and postsynaptic cells. This process has been referred to as spike-timing dependent plasticity (STDP). Here we discuss the experimental data on STDP, and develop models of the mechanisms that may underlie it. Specifically, we examine whether the standard model of LTP and LTD in which high and low levels of Ca(2+) produce LTP and LTD, respectively, can also account for STDP. We conclude that the standard model can account for a type of STDP in which, counterintuitively, LTD will be observed at some intervals in which the presynaptic cell fires before the postsynaptic cell. This form of STDP will also be sensitive to parameters such as the presence of an after depolarization following an action potential. Indeed, the sensitivity of this type of STDP to experimental parameters suggests that it may not play an important physiological role in vivo. We suggest that more robust forms of STDP, which do not exhibit LTD at pre-before-post intervals, are not accounted for by the standard model, and are likely to rely on a second coincidence detector in addition to the NMDA receptor.     

Kinetic models of spike-timing dependent plasticity and their functional consequences in detecting correlations

Spike-timing dependent plasticity (STDP) is a type of synaptic modification found relatively recently, but the underlying biophysical mechanisms are still unclear. Several models of STDP have been proposed, and differ by their implementation, and in particular how synaptic weights saturate to their minimal and maximal values. We analyze here kinetic models of transmitter-receptor interaction and derive a series of STDP models. In general, such kinetic models predict progressive saturation of the weights. Various forms can be obtained depending on the hypotheses made in the kinetic model, and these include a simple linear dependence on the value of the weight (“soft bounds”), mixed soft and abrupt saturation (“hard bound”), or more complex forms. We analyze in more detail simple soft-bound models of Hebbian and anti-Hebbian STDPs, in which nonlinear spike interactions (triplets) are taken into account. We show that Hebbian STDPs can be used to selectively potentiate synapses that are correlated in time, while anti-Hebbian STDPs depress correlated synapses, despite the presence of nonlinear spike interactions. This correlation detection enables neurons to develop a selectivity to correlated inputs. We also examine different versions of kinetics-based STDP models and compare their sensitivity to correlations. We conclude that kinetic models generally predict soft-bound dynamics, and that such models seem ideal for detecting correlations among large numbers of inputs.     

Intrinsic stability of temporally shifted spike-timing dependent plasticity

Spike-timing dependent plasticity (STDP), a widespread synaptic modification mechanism, is sensitive to correlations between presynaptic spike trains and it generates competition among synapses. However, STDP has an inherent instability because strong synapses are more likely to be strengthened than weak ones, causing them to grow in strength until some biophysical limit is reached. Through simulations and analytic calculations, we show that a small temporal shift in the STDP window that causes synchronous, or nearly synchronous, pre- and postsynaptic action potentials to induce long-term depression can stabilize synaptic strengths. Shifted STDP also stabilizes the postsynaptic firing rate and can implement both Hebbian and anti-Hebbian forms of competitive synaptic plasticity. Interestingly, the overall level of inhibition determines whether plasticity is Hebbian or anti-Hebbian. Even a random symmetric jitter of a few milliseconds in the STDP window can stabilize synaptic strengths while retaining these features. The same results hold for a shifted version of the more recent "triplet" model of STDP. Our results indicate that the detailed shape of the STDP window function near the transition from depression to potentiation is of the utmost importance in determining the consequences of STDP, suggesting that this region warrants further experimental study.     

Hippocampal memory modification induced by pattern completion and spike-timing dependent synaptic plasticity

One of the roles of the hippocampus is viewed as modifying episodic memory so that it can contribute to form semantic memory. In this paper, we show that pattern completion ability of the hippocampal CA3 and symmetric spike timing-dependent synaptic plasticity (STDP) induce memory modification so that the hippocampal CA3 can memorize invariable parts of repetitive episodes as essential elements and forget variable parts of them as unnecessary ones.     

Active control of spike-timing dependent synaptic plasticity in an electrosensory system.

A spike timing dependent learning rule is present at the synapse between parallel fibers and Purkinje-like medium ganglion cells in the electrosensory lobe of mormyrid electric fish. The synapse is depressed when a postsynaptic dendritic spike occurs within 50 ms of the onset of a parallel fiber excitatory postsynaptic potential, but is enhanced at all other timing relations. Operation of this learning rule results in the cancellation of predictable membrane potential changes, driving the cell towards a constant output frequency. But medium ganglion cells show a strong and predictable response to corollary discharge signals associated with the motor command that initiates the electric organ discharge. The modeling study presented here resolves this conflict by proposing an active control of dendritic spike threshold during the brief period of medium ganglion cell response.     

The spike-timing dependence of plasticity

In spike-timing-dependent plasticity (STDP), the order and precise temporal interval between presynaptic and postsynaptic spikes determine the sign and magnitude of long-term potentiation (LTP) or depression (LTD). STDP is widely utilized in models of circuit-level plasticity, development, and learning. However, spike timing is just one of several factors (including firing rate, synaptic cooperativity, and depolarization) that govern plasticity induction, and its relative importance varies across synapses and activity regimes. This review summarizes this broader view of plasticity, including the forms and cellular mechanisms for the spike-timing dependence of plasticity, and, the evidence that spike timing is an important determinant of plasticity in?vivo.     

Spike-timing dependent synaptic plasticity: a phenomenological framework

 In this paper a phenomenological model of spike-timing dependent synaptic plasticity (STDP) is developed that is based on a Volterra series-like expansion. Synaptic weight changes as a function of the relative timing of pre- and postsynaptic spikes are described by integral kernels that can easily be inferred from experimental data. The resulting weight dynamics can be stated in terms of statistical properties of pre- and postsynaptic spike trains. Generalizations to neurons that fire two different types of action potentials, such as cerebellar Purkinje cells where synaptic plasticity depends on correlations in two distinct presynaptic fibers, are discussed. We show that synaptic plasticity, together with strictly local bounds for the weights, can result in synaptic competition that is required for any form of pattern formation. This is illustrated by a concrete example where a single neuron equipped with STDP can selectively strengthen those synapses with presynaptic neurons that reliably deliver precisely timed spikes at the expense of other synapses which transmit spikes with a broad temporal distribution. Such a mechanism may be of vital importance for any neuronal system where information is coded in the timing of individual action potentials. Received: 23 January 2002 / Accepted: 28 March 2002 Correspondence to: W.M. Kistler (e-mail: kistler@anat.fgg.eur.nl Fax: +31 10 408 5459)     

Tuning bat LSO neurons to interaural intensity differences through spike-timing dependent plasticity

Bats, like other mammals, are known to use interaural intensity differences (IID) to determine azimuthal position. In the lateral superior olive (LSO) neurons have firing behaviors which vary systematically with IID. Those neurons receive excitatory inputs from the ipsilateral ear and inhibitory inputs from the contralateral one. The IID sensitivity of a LSO neuron is thought to be due to delay differences between the signals coming from both ears, differences due to different synaptic delays and to intensity-dependent delays. In this paper we model the auditory pathway until the LSO. We propose a learning scheme where inputs to LSO neurons start out numerous with different relative delays. Spike timing-dependent plasticity (STDP) is then used to prune those connections. We compare the pruned neuron responses with physiological data and analyse the relationship between IID’s of teacher stimuli and IID sensitivities of trained LSO neurons.     

Group I mGluR regulates the polarity of spike-timing dependent plasticity in substantia gelatinosa neurons

The spinal synaptic plasticity is associated with a central sensitization of nociceptive input, which accounts for the generation of hyperalgesia in chronic pain. However, how group I metabotropic glutamate receptors (mGluRs) may operate spinal plasticity remains essentially unexplored. Here, we have identified spike-timing dependent synaptic plasticity in substantia gelatinosa (SG) neurons, using perforated patch-clamp recordings of SG neuron in a spinal cord slice preparation. In the presence of bicuculline and strychnine, long-term potentiation (LTP) was blocked by AP-5 and Ca2+ chelator BAPTA-AM. The group I mGluR antagonist AIDA, PLC inhibitor U-73122, and IP3 receptor blocker 2-APB shifted LTP to long-term depression (LTD) without affecting acute synaptic transmission. These findings provide a link between postsynaptic group I mGluR/PLC/IP3-gated Ca2+ store regulating the polarity of synaptic plasticity and spinal central sensitization.     

Unsupervised learning of visual features through spike timing dependent plasticity

Spike timing dependent plasticity (STDP) is a learning rule that modifies synaptic strength as a function of the relative timing of pre- and postsynaptic spikes. When a neuron is repeatedly presented with similar inputs, STDP is known to have the effect of concentrating high synaptic weights on afferents that systematically fire early, while postsynaptic spike latencies decrease. Here we use this learning rule in an asynchronous feedforward spiking neural network that mimics the ventral visual pathway and shows that when the network is presented with natural images, selectivity to intermediate-complexity visual features emerges. Those features, which correspond to prototypical patterns that are both salient and consistently present in the images, are highly informative and enable robust object recognition, as demonstrated on various classification tasks. Taken together, these results show that temporal codes may be a key to understanding the phenomenal processing speed achieved by the visual system and that STDP can lead to fast and selective responses.     

Phenomenological models of synaptic plasticity based on spike timing

Synaptic plasticity is considered to be the biological substrate of learning and memory. In this document we review phenomenological models of short-term and long-term synaptic plasticity, in particular spike-timing dependent plasticity (STDP). The aim of the document is to provide a framework for classifying and evaluating different models of plasticity. We focus on phenomenological synaptic models that are compatible with integrate-and-fire type neuron models where each neuron is described by a small number of variables. This implies that synaptic update rules for short-term or long-term plasticity can only depend on spike timing and, potentially, on membrane potential, as well as on the value of the synaptic weight, or on low-pass filtered (temporally averaged) versions of the above variables. We examine the ability of the models to account for experimental data and to fulfill expectations derived from theoretical considerations. We further discuss their relations to teacher-based rules (supervised learning) and reward-based rules (reinforcement learning). All models discussed in this paper are suitable for large-scale network simulations.     

An implementation of reinforcement learning based on spike timing dependent plasticity

An explanatory model is developed to show how synaptic learning mechanisms modeled through spike-timing dependent plasticity (STDP) can result in long-term adaptations consistent with reinforcement learning models. In particular, the reinforcement learning model known as temporal difference (TD) learning has been used to model neuronal behavior in the orbitofrontal cortex (OFC) and ventral tegmental area (VTA) of macaque monkey during reinforcement learning. While some research has observed, empirically, a connection between STDP and TD, there has not been an explanatory model directly connecting TD to STDP. Through analysis of the learning dynamics that results from a general form of a STDP learning rule, the connection between STDP and TD is explained. We further demonstrate that a STDP learning rule drives the spike probability of a reward predicting neuronal population to a stable equilibrium. The equilibrium solution has an increasing slope where the steepness of the slope predicts the probability of the reward, similar to the results from electrophysiological recordings suggesting a different slope that predicts the value of the anticipated reward of Montague and Berns [Neuron 36(2):265–284, 2002]. This connection begins to shed light into more recent data gathered from VTA and OFC which are not well modeled by TD. We suggest that STDP provides the underlying mechanism for explaining reinforcement learning and other higher level perceptual and cognitive function. This material is based upon work supported by the National Science Foundation under Grants No. IOB-0445648 (PDR) and DMS-0408334 (GL) and by a Career Support grant from Portland State University (GL).     

Adaptive and phase selective spike timing dependent plasticity in synaptically coupled neuronal oscillators

We consider and analyze the influence of spike-timing dependent plasticity (STDP) on homeostatic states in synaptically coupled neuronal oscillators. In contrast to conventional models of STDP in which spike-timing affects weights of synaptic connections, we consider a model of STDP in which the time lags between pre- and/or post-synaptic spikes change internal state of pre- and/or post-synaptic neurons respectively. The analysis reveals that STDP processes of this type, modeled by a single ordinary differential equation, may ensure efficient, yet coarse, phase-locking of spikes in the system to a given reference phase. Precision of the phase locking, i.e. the amplitude of relative phase deviations from the reference, depends on the values of natural frequencies of oscillators and, additionally, on parameters of the STDP law. These deviations can be optimized by appropriate tuning of gains (i.e. sensitivity to spike-timing mismatches) of the STDP mechanism. However, as we demonstrate, such deviations can not be made arbitrarily small neither by mere tuning of STDP gains nor by adjusting synaptic weights. Thus if accurate phase-locking in the system is required then an additional tuning mechanism is generally needed. We found that adding a very simple adaptation dynamics in the form of slow fluctuations of the base line in the STDP mechanism enables accurate phase tuning in the system with arbitrary high precision. Adaptation operating at a slow time scale may be associated with extracellular matter such as matrix and glia. Thus the findings may suggest a possible role of the latter in regulating synaptic transmission in neuronal circuits.     

Spike timing dependent plasticity finds the start of repeating patterns in continuous spike trains

Experimental studies have observed Long Term synaptic Potentiation (LTP) when a presynaptic neuron fires shortly before a postsynaptic neuron, and Long Term Depression (LTD) when the presynaptic neuron fires shortly after, a phenomenon known as Spike Timing Dependent Plasticity (STDP). When a neuron is presented successively with discrete volleys of input spikes STDP has been shown to learn 'early spike patterns', that is to concentrate synaptic weights on afferents that consistently fire early, with the result that the postsynaptic spike latency decreases, until it reaches a minimal and stable value. Here, we show that these results still stand in a continuous regime where afferents fire continuously with a constant population rate. As such, STDP is able to solve a very difficult computational problem: to localize a repeating spatio-temporal spike pattern embedded in equally dense 'distractor' spike trains. STDP thus enables some form of temporal coding, even in the absence of an explicit time reference. Given that the mechanism exposed here is simple and cheap it is hard to believe that the brain did not evolve to use it.     

On a phase diagram for random neural networks with embedded spike timing dependent plasticity

This paper presents an original mathematical framework based on graph theory which is a first attempt to investigate the dynamics of a model of neural networks with embedded spike timing dependent plasticity. The neurons correspond to integrate-and-fire units located at the vertices of a finite subset of 2D lattice. There are two types of vertices, corresponding to the inhibitory and the excitatory neurons. The edges are directed and labelled by the discrete values of the synaptic strength. We assume that there is an initial firing pattern corresponding to a subset of units that generate a spike. The number of activated externally vertices is a small fraction of the entire network. The model presented here describes how such pattern propagates throughout the network as a random walk on graph. Several results are compared with computational simulations and new data are presented for identifying critical parameters of the model.     

Biophysical model of synaptic plasticity dynamics

We discuss a biophysical model of synaptic plasticity that provides a unified view of the outcomes of synaptic modification protocols, including: (1) prescribed time courses of postsynaptic intracellular Ca²⁺ release, (2) postsynaptic voltage clamping with presentation of presynaptic spike trains at various frequencies, (3) direct postsynaptic response to presynaptic spike trains at various frequencies, and (4) LTP/LTD as a response to precisely timed presynaptic and postsynaptic spikes.     

Messages in spike timing-dependent plasticity: pros and cons

Spike-timing dependent plasticity (STDP), a synaptic modification depending on a relative timing of presynaptic and postsynaptic spikes, has fascinated researchers in the fields of neurophysiology and computational neuroscience, because it is not only conceptually simple or biologically reasonable but is also versatile in neural network simulations. The STDP rule may be valid only under specific conditions, however. We propose herein a method that could find more natural and potent rules of synaptic plasticity.     

Biophysical models of fMRI responses

Functional magnetic resonance imaging (fMRI) is used to investigate where the neural implementation of specific cognitive processes occurs. The standard approach uses linear convolution models that relate experimentally designed inputs, through a haemodynamic response function, to observed blood oxygen level dependent (BOLD) signals. Such models are, however, blind to the causal mechanisms that underlie observed BOLD responses. Recent developments have focused on how BOLD responses are generated and include biophysical input-state-output models with neural and haemodynamic state equations and models of functional integration that explain local dynamics through interactions with remote areas. Forward models with parameters at the neural level, such as dynamic causal modelling, combine both approaches, modelling the whole causal chain from external stimuli, via induced neural dynamics, to observed BOLD responses.     

Biophysical evidence of arm-domain interactions in AraC

We report development of a method for the direct measurement of the interaction between the N-terminal arm and the remainder of the dimerization domain in the Escherichia coli AraC protein, the regulator of the l-arabinose operon. The interaction was measured using surface plasmon resonance to monitor the association between the immobilized peptide arm and the dimerization domain, truncated of its arm, in solution. As expected from genetic and physiological data, the interaction is strongly stimulated by l-arabinose and is insensitive to sugars like d-glucose or d-galactose. Alterations in the sequence of the arm which physiological experiments predict either to strengthen or weaken the arm produce the expected responses.     

Determinants of spike timing-dependent synaptic plasticity.

Recent studies show that the precise timing of presynaptic inputs and postsynaptic action potentials influences the strength and sign of synaptic plasticity. In this issue of Neuron, Sj?str?m and colleagues (2001) determine how this so-called spike timing-dependent plasticity depends on the frequency and strength of the presynaptic inputs.