Intrinsic stability of temporally shifted spike-timing dependent plasticity

Spike-timing dependent plasticity (STDP), a widespread synaptic modification mechanism, is sensitive to correlations between presynaptic spike trains and it generates competition among synapses. However, STDP has an inherent instability because strong synapses are more likely to be strengthened than weak ones, causing them to grow in strength until some biophysical limit is reached. Through simulations and analytic calculations, we show that a small temporal shift in the STDP window that causes synchronous, or nearly synchronous, pre- and postsynaptic action potentials to induce long-term depression can stabilize synaptic strengths. Shifted STDP also stabilizes the postsynaptic firing rate and can implement both Hebbian and anti-Hebbian forms of competitive synaptic plasticity. Interestingly, the overall level of inhibition determines whether plasticity is Hebbian or anti-Hebbian. Even a random symmetric jitter of a few milliseconds in the STDP window can stabilize synaptic strengths while retaining these features. The same results hold for a shifted version of the more recent "triplet" model of STDP. Our results indicate that the detailed shape of the STDP window function near the transition from depression to potentiation is of the utmost importance in determining the consequences of STDP, suggesting that this region warrants further experimental study.     

Bursts shape the NMDA-R mediated spike timing dependent plasticity curve: role of burst interspike interval and GABAergic inhibition

Spike timing dependent plasticity (STDP) is a synaptic learning rule where the relative timing between the presynaptic and postsynaptic action potentials determines the sign and strength of synaptic plasticity. In its basic form STDP has an asymmetric form which incorporates both persistent increases and persistent decreases in synaptic strength. The basic form of STDP, however, is not a fixed property and depends on the dendritic location. An asymmetric curve is observed in the distal dendrites, whereas a symmetrical one is observed in the proximal ones. A recent computational study has shown that the transition from the asymmetry to symmetry is due to inhibition under certain conditions. Synapses have also been observed to be unreliable at generating plasticity when excitatory postsynaptic potentials and single spikes are paired at low frequencies. Bursts of spikes, however, are reliably signaled because transmitter release is facilitated. This article presents a two-compartment model of the CA1 pyramidal cell. The model is neurophysiologically plausible with its dynamics resulting from the interplay of many ionic and synaptic currents. Plasticity is measured by a deterministic Ca²⁺ dynamics model which measures the instantaneous calcium level and its time course in the dendrite and change the strength of the synapse accordingly. The model is validated to match the asymmetrical form of STDP from the pairing of a presynaptic (dendritic) and postsynaptic (somatic) spikes as observed experimentally. With the parameter set unchanged the model investigates how pairing of bursts with single spikes and bursts in the presence or absence of inhibition shapes the STDP curve. The model predicts that inhibition strength and frequency are not the only factors of the asymmetry-to-symmetry switch of the STDP curve. Burst interspike interval is another factor. This study is an important first step towards understanding how STDP is affected under natural firing patterns in vivo.     

Interplay of the magnitude and time-course of postsynaptic Ca<Superscript>2 + </Superscript> concentration in producing spike timing-dependent plasticity

Synaptic strength can be modified by the relative timing of pre- and postsynaptic activity, a phenomenon termed spike timing-dependent plasticity (STDP). Studies of neurons in the hippocampus and in other regions have found that when presynaptic activity occurs within a narrow time window, typically 10 or 20 ms, before postsynaptic activity, long-term potentiation (LTP) is induced, while if presynaptic activity occurs within a similar time window after postsynaptic activity, long-term depression (LTD) results. The mechanisms underlying these modifications are not completely understood, although there is strong evidence that the postsynaptic Ca ^2 + concentration plays a central role. Some previous modeling of STDP has focused on the dynamics of the postsynaptic Ca ^2 + concentration, while other work has studied biophysical mechanisms of how a synapse can exist in, and switch between, different states corresponding to LTP and LTD. Building on previous work in these two areas we have developed the first low level STDP model of a tristable biochemical system that incorporates induction and maintenance of both LTP and LTD. Our model is able to explain the STDP observed in hippocampal neurons in response to pre- and postsynaptic pulse pairs, using only parameters derived from previous work and without the need for parameter fine-tuning. Our results also give insight into how and why the time course of the postsynaptic Ca ^2 + concentration can lead to either LTP or LTD, and suggest that voltage dependent calcium channels play a key role.     

Maturation of GABAergic Inhibition Promotes Strengthening of Temporally Coherent Inputs among Convergent Pathways

Spike-timing-dependent plasticity (STDP), a form of Hebbian plasticity, is inherently stabilizing. Whether and how GABAergic inhibition influences STDP is not well understood. Using a model neuron driven by converging inputs modifiable by STDP, we determined that a sufficient level of inhibition was critical to ensure that temporal coherence (correlation among presynaptic spike times) of synaptic inputs, rather than initial strength or number of inputs within a pathway, controlled postsynaptic spike timing. Inhibition exerted this effect by preferentially reducing synaptic efficacy, the ability of inputs to evoke postsynaptic action potentials, of the less coherent inputs. In visual cortical slices, inhibition potently reduced synaptic efficacy at ages during but not before the critical period of ocular dominance (OD) plasticity. Whole-cell recordings revealed that the amplitude of unitary IPSCs from parvalbumin positive (Pv+) interneurons to pyramidal neurons increased during the critical period, while the synaptic decay time-constant decreased. In addition, intrinsic properties of Pv+ interneurons matured, resulting in an increase in instantaneous firing rate. Our results suggest that maturation of inhibition in visual cortex ensures that the temporally coherent inputs (e.g. those from the open eye during monocular deprivation) control postsynaptic spike times of binocular neurons, a prerequisite for Hebbian mechanisms to induce OD plasticity.     

A computational framework for cortical learning

Recent physiological findings have revealed that long-term adaptation of the synaptic strengths between cortical pyramidal neurons depends on the temporal order of presynaptic and postsynaptic spikes, which is called spike-timing-dependent plasticity (STDP) or temporally asymmetric Hebbian (TAH) learning. Here I prove by analytical means that a physiologically plausible variant of STDP adapts synaptic strengths such that the presynaptic spikes predict the postsynaptic spikes with minimal error. This prediction error model of STDP implies a mechanism for cortical memory: cortical tissue learns temporal spike patterns if these spike patterns are repeatedly elicited in a set of pyramidal neurons. The trained network finishes these patterns if their beginnings are presented, thereby recalling the memory. Implementations of the proposed algorithms may be useful for applications in voice recognition and computer vision.     

A Biophysical Basis for the Inter-spike Interaction of Spike-timing-dependent Plasticity

Although spike-timing-dependent plasticity (STDP) is well characterized when pre- and postsynaptic spikes are paired with a given time lag, how this generalizes for more complex spike-trains is unclear. Recent experiments demonstrate that contributions to synaptic plasticity from different spike pairs within a spike train do not add linearly. In the visual cortex conditioning with spike triplets shows that the effect of the first spike pair dominates over the second. Using a previously proposed calcium-dependent plasticity model, we show that short-term synaptic dynamics and interaction between successive back-propagating action potentials (BPAP) may jointly account for the nonlinearities observed. Paired-pulse depression and attenuation of BPAPs are incorporated into the model through the use-dependent depletion of pre- and postsynaptic resources, respectively. Simulations suggest that these processes may play critical roles in determining how STDP operates in the context of natural spike-trains.     

The spike-timing dependence of plasticity

In spike-timing-dependent plasticity (STDP), the order and precise temporal interval between presynaptic and postsynaptic spikes determine the sign and magnitude of long-term potentiation (LTP) or depression (LTD). STDP is widely utilized in models of circuit-level plasticity, development, and learning. However, spike timing is just one of several factors (including firing rate, synaptic cooperativity, and depolarization) that govern plasticity induction, and its relative importance varies across synapses and activity regimes. This review summarizes this broader view of plasticity, including the forms and cellular mechanisms for the spike-timing dependence of plasticity, and, the evidence that spike timing is an important determinant of plasticity in?vivo.     

Spike timing-dependent plasticity of neural circuits

Recent findings of spike timing-dependent plasticity (STDP) have stimulated much interest among experimentalists and theorists. Beyond the traditional correlation-based Hebbian plasticity, STDP opens up new avenues for understanding information coding and circuit plasticity that depend on the precise timing of neuronal spikes. Here we summarize experimental characterization of STDP at various synapses, the underlying cellular mechanisms, and the associated changes in neuronal excitability and dendritic integration. We also describe STDP in the context of complex spike patterns and its dependence on the dendritic location of the synapse. Finally, we discuss timing-dependent modification of neuronal receptive fields and human visual perception and the computational significance of STDP as a synaptic learning rule.     

Timing-based LTP and LTD at vertical inputs to layer II/III pyramidal cells in rat barrel cortex

Experience-dependent plasticity in somatosensory (S1) and visual (V1) cortex involves rapid depression of responses to a deprived sensory input (a closed eye or a trimmed whisker). Such depression occurs first in layer II/III and may reflect plasticity at vertical inputs from layer IV to layer II/III pyramids. Here, I describe a timing-based, associative form of long-term potentiation and depression (LTP/LTD) at this synapse in S1. LTP occurred when excitatory postsynaptic potentials (EPSPs) led single postsynaptic action potentials (APs) within a narrow temporal window, and LTD occurred when APs led EPSPs within a significantly broader window. This long LTD window is unusual among timing-based learning rules and causes EPSPs that are uncorrelated with postsynaptic APs to become depressed. This behavior suggests a simple model for depression of deprived sensory responses in S1 and V1.     

Natural patterns of activity and long-term synaptic plasticity

Long-term potentiation (LTP) of synaptic transmission is traditionally elicited by massively synchronous, high-frequency inputs, which rarely occur naturally. Recent in vitro experiments have revealed that both LTP and long-term depression (LTD) can arise by appropriately pairing weak synaptic inputs with action potentials in the postsynaptic cell. This discovery has generated new insights into the conditions under which synaptic modification may occur in pyramidal neurons in vivo. First, it has been shown that the temporal order of the synaptic input and the postsynaptic spike within a narrow temporal window determines whether LTP or LTD is elicited, according to a temporally asymmetric Hebbian learning rule. Second, backpropagating action potentials are able to serve as a global signal for synaptic plasticity in a neuron compared with local associative interactions between synaptic inputs on dendrites. Third, a specific temporal pattern of activity--postsynaptic bursting--accompanies synaptic potentiation in adults.     

Pre- and postsynaptically expressed spike-timing-dependent plasticity contribute differentially to neuronal learning

A plethora of experimental studies have shown that long-term synaptic plasticity can be expressed pre- or postsynaptically depending on a range of factors such as developmental stage, synapse type, and activity patterns. The functional consequences of this diversity are not clear, although it is understood that whereas postsynaptic expression of plasticity predominantly affects synaptic response amplitude, presynaptic expression alters both synaptic response amplitude and short-term dynamics. In most models of neuronal learning, long-term synaptic plasticity is implemented as changes in connective weights. The consideration of long-term plasticity as a fixed change in amplitude corresponds more closely to post- than to presynaptic expression, which means theoretical outcomes based on this choice of implementation may have a postsynaptic bias. To explore the functional implications of the diversity of expression of long-term synaptic plasticity, we adapted a model of long-term plasticity, more specifically spike-timing-dependent plasticity (STDP), such that it was expressed either independently pre- or postsynaptically, or in a mixture of both ways. We compared pair-based standard STDP models and a biologically tuned triplet STDP model, and investigated the outcomes in a minimal setting, using two different learning schemes: in the first, inputs were triggered at different latencies, and in the second a subset of inputs were temporally correlated. We found that presynaptic changes adjusted the speed of learning, while postsynaptic expression was more efficient at regulating spike timing and frequency. When combining both expression loci, postsynaptic changes amplified the response range, while presynaptic plasticity allowed control over postsynaptic firing rates, potentially providing a form of activity homeostasis. Our findings highlight how the seemingly innocuous choice of implementing synaptic plasticity by single weight modification may unwittingly introduce a postsynaptic bias in modelling outcomes. We conclude that pre- and postsynaptically expressed plasticity are not interchangeable, but enable complimentary functions.     

Spectral analysis of input spike trains by spike-timing-dependent plasticity

Spike-timing-dependent plasticity (STDP) has been observed in many brain areas such as sensory cortices, where it is hypothesized to structure synaptic connections between neurons. Previous studies have demonstrated how STDP can capture spiking information at short timescales using specific input configurations, such as coincident spiking, spike patterns and oscillatory spike trains. However, the corresponding computation in the case of arbitrary input signals is still unclear. This paper provides an overarching picture of the algorithm inherent to STDP, tying together many previous results for commonly used models of pairwise STDP. For a single neuron with plastic excitatory synapses, we show how STDP performs a spectral analysis on the temporal cross-correlograms between its afferent spike trains. The postsynaptic responses and STDP learning window determine kernel functions that specify how the neuron "sees" the input correlations. We thus denote this unsupervised learning scheme as 'kernel spectral component analysis' (kSCA). In particular, the whole input correlation structure must be considered since all plastic synapses compete with each other. We find that kSCA is enhanced when weight-dependent STDP induces gradual synaptic competition. For a spiking neuron with a "linear" response and pairwise STDP alone, we find that kSCA resembles principal component analysis (PCA). However, plain STDP does not isolate correlation sources in general, e.g., when they are mixed among the input spike trains. In other words, it does not perform independent component analysis (ICA). Tuning the neuron to a single correlation source can be achieved when STDP is paired with a homeostatic mechanism that reinforces the competition between synaptic inputs. Our results suggest that neuronal networks equipped with STDP can process signals encoded in the transient spiking activity at the timescales of tens of milliseconds for usual STDP.     

Proteolytic activity,synapse elimination,and the Hebb synapse

The Hebb synapse has been postulated to serve as a mechanism subserving both regulation of synaptic strength in the adult nervous system (long-term potentiation and depression) and developmental activity-dependent plasticity. According to this model, pre- and postsynaptic temporal concordance of activity results in strengthening of connections, while discordant activity results in synapse weakening. Evidence is presented that proteases and protease inhibitors may be involved in modification of synaptic strength. This leads to a modification of the Hebb assumptions, namely that postsynaptic activity results in protease elaboration with a consequent general reduction of synaptic connections to the active postsynaptic element. Further, presynaptic activity, if strong enough, induces local release of a protease inhibitor, such as protease nexin I, which neutralizes proteolytic activity and produces a relative preservation of the active input. This formulation produces many of the effects of the classical Hebbian construction, but the protease/inhibitor model suggests additional specific mechanistic features for activity-dependent plasticity. 1994 John Wiley & Sons, Inc.     

Cortical development and remapping through spike timing-dependent plasticity.

Long-term modification of synaptic efficacy can depend on the timing of pre- and postsynaptic action potentials. In model studies, such spike timing-dependent plasticity (STDP) introduces the desirable features of competition among synapses and regulation of postsynaptic firing characteristics. STDP strengthens synapses that receive correlated input, which can lead to the formation of stimulus-selective columns and the development, refinement, and maintenance of selectivity maps in network models. The temporal asymmetry of STDP suppresses strong destabilizing self-excitatory loops and allows a group of neurons that become selective early in development to direct other neurons to become similarly selective. STDP, acting alone without further hypothetical global constraints or additional forms of plasticity, can also reproduce the remapping seen in adult cortex following afferent lesions.     

Depolarization gates spine calcium transients and spike-timing-dependent potentiation

Timing-dependent long-term potentiation (t-LTP) is induced when synaptic activity is immediately followed by one or more back-propagating action potentials (bAPs) in the postsynaptic cell. As a mechanistic explanation, it has been proposed that the bAP removes the Mg2+ block of synaptic NMDA receptors, allowing for rapid Ca2+ entry at the active synapse. Recent experimental studies suggest that this model is incomplete: NMDA receptor-based coincidence detection requires strong postsynaptic depolarization, usually provided by AMPA receptor currents. Apparently, the brief AMPA-EPSP does not only enable t-LTP, it is also responsible for the very narrow time window for t-LTP induction. The emerging consensus puts the spine in the center of coincidence detection, as active conductances on the spine together with the electrical resistance of the spine neck regulate the depolarization of the spine head and thus Ca2+ influx during pairing. A focus on postsynaptic voltage during synaptic activation not only encompasses spike-timing-dependent plasticity (STDP), but explains also the cooperativity and frequency-dependence of plasticity.     

The effects of NMDA subunit composition on calcium influx and spike timing-dependent plasticity in striatal medium spiny neurons

Calcium through NMDA receptors (NMDARs) is necessary for the long-term potentiation (LTP) of synaptic strength; however, NMDARs differ in several properties that can influence the amount of calcium influx into the spine. These properties, such as sensitivity to magnesium block and conductance decay kinetics, change the receptor's response to spike timing dependent plasticity (STDP) protocols, and thereby shape synaptic integration and information processing. This study investigates the role of GluN2 subunit differences on spine calcium concentration during several STDP protocols in a model of a striatal medium spiny projection neuron (MSPN). The multi-compartment, multi-channel model exhibits firing frequency, spike width, and latency to first spike similar to current clamp data from mouse dorsal striatum MSPN. We find that NMDAR-mediated calcium is dependent on GluN2 subunit type, action potential timing, duration of somatic depolarization, and number of action potentials. Furthermore, the model demonstrates that in MSPNs, GluN2A and GluN2B control which STDP intervals allow for substantial calcium elevation in spines. The model predicts that blocking GluN2B subunits would modulate the range of intervals that cause long term potentiation. We confirmed this prediction experimentally, demonstrating that blocking GluN2B in the striatum, narrows the range of STDP intervals that cause long term potentiation. This ability of the GluN2 subunit to modulate the shape of the STDP curve could underlie the role that GluN2 subunits play in learning and development.     

Spike-timing dependent synaptic plasticity: a phenomenological framework

 In this paper a phenomenological model of spike-timing dependent synaptic plasticity (STDP) is developed that is based on a Volterra series-like expansion. Synaptic weight changes as a function of the relative timing of pre- and postsynaptic spikes are described by integral kernels that can easily be inferred from experimental data. The resulting weight dynamics can be stated in terms of statistical properties of pre- and postsynaptic spike trains. Generalizations to neurons that fire two different types of action potentials, such as cerebellar Purkinje cells where synaptic plasticity depends on correlations in two distinct presynaptic fibers, are discussed. We show that synaptic plasticity, together with strictly local bounds for the weights, can result in synaptic competition that is required for any form of pattern formation. This is illustrated by a concrete example where a single neuron equipped with STDP can selectively strengthen those synapses with presynaptic neurons that reliably deliver precisely timed spikes at the expense of other synapses which transmit spikes with a broad temporal distribution. Such a mechanism may be of vital importance for any neuronal system where information is coded in the timing of individual action potentials. Received: 23 January 2002 / Accepted: 28 March 2002 Correspondence to: W.M. Kistler (e-mail: kistler@anat.fgg.eur.nl Fax: +31 10 408 5459)     

Unsupervised learning of visual features through spike timing dependent plasticity

Spike timing dependent plasticity (STDP) is a learning rule that modifies synaptic strength as a function of the relative timing of pre- and postsynaptic spikes. When a neuron is repeatedly presented with similar inputs, STDP is known to have the effect of concentrating high synaptic weights on afferents that systematically fire early, while postsynaptic spike latencies decrease. Here we use this learning rule in an asynchronous feedforward spiking neural network that mimics the ventral visual pathway and shows that when the network is presented with natural images, selectivity to intermediate-complexity visual features emerges. Those features, which correspond to prototypical patterns that are both salient and consistently present in the images, are highly informative and enable robust object recognition, as demonstrated on various classification tasks. Taken together, these results show that temporal codes may be a key to understanding the phenomenal processing speed achieved by the visual system and that STDP can lead to fast and selective responses.     

Spike-timing-dependent plasticity: common themes and divergent vistas

Recent experimental observations of spike-timing-dependent synaptic plasticity (STDP) have revitalized the study of synaptic learning rules. The most surprising aspect of these experiments lies in the observation that synapses activated shortly after the occurrence of a postsynaptic spike are weakened. Thus, synaptic plasticity is sensitive to the temporal ordering of pre- and postsynaptic activation. This temporal asymmetry has been suggested to underlie a range of learning tasks. In the first part of this review we highlight some of the common themes from a range of findings in the framework of predictive coding. As an example of how this principle can be used in a learning task, we discuss a recent model of cortical map formation. In the second part of the review, we point out some of the differences in STDP models and their functional consequences. We discuss how differences in the weight-dependence, the time-constants and the non-linear properties of learning rules give rise to distinct computational functions. In light of these computational issues raised, we review current experimental findings and suggest further experiments to resolve some controversies.     

The Effect of STDP Temporal Kernel Structure on the Learning Dynamics of Single Excitatory and Inhibitory Synapses

Spike-Timing Dependent Plasticity (STDP) is characterized by a wide range of temporal kernels. However, much of the theoretical work has focused on a specific kernel – the “temporally asymmetric Hebbian” learning rules. Previous studies linked excitatory STDP to positive feedback that can account for the emergence of response selectivity. Inhibitory plasticity was associated with negative feedback that can balance the excitatory and inhibitory inputs. Here we study the possible computational role of the temporal structure of the STDP. We represent the STDP as a superposition of two processes: potentiation and depression. This allows us to model a wide range of experimentally observed STDP kernels, from Hebbian to anti-Hebbian, by varying a single parameter. We investigate STDP dynamics of a single excitatory or inhibitory synapse in purely feed-forward architecture. We derive a mean-field-Fokker-Planck dynamics for the synaptic weight and analyze the effect of STDP structure on the fixed points of the mean field dynamics. We find a phase transition along the Hebbian to anti-Hebbian parameter from a phase that is characterized by a unimodal distribution of the synaptic weight, in which the STDP dynamics is governed by negative feedback, to a phase with positive feedback characterized by a bimodal distribution. The critical point of this transition depends on general properties of the STDP dynamics and not on the fine details. Namely, the dynamics is affected by the pre-post correlations only via a single number that quantifies its overlap with the STDP kernel. We find that by manipulating the STDP temporal kernel, negative feedback can be induced in excitatory synapses and positive feedback in inhibitory. Moreover, there is an exact symmetry between inhibitory and excitatory plasticity, i.e., for every STDP rule of inhibitory synapse there exists an STDP rule for excitatory synapse, such that their dynamics is identical.