Memory Maintenance in Synapses with Calcium-Based Plasticity in the Presence of Background Activity

Most models of learning and memory assume that memories are maintained in neuronal circuits by persistent synaptic modifications induced by specific patterns of pre- and postsynaptic activity. For this scenario to be viable, synaptic modifications must survive the ubiquitous ongoing activity present in neural circuits in vivo. In this paper, we investigate the time scales of memory maintenance in a calcium-based synaptic plasticity model that has been shown recently to be able to fit different experimental data-sets from hippocampal and neocortical preparations. We find that in the presence of background activity on the order of 1 Hz parameters that fit pyramidal layer 5 neocortical data lead to a very fast decay of synaptic efficacy, with time scales of minutes. We then identify two ways in which this memory time scale can be extended: (i) the extracellular calcium concentration in the experiments used to fit the model are larger than estimated concentrations in vivo. Lowering extracellular calcium concentration to in vivo levels leads to an increase in memory time scales of several orders of magnitude; (ii) adding a bistability mechanism so that each synapse has two stable states at sufficiently low background activity leads to a further boost in memory time scale, since memory decay is no longer described by an exponential decay from an initial state, but by an escape from a potential well. We argue that both features are expected to be present in synapses in vivo. These results are obtained first in a single synapse connecting two independent Poisson neurons, and then in simulations of a large network of excitatory and inhibitory integrate-and-fire neurons. Our results emphasise the need for studying plasticity at physiological extracellular calcium concentration, and highlight the role of synaptic bi- or multistability in the stability of learned synaptic structures.     

Population rate coding in recurrent neuronal networks with unreliable synapses

Neuron transmits spikes to postsynaptic neurons through synapses. Experimental observations indicated that the communication between neurons is unreliable. However most modelling and computational studies considered deterministic synaptic interaction model. In this paper, we investigate the population rate coding in an all-to-all coupled recurrent neuronal network consisting of both excitatory and inhibitory neurons connected with unreliable synapses. We use a stochastic on-off process to model the unreliable synaptic transmission. We find that synapses with suitable successful transmission probability can enhance the encoding performance in the case of weak noise; while in the case of strong noise, the synaptic interactions reduce the encoding performance. We also show that several important synaptic parameters, such as the excitatory synaptic strength, the relative strength of inhibitory and excitatory synapses, as well as the synaptic time constant, have significant effects on the performance of the population rate coding. Further simulations indicate that the encoding dynamics of our considered network cannot be simply determined by the average amount of received neurotransmitter for each neuron in a time instant. Moreover, we compare our results with those obtained in the corresponding random neuronal networks. Our numerical results demonstrate that the network randomness has the similar qualitative effect as the synaptic unreliability but not completely equivalent in quantity.     

Emergence and fragmentation of the alpha-band driven by neuronal network dynamics

Rhythmic neuronal network activity underlies brain oscillations. To investigate how connected neuronal networks contribute to the emergence of the α-band and to the regulation of Up and Down states, we study a model based on synaptic short-term depression-facilitation with afterhyperpolarization (AHP). We found that the α-band is generated by the network behavior near the attractor of the Up-state. Coupling inhibitory and excitatory networks by reciprocal connections leads to the emergence of a stable α-band during the Up states, as reflected in the spectrogram. To better characterize the emergence and stability of thalamocortical oscillations containing α and δ rhythms during anesthesia, we model the interaction of two excitatory networks with one inhibitory network, showing that this minimal topology underlies the generation of a persistent α-band in the neuronal voltage characterized by dominant Up over Down states. Finally, we show that the emergence of the α-band appears when external inputs are suppressed, while fragmentation occurs at small synaptic noise or with increasing inhibitory inputs. To conclude, α-oscillations could result from the synaptic dynamics of interacting excitatory neuronal networks with and without AHP, a principle that could apply to other rhythms.     

Long-Term Relationships between Synaptic Tenacity, Synaptic Remodeling, and Network Activity

Synaptic plasticity is widely believed to constitute a key mechanism for modifying functional properties of neuronal networks. This belief implicitly implies, however, that synapses, when not driven to change their characteristics by physiologically relevant stimuli, will maintain these characteristics over time. How tenacious are synapses over behaviorally relevant time scales? To begin to address this question, we developed a system for continuously imaging the structural dynamics of individual synapses over many days, while recording network activity in the same preparations. We found that in spontaneously active networks, distributions of synaptic sizes were generally stable over days. Following individual synapses revealed, however, that the apparently static distributions were actually steady states of synapses exhibiting continual and extensive remodeling. In active networks, large synapses tended to grow smaller, whereas small synapses tended to grow larger, mainly during periods of particularly synchronous activity. Suppression of network activity only mildly affected the magnitude of synaptic remodeling, but dependence on synaptic size was lost, leading to the broadening of synaptic size distributions and increases in mean synaptic size. From the perspective of individual neurons, activity drove changes in the relative sizes of their excitatory inputs, but such changes continued, albeit at lower rates, even when network activity was blocked. Our findings show that activity strongly drives synaptic remodeling, but they also show that significant remodeling occurs spontaneously. Whereas such spontaneous remodeling provides an explanation for “synaptic homeostasis” like processes, it also raises significant questions concerning the reliability of individual synapses as sites for persistently modifying network function.     

SynGAP Regulates Protein Synthesis and Homeostatic Synaptic Plasticity in Developing Cortical Networks

Disrupting the balance between excitatory and inhibitory neurotransmission in the developing brain has been causally linked with intellectual disability (ID) and autism spectrum disorders (ASD). Excitatory synapse strength is regulated in the central nervous system by controlling the number of postsynaptic α-amino-3-hydroxy-5-methyl-4-isoxazolepropionic acid receptors (AMPARs). De novo genetic mutations of the synaptic GTPase-activating protein (SynGAP) are associated with ID and ASD. SynGAP is enriched at excitatory synapses and genetic suppression of SynGAP increases excitatory synaptic strength. However, exactly how SynGAP acts to maintain synaptic AMPAR content is unclear. We show here that SynGAP limits excitatory synaptic strength, in part, by suppressing protein synthesis in cortical neurons. The data presented here from in vitro, rat and mouse cortical networks, demonstrate that regulation of translation by SynGAP involves ERK, mTOR, and the small GTP-binding protein Rheb. Furthermore, these data show that GluN2B-containing NMDARs and the cognitive kinase CaMKII act upstream of SynGAP and that this signaling cascade is required for proper translation-dependent homeostatic synaptic plasticity of excitatory synapses in developing cortical networks.     

On the stationary state of a network of inhibitory spiking neurons

The background activity of a cortical neural network is modeled by a homogeneous integrate-and-fire network with unreliable inhibitory synapses. For the case of fast synapses, numerical and analytical calculations show that the network relaxes into a stationary state of high attention. The majority of the neurons has a membrane potential just below the threshold; as a consequence the network can react immediately – on the time scale of synaptic transmission- on external pulses. The neurons fire with a low rate and with a broad distribution of interspike intervals. Firing events of the total network are correlated over short time periods. The firing rate increases linearly with external stimuli. In the limit of infinitely large networks, the synaptic noise decreases to zero. Nevertheless, the distribution of interspike intervals remains broad. Action Editor: Misha Tsodyks     

Acquiring new information in a neuronal network: from Hebb's concept to homeostatic plasticity

Synaptic plasticity is the cellular mechanism underlying the phenomena of learning and memory. Much of the research on synaptic plasticity is based on the postulate of Hebb (1949) who proposed that, when a neuron repeatedly takes part in the activation of another neuron, the efficacy of the connections between these neurons is increased. Plasticity has been extensively studied, and often demonstrated through the processes of LTP (Long Term Potentiation) and LTD (Long Term Depression), which represent an increase and a decrease of the efficacy of long-term synaptic transmission. This review summarizes current knowledge concerning the cellular mechanisms of LTP and LTD, whether at the level of excitatory synapses, which have been the most studied, or at the level of inhibitory synapses. However, if we consider neuronal networks rather than the individual synapses, the consequences of synaptic plasticity need to be considered on a large scale to determine if the activity of networks are changed or not. Homeostatic plasticity takes into account the mechanisms which control the efficacy of synaptic transmission for all the synaptic inputs of a neuron. Consequently, this new concept deals with the coordinated activity of excitatory and inhibitory networks afferent to a neuron which maintain a controlled level of excitability during the acquisition of new information related to the potentiation or to the depression of synaptic efficacy. We propose that the protocols of stimulation used to induce plasticity at the synaptic level set up a "homeostatic potentiation" or a "homeostatic depression" of excitation and inhibition at the level of the neuronal networks. The coordination between excitatory and inhibitory circuits allows the neuronal networks to preserve a level of stable activity, thus avoiding episodes of hyper- or hypo-activity during the learning and memory phases.     

Local and global synchronization transitions induced by time delays in small-world neuronal networks with chemical synapses

Effects of time delay on the local and global synchronization in small-world neuronal networks with chemical synapses are investigated in this paper. Numerical results show that, for both excitatory and inhibitory coupling types, the information transmission delay can always induce synchronization transitions of spiking neurons in small-world networks. In particular, regions of in-phase and out-of-phase synchronization of connected neurons emerge intermittently as the synaptic delay increases. For excitatory coupling, all transitions to spiking synchronization occur approximately at integer multiples of the firing period of individual neurons; while for inhibitory coupling, these transitions appear at the odd multiples of the half of the firing period of neurons. More importantly, the local synchronization transition is more profound than the global synchronization transition, depending on the type of coupling synapse. For excitatory synapses, the local in-phase synchronization observed for some values of the delay also occur at a global scale; while for inhibitory ones, this synchronization, observed at the local scale, disappears at a global scale. Furthermore, the small-world structure can also affect the phase synchronization of neuronal networks. It is demonstrated that increasing the rewiring probability can always improve the global synchronization of neuronal activity, but has little effect on the local synchronization of neighboring neurons.     

Emergence of Connectivity Motifs in Networks of Model Neurons with Short- and Long-Term Plastic Synapses

Recent experimental data from the rodent cerebral cortex and olfactory bulb indicate that specific connectivity motifs are correlated with short-term dynamics of excitatory synaptic transmission. It was observed that neurons with short-term facilitating synapses form predominantly reciprocal pairwise connections, while neurons with short-term depressing synapses form predominantly unidirectional pairwise connections. The cause of these structural differences in excitatory synaptic microcircuits is unknown. We show that these connectivity motifs emerge in networks of model neurons, from the interactions between short-term synaptic dynamics (SD) and long-term spike-timing dependent plasticity (STDP). While the impact of STDP on SD was shown in simultaneous neuronal pair recordings in vitro, the mutual interactions between STDP and SD in large networks are still the subject of intense research. Our approach combines an SD phenomenological model with an STDP model that faithfully captures long-term plasticity dependence on both spike times and frequency. As a proof of concept, we first simulate and analyze recurrent networks of spiking neurons with random initial connection efficacies and where synapses are either all short-term facilitating or all depressing. For identical external inputs to the network, and as a direct consequence of internally generated activity, we find that networks with depressing synapses evolve unidirectional connectivity motifs, while networks with facilitating synapses evolve reciprocal connectivity motifs. We then show that the same results hold for heterogeneous networks, including both facilitating and depressing synapses. This does not contradict a recent theory that proposes that motifs are shaped by external inputs, but rather complements it by examining the role of both the external inputs and the internally generated network activity. Our study highlights the conditions under which SD-STDP might explain the correlation between facilitation and reciprocal connectivity motifs, as well as between depression and unidirectional motifs.     

Synaptic information transfer in computer models of neocortical columns

Understanding the direction and quantity of information flowing in neuronal networks is a fundamental problem in neuroscience. Brains and neuronal networks must at the same time store information about the world and react to information in the world. We sought to measure how the activity of the network alters information flow from inputs to output patterns. Using neocortical column neuronal network simulations, we demonstrated that networks with greater internal connectivity reduced input/output correlations from excitatory synapses and decreased negative correlations from inhibitory synapses, measured by Kendall’s τ correlation. Both of these changes were associated with reduction in information flow, measured by normalized transfer entropy (nTE). Information handling by the network reflected the degree of internal connectivity. With no internal connectivity, the feedforward network transformed inputs through nonlinear summation and thresholding. With greater connectivity strength, the recurrent network translated activity and information due to contribution of activity from intrinsic network dynamics. This dynamic contribution amounts to added information drawn from that stored in the network. At still higher internal synaptic strength, the network corrupted the external information, producing a state where little external information came through. The association of increased information retrieved from the network with increased gamma power supports the notion of gamma oscillations playing a role in information processing.     

Spike timing-dependent plasticity and memory

Spike timing-dependent plasticity (STDP) is a bidirectional form of synaptic plasticity discovered about 30 years ago and based on the relative timing of pre- and post-synaptic spiking activity with a millisecond precision. STDP is thought to be involved in the formation of memory but the millisecond-precision spike-timing required for STDP is difficult to reconcile with the much slower timescales of behavioral learning. This review therefore aims to expose and discuss recent findings about i) the multiple STDP learning rules at both excitatory and inhibitory synapses in vitro, ii) the contribution of STDP-like synaptic plasticity in the formation of memory in vivo and iii) the implementation of STDP rules in artificial neural networks and memristive devices.     

Signal propagation in feedforward neuronal networks with unreliable synapses

In this paper, we systematically investigate both the synfire propagation and firing rate propagation in feedforward neuronal network coupled in an all-to-all fashion. In contrast to most earlier work, where only reliable synaptic connections are considered, we mainly examine the effects of unreliable synapses on both types of neural activity propagation in this work. We first study networks composed of purely excitatory neurons. Our results show that both the successful transmission probability and excitatory synaptic strength largely influence the propagation of these two types of neural activities, and better tuning of these synaptic parameters makes the considered network support stable signal propagation. It is also found that noise has significant but different impacts on these two types of propagation. The additive Gaussian white noise has the tendency to reduce the precision of the synfire activity, whereas noise with appropriate intensity can enhance the performance of firing rate propagation. Further simulations indicate that the propagation dynamics of the considered neuronal network is not simply determined by the average amount of received neurotransmitter for each neuron in a time instant, but also largely influenced by the stochastic effect of neurotransmitter release. Second, we compare our results with those obtained in corresponding feedforward neuronal networks connected with reliable synapses but in a random coupling fashion. We confirm that some differences can be observed in these two different feedforward neuronal network models. Finally, we study the signal propagation in feedforward neuronal networks consisting of both excitatory and inhibitory neurons, and demonstrate that inhibition also plays an important role in signal propagation in the considered networks.     

Bursting Reverberation as a Multiscale Neuronal Network Process Driven by Synaptic Depression-Facilitation

Neuronal networks can generate complex patterns of activity that depend on membrane properties of individual neurons as well as on functional synapses. To decipher the impact of synaptic properties and connectivity on neuronal network behavior, we investigate the responses of neuronal ensembles from small (5–30 cells in a restricted sphere) and large (acute hippocampal slice) networks to single electrical stimulation: in both cases, a single stimulus generated a synchronous long-lasting bursting activity. While an initial spike triggered a reverberating network activity that lasted 2–5 seconds for small networks, we found here that it lasted only up to 300 milliseconds in slices. To explain this phenomena present at different scales, we generalize the depression-facilitation model and extracted the network time constants. The model predicts that the reverberation time has a bell shaped relation with the synaptic density, revealing that the bursting time cannot exceed a maximum value. Furthermore, before reaching its maximum, the reverberation time increases sub-linearly with the synaptic density of the network. We conclude that synaptic dynamics and connectivity shape the mean burst duration, a property present at various scales of the networks. Thus bursting reverberation is a property of sufficiently connected neural networks, and can be generated by collective depression and facilitation of underlying functional synapses.     

Network Events on Multiple Space and Time Scales in Cultured Neural Networks and in a Stochastic Rate Model

Cortical networks, in-vitro as well as in-vivo, can spontaneously generate a variety of collective dynamical events such as network spikes, UP and DOWN states, global oscillations, and avalanches. Though each of them has been variously recognized in previous works as expression of the excitability of the cortical tissue and the associated nonlinear dynamics, a unified picture of the determinant factors (dynamical and architectural) is desirable and not yet available. Progress has also been partially hindered by the use of a variety of statistical measures to define the network events of interest. We propose here a common probabilistic definition of network events that, applied to the firing activity of cultured neural networks, highlights the co-occurrence of network spikes, power-law distributed avalanches, and exponentially distributed ‘quasi-orbits’, which offer a third type of collective behavior. A rate model, including synaptic excitation and inhibition with no imposed topology, synaptic short-term depression, and finite-size noise, accounts for all these different, coexisting phenomena. We find that their emergence is largely regulated by the proximity to an oscillatory instability of the dynamics, where the non-linear excitable behavior leads to a self-amplification of activity fluctuations over a wide range of scales in space and time. In this sense, the cultured network dynamics is compatible with an excitation-inhibition balance corresponding to a slightly sub-critical regime. Finally, we propose and test a method to infer the characteristic time of the fatigue process, from the observed time course of the network’s firing rate. Unlike the model, possessing a single fatigue mechanism, the cultured network appears to show multiple time scales, signalling the possible coexistence of different fatigue mechanisms.     

Glutamate-Bound NMDARs Arising from In Vivo-like Network Activity Extend Spatio-temporal Integration in a L5 Cortical Pyramidal Cell Model

In vivo, cortical pyramidal cells are bombarded by asynchronous synaptic input arising from ongoing network activity. However, little is known about how such ‘background’ synaptic input interacts with nonlinear dendritic mechanisms. We have modified an existing model of a layer 5 (L5) pyramidal cell to explore how dendritic integration in the apical dendritic tuft could be altered by the levels of network activity observed in vivo. Here we show that asynchronous background excitatory input increases neuronal gain and extends both temporal and spatial integration of stimulus-evoked synaptic input onto the dendritic tuft. Addition of fast and slow inhibitory synaptic conductances, with properties similar to those from dendritic targeting interneurons, that provided a ‘balanced’ background configuration, partially counteracted these effects, suggesting that inhibition can tune spatio-temporal integration in the tuft. Excitatory background input lowered the threshold for NMDA receptor-mediated dendritic spikes, extended their duration and increased the probability of additional regenerative events occurring in neighbouring branches. These effects were also observed in a passive model where all the non-synaptic voltage-gated conductances were removed. Our results show that glutamate-bound NMDA receptors arising from ongoing network activity can provide a powerful spatially distributed nonlinear dendritic conductance. This may enable L5 pyramidal cells to change their integrative properties as a function of local network activity, potentially allowing both clustered and spatially distributed synaptic inputs to be integrated over extended timescales.     

Bifurcation properties of the average activity of interconnected neural populations

The relevant scale for the study of the electrical activity of neural networks is a problem of mathematical and biological interest. From a continuous model of the cortex activity we derive a simple model of an interconnected pair of excitatory and inhibitory neural populations that describes the activity of a homogeneous network. Our model depends on three parameters that stand for the scale variability of the network. A bifurcation analysis reveals a great variety of patterns that arise from the interplay of excitatory and inhibitory populations provided by synaptic interactions. We emphasize the differences between the dynamical regimes when considering a moderate and a high inhibitory scale. We discuss the consequences on a propagating activity.     

Exact neural mass model for synaptic-based working memory

A synaptic theory of Working Memory (WM) has been developed in the last decade as a possible alternative to the persistent spiking paradigm. In this context, we have developed a neural mass model able to reproduce exactly the dynamics of heterogeneous spiking neural networks encompassing realistic cellular mechanisms for short-term synaptic plasticity. This population model reproduces the macroscopic dynamics of the network in terms of the firing rate and the mean membrane potential. The latter quantity allows us to gain insight of the Local Field Potential and electroencephalographic signals measured during WM tasks to characterize the brain activity. More specifically synaptic facilitation and depression integrate each other to efficiently mimic WM operations via either synaptic reactivation or persistent activity. Memory access and loading are related to stimulus-locked transient oscillations followed by a steady-state activity in the β-γ band, thus resembling what is observed in the cortex during vibrotactile stimuli in humans and object recognition in monkeys. Memory juggling and competition emerge already by loading only two items. However more items can be stored in WM by considering neural architectures composed of multiple excitatory populations and a common inhibitory pool. Memory capacity depends strongly on the presentation rate of the items and it maximizes for an optimal frequency range. In particular we provide an analytic expression for the maximal memory capacity. Furthermore, the mean membrane potential turns out to be a suitable proxy to measure the memory load, analogously to event driven potentials in experiments on humans. Finally we show that the γ power increases with the number of loaded items, as reported in many experiments, while θ and β power reveal non monotonic behaviours. In particular, β and γ rhythms are crucially sustained by the inhibitory activity, while the θ rhythm is controlled by excitatory synapses.     

Molecular dynamics of postsynaptic receptors and scaffold proteins

The activity of neurotransmitter receptors determines the strength of synaptic transmission. Therefore, the clustering of receptors at synapses is an important mechanism underlying synaptic plasticity. The dynamic exchange of receptors between synaptic and extrasynaptic membranes is dependent on their interaction with synaptic scaffold proteins. Here, we review the recent advances and emerging concepts related to the dynamics of synaptic proteins at inhibitory and excitatory synapses. These include the imaging techniques that enable the study of protein dynamics in cells, the differences and similarities of receptor dynamics at excitatory and inhibitory synapses, the relationship between the exchange of receptor and scaffold proteins, as well as the role of receptor fluxes in the modulation of synaptic strength.     

Long-term Relationships between Cholinergic Tone, Synchronous Bursting and Synaptic Remodeling

Cholinergic neuromodulation plays key roles in the regulation of neuronal excitability, network activity, arousal, and behavior. On longer time scales, cholinergic systems play essential roles in cortical development, maturation, and plasticity. Presumably, these processes are associated with substantial synaptic remodeling, yet to date, long-term relationships between cholinergic tone and synaptic remodeling remain largely unknown. Here we used automated microscopy combined with multielectrode array recordings to study long-term relationships between cholinergic tone, excitatory synapse remodeling, and network activity characteristics in networks of cortical neurons grown on multielectrode array substrates. Experimental elevations of cholinergic tone led to the abrupt suppression of episodic synchronous bursting activity (but not of general activity), followed by a gradual growth of excitatory synapses over hours. Subsequent blockage of cholinergic receptors led to an immediate restoration of synchronous bursting and the gradual reversal of synaptic growth. Neither synaptic growth nor downsizing was governed by multiplicative scaling rules. Instead, these occurred in a subset of synapses, irrespective of initial synaptic size. Synaptic growth seemed to depend on intrinsic network activity, but not on the degree to which bursting was suppressed. Intriguingly, sustained elevations of cholinergic tone were associated with a gradual recovery of synchronous bursting but not with a reversal of synaptic growth. These findings show that cholinergic tone can strongly affect synaptic remodeling and synchronous bursting activity, but do not support a strict coupling between the two. Finally, the reemergence of synchronous bursting in the presence of elevated cholinergic tone indicates that the capacity of cholinergic neuromodulation to indefinitely suppress synchronous bursting might be inherently limited.     

Inhibitory Contribution to Suprathreshold Corticostriatal Responses: An Experimental and Modeling Study

Neostriatal neurons may undergo events of spontaneous synchronization as those observed in recurrent networks of excitatory neurons, even when cortical afferents are transected. It is necessary to explain these events because the neostriatum is a recurrent network of inhibitory neurons. Synchronization of neuronal activity may be caused by plateau-like depolarizations. Plateau-like orthodromic depolarizations that resemble up-states in medium spiny neostriatal neurons (MSNs) may be induced by a single corticostriatal suprathreshold stimulus. Slow synaptic depolarizations may last hundreds of milliseconds, decay slower than the monosynaptic glutamatergic synaptic potentials that induce them, and sustain repetitive firing. Because inhibitory inputs impinging onto MSNs have a reversal potential above the resting membrane potential but below the threshold for firing, they conform a type of “shunting inhibition”. This work asks if shunting GABAergic inputs onto MSNs arrive asynchronously enough as to help in sustaining the plateau-like corticostriatal response after a single cortical stimulus. This may help to begin explaining autonomous processing in the striatal micro-circuitry in the presence of a tonic excitatory drive and independently of spatio-temporally organized inputs. It is shown here that besides synaptic currents from AMPA/KA- and NMDA-receptors, as well as L-type intrinsic Ca²⁺- currents, inhibitory synapses help in maintaining the slow depolarization, although they accomplish the role of depressing firing at the beginning of the response. We then used a NEURON model of spiny cells to show that inhibitory synapses arriving asynchronously on the dendrites can help to simulate a plateau potential similar to that observed experimentally. Electronic supplementary material  The online version of this article (doi:) contains supplementary material, which is available to authorized users.