Self-Organization of Microcircuits in Networks of Spiking Neurons with Plastic Synapses

The synaptic connectivity of cortical networks features an overrepresentation of certain wiring motifs compared to simple random-network models. This structure is shaped, in part, by synaptic plasticity that promotes or suppresses connections between neurons depending on their joint spiking activity. Frequently, theoretical studies focus on how feedforward inputs drive plasticity to create this network structure. We study the complementary scenario of self-organized structure in a recurrent network, with spike timing-dependent plasticity driven by spontaneous dynamics. We develop a self-consistent theory for the evolution of network structure by combining fast spiking covariance with a slow evolution of synaptic weights. Through a finite-size expansion of network dynamics we obtain a low-dimensional set of nonlinear differential equations for the evolution of two-synapse connectivity motifs. With this theory in hand, we explore how the form of the plasticity rule drives the evolution of microcircuits in cortical networks. When potentiation and depression are in approximate balance, synaptic dynamics depend on weighted divergent, convergent, and chain motifs. For additive, Hebbian STDP these motif interactions create instabilities in synaptic dynamics that either promote or suppress the initial network structure. Our work provides a consistent theoretical framework for studying how spiking activity in recurrent networks interacts with synaptic plasticity to determine network structure.     

On how network architecture determines the dominant patterns of spontaneous neural activity

In the absence of sensory stimulation, neocortical circuits display complex patterns of neural activity. These patterns are thought to reflect relevant properties of the network, including anatomical features like its modularity. It is also assumed that the synaptic connections of the network constrain the repertoire of emergent, spontaneous patterns. Although the link between network architecture and network activity has been extensively investigated in the last few years from different perspectives, our understanding of the relationship between the network connectivity and the structure of its spontaneous activity is still incomplete. Using a general mathematical model of neural dynamics we have studied the link between spontaneous activity and the underlying network architecture. In particular, here we show mathematically how the synaptic connections between neurons determine the repertoire of spatial patterns displayed in the spontaneous activity. To test our theoretical result, we have also used the model to simulate spontaneous activity of a neural network, whose architecture is inspired by the patchy organization of horizontal connections between cortical columns in the neocortex of primates and other mammals. The dominant spatial patterns of the spontaneous activity, calculated as its principal components, coincide remarkably well with those patterns predicted from the network connectivity using our theory. The equivalence between the concept of dominant pattern and the concept of attractor of the network dynamics is also demonstrated. This in turn suggests new ways of investigating encoding and storage capabilities of neural networks.     

Activity-dependent clustering of functional synaptic inputs on developing hippocampal dendrites

During brain development, before sensory systems become functional, neuronal networks spontaneously generate repetitive bursts of neuronal activity, which are typically synchronized across many neurons. Such activity patterns have been described on the level of networks and cells, but the fine-structure of inputs received by an individual neuron during spontaneous network activity has not been studied. Here, we used calcium imaging to record activity at many synapses of hippocampal pyramidal neurons simultaneously to establish the activity patterns in the majority of synapses of an entire cell. Analysis of the spatiotemporal patterns of synaptic activity revealed a fine-scale connectivity rule: neighboring synapses (<16?μm intersynapse distance) are more likely to be coactive than synapses that are farther away from each other. Blocking spiking activity or NMDA receptor activation revealed that the clustering of synaptic inputs required neuronal activity, demonstrating a role of developmentally expressed spontaneous activity for connecting neurons with subcellular precision.     

The Influence of Cold Temperature on Cellular Excitability of Hippocampal Networks

The hippocampus plays an important role in short term memory, learning and spatial navigation. A characteristic feature of the hippocampal region is its expression of different electrical population rhythms and activities during different brain states. Physiological fluctuations in brain temperature affect the activity patterns in hippocampus, but the underlying cellular mechanisms are poorly understood. In this work, we investigated the thermal modulation of hippocampal activity at the cellular network level. Primary cell cultures of mouse E17 hippocampus displayed robust network activation upon light cooling of the extracellular solution from baseline physiological temperatures. The activity generated was dependent on action potential firing and excitatory glutamatergic synaptic transmission. Involvement of thermosensitive channels from the transient receptor potential (TRP) family in network activation by temperature changes was ruled out, whereas pharmacological and immunochemical experiments strongly pointed towards the involvement of temperature-sensitive two-pore-domain potassium channels (K_2P), TREK/TRAAK family. In hippocampal slices we could show an increase in evoked and spontaneous synaptic activity produced by mild cooling in the physiological range that was prevented by chloroform, a K_2P channel opener. We propose that cold-induced closure of background TREK/TRAAK family channels increases the excitability of some hippocampal neurons, acting as a temperature-sensitive gate of network activation. Our findings in the hippocampus open the possibility that small temperature variations in the brain in vivo, associated with metabolism or blood flow oscillations, act as a switch mechanism of neuronal activity and determination of firing patterns through regulation of thermosensitive background potassium channel activity.     

Homeostatic control of synaptic rewiring in recurrent networks induces the formation of stable memory engrams

Brain networks store new memories using functional and structural synaptic plasticity. Memory formation is generally attributed to Hebbian plasticity, while homeostatic plasticity is thought to have an ancillary role in stabilizing network dynamics. Here we report that homeostatic plasticity alone can also lead to the formation of stable memories. We analyze this phenomenon using a new theory of network remodeling, combined with numerical simulations of recurrent spiking neural networks that exhibit structural plasticity based on firing rate homeostasis. These networks are able to store repeatedly presented patterns and recall them upon the presentation of incomplete cues. Storage is fast, governed by the homeostatic drift. In contrast, forgetting is slow, driven by a diffusion process. Joint stimulation of neurons induces the growth of associative connections between them, leading to the formation of memory engrams. These memories are stored in a distributed fashion throughout connectivity matrix, and individual synaptic connections have only a small influence. Although memory-specific connections are increased in number, the total number of inputs and outputs of neurons undergo only small changes during stimulation. We find that homeostatic structural plasticity induces a specific type of “silent memories”, different from conventional attractor states.     

Dynamics of Sparsely Connected Networks of Excitatory and Inhibitory Spiking Neurons

The dynamics of networks of sparsely connected excitatory and inhibitory integrate-and-fire neurons are studied analytically. The analysis reveals a rich repertoire of states, including synchronous states in which neurons fire regularly; asynchronous states with stationary global activity and very irregular individual cell activity; and states in which the global activity oscillates but individual cells fire irregularly, typically at rates lower than the global oscillation frequency. The network can switch between these states, provided the external frequency, or the balance between excitation and inhibition, is varied. Two types of network oscillations are observed. In the fast oscillatory state, the network frequency is almost fully controlled by the synaptic time scale. In the slow oscillatory state, the network frequency depends mostly on the membrane time constant. Finite size effects in the asynchronous state are also discussed.     

Role of connectivity in immune and neural network models: memory development and aging.

In this paper we analyzed how connectivity (defined as number of connections between network elements) can affect the memory capacity of a network-based model of the Immune System (IS) and of a model of the Nervous System (NS) synaptic plasticity (BCM model). The key point is the concept of competition between the characteristic variables that represent the response of such systems to environmental stimuli: the clonal concentrations for the IS, and the neuron responses for the BCM model. The memory states of both systems are characterized by a high selectivity to specific input patterns, reflecting a similar behaviour of their development rules. This selectivity property of memory states can be controlled by changing the degree of the internal connectivity in each system. We can explain the changes occurring in IS memory states during lifespan as due to a reshaping of its internal connectivity. This assumption is in agreement with experimental observations, reporting an increase of IS memory cells during lifespan. The change of connectivity in the BCM model leads to the introduction of quasilocal variables governing the plasticity of groups of synaptic junctions. This could be interpreted as the result of a refinement of neuron internal mechanisms during development, or it could be seen as a different learning rule deriving from the original BCM theory. We argue that connectivity seems to play an important role in a large class of biological systems controlled by competition mechanisms. Moreover, changes in connectivity may lead to changes in memory properties during development and aging.     

Long-term potentiation in rat hippocampal neurons is accompanied by spatially widespread changes in intrinsic oscillatory dynamics and excitability

Oscillations in neural activity are a prominent feature of many brain states. Individual hippocampal neurons exhibit intrinsic membrane potential oscillations and intrinsic resonance in the theta frequency range. We found that the subthreshold resonance frequency of CA1 pyramidal neurons was location dependent, varying more than 3-fold between the soma and the distal dendrites. Furthermore, activity- and NMDA-receptor-dependent long-term plasticity increased this resonance frequency through changes in h channel properties. The increase in resonance frequency and an associated reduction in excitability were nearly identical in the soma and the first 300 mum of the apical dendrites. These spatially widespread changes accompanying long-term synaptic potentiation also reduced the neuron's ability to elicit spikes evoked through a nonpotentiated synaptic pathway. Our results suggest that the frequency response of these neurons depends on the dendritic location of their inputs and that activity can regulate their response dynamics within an oscillating neural network.     

A hemicord locomotor network of excitatory interneurons: a simulation study

Locomotor burst generation is simulated using a full-scale network model of the unilateral excitatory interneuronal population. Earlier small-scale models predicted that a population of excitatory neurons would be sufficient to produce burst activity, and this has recently been experimentally confirmed. Here we simulate the hemicord activity induced under various experimental conditions, including pharmacological activation by NMDA and AMPA as well as electrical stimulation. The model network comprises a realistic number of cells and synaptic connectivity patterns. Using similar distributions of cellular and synaptic parameters, as have been estimated experimentally, a large variation in dynamic characteristics like firing rates, burst, and cycle durations were seen in single cells. On the network level an overall rhythm was generated because the synaptic interactions cause partial synchronization within the population. This network rhythm not only emerged despite the distributed cellular parameters but relied on this variability, in particular, in reproducing variations of the activity during the cycle and showing recruitment in interneuronal populations. A slow rhythm (0.4–2 Hz) can be induced by tonic activation of NMDA-sensitive channels, which are voltage dependent and generate depolarizing plateaus. The rhythm emerges through a synchronization of bursts of the individual neurons. A fast rhythm (4–12 Hz), induced by AMPA, relies on spike synchronization within the population, and each burst is composed of single spikes produced by different neurons. The dynamic range of the fast rhythm is limited by the ability of the network to synchronize oscillations and depends on the strength of synaptic connections and the duration of the slow after hyperpolarization. The model network also produces prolonged bouts of rhythmic activity in response to brief electrical activations, as seen experimentally. The mutual excitation can sustain long-lasting activity for a realistic set of synaptic parameters. The bout duration depends on the strength of excitatory synaptic connections, the level of persistent depolarization, and the influx of Ca²⁺ ions and activation of Ca²⁺-dependent K⁺ current.     

Dynamic effective connectivity of inter-areal brain circuits

Anatomic connections between brain areas affect information flow between neuronal circuits and the synchronization of neuronal activity. However, such structural connectivity does not coincide with effective connectivity (or, more precisely, causal connectivity), related to the elusive question “Which areas cause the present activity of which others?”. Effective connectivity is directed and depends flexibly on contexts and tasks. Here we show that dynamic effective connectivity can emerge from transitions in the collective organization of coherent neural activity. Integrating simulation and semi-analytic approaches, we study mesoscale network motifs of interacting cortical areas, modeled as large random networks of spiking neurons or as simple rate units. Through a causal analysis of time-series of model neural activity, we show that different dynamical states generated by a same structural connectivity motif correspond to distinct effective connectivity motifs. Such effective motifs can display a dominant directionality, due to spontaneous symmetry breaking and effective entrainment between local brain rhythms, although all connections in the considered structural motifs are reciprocal. We show then that transitions between effective connectivity configurations (like, for instance, reversal in the direction of inter-areal interactions) can be triggered reliably by brief perturbation inputs, properly timed with respect to an ongoing local oscillation, without the need for plastic synaptic changes. Finally, we analyze how the information encoded in spiking patterns of a local neuronal population is propagated across a fixed structural connectivity motif, demonstrating that changes in the active effective connectivity regulate both the efficiency and the directionality of information transfer. Previous studies stressed the role played by coherent oscillations in establishing efficient communication between distant areas. Going beyond these early proposals, we advance here that dynamic interactions between brain rhythms provide as well the basis for the self-organized control of this “communication-through-coherence”, making thus possible a fast “on-demand” reconfiguration of global information routing modalities.     

Dynamics of pruning in simulated large-scale spiking neural networks

Massive synaptic pruning following over-growth is a general feature of mammalian brain maturation. This article studies the synaptic pruning that occurs in large networks of simulated spiking neurons in the absence of specific input patterns of activity. The evolution of connections between neurons were governed by an original bioinspired spike-timing-dependent synaptic plasticity (STDP) modification rule which included a slow decay term. The network reached a steady state with a bimodal distribution of the synaptic weights that were either incremented to the maximum value or decremented to the lowest value. After 1x10(6) time steps the final number of synapses that remained active was below 10% of the number of initially active synapses independently of network size. The synaptic modification rule did not introduce spurious biases in the geometrical distribution of the remaining active projections. The results show that, under certain conditions, the model is capable of generating spontaneously emergent cell assemblies.     

Unsupervised learning for robust working memory

Working memory is a core component of critical cognitive functions such as planning and decision-making. Persistent activity that lasts long after the stimulus offset has been considered a neural substrate for working memory. Attractor dynamics based on network interactions can successfully reproduce such persistent activity. However, it requires a fine-tuning of network connectivity, in particular, to form continuous attractors which were suggested for encoding continuous signals in working memory. Here, we investigate whether a specific form of synaptic plasticity rules can mitigate such tuning problems in two representative working memory models, namely, rate-coded and location-coded persistent activity. We consider two prominent types of plasticity rules, differential plasticity correcting the rapid activity changes and homeostatic plasticity regularizing the long-term average of activity, both of which have been proposed to fine-tune the weights in an unsupervised manner. Consistent with the findings of previous works, differential plasticity alone was enough to recover a graded-level persistent activity after perturbations in the connectivity. For the location-coded memory, differential plasticity could also recover persistent activity. However, its pattern can be irregular for different stimulus locations under slow learning speed or large perturbation in the connectivity. On the other hand, homeostatic plasticity shows a robust recovery of smooth spatial patterns under particular types of synaptic perturbations, such as perturbations in incoming synapses onto the entire or local populations. However, homeostatic plasticity was not effective against perturbations in outgoing synapses from local populations. Instead, combining it with differential plasticity recovers location-coded persistent activity for a broader range of perturbations, suggesting compensation between two plasticity rules.     

Energy features in spontaneous up and down oscillations

Spontaneous brain activities consume most of the brain’s energy. So if we want to understand how the brain operates, we must take into account these spontaneous activities. Up and down transitions of membrane potentials are considered to be one of significant spontaneous activities. This kind of oscillation always shows bistable and bimodal distribution of membrane potentials. Our previous theoretical studies on up and down oscillations mainly looked at the ion channel dynamics. In this paper, we focus on energy feature of spontaneous up and down transitions based on a network model and its simulation. The simulated results indicate that the energy is a robust index and distinguishable of excitatory and inhibitory neurons. Meanwhile, one the whole, energy consumption of neurons shows bistable feature and bimodal distribution as well as the membrane potential, which turns out that the indicator of energy consumption encodes up and down states in this spontaneous activity. In detail, energy consumption mainly occurs during up states temporally, and mostly concentrates inside neurons rather than synapses spatially. The stimulation related energy is small, indicating that energy consumption is not driven by external stimulus, but internal spontaneous activity. This point of view is also consistent with brain imaging results. Through the observation and analysis of the findings, we prove the validity of the model again, and we can further explore the energy mechanism of more spontaneous activities.     

Effects of Isoflurane Anesthesia on Ensemble Patterns of Ca2+ Activity in Mouse V1: Reduced Direction Selectivity Independent of Increased Correlations in Cellular Activity

Anesthesia affects brain activity at the molecular, neuronal and network level, but it is not well-understood how tuning properties of sensory neurons and network connectivity change under its influence. Using in vivo two-photon calcium imaging we matched neuron identity across episodes of wakefulness and anesthesia in the same mouse and recorded spontaneous and visually evoked activity patterns of neuronal ensembles in these two states. Correlations in spontaneous patterns of calcium activity between pairs of neurons were increased under anesthesia. While orientation selectivity remained unaffected by anesthesia, this treatment reduced direction selectivity, which was attributable to an increased response to the null-direction. As compared to anesthesia, populations of V1 neurons coded more mutual information on opposite stimulus directions during wakefulness, whereas information on stimulus orientation differences was lower. Increases in correlations of calcium activity during visual stimulation were correlated with poorer population coding, which raised the hypothesis that the anesthesia-induced increase in correlations may be causal to degrading directional coding. Visual stimulation under anesthesia, however, decorrelated ongoing activity patterns to a level comparable to wakefulness. Because visual stimulation thus appears to ‘break’ the strength of pairwise correlations normally found in spontaneous activity under anesthesia, the changes in correlational structure cannot explain the awake-anesthesia difference in direction coding. The population-wide decrease in coding for stimulus direction thus occurs independently of anesthesia-induced increments in correlations of spontaneous activity.     

Neuromodulation of STDP through short-term changes in firing causality

Spike timing dependent plasticity (STDP) likely plays an important role in forming and changing connectivity patterns between neurons in our brain. In a unidirectional synaptic connection between two neurons, it uses the causal relation between spiking activity of a presynaptic input neuron and a postsynaptic output neuron to change the strength of this connection. While the nature of STDP benefits unsupervised learning of correlated inputs, any incorporation of value into the learning process needs some form of reinforcement. Chemical neuromodulators such as Dopamine or Acetylcholine are thought to signal changes between external reward and internal expectation to many brain regions, including the basal ganglia. This effect is often modelled through a direct inclusion of the level of Dopamine as a third factor into the STDP rule. While this gives the benefit of direct control over synaptic modification, it does not account for observed instantaneous effects in neuronal activity on application of Dopamine agonists. Specifically, an instant facilitation of neuronal excitability in the striatum can not be explained by the only indirect effect that dopamine-modulated STDP has on a neuron’s firing pattern. We therefore propose a model for synaptic transmission where the level of neuromodulator does not directly influence synaptic plasticity, but instead alters the relative firing causality between pre- and postsynaptic neurons. Through the direct effect on postsynaptic activity, our rule allows indirect modulation of the learning outcome even with unmodulated, two-factor STDP. However, it also does not prohibit joint operation together with three-factor STDP rules.     

Exploring the spectrum of dynamical regimes and timescales in spontaneous cortical activity

Rhythms at slow (<1 Hz) frequency of alternating Up and Down states occur during slow-wave sleep states, under deep anaesthesia and in cortical slices of mammals maintained in vitro. Such spontaneous oscillations result from the interplay between network reverberations nonlinearly sustained by a strong synaptic coupling and a fatigue mechanism inhibiting the neurons firing in an activity-dependent manner. Varying pharmacologically the excitability level of brain slices we exploit the network dynamics underlying slow rhythms, uncovering an intrinsic anticorrelation between Up and Down state durations. Besides, a non-monotonic change of Down state duration is also observed, which shrinks the distribution of the accessible frequencies of the slow rhythms. Attractor dynamics with activity-dependent self-inhibition predicts a similar trend even when the system excitability is reduced, because of a stability loss of Up and Down states. Hence, such cortical rhythms tend to display a maximal size of the distribution of Up/Down frequencies, envisaging the location of the system dynamics on a critical boundary of the parameter space. This would be an optimal solution for the system in order to display a wide spectrum of dynamical regimes and timescales.     

Spontaneously active cells induce state transitions in a model of olfactory cortex

The existence of neurons with intrinsic oscillations does not in itself explain the synchronization of local populations of neurons, but it is likely to pace population rhythms when the neurons are suitably coupled by chemical and/or electrical synapses. In the present study, we have investigated the role of spontaneously active cells as noisy or pacemaker units in setting global oscillations in a three-layered cortical model. The presence of a small number of noisy (spontaneously active) units induce oscillations at the network level in the range of the gamma rhythm. The number of noisy units in the network and their type (excitatory or inhibitory or excitatory and inhibitory together) determines the emergence of regular oscillations or aperiodic (chaotic) behaviour. It also determines the onset of the global behaviour. On replacing a noisy unit by a pacemaker unit, similar gamma oscillations were generated. With both noisy and pacemaker units, we found that certain characteristics of the spontaneous activity determine the delay period for the onset of global activity. Preliminary studies have been carried out with spontaneously active units having a chaotic dynamics but the results are much similar to that with a noisy burst. Different functional roles have been suggested for cortical oscillations, such as determining global functional states and specifying connectivity during development. Oscillations at different frequency bands, in particular in the gamma band (around 40 Hz), have also been associated with memory and attention. The presence of spontaneously active neurons, either with noisy or oscillatory activity, could be responsible for global oscillations in the absence of external stimuli in certain cortical areas in the mature brain.     

Synaptic Plasticity Enables Adaptive Self-Tuning Critical Networks

During rest, the mammalian cortex displays spontaneous neural activity. Spiking of single neurons during rest has been described as irregular and asynchronous. In contrast, recent in vivo and in vitro population measures of spontaneous activity, using the LFP, EEG, MEG or fMRI suggest that the default state of the cortex is critical, manifested by spontaneous, scale-invariant, cascades of activity known as neuronal avalanches. Criticality keeps a network poised for optimal information processing, but this view seems to be difficult to reconcile with apparently irregular single neuron spiking. Here, we simulate a 10,000 neuron, deterministic, plastic network of spiking neurons. We show that a combination of short- and long-term synaptic plasticity enables these networks to exhibit criticality in the face of intrinsic, i.e. self-sustained, asynchronous spiking. Brief external perturbations lead to adaptive, long-term modification of intrinsic network connectivity through long-term excitatory plasticity, whereas long-term inhibitory plasticity enables rapid self-tuning of the network back to a critical state. The critical state is characterized by a branching parameter oscillating around unity, a critical exponent close to -3/2 and a long tail distribution of a self-similarity parameter between 0.5 and 1.     

Emergent Oscillations in a Realistic Network: The Role of Inhibition and the Effect of the Spatiotemporal Distribution of the Input

We have simulated a network of 10,000 two-compartment cells, spatially distributed on a two-dimensional sheet; 15% of the cells were inhibitory. The input to the network was spatially delimited. Global oscillations frequently were achieved with a simple set of connectivity rules. The inhibitory neurons paced the network, whereas the excitatory neurons amplified the input, permitting oscillations at low-input intensities. Inhibitory neurons were active over a greater area than excitatory ones, forming a ring of inhibition. The oscillation frequency was modulated to some extent by the input intensity, as has been shown experimentally in the striate cortex, but predominantly by the properties of the inhibitory neurons and their connections: the membrane and synaptic time constants and the distribution of delays.In networks that showed oscillations and in those that did not, widely distributed inputs could lead to the specific recruitment of the inhibitory neurons and to near zero activity of the excitatory cells. Hence the spatial distribution of excitatory inputs could provide a means of selectively exciting or inhibiting a target network. Finally, neither the presence of oscillations nor the global spike activity provided any reliable indication of the level of excitatory output from the network.     

Emergent oscillations in a realistic network: the role of inhibition and the effect of the spatiotemporal distribution of the input.

We have simulated a network of 10,000 two-compartment cells, spatially distributed on a two-dimensional sheet; 15% of the cells were inhibitory. The input to the network was spatially delimited. Global oscillations frequently were achieved with a simple set of connectivity rules. The inhibitory neurons paced the network, whereas the excitatory neurons amplified the input, permitting oscillations at low-input intensities. Inhibitory neurons were active over a greater area than excitatory ones, forming a ring of inhibition. The oscillation frequency was modulated to some extent by the input intensity, as has been shown experimentally in the striate cortex, but predominantly by the properties of the inhibitory neurons and their connections: the membrane and synaptic time constants and the distribution of delays. In networks that showed oscillations and in those that did not, widely distributed inputs could lead to the specific recruitment of the inhibitory neurons and to near zero activity of the excitatory cells. Hence the spatial distribution of excitatory inputs could provide a means of selectively exciting or inhibiting a target network. Finally, neither the presence of oscillations nor the global spike activity provided any reliable indication of the level of excitatory output from the network.