Synaptic plasticity and connectivity requirements to produce stimulus-pair specific responses in recurrent networks of spiking neurons

Animals must respond selectively to specific combinations of salient environmental stimuli in order to survive in complex environments. A task with these features, biconditional discrimination, requires responses to select pairs of stimuli that are opposite to responses to those stimuli in another combination. We investigate the characteristics of synaptic plasticity and network connectivity needed to produce stimulus-pair neural responses within randomly connected model networks of spiking neurons trained in biconditional discrimination. Using reward-based plasticity for synapses from the random associative network onto a winner-takes-all decision-making network representing perceptual decision-making, we find that reliably correct decision making requires upstream neurons with strong stimulus-pair selectivity. By chance, selective neurons were present in initial networks; appropriate plasticity mechanisms improved task performance by enhancing the initial diversity of responses. We find long-term potentiation of inhibition to be the most beneficial plasticity rule by suppressing weak responses to produce reliably correct decisions across an extensive range of networks.     

Anti-correlations in the degree distribution increase stimulus detection performance in noisy spiking neural networks

Neuronal circuits in the rodent barrel cortex are characterized by stable low firing rates. However, recent experiments show that short spike trains elicited by electrical stimulation in single neurons can induce behavioral responses. Hence, the underlying neural networks provide stability against internal fluctuations in the firing rate, while simultaneously making the circuits sensitive to small external perturbations. Here we studied whether stability and sensitivity are affected by the connectivity structure in recurrently connected spiking networks. We found that anti-correlation between the number of afferent (in-degree) and efferent (out-degree) synaptic connections of neurons increases stability against pathological bursting, relative to networks where the degrees were either positively correlated or uncorrelated. In the stable network state, stimulation of a few cells could lead to a detectable change in the firing rate. To quantify the ability of networks to detect the stimulation, we used a receiver operating characteristic (ROC) analysis. For a given level of background noise, networks with anti-correlated degrees displayed the lowest false positive rates, and consequently had the highest stimulus detection performance. We propose that anti-correlation in the degree distribution may be a computational strategy employed by sensory cortices to increase the detectability of external stimuli. We show that networks with anti-correlated degrees can in principle be formed by applying learning rules comprised of a combination of spike-timing dependent plasticity, homeostatic plasticity and pruning to networks with uncorrelated degrees. To test our prediction we suggest a novel experimental method to estimate correlations in the degree distribution.     

Molecular mechanisms of homeostatic plasticity in central pattern generator networks

Central pattern generator (CPG) networks rely on a balance of intrinsic and network properties to produce reliable, repeatable activity patterns. This balance is maintained by homeostatic plasticity where alterations in neuronal properties dynamically maintain appropriate neural output in the face of changing environmental conditions and perturbations. However, it remains unclear just how these neurons and networks can both monitor their ongoing activity and use this information to elicit homeostatic physiological responses to ensure robustness of output over time. Evidence exists that CPG networks use a mixed strategy of activity‐dependent, activity‐independent, modulator‐dependent, and synaptically regulated homeostatic plasticity to achieve this critical stability. In this review, we focus on some of the current understanding of the molecular pathways and mechanisms responsible for this homeostatic plasticity in the context of central pattern generator function, with a special emphasis on some of the smaller invertebrate networks that have allowed for extensive cellular‐level analyses that have brought recent insights to these questions.     

Balancing homeostasis and learning in neural circuits

Neural circuits are remarkably adaptable, providing animals with the ability to modify their behavior on the basis of experience. At the same time, they are extremely robust and maintain stability despite the changes associated with adaptation. This combination of adaptability and stability is difficult to achieve, and it provides a strong constraint on any models of plasticity in neural circuits. New evidence suggests that the effect of action potential timing on synaptic plasticity may be an important element in reconciling homeostasis with adaptability. In particular, spike-timing dependent plasticity can act as both an adaptive and a homeostatic mechanism, controlling overall firing rates and distributions of synaptic efficacies while making neurons selective for certain aspects of their inputs. It can also cause networks that initially represent the present state of a stimulus to predict its future state on the basis of experience, a theoretical result supported by experimental data in behaving rats.     

Network reconfiguration and neuronal plasticity in rhythm-generating networks

Neuronal networks are highly plastic and reconfigure in a state-dependent manner. The plasticity at the network level emerges through multiple intrinsic and synaptic membrane properties that imbue neurons and their interactions with numerous nonlinear properties. These properties are continuously regulated by neuromodulators and homeostatic mechanisms that are critical to maintain not only network stability and also adapt networks in a short- and long-term manner to changes in behavioral, developmental, metabolic, and environmental conditions. This review provides concrete examples from neuronal networks in invertebrates and vertebrates, and illustrates that the concepts and rules that govern neuronal networks and behaviors are universal.     

Robustness in phenotypic plasticity and heterogeneity patterns enabled by EMT networks

Epithelial-mesenchymal plasticity (EMP) is a key arm of cancer metastasis and is observed across many contexts. Cells undergoing EMP can reversibly switch between three classes of phenotypes: epithelial (E), mesenchymal (M), and hybrid E/M. While a large number of multistable regulatory networks have been identified to be driving EMP in various contexts, the exact mechanisms and design principles that enable robustness in driving EMP across contexts are not yet fully understood. Here, we investigated dynamic and structural robustness in EMP networks with regard to phenotypic heterogeneity and plasticity. We use two different approaches to simulate these networks: a computationally inexpensive, parameter-independent continuous state space Boolean model, and an ODE-based parameter-agnostic framework (RACIPE), both of which yielded similar phenotypic distributions. While the latter approach is useful for measurements of plasticity, the former model enabled us to extensively investigate robustness in phenotypic heterogeneity. Using perturbations to network topology and by varying network parameters, we show that multistable EMP networks are structurally and dynamically more robust compared with their randomized counterparts, thereby highlighting their topological hallmarks. These features of robustness are governed by a balance of positive and negative feedback loops embedded in these networks. Using a combination of the number of negative and positive feedback loops weighted by their lengths, we identified a metric that can explain the structural and dynamical robustness of these networks. This metric enabled us to compare networks across multiple sizes, and the network principles thus obtained can be used to identify fragilities in large networks without simulating their dynamics. Our analysis highlights a network topology-based approach to quantify robustness in the phenotypic heterogeneity and plasticity emergent from EMP networks.     

On the Relationships between Generative Encodings,Regularity, and Learning Abilities when Evolving Plastic Artificial Neural Networks

A major goal of bio-inspired artificial intelligence is to design artificial neural networks with abilities that resemble those of animal nervous systems. It is commonly believed that two keys for evolving nature-like artificial neural networks are (1) the developmental process that links genes to nervous systems, which enables the evolution of large, regular neural networks, and (2) synaptic plasticity, which allows neural networks to change during their lifetime. So far, these two topics have been mainly studied separately. The present paper shows that they are actually deeply connected. Using a simple operant conditioning task and a classic evolutionary algorithm, we compare three ways to encode plastic neural networks: a direct encoding, a developmental encoding inspired by computational neuroscience models, and a developmental encoding inspired by morphogen gradients (similar to HyperNEAT). Our results suggest that using a developmental encoding could improve the learning abilities of evolved, plastic neural networks. Complementary experiments reveal that this result is likely the consequence of the bias of developmental encodings towards regular structures: (1) in our experimental setup, encodings that tend to produce more regular networks yield networks with better general learning abilities; (2) whatever the encoding is, networks that are the more regular are statistically those that have the best learning abilities.     

Mirrored STDP Implements Autoencoder Learning in a Network of Spiking Neurons

The autoencoder algorithm is a simple but powerful unsupervised method for training neural networks. Autoencoder networks can learn sparse distributed codes similar to those seen in cortical sensory areas such as visual area V1, but they can also be stacked to learn increasingly abstract representations. Several computational neuroscience models of sensory areas, including Olshausen & Field’s Sparse Coding algorithm, can be seen as autoencoder variants, and autoencoders have seen extensive use in the machine learning community. Despite their power and versatility, autoencoders have been difficult to implement in a biologically realistic fashion. The challenges include their need to calculate differences between two neuronal activities and their requirement for learning rules which lead to identical changes at feedforward and feedback connections. Here, we study a biologically realistic network of integrate-and-fire neurons with anatomical connectivity and synaptic plasticity that closely matches that observed in cortical sensory areas. Our choice of synaptic plasticity rules is inspired by recent experimental and theoretical results suggesting that learning at feedback connections may have a different form from learning at feedforward connections, and our results depend critically on this novel choice of plasticity rules. Specifically, we propose that plasticity rules at feedforward versus feedback connections are temporally opposed versions of spike-timing dependent plasticity (STDP), leading to a symmetric combined rule we call Mirrored STDP (mSTDP). We show that with mSTDP, our network follows a learning rule that approximately minimizes an autoencoder loss function. When trained with whitened natural image patches, the learned synaptic weights resemble the receptive fields seen in V1. Our results use realistic synaptic plasticity rules to show that the powerful autoencoder learning algorithm could be within the reach of real biological networks.     

Homeostatic control of synaptic rewiring in recurrent networks induces the formation of stable memory engrams

Brain networks store new memories using functional and structural synaptic plasticity. Memory formation is generally attributed to Hebbian plasticity, while homeostatic plasticity is thought to have an ancillary role in stabilizing network dynamics. Here we report that homeostatic plasticity alone can also lead to the formation of stable memories. We analyze this phenomenon using a new theory of network remodeling, combined with numerical simulations of recurrent spiking neural networks that exhibit structural plasticity based on firing rate homeostasis. These networks are able to store repeatedly presented patterns and recall them upon the presentation of incomplete cues. Storage is fast, governed by the homeostatic drift. In contrast, forgetting is slow, driven by a diffusion process. Joint stimulation of neurons induces the growth of associative connections between them, leading to the formation of memory engrams. These memories are stored in a distributed fashion throughout connectivity matrix, and individual synaptic connections have only a small influence. Although memory-specific connections are increased in number, the total number of inputs and outputs of neurons undergo only small changes during stimulation. We find that homeostatic structural plasticity induces a specific type of “silent memories”, different from conventional attractor states.     

The Stability of Cellulose: A Statistical Perspective from a Coarse-Grained Model of Hydrogen-Bond Networks

A critical roadblock to the production of biofuels from lignocellulosic biomass is the efficient degradation of crystalline microfibrils of cellulose to glucose. A microscopic understanding of how different physical conditions affect the overall stability of the crystalline structure of microfibrils could facilitate the design of more effective protocols for their degradation. One of the essential physical interactions that stabilizes microfibrils is a network of hydrogen (H) bonds: both intrachain H-bonds between neighboring monomers of a single cellulose polymer chain and interchain H-bonds between adjacent chains. We construct a statistical mechanical model of cellulose assembly at the resolution of explicit hydrogen-bond networks. Using the transfer matrix method, the partition function and the subsequent statistical properties are evaluated. With the help of this lattice-based model, we capture the plasticity of the H-bond network in cellulose due to frustration and redundancy in the placement of H-bonds. This plasticity is responsible for the stability of cellulose over a wide range of temperatures. Stable intrachain and interchain H-bonds are identified as a function of temperature that could possibly be manipulated toward rational destruction of crystalline cellulose.     

Self-Organization of Microcircuits in Networks of Spiking Neurons with Plastic Synapses

The synaptic connectivity of cortical networks features an overrepresentation of certain wiring motifs compared to simple random-network models. This structure is shaped, in part, by synaptic plasticity that promotes or suppresses connections between neurons depending on their joint spiking activity. Frequently, theoretical studies focus on how feedforward inputs drive plasticity to create this network structure. We study the complementary scenario of self-organized structure in a recurrent network, with spike timing-dependent plasticity driven by spontaneous dynamics. We develop a self-consistent theory for the evolution of network structure by combining fast spiking covariance with a slow evolution of synaptic weights. Through a finite-size expansion of network dynamics we obtain a low-dimensional set of nonlinear differential equations for the evolution of two-synapse connectivity motifs. With this theory in hand, we explore how the form of the plasticity rule drives the evolution of microcircuits in cortical networks. When potentiation and depression are in approximate balance, synaptic dynamics depend on weighted divergent, convergent, and chain motifs. For additive, Hebbian STDP these motif interactions create instabilities in synaptic dynamics that either promote or suppress the initial network structure. Our work provides a consistent theoretical framework for studying how spiking activity in recurrent networks interacts with synaptic plasticity to determine network structure.     

Homeostatically regulated synchronized oscillations induced by short-term tetrodotoxin treatment in cultured neuronal network

Homeostatic plasticity plays a critical role in the stability of neuronal activities. Here, with high-density hippocampal networks cultured on multi-electrode arrays (MEAs), the transformation of spontaneous neuronal firing patterns induced by 1microM tetrodotoxin was clarified. Once tetrodotoxin was washed out after a 4-h treatment, spontaneous activities rose significantly with spike rate increasing approximately three times, and synchronized burst oscillations appeared throughout the network, with the cross-correlation coefficient between the active sites rising from 0.06+/-0.03 to 0.27+/-0.05. The long-term recording showed that the oscillations lasted for more than 4h before the network recovered. These results suggest that short-term treatment by tetrodotoxin may induce the homeostatically enhanced neuronal excitability, and that the spontaneous synchronized oscillations should be an indicator of homeostatic plasticity in cultured neuronal network. Furthermore, the non-invasive and long-term recording with MEAs as a novel sensing system is identified to be appropriate for pharmacological investigations of neuronal plasticity at the network level.     

Emergence of Functional Specificity in Balanced Networks with Synaptic Plasticity

In rodent visual cortex, synaptic connections between orientation-selective neurons are unspecific at the time of eye opening, and become to some degree functionally specific only later during development. An explanation for this two-stage process was proposed in terms of Hebbian plasticity based on visual experience that would eventually enhance connections between neurons with similar response features. For this to work, however, two conditions must be satisfied: First, orientation selective neuronal responses must exist before specific recurrent synaptic connections can be established. Second, Hebbian learning must be compatible with the recurrent network dynamics contributing to orientation selectivity, and the resulting specific connectivity must remain stable for unspecific background activity. Previous studies have mainly focused on very simple models, where the receptive fields of neurons were essentially determined by feedforward mechanisms, and where the recurrent network was small, lacking the complex recurrent dynamics of large-scale networks of excitatory and inhibitory neurons. Here we studied the emergence of functionally specific connectivity in large-scale recurrent networks with synaptic plasticity. Our results show that balanced random networks, which already exhibit highly selective responses at eye opening, can develop feature-specific connectivity if appropriate rules of synaptic plasticity are invoked within and between excitatory and inhibitory populations. If these conditions are met, the initial orientation selectivity guides the process of Hebbian learning and, as a result, functionally specific and a surplus of bidirectional connections emerge. Our results thus demonstrate the cooperation of synaptic plasticity and recurrent dynamics in large-scale functional networks with realistic receptive fields, highlight the role of inhibition as a critical element in this process, and paves the road for further computational studies of sensory processing in neocortical network models equipped with synaptic plasticity.     

Phylogenetic,ontogenetic and adult adaptive plasticity of rhythmic neural networks: a common neuromodulatory mechanism?

Neuromodulatory inputs are known to play a major role in the adaptive plasticity of rhythmic neural networks in adult animals. Using the crustacean stomatogastric nervous system, we have investigated the role of modulatory inputs in the development of rhythmic neural networks. We found that the same neuronal population is organised into a single network in the embryo, as opposed to the two networks present in the adult. However, these adult networks pre-exist in the embryo and can be unmasked by specific alterations of the neuromodulatory environment. Similarly, adult networks may switch back to the embryonic phenotype by manipulating neuromodulatory inputs. During development, we found that the early established neuromodulatory population display alteration in expressed neurotransmitter phenotypes, and that although the population of modulatory neurones is established early, with morphology and projection pattern similar to adult ones, their neurotransmitter phenotype may appear gradually. Therefore the abrupt switch from embryonic to adult network expression occurring at metamorphosis may be due to network reconfiguration in response to changes in modulatory input, as found in adult adaptive plasticity. Strikingly, related crustacean species express different motor outputs using the same basic network circuitry, due to species-specific alteration in neuromodulatory substances within homologous projecting neurones. Therefore we propose that alterations within neuromodulatory systems to a given rhythmic neural network displaying the same basic circuitry may account for the generation of different motor outputs throughout development (ontogenetic plasticity), adulthood (adaptive plasticity) and evolution (phylogenetic plasticity).Abbreviations CoG Commissural ganglion - OG Oesophageal ganglion - STG Stomatogastric ganglion - STNS Stomatogastric nervous system     

Dynamic Regulation of N-Methyl-d-aspartate (NMDA) and α-Amino-3-hydroxy-5-methyl-4-isoxazolepropionic Acid (AMPA) Receptors by Posttranslational Modifications

Many molecular mechanisms underlie the changes in synaptic glutamate receptor content that are required by neuronal networks to generate cellular correlates of learning and memory. During the last decade, posttranslational modifications have emerged as critical regulators of synaptic transmission and plasticity. Notably, phosphorylation, ubiquitination, and palmitoylation control the stability, trafficking, and synaptic expression of glutamate receptors in the central nervous system. In the current review, we will summarize some of the progress made by the neuroscience community regarding our understanding of phosphorylation, ubiquitination, and palmitoylation of the NMDA and AMPA subtypes of glutamate receptors.     

Structural Synaptic Plasticity Has High Memory Capacity and Can Explain Graded Amnesia,Catastrophic Forgetting,and the Spacing Effect

Although already William James and, more explicitly, Donald Hebb''s theory of cell assemblies have suggested that activity-dependent rewiring of neuronal networks is the substrate of learning and memory, over the last six decades most theoretical work on memory has focused on plasticity of existing synapses in prewired networks. Research in the last decade has emphasized that structural modification of synaptic connectivity is common in the adult brain and tightly correlated with learning and memory. Here we present a parsimonious computational model for learning by structural plasticity. The basic modeling units are “potential synapses” defined as locations in the network where synapses can potentially grow to connect two neurons. This model generalizes well-known previous models for associative learning based on weight plasticity. Therefore, existing theory can be applied to analyze how many memories and how much information structural plasticity can store in a synapse. Surprisingly, we find that structural plasticity largely outperforms weight plasticity and can achieve a much higher storage capacity per synapse. The effect of structural plasticity on the structure of sparsely connected networks is quite intuitive: Structural plasticity increases the “effectual network connectivity”, that is, the network wiring that specifically supports storage and recall of the memories. Further, this model of structural plasticity produces gradients of effectual connectivity in the course of learning, thereby explaining various cognitive phenomena including graded amnesia, catastrophic forgetting, and the spacing effect.     

体外培养的神经元网络可塑性

神经元网络是大脑执行高级认知行为的结构基础,研究证明学习记忆及神经退行性疾病与神经元网络可塑性密切相关。因此,揭示调控和改变神经元网络可塑性的机制对理解神经系统信息交互以及疾病治疗具有重大意义。目前,基于微电极阵列（microelectrode array, MEA）培养的神经元网络是体外探究学习和记忆机制的理想模型,同时针对该模型的研究为预防和治疗神经退行性疾病提供了独特的视角。本文综述了基于MEA采集体外培养神经元网络的放电信号来构建功能网络的相关研究,分别从二维神经元网络和三维脑类器官发育,以及开环和闭环电刺激对神经元网络可塑性影响的角度,总结了体外培养神经元网络可塑性的相关研究,最后对该方向的应用前景进行了展望。     

Synaptic Plasticity in Neural Networks Needs Homeostasis with a Fast Rate Detector

Hebbian changes of excitatory synapses are driven by and further enhance correlations between pre- and postsynaptic activities. Hence, Hebbian plasticity forms a positive feedback loop that can lead to instability in simulated neural networks. To keep activity at healthy, low levels, plasticity must therefore incorporate homeostatic control mechanisms. We find in numerical simulations of recurrent networks with a realistic triplet-based spike-timing-dependent plasticity rule (triplet STDP) that homeostasis has to detect rate changes on a timescale of seconds to minutes to keep the activity stable. We confirm this result in a generic mean-field formulation of network activity and homeostatic plasticity. Our results strongly suggest the existence of a homeostatic regulatory mechanism that reacts to firing rate changes on the order of seconds to minutes.