Working Memory Cells' Behavior May Be Explained by Cross-Regional Networks with Synaptic Facilitation

Neurons in the cortex exhibit a number of patterns that correlate with working memory. Specifically, averaged across trials of working memory tasks, neurons exhibit different firing rate patterns during the delay of those tasks. These patterns include: 1) persistent fixed-frequency elevated rates above baseline, 2) elevated rates that decay throughout the tasks memory period, 3) rates that accelerate throughout the delay, and 4) patterns of inhibited firing (below baseline) analogous to each of the preceding excitatory patterns. Persistent elevated rate patterns are believed to be the neural correlate of working memory retention and preparation for execution of behavioral/motor responses as required in working memory tasks. Models have proposed that such activity corresponds to stable attractors in cortical neural networks with fixed synaptic weights. However, the variability in patterned behavior and the firing statistics of real neurons across the entire range of those behaviors across and within trials of working memory tasks are typical not reproduced. Here we examine the effect of dynamic synapses and network architectures with multiple cortical areas on the states and dynamics of working memory networks. The analysis indicates that the multiple pattern types exhibited by cells in working memory networks are inherent in networks with dynamic synapses, and that the variability and firing statistics in such networks with distributed architectures agree with that observed in the cortex.     

Self-sustained asynchronous irregular states and Up–Down states in thalamic,cortical and thalamocortical networks of nonlinear integrate-and-fire neurons

Randomly-connected networks of integrate-and-fire (IF) neurons are known to display asynchronous irregular (AI) activity states, which resemble the discharge activity recorded in the cerebral cortex of awake animals. However, it is not clear whether such activity states are specific to simple IF models, or if they also exist in networks where neurons are endowed with complex intrinsic properties similar to electrophysiological measurements. Here, we investigate the occurrence of AI states in networks of nonlinear IF neurons, such as the adaptive exponential IF (Brette-Gerstner-Izhikevich) model. This model can display intrinsic properties such as low-threshold spike (LTS), regular spiking (RS) or fast-spiking (FS). We successively investigate the oscillatory and AI dynamics of thalamic, cortical and thalamocortical networks using such models. AI states can be found in each case, sometimes with surprisingly small network size of the order of a few tens of neurons. We show that the presence of LTS neurons in cortex or in thalamus, explains the robust emergence of AI states for relatively small network sizes. Finally, we investigate the role of spike-frequency adaptation (SFA). In cortical networks with strong SFA in RS cells, the AI state is transient, but when SFA is reduced, AI states can be self-sustained for long times. In thalamocortical networks, AI states are found when the cortex is itself in an AI state, but with strong SFA, the thalamocortical network displays Up and Down state transitions, similar to intracellular recordings during slow-wave sleep or anesthesia. Self-sustained Up and Down states could also be generated by two-layer cortical networks with LTS cells. These models suggest that intrinsic properties such as adaptation and low-threshold bursting activity are crucial for the genesis and control of AI states in thalamocortical networks.     

Homeostatic control of synaptic rewiring in recurrent networks induces the formation of stable memory engrams

Brain networks store new memories using functional and structural synaptic plasticity. Memory formation is generally attributed to Hebbian plasticity, while homeostatic plasticity is thought to have an ancillary role in stabilizing network dynamics. Here we report that homeostatic plasticity alone can also lead to the formation of stable memories. We analyze this phenomenon using a new theory of network remodeling, combined with numerical simulations of recurrent spiking neural networks that exhibit structural plasticity based on firing rate homeostasis. These networks are able to store repeatedly presented patterns and recall them upon the presentation of incomplete cues. Storage is fast, governed by the homeostatic drift. In contrast, forgetting is slow, driven by a diffusion process. Joint stimulation of neurons induces the growth of associative connections between them, leading to the formation of memory engrams. These memories are stored in a distributed fashion throughout connectivity matrix, and individual synaptic connections have only a small influence. Although memory-specific connections are increased in number, the total number of inputs and outputs of neurons undergo only small changes during stimulation. We find that homeostatic structural plasticity induces a specific type of “silent memories”, different from conventional attractor states.     

Clustering in small networks of excitatory neurons with heterogeneous coupling strengths

Excitatory coupling with a slow rise time destabilizes synchrony between coupled neurons. Thus, the fully synchronous state is usually unstable in networks of excitatory neurons. Phase-clustered states, in which neurons are divided into multiple synchronized clusters, have also been found unstable in numerical studies of excitatory networks in the presence of noise. The question arises as to whether synchrony is possible in networks of neurons coupled through slow, excitatory synapses. In this paper, we show that robust, synchronous clustered states can occur in such networks. The effects of non-uniform distributions of coupling strengths are explored. Conditions for the existence and stability of clustered states are derived analytically. The analysis shows that a multi-cluster state can be stable in excitatory networks if the overall interactions between neurons in different clusters are stabilizing and strong enough to counter-act the destabilizing interactions between neurons within each cluster. When heterogeneity in the coupling strengths strengthens the stabilizing inter-cluster interactions and/or weakens the destabilizing in-cluster interactions, robust clustered states can occur in excitatory networks of all known model neurons. Numerical simulations were carried out to support the analytical results.     

Self-organized dynamics in plastic neural networks: bistability and coherence

 In this paper, we study the combined dynamics of the neural activity and the synaptic efficiency changes in a fully connected network of biologically realistic neurons with simple synaptic plasticity dynamics including both potentiation and depression. Using a mean-field of technique, we analyzed the equilibrium states of neural networks with dynamic synaptic connections and found a class of bistable networks. For this class of networks, one of the stable equilibrium states shows strong connectivity and coherent responses to external input. In the other stable equilibrium, the network is loosely connected and responds non coherently to external input. Transitions between the two states can be achieved by positively or negatively correlated external inputs. Such networks can therefore switch between their phases according to the statistical properties of the external input. Non-coherent input can only “rcad” the state of the network, while a correlated one can change its state. We speculate that this property, specific for plastic neural networks, can give a clue to understand fully unsupervised learning models. Received: 8 August 1999 / Accepted in revised form: 16 March 2000     

Oscillations and Synchrony in Large-scale Cortical Network Models

Intrinsic neuronal and circuit properties control the responses of large ensembles of neurons by creating spatiotemporal patterns of activity that are used for sensory processing, memory formation, and other cognitive tasks. The modeling of such systems requires computationally efficient single-neuron models capable of displaying realistic response properties. We developed a set of reduced models based on difference equations (map-based models) to simulate the intrinsic dynamics of biological neurons. These phenomenological models were designed to capture the main response properties of specific types of neurons while ensuring realistic model behavior across a sufficient dynamic range of inputs. This approach allows for fast simulations and efficient parameter space analysis of networks containing hundreds of thousands of neurons of different types using a conventional workstation. Drawing on results obtained using large-scale networks of map-based neurons, we discuss spatiotemporal cortical network dynamics as a function of parameters that affect synaptic interactions and intrinsic states of the neurons.     

Changing excitation and inhibition in simulated neural networks: effects on induced bursting behavior

 The development of synchronous bursting in neuronal ensembles represents an important change in network behavior. To determine the influences on development of such synchronous bursting behavior we study the dynamics of small networks of sparsely connected excitatory and inhibitory neurons using numerical simulations. The synchronized bursting activities in networks evoked by background spikes are investigated. Specifically, patterns of bursting activity are examined when the balance between excitation and inhibition on neuronal inputs is varied and the fraction of inhibitory neurons in the network is changed. For quantitative comparison of bursting activities in networks, measures of the degree of synchrony are used. We demonstrate how changes in the strength of excitation on inputs of neurons can be compensated by changes in the strength of inhibition without changing the degree of synchrony in the network. The effects of changing several network parameters on the network activity are analyzed and discussed. These changes may underlie the transition of network activity from normal to potentially pathologic (e.g., epileptic) states. Received: 21 May 2002 / Accepted in revised form: 3 December 2002 / Published online: 7 March 2003 Correspondence to: P. Kudela (e-mail: pkudela@jhmi.edu) Acknowledgements. This research was supported by NIH grant NS 38958.     

Physical models of neural networks

The state of art in computer modelling of neural networks with associative memory is reviewed. The available experimental data are considered on learning and memory of small neural systems, on isolated synapses and on molecular level. Computer simulations demonstrate that realistic models of neural ensembles exhibit properties which can be interpreted as image recognition, categorization, learning, prototype forming, etc. A bilayer model of associative neural network is proposed. One layer corresponds to the short-term memory, the other one to the long-term memory. Patterns are stored in terms of the synaptic strength matrix. We have studied the relaxational dynamics of neurons firing and suppression within the short-term memory layer under the influence of the long-term memory layer. The interaction among the layers has found to create a number of novel stable states which are not the learning patterns. These synthetic patterns may consist of elements belonging to different non-intersecting learning patterns. Within the framework of a hypothesis of selective and definite coding of images in brain one can interpret the observed effect as the "idea? generating" process.     

Spontaneous coordinated activity in cultured networks: Analysis of multiple ignition sites,primary circuits,and burst phase delay distributions

All higher order central nervous systems exhibit spontaneous neural activity, though the purpose and mechanistic origin of such activity remains poorly understood. We quantitatively analyzed the ignition and spread of collective spontaneous electrophysiological activity in networks of cultured cortical neurons growing on microelectrode arrays. Leader neurons, which form a mono-synaptically connected primary circuit, and initiate a majority of network bursts were found to be a small subset of recorded neurons. Leader/follower firing delay times formed temporally stable positively skewed distributions. Blocking inhibitory synapses usually resulted in shorter delay times with reduced variance. These distributions are characterizations of general aspects of internal network dynamics and provide estimates of pair-wise synaptic distances. The resulting analysis produced specific quantitative constraints and insights into the activation patterns of collective neuronal activity in self-organized cortical networks, which may prove useful for models emulating spontaneously active systems.     

Structure of spontaneous UP and DOWN transitions self-organizing in a cortical network model

Synaptic plasticity is considered to play a crucial role in the experience-dependent self-organization of local cortical networks. In the absence of sensory stimuli, cerebral cortex exhibits spontaneous membrane potential transitions between an UP and a DOWN state. To reveal how cortical networks develop spontaneous activity, or conversely, how spontaneous activity structures cortical networks, we analyze the self-organization of a recurrent network model of excitatory and inhibitory neurons, which is realistic enough to replicate UP–DOWN states, with spike-timing-dependent plasticity (STDP). The individual neurons in the self-organized network exhibit a variety of temporal patterns in the two-state transitions. In addition, the model develops a feed-forward network-like structure that produces a diverse repertoire of precise sequences of the UP state. Our model shows that the self-organized activity well resembles the spontaneous activity of cortical networks if STDP is accompanied by the pruning of weak synapses. These results suggest that the two-state membrane potential transitions play an active role in structuring local cortical circuits.     

Pacemaker and network mechanisms of rhythm generation: cooperation and competition

The origin of rhythmic activity in brain circuits and CPG-like motor networks is still not fully understood. The main unsolved questions are (i) What are the respective roles of intrinsic bursting and network based dynamics in systems of coupled heterogeneous, intrinsically complex, even chaotic, neurons? (ii) What are the mechanisms underlying the coexistence of robustness and flexibility in the observed rhythmic spatio-temporal patterns? One common view is that particular bursting neurons provide the rhythmogenic component while the connections between different neurons are responsible for the regularisation and synchronisation of groups of neurons and for specific phase relationships in multi-phasic patterns. We have examined the spatio-temporal rhythmic patterns in computer-simulated motif networks of H-H neurons connected by slow inhibitory synapses with a non-symmetric pattern of coupling strengths. We demonstrate that the interplay between intrinsic and network dynamics features either cooperation or competition, depending on three basic control parameters identified in our model: the shape of intrinsic bursts, the strength of the coupling and its degree of asymmetry. The cooperation of intrinsic dynamics and network mechanisms is shown to correlate with bistability, i.e., the coexistence of two different attractors in the phase space of the system corresponding to different rhythmic spatio-temporal patterns. Conversely, if the network mechanism of rhythmogenesis dominates, monostability is observed with a typical pattern of winnerless competition between neurons. We analyse bifurcations between the two regimes and demonstrate how they provide robustness and flexibility to the network performance.     

Memory Capacity of Networks with Stochastic Binary Synapses

In standard attractor neural network models, specific patterns of activity are stored in the synaptic matrix, so that they become fixed point attractors of the network dynamics. The storage capacity of such networks has been quantified in two ways: the maximal number of patterns that can be stored, and the stored information measured in bits per synapse. In this paper, we compute both quantities in fully connected networks of N binary neurons with binary synapses, storing patterns with coding level , in the large and sparse coding limits (). We also derive finite-size corrections that accurately reproduce the results of simulations in networks of tens of thousands of neurons. These methods are applied to three different scenarios: (1) the classic Willshaw model, (2) networks with stochastic learning in which patterns are shown only once (one shot learning), (3) networks with stochastic learning in which patterns are shown multiple times. The storage capacities are optimized over network parameters, which allows us to compare the performance of the different models. We show that finite-size effects strongly reduce the capacity, even for networks of realistic sizes. We discuss the implications of these results for memory storage in the hippocampus and cerebral cortex.     

Biophysical mechanism of the interaction between default mode network and working memory network

Default mode network (DMN) is a functional brain network with a unique neural activity pattern that shows high activity in resting states but low activity in task states. This unique pattern has been proved to relate with higher cognitions such as learning, memory and decision-making. But neural mechanisms of interactions between the default network and the task-related network are still poorly understood. In this paper, a theoretical model of coupling the DMN and working memory network (WMN) is proposed. The WMN and DMN both consist of excitatory and inhibitory neurons connected by AMPA, NMDA, GABA synapses, and are coupled with each other only by excitatory synapses. This model is implemented to demonstrate dynamical processes in a working memory task containing encoding, maintenance and retrieval phases. Simulated results have shown that: (1) AMPA channels could produce significant synchronous oscillations in population neurons, which is beneficial to change oscillation patterns in the WMN and DMN. (2) Different NMDA conductance between the networks could generate multiple neural activity modes in the whole network, which may be an important mechanism to switch states of the networks between three different phases of working memory. (3) The number of sequentially memorized stimuli was related to the energy consumption determined by the network''s internal parameters, and the DMN contributed to a more stable working memory process. (4) Finally, this model demonstrated that, in three phases of working memory, different memory phases corresponded to different functional connections between the DMN and WMN. Coupling strengths that measured these functional connections differed in terms of phase synchronization. Phase synchronization characteristics of the contained energy were consistent with the observations of negative and positive correlations between the WMN and DMN reported in referenced fMRI experiments. The results suggested that the coupled interaction between the WMN and DMN played important roles in working memory.Supplementary InformationThe online version contains supplementary material available at 10.1007/s11571-021-09674-1.     

Composite cortical networks as systems of multimodal oscillators

This paper uses a theory of coordinated firing patterns in local cortical networks to extend the modular view of cortical organization into a theory of the structure of neuroelectric signaling in composite regions of cortex that are the size of association or primary receiving areas. The theory assumes that individual cortical modules signal informational states according to particular modes of locally sustained recurrent reverberations, and that the resultant equilibrium configurations across entire composite cortical regions are determined by excitatory and inhibitory lateral interactions among large numbers of such modules. Rough computer simulation of the theory indicates the influences of the local, regional, and global interconnections and the general character of the composite network patterns. The work builds a tentative theoretical bridge across the structure of neuroelectric signals in single neurons, in local networks, and in composite networks, and indicates possible relationships to neuropsychological representations in composite networks.     

Emergent oscillations in networks of stochastic spiking neurons

Networks of neurons produce diverse patterns of oscillations, arising from the network's global properties, the propensity of individual neurons to oscillate, or a mixture of the two. Here we describe noisy limit cycles and quasi-cycles, two related mechanisms underlying emergent oscillations in neuronal networks whose individual components, stochastic spiking neurons, do not themselves oscillate. Both mechanisms are shown to produce gamma band oscillations at the population level while individual neurons fire at a rate much lower than the population frequency. Spike trains in a network undergoing noisy limit cycles display a preferred period which is not found in the case of quasi-cycles, due to the even faster decay of phase information in quasi-cycles. These oscillations persist in sparsely connected networks, and variation of the network's connectivity results in variation of the oscillation frequency. A network of such neurons behaves as a stochastic perturbation of the deterministic Wilson-Cowan equations, and the network undergoes noisy limit cycles or quasi-cycles depending on whether these have limit cycles or a weakly stable focus. These mechanisms provide a new perspective on the emergence of rhythmic firing in neural networks, showing the coexistence of population-level oscillations with very irregular individual spike trains in a simple and general framework.     

Dynamics of Sparsely Connected Networks of Excitatory and Inhibitory Spiking Neurons

The dynamics of networks of sparsely connected excitatory and inhibitory integrate-and-fire neurons are studied analytically. The analysis reveals a rich repertoire of states, including synchronous states in which neurons fire regularly; asynchronous states with stationary global activity and very irregular individual cell activity; and states in which the global activity oscillates but individual cells fire irregularly, typically at rates lower than the global oscillation frequency. The network can switch between these states, provided the external frequency, or the balance between excitation and inhibition, is varied. Two types of network oscillations are observed. In the fast oscillatory state, the network frequency is almost fully controlled by the synaptic time scale. In the slow oscillatory state, the network frequency depends mostly on the membrane time constant. Finite size effects in the asynchronous state are also discussed.     

Synchronous Clusters in a Noisy Inhibitory Neural Network

We study the stability and information encoding capacity of synchronized states in a neuronal network model that represents part of thalamic circuitry. Our model neurons have a Hodgkin-Huxley-type low-threshold calcium channel, display postinhibitory rebound, and are connected via GABAergic inhibitory synapses.We find that there is a threshold in synaptic strength, _c, below which there are no stable spiking network states. Above threshold the stable spiking state is a cluster state, where different groups of neurons fire consecutively, and each neuron fires with the same cluster each time. Weak noise destabilizes this state, but stronger noise drives the system into a different, self-organized, stochastically synchronized state. Neuronal firing is still organized in clusters, but individual neurons can hop from cluster to cluster. Noise can actually induce and sustain such a state below the threshold of synaptic strength. We do find a qualitative difference in the firing patterns between small (10 neurons) and large (1000 neurons) networks.We determine the information content of the spike trains in terms of two separate contributions: the spike-time jitter around cluster firing times, and the hopping from cluster to cluster. We quantify the information loss due to temporally correlated interspike intervals. Recent experiments on the locust olfactory system and striatal neurons suggest that the nervous system may actually use these two channels to encode separate and unique information.     

Impact of adaptation currents on synchronization of coupled exponential integrate-and-fire neurons

The ability of spiking neurons to synchronize their activity in a network depends on the response behavior of these neurons as quantified by the phase response curve (PRC) and on coupling properties. The PRC characterizes the effects of transient inputs on spike timing and can be measured experimentally. Here we use the adaptive exponential integrate-and-fire (aEIF) neuron model to determine how subthreshold and spike-triggered slow adaptation currents shape the PRC. Based on that, we predict how synchrony and phase locked states of coupled neurons change in presence of synaptic delays and unequal coupling strengths. We find that increased subthreshold adaptation currents cause a transition of the PRC from only phase advances to phase advances and delays in response to excitatory perturbations. Increased spike-triggered adaptation currents on the other hand predominantly skew the PRC to the right. Both adaptation induced changes of the PRC are modulated by spike frequency, being more prominent at lower frequencies. Applying phase reduction theory, we show that subthreshold adaptation stabilizes synchrony for pairs of coupled excitatory neurons, while spike-triggered adaptation causes locking with a small phase difference, as long as synaptic heterogeneities are negligible. For inhibitory pairs synchrony is stable and robust against conduction delays, and adaptation can mediate bistability of in-phase and anti-phase locking. We further demonstrate that stable synchrony and bistable in/anti-phase locking of pairs carry over to synchronization and clustering of larger networks. The effects of adaptation in aEIF neurons on PRCs and network dynamics qualitatively reflect those of biophysical adaptation currents in detailed Hodgkin-Huxley-based neurons, which underscores the utility of the aEIF model for investigating the dynamical behavior of networks. Our results suggest neuronal spike frequency adaptation as a mechanism synchronizing low frequency oscillations in local excitatory networks, but indicate that inhibition rather than excitation generates coherent rhythms at higher frequencies.     

Circuits constructed from identified Aplysia neurons exhibit multiple patterns of persistent activity.

We have used identified neurons from the abdominal ganglion of the mollusc Aplysia to construct and analyze two circuits in vitro. Each of these circuits was capable of producing two patterns of persistent activity; that is, they had bistable output states. The output could be switched between the stable states by a brief, external input. One circuit consisted of cocultured L10 and left upper quadrant (LUQ) neurons that formed reciprocal, inhibitory connections. In one stable state L10 was active and the LUQ was quiescent, whereas in the other stable state L10 was quiescent and the LUQ was active. A second circuit consisted of co-cultured L7 and L12 neurons that formed reciprocal, excitatory connections. In this circuit, both cells were quiescent in one stable state and both cells fired continuously in the other state. Bistable output in both circuits resulted from the nonlinear firing characteristics of each neuron and the feedback between the two neurons. We explored how the stability of the neuronal output could be controlled by the background currents injected into each neuron. We observed a relatively well-defined range of currents for which bistability occurred, consistent with the values expected from the measured strengths of the connections and a simple model. Outside of the range, the output was stable in only a single state. These results suggest how stable patterns of output are produced by some in vivo circuits and how command neurons from higher neural centers may control the activity of these circuits. The criteria that guided us in forming our circuits in culture were derived from theoretical studies on the properties of certain neuronal network models (e.g., Hopfield, J. J. 1984. Proc. Natl. Acad. Sci. USA. 81:3088-3092). Our results show that circuits consisting of only two co-cultured neurons can exhibit bistable output states of the form hypothesized to occur in populations of neurons.     

The frustrated brain: from dynamics on motifs to communities and networks

Cognitive function depends on an adaptive balance between flexible dynamics and integrative processes in distributed cortical networks. Patterns of zero-lag synchrony likely underpin numerous perceptual and cognitive functions. Synchronization fulfils integration by reducing entropy, while adaptive function mandates that a broad variety of stable states be readily accessible. Here, we elucidate two complementary influences on patterns of zero-lag synchrony that derive from basic properties of brain networks. First, mutually coupled pairs of neuronal subsystems—resonance pairs—promote stable zero-lag synchrony among the small motifs in which they are embedded, and whose effects can propagate along connected chains. Second, frustrated closed-loop motifs disrupt synchronous dynamics, enabling metastable configurations of zero-lag synchrony to coexist. We document these two complementary influences in small motifs and illustrate how these effects underpin stable versus metastable phase-synchronization patterns in prototypical modular networks and in large-scale cortical networks of the macaque (CoCoMac). We find that the variability of synchronization patterns depends on the inter-node time delay, increases with the network size and is maximized for intermediate coupling strengths. We hypothesize that the dialectic influences of resonance versus frustration may form a dynamic substrate for flexible neuronal integration, an essential platform across diverse cognitive processes.