Synchronization and Oscillatory Dynamics in Heterogeneous, Mutually Inhibited Neurons

We study some mechanisms responsible for synchronous oscillations and loss of synchrony at physiologically relevant frequencies (10–200 Hz) in a network of heterogeneous inhibitory neurons. We focus on the factors that determine the level of synchrony and frequency of the network response, as well as the effects of mild heterogeneity on network dynamics. With mild heterogeneity, synchrony is never perfect and is relatively fragile. In addition, the effects of inhibition are more complex in mildly heterogeneous networks than in homogeneous ones. In the former, synchrony is broken in two distinct ways, depending on the ratio of the synaptic decay time to the period of repetitive action potentials (_s/T), where T can be determined either from the network or from a single, self-inhibiting neuron. With _s/T > 2, corresponding to large applied current, small synaptic strength or large synaptic decay time, the effects of inhibition are largely tonic and heterogeneous neurons spike relatively independently. With _s/T < 1, synchrony breaks when faster cells begin to suppress their less excitable neighbors; cells that fire remain nearly synchronous. We show numerically that the behavior of mildly heterogeneous networks can be related to the behavior of single, self-inhibiting cells, which can be studied analytically.     

The mechanism of abrupt transition between theta and hyper-excitable spiking activity in medial entorhinal cortex layer II stellate cells

Recent studies have shown that stellate cells (SCs) of the medial entorhinal cortex become hyper-excitable in animal models of temporal lobe epilepsy. These studies have also demonstrated the existence of recurrent connections among SCs, reduced levels of recurrent inhibition in epileptic networks as compared to control ones, and comparable levels of recurrent excitation among SCs in both network types. In this work, we investigate the biophysical and dynamic mechanism of generation of the fast time scale corresponding to hyper-excitable firing and the transition between theta and fast firing frequency activity in SCs. We show that recurrently connected minimal networks of SCs exhibit abrupt, threshold-like transition between theta and hyper-excitable firing frequencies as the result of small changes in the maximal synaptic (AMPAergic) conductance. The threshold required for this transition is modulated by synaptic inhibition. Similar abrupt transition between firing frequency regimes can be observed in single, self-coupled SCs, which represent a network of recurrently coupled neurons synchronized in phase, but not in synaptically isolated SCs as the result of changes in the levels of the tonic drive. Using dynamical systems tools (phase-space analysis), we explain the dynamic mechanism underlying the genesis of the fast time scale and the abrupt transition between firing frequency regimes, their dependence on the intrinsic SC's currents and synaptic excitation. This abrupt transition is mechanistically different from others observed in similar networks with different cell types. Most notably, there is no bistability involved. 'In vitro' experiments using single SCs self-coupled with dynamic clamp show the abrupt transition between firing frequency regimes, and demonstrate that our theoretical predictions are not an artifact of the model. In addition, these experiments show that high-frequency firing is burst-like with a duration modulated by an M-current.     

Long-Term Relationships between Synaptic Tenacity, Synaptic Remodeling, and Network Activity

Synaptic plasticity is widely believed to constitute a key mechanism for modifying functional properties of neuronal networks. This belief implicitly implies, however, that synapses, when not driven to change their characteristics by physiologically relevant stimuli, will maintain these characteristics over time. How tenacious are synapses over behaviorally relevant time scales? To begin to address this question, we developed a system for continuously imaging the structural dynamics of individual synapses over many days, while recording network activity in the same preparations. We found that in spontaneously active networks, distributions of synaptic sizes were generally stable over days. Following individual synapses revealed, however, that the apparently static distributions were actually steady states of synapses exhibiting continual and extensive remodeling. In active networks, large synapses tended to grow smaller, whereas small synapses tended to grow larger, mainly during periods of particularly synchronous activity. Suppression of network activity only mildly affected the magnitude of synaptic remodeling, but dependence on synaptic size was lost, leading to the broadening of synaptic size distributions and increases in mean synaptic size. From the perspective of individual neurons, activity drove changes in the relative sizes of their excitatory inputs, but such changes continued, albeit at lower rates, even when network activity was blocked. Our findings show that activity strongly drives synaptic remodeling, but they also show that significant remodeling occurs spontaneously. Whereas such spontaneous remodeling provides an explanation for “synaptic homeostasis” like processes, it also raises significant questions concerning the reliability of individual synapses as sites for persistently modifying network function.     

Using phase resetting to predict 1:1 and 2:2 locking in two neuron networks in which firing order is not always preserved

Our goal is to understand how nearly synchronous modes arise in heterogenous networks of neurons. In heterogenous networks, instead of exact synchrony, nearly synchronous modes arise, which include both 1:1 and 2:2 phase-locked modes. Existence and stability criteria for 2:2 phase-locked modes in reciprocally coupled two neuron circuits were derived based on the open loop phase resetting curve (PRC) without the assumption of weak coupling. The PRC for each component neuron was generated using the change in synaptic conductance produced by a presynaptic action potential as the perturbation. Separate derivations were required for modes in which the firing order is preserved and for those in which it alternates. Networks composed of two model neurons coupled by reciprocal inhibition were examined to test the predictions. The parameter regimes in which both types of nearly synchronous modes are exhibited were accurately predicted both qualitatively and quantitatively provided that the synaptic time constant is short with respect to the period and that the effect of second order resetting is considered. In contrast, PRC methods based on weak coupling could not predict 2:2 modes and did not predict the 1:1 modes with the level of accuracy achieved by the strong coupling methods. The strong coupling prediction methods provide insight into what manipulations promote near-synchrony in a two neuron network and may also have predictive value for larger networks, which can also manifest changes in firing order. We also identify a novel route by which synchrony is lost in mildly heterogenous networks.     

Modelling the modulation of cortical Up-Down state switching by astrocytes

Up-Down synchronization in neuronal networks refers to spontaneous switches between periods of high collective firing activity (Up state) and periods of silence (Down state). Recent experimental reports have shown that astrocytes can control the emergence of such Up-Down regimes in neural networks, although the molecular or cellular mechanisms that are involved are still uncertain. Here we propose neural network models made of three populations of cells: excitatory neurons, inhibitory neurons and astrocytes, interconnected by synaptic and gliotransmission events, to explore how astrocytes can control this phenomenon. The presence of astrocytes in the models is indeed observed to promote the emergence of Up-Down regimes with realistic characteristics. Our models show that the difference of signalling timescales between astrocytes and neurons (seconds versus milliseconds) can induce a regime where the frequency of gliotransmission events released by the astrocytes does not synchronize with the Up and Down phases of the neurons, but remains essentially stable. However, these gliotransmission events are found to change the localization of the bifurcations in the parameter space so that with the addition of astrocytes, the network enters a bistability region of the dynamics that corresponds to Up-Down synchronization. Taken together, our work provides a theoretical framework to test scenarios and hypotheses on the modulation of Up-Down dynamics by gliotransmission from astrocytes.     

Signal propagation in feedforward neuronal networks with unreliable synapses

In this paper, we systematically investigate both the synfire propagation and firing rate propagation in feedforward neuronal network coupled in an all-to-all fashion. In contrast to most earlier work, where only reliable synaptic connections are considered, we mainly examine the effects of unreliable synapses on both types of neural activity propagation in this work. We first study networks composed of purely excitatory neurons. Our results show that both the successful transmission probability and excitatory synaptic strength largely influence the propagation of these two types of neural activities, and better tuning of these synaptic parameters makes the considered network support stable signal propagation. It is also found that noise has significant but different impacts on these two types of propagation. The additive Gaussian white noise has the tendency to reduce the precision of the synfire activity, whereas noise with appropriate intensity can enhance the performance of firing rate propagation. Further simulations indicate that the propagation dynamics of the considered neuronal network is not simply determined by the average amount of received neurotransmitter for each neuron in a time instant, but also largely influenced by the stochastic effect of neurotransmitter release. Second, we compare our results with those obtained in corresponding feedforward neuronal networks connected with reliable synapses but in a random coupling fashion. We confirm that some differences can be observed in these two different feedforward neuronal network models. Finally, we study the signal propagation in feedforward neuronal networks consisting of both excitatory and inhibitory neurons, and demonstrate that inhibition also plays an important role in signal propagation in the considered networks.     

The role of short-term synaptic dynamics in motor control

During the past few years, much attention has been given to the role of short-term synaptic plasticity, in particular depression and facilitation, in sculpting network activity. A recent study shows that synaptic depression in rhythmic motor networks could switch the control of network frequency from intrinsic neuronal properties to the synaptic dynamics. Short-term synaptic plasticity is also involved in the stabilization and reconfiguration of motor circuits and in the initiation, maintenance and modulation of motor programs.     

Emergence of Connectivity Motifs in Networks of Model Neurons with Short- and Long-Term Plastic Synapses

Recent experimental data from the rodent cerebral cortex and olfactory bulb indicate that specific connectivity motifs are correlated with short-term dynamics of excitatory synaptic transmission. It was observed that neurons with short-term facilitating synapses form predominantly reciprocal pairwise connections, while neurons with short-term depressing synapses form predominantly unidirectional pairwise connections. The cause of these structural differences in excitatory synaptic microcircuits is unknown. We show that these connectivity motifs emerge in networks of model neurons, from the interactions between short-term synaptic dynamics (SD) and long-term spike-timing dependent plasticity (STDP). While the impact of STDP on SD was shown in simultaneous neuronal pair recordings in vitro, the mutual interactions between STDP and SD in large networks are still the subject of intense research. Our approach combines an SD phenomenological model with an STDP model that faithfully captures long-term plasticity dependence on both spike times and frequency. As a proof of concept, we first simulate and analyze recurrent networks of spiking neurons with random initial connection efficacies and where synapses are either all short-term facilitating or all depressing. For identical external inputs to the network, and as a direct consequence of internally generated activity, we find that networks with depressing synapses evolve unidirectional connectivity motifs, while networks with facilitating synapses evolve reciprocal connectivity motifs. We then show that the same results hold for heterogeneous networks, including both facilitating and depressing synapses. This does not contradict a recent theory that proposes that motifs are shaped by external inputs, but rather complements it by examining the role of both the external inputs and the internally generated network activity. Our study highlights the conditions under which SD-STDP might explain the correlation between facilitation and reciprocal connectivity motifs, as well as between depression and unidirectional motifs.     

Variability v.s. synchronicity of neuronal activity in local cortical network models with different wiring topologies

Dynamical behavior of a biological neuronal network depends significantly on the spatial pattern of synaptic connections among neurons. While neuronal network dynamics has extensively been studied with simple wiring patterns, such as all-to-all or random synaptic connections, not much is known about the activity of networks with more complicated wiring topologies. Here, we examined how different wiring topologies may influence the response properties of neuronal networks, paying attention to irregular spike firing, which is known as a characteristic of in vivo cortical neurons, and spike synchronicity. We constructed a recurrent network model of realistic neurons and systematically rewired the recurrent synapses to change the network topology, from a localized regular and a “small-world” network topology to a distributed random network topology. Regular and small-world wiring patterns greatly increased the irregularity or the coefficient of variation (Cv) of output spike trains, whereas such an increase was small in random connectivity patterns. For given strength of recurrent synapses, the firing irregularity exhibited monotonous decreases from the regular to the random network topology. By contrast, the spike coherence between an arbitrary neuron pair exhibited a non-monotonous dependence on the topological wiring pattern. More precisely, the wiring pattern to maximize the spike coherence varied with the strength of recurrent synapses. In a certain range of the synaptic strength, the spike coherence was maximal in the small-world network topology, and the long-range connections introduced in this wiring changed the dependence of spike synchrony on the synaptic strength moderately. However, the effects of this network topology were not really special in other properties of network activity. Action Editor: Xiao-Jing Wang     

Growth rules for the repair of Asynchronous Irregular neuronal networks after peripheral lesions

Several homeostatic mechanisms enable the brain to maintain desired levels of neuronal activity. One of these, homeostatic structural plasticity, has been reported to restore activity in networks disrupted by peripheral lesions by altering their neuronal connectivity. While multiple lesion experiments have studied the changes in neurite morphology that underlie modifications of synapses in these networks, the underlying mechanisms that drive these changes are yet to be explained. Evidence suggests that neuronal activity modulates neurite morphology and may stimulate neurites to selective sprout or retract to restore network activity levels. We developed a new spiking network model of peripheral lesioning and accurately reproduced the characteristics of network repair after deafferentation that are reported in experiments to study the activity dependent growth regimes of neurites. To ensure that our simulations closely resemble the behaviour of networks in the brain, we model deafferentation in a biologically realistic balanced network model that exhibits low frequency Asynchronous Irregular (AI) activity as observed in cerebral cortex. Our simulation results indicate that the re-establishment of activity in neurons both within and outside the deprived region, the Lesion Projection Zone (LPZ), requires opposite activity dependent growth rules for excitatory and inhibitory post-synaptic elements. Analysis of these growth regimes indicates that they also contribute to the maintenance of activity levels in individual neurons. Furthermore, in our model, the directional formation of synapses that is observed in experiments requires that pre-synaptic excitatory and inhibitory elements also follow opposite growth rules. Lastly, we observe that our proposed structural plasticity growth rules and the inhibitory synaptic plasticity mechanism that also balances our AI network both contribute to the restoration of the network to pre-deafferentation stable activity levels.     

Phase-response curves and synchronized neural networks

We review the principal assumptions underlying the application of phase-response curves (PRCs) to synchronization in neuronal networks. The PRC measures how much a given synaptic input perturbs spike timing in a neural oscillator. Among other applications, PRCs make explicit predictions about whether a given network of interconnected neurons will synchronize, as is often observed in cortical structures. Regarding the assumptions of the PRC theory, we conclude: (i) The assumption of noise-tolerant cellular oscillations at or near the network frequency holds in some but not all cases. (ii) Reduced models for PRC-based analysis can be formally related to more realistic models. (iii) Spike-rate adaptation limits PRC-based analysis but does not invalidate it. (iv) The dependence of PRCs on synaptic location emphasizes the importance of improving methods of synaptic stimulation. (v) New methods can distinguish between oscillations that derive from mutual connections and those arising from common drive. (vi) It is helpful to assume linear summation of effects of synaptic inputs; experiments with trains of inputs call this assumption into question. (vii) Relatively subtle changes in network structure can invalidate PRC-based predictions. (viii) Heterogeneity in the preferred frequencies of component neurons does not invalidate PRC analysis, but can annihilate synchronous activity.     

Minimal size of cell assemblies coordinated by gamma oscillations

In networks of excitatory and inhibitory neurons with mutual synaptic coupling, specific drive to sub-ensembles of cells often leads to gamma-frequency (25-100 Hz) oscillations. When the number of driven cells is too small, however, the synaptic interactions may not be strong or homogeneous enough to support the mechanism underlying the rhythm. Using a combination of computational simulation and mathematical analysis, we study the breakdown of gamma rhythms as the driven ensembles become too small, or the synaptic interactions become too weak and heterogeneous. Heterogeneities in drives or synaptic strengths play an important role in the breakdown of the rhythms; nonetheless, we find that the analysis of homogeneous networks yields insight into the breakdown of rhythms in heterogeneous networks. In particular, if parameter values are such that in a homogeneous network, it takes several gamma cycles to converge to synchrony, then in a similar, but realistically heterogeneous network, synchrony breaks down altogether. This leads to the surprising conclusion that in a network with realistic heterogeneity, gamma rhythms based on the interaction of excitatory and inhibitory cell populations must arise either rapidly, or not at all. For given synaptic strengths and heterogeneities, there is a (soft) lower bound on the possible number of cells in an ensemble oscillating at gamma frequency, based simply on the requirement that synaptic interactions between the two cell populations be strong enough. This observation suggests explanations for recent experimental results concerning the modulation of gamma oscillations in macaque primary visual cortex by varying spatial stimulus size or attention level, and for our own experimental results, reported here, concerning the optogenetic modulation of gamma oscillations in kainate-activated hippocampal slices. We make specific predictions about the behavior of pyramidal cells and fast-spiking interneurons in these experiments.     

Bursting Reverberation as a Multiscale Neuronal Network Process Driven by Synaptic Depression-Facilitation

Neuronal networks can generate complex patterns of activity that depend on membrane properties of individual neurons as well as on functional synapses. To decipher the impact of synaptic properties and connectivity on neuronal network behavior, we investigate the responses of neuronal ensembles from small (5–30 cells in a restricted sphere) and large (acute hippocampal slice) networks to single electrical stimulation: in both cases, a single stimulus generated a synchronous long-lasting bursting activity. While an initial spike triggered a reverberating network activity that lasted 2–5 seconds for small networks, we found here that it lasted only up to 300 milliseconds in slices. To explain this phenomena present at different scales, we generalize the depression-facilitation model and extracted the network time constants. The model predicts that the reverberation time has a bell shaped relation with the synaptic density, revealing that the bursting time cannot exceed a maximum value. Furthermore, before reaching its maximum, the reverberation time increases sub-linearly with the synaptic density of the network. We conclude that synaptic dynamics and connectivity shape the mean burst duration, a property present at various scales of the networks. Thus bursting reverberation is a property of sufficiently connected neural networks, and can be generated by collective depression and facilitation of underlying functional synapses.     

Cellularly-driven differences in network synchronization propensity are differentially modulated by firing frequency

Spatiotemporal pattern formation in neuronal networks depends on the interplay between cellular and network synchronization properties. The neuronal phase response curve (PRC) is an experimentally obtainable measure that characterizes the cellular response to small perturbations, and can serve as an indicator of cellular propensity for synchronization. Two broad classes of PRCs have been identified for neurons: Type I, in which small excitatory perturbations induce only advances in firing, and Type II, in which small excitatory perturbations can induce both advances and delays in firing. Interestingly, neuronal PRCs are usually attenuated with increased spiking frequency, and Type II PRCs typically exhibit a greater attenuation of the phase delay region than of the phase advance region. We found that this phenomenon arises from an interplay between the time constants of active ionic currents and the interspike interval. As a result, excitatory networks consisting of neurons with Type I PRCs responded very differently to frequency modulation compared to excitatory networks composed of neurons with Type II PRCs. Specifically, increased frequency induced a sharp decrease in synchrony of networks of Type II neurons, while frequency increases only minimally affected synchrony in networks of Type I neurons. These results are demonstrated in networks in which both types of neurons were modeled generically with the Morris-Lecar model, as well as in networks consisting of Hodgkin-Huxley-based model cortical pyramidal cells in which simulated effects of acetylcholine changed PRC type. These results are robust to different network structures, synaptic strengths and modes of driving neuronal activity, and they indicate that Type I and Type II excitatory networks may display two distinct modes of processing information.     

Adaptive synaptogenesis constructs networks that maintain information and reduce statistical dependence

This report demonstrates the effectiveness of two processes in constructing simple feedforward networks which perform good transformations on their inputs. Good transformations are characterized by the minimization of two information measures: the information loss incurred with the transformation and the statistical dependency of the output. The two processes build appropriate synaptic connections in initially unconnected networks. The first process, synaptogenesis, creates new synaptic connections; the second process, associative synaptic modification, adjusts the connection strength of existing synapses. Synaptogenesis produces additional innervation for each output neuron until each output neuron achieves a firing rate of approximately 0.50. Associative modification of existing synaptic connections lends robustness to network construction by adjusting suboptimal choices of initial synaptic weights. Networks constructed using synaptogenesis and synaptic modification successfully preserve the information content of a variety of inputs. By recording a high-dimensional input into an output of much smaller dimension, these networks drastically reduce the statistical dependence of neuronal representations. Networks constructed with synaptogenesis and associative modification perform good transformations over a wide range of neuron firing thresholds.     

Information processing in neural networks by means of controlled dynamic regimes

This paper is concerned with the modeling of neural systems regarded as information processing entities. I investigate the various dynamic regimes that are accessible in neural networks considered as nonlinear adaptive dynamic systems. The possibilities of obtaining steady, oscillatory or chaotic regimes are illustrated with different neural network models. Some aspects of the dependence of the dynamic regimes upon the synaptic couplings are examined. I emphasize the role that the various regimes may play to support information processing abilities. I present an example where controlled transient evolutions in a neural network, are used to model the regulation of motor activities by the cerebellar cortex.     

Slow Noise in the Period of a Biological Oscillator Underlies Gradual Trends and Abrupt Transitions in Phasic Relationships in Hybrid Neural Networks

In order to study the ability of coupled neural oscillators to synchronize in the presence of intrinsic as opposed to synaptic noise, we constructed hybrid circuits consisting of one biological and one computational model neuron with reciprocal synaptic inhibition using the dynamic clamp. Uncoupled, both neurons fired periodic trains of action potentials. Most coupled circuits exhibited qualitative changes between one-to-one phase-locking with fairly constant phasic relationships and phase slipping with a constant progression in the phasic relationships across cycles. The phase resetting curve (PRC) and intrinsic periods were measured for both neurons, and used to construct a map of the firing intervals for both the coupled and externally forced (PRC measurement) conditions. For the coupled network, a stable fixed point of the map predicted phase locking, and its absence produced phase slipping. Repetitive application of the map was used to calibrate different noise models to simultaneously fit the noise level in the measurement of the PRC and the dynamics of the hybrid circuit experiments. Only a noise model that added history-dependent variability to the intrinsic period could fit both data sets with the same parameter values, as well as capture bifurcations in the fixed points of the map that cause switching between slipping and locking. We conclude that the biological neurons in our study have slowly-fluctuating stochastic dynamics that confer history dependence on the period. Theoretical results to date on the behavior of ensembles of noisy biological oscillators may require re-evaluation to account for transitions induced by slow noise dynamics.     

Two-Cell to N-Cell Heterogeneous,Inhibitory Networks: Precise Linking of Multistable and Coherent Properties

Inhibitory networks are now recognized as being the controllers of several brain rhythms. However, experimental work with inhibitory cells is technically difficult not only because of their smaller percentage of the neuronal population, but also because of their diverse properties. As such, inhibitory network models with tight links to the experimental data are needed to understand their contributions to population rhythms. However, mathematical analyses of network models with more than two cells is challenging when the cellular models involve biophysical details. We use bifurcation analyses and simulations to show that two-cell analyses can quantitatively predict N-cell (N = 20, 50, 100) network dynamics for heterogeneous, inhibitory networks. Interestingly, multistable states in the two-cell system are manifest as different and distinct coherent network patterns in the N-cell networks for the same parameter sets.     

Pseudo-Lyapunov exponents and predictability of Hodgkin-Huxley neuronal network dynamics

We present a numerical analysis of the dynamics of all-to-all coupled Hodgkin-Huxley (HH) neuronal networks with Poisson spike inputs. It is important to point out that, since the dynamical vector of the system contains discontinuous variables, we propose a so-called pseudo-Lyapunov exponent adapted from the classical definition using only continuous dynamical variables, and apply it in our numerical investigation. The numerical results of the largest Lyapunov exponent using this new definition are consistent with the dynamical regimes of the network. Three typical dynamical regimes—asynchronous, chaotic and synchronous, are found as the synaptic coupling strength increases from weak to strong. We use the pseudo-Lyapunov exponent and the power spectrum analysis of voltage traces to characterize the types of the network behavior. In the nonchaotic (asynchronous or synchronous) dynamical regimes, i.e., the weak or strong coupling limits, the pseudo-Lyapunov exponent is negative and there is a good numerical convergence of the solution in the trajectory-wise sense by using our numerical methods. Consequently, in these regimes the evolution of neuronal networks is reliable. For the chaotic dynamical regime with an intermediate strong coupling, the pseudo-Lyapunov exponent is positive, and there is no numerical convergence of the solution and only statistical quantifications of the numerical results are reliable. Finally, we present numerical evidence that the value of pseudo-Lyapunov exponent coincides with that of the standard Lyapunov exponent for systems we have been able to examine.     

How well do mean field theories of spiking quadratic-integrate-and-fire networks work in realistic parameter regimes?

We use mean field techniques to compute the distribution of excitatory and inhibitory firing rates in large networks of randomly connected spiking quadratic integrate and fire neurons. These techniques are based on the assumption that activity is asynchronous and Poisson. For most parameter settings these assumptions are strongly violated; nevertheless, so long as the networks are not too synchronous, we find good agreement between mean field prediction and network simulations. Thus, much of the intuition developed for randomly connected networks in the asynchronous regime applies to mildly synchronous networks.