Synchronization properties of networks of electrically coupled neurons in the presence of noise and heterogeneities

We investigate how synchrony can be generated or induced in networks of electrically coupled integrate-and-fire neurons subject to noisy and heterogeneous inputs. Using analytical tools, we find that in a network under constant external inputs, synchrony can appear via a Hopf bifurcation from the asynchronous state to an oscillatory state. In a homogeneous net work, in the oscillatory state all neurons fire in synchrony, while in a heterogeneous network synchrony is looser, many neurons skipping cycles of the oscillation. If the transmission of action potentials via the electrical synapses is effectively excitatory, the Hopf bifurcation is supercritical, while effectively inhibitory transmission due to pronounced hyperpolarization leads to a subcritical bifurcation. In the latter case, the network exhibits bistability between an asynchronous state and an oscillatory state where all the neurons fire in synchrony. Finally we show that for time-varying external inputs, electrical coupling enhances the synchronization in an asynchronous network via a resonance at the firing-rate frequency.

Self-sustained asynchronous irregular states and Up–Down states in thalamic,cortical and thalamocortical networks of nonlinear integrate-and-fire neurons

Randomly-connected networks of integrate-and-fire (IF) neurons are known to display asynchronous irregular (AI) activity states, which resemble the discharge activity recorded in the cerebral cortex of awake animals. However, it is not clear whether such activity states are specific to simple IF models, or if they also exist in networks where neurons are endowed with complex intrinsic properties similar to electrophysiological measurements. Here, we investigate the occurrence of AI states in networks of nonlinear IF neurons, such as the adaptive exponential IF (Brette-Gerstner-Izhikevich) model. This model can display intrinsic properties such as low-threshold spike (LTS), regular spiking (RS) or fast-spiking (FS). We successively investigate the oscillatory and AI dynamics of thalamic, cortical and thalamocortical networks using such models. AI states can be found in each case, sometimes with surprisingly small network size of the order of a few tens of neurons. We show that the presence of LTS neurons in cortex or in thalamus, explains the robust emergence of AI states for relatively small network sizes. Finally, we investigate the role of spike-frequency adaptation (SFA). In cortical networks with strong SFA in RS cells, the AI state is transient, but when SFA is reduced, AI states can be self-sustained for long times. In thalamocortical networks, AI states are found when the cortex is itself in an AI state, but with strong SFA, the thalamocortical network displays Up and Down state transitions, similar to intracellular recordings during slow-wave sleep or anesthesia. Self-sustained Up and Down states could also be generated by two-layer cortical networks with LTS cells. These models suggest that intrinsic properties such as adaptation and low-threshold bursting activity are crucial for the genesis and control of AI states in thalamocortical networks.     

A computational model of how an interaction between the thalamocortical and thalamic reticular neurons transforms the low-frequency oscillations of the globus pallidus

In Parkinson’s disease, neurons of the internal segment of the globus pallidus (GPi) display the low-frequency tremor-related oscillations. These oscillatory activities are transmitted to the thalamic relay nuclei. Computer models of the interacting thalamocortical (TC) and thalamic reticular (RE) neurons were used to explore how the TC-RE network processes the low-frequency oscillations of the GPi neurons. The simulation results show that, by an interaction between the TC and RE neurons, the TC-RE network transforms a low-frequency oscillatory activity of the GPi neurons to a higher frequency of oscillatory activity of the TC neurons (the superharmonic frequency transformation). In addition to the interaction between the TC and RE neurons, the low-threshold calcium current in the RE and TC neurons and the hyperpolarization-activated cation current (I _h) in the TC neurons have significant roles in the superharmonic frequency transformation property of the TC-RE network. The external globus pallidus (GPe) oscillatory activity, which is directly transmitted to the RE nucleus also displays a significant modulatory effect on the superharmonic frequency transformation property of the TC-RE network. Action Editor: John Rinzel     

Shaping Neuronal Network Activity by Presynaptic Mechanisms

Neuronal microcircuits generate oscillatory activity, which has been linked to basic functions such as sleep, learning and sensorimotor gating. Although synaptic release processes are well known for their ability to shape the interaction between neurons in microcircuits, most computational models do not simulate the synaptic transmission process directly and hence cannot explain how changes in synaptic parameters alter neuronal network activity. In this paper, we present a novel neuronal network model that incorporates presynaptic release mechanisms, such as vesicle pool dynamics and calcium-dependent release probability, to model the spontaneous activity of neuronal networks. The model, which is based on modified leaky integrate-and-fire neurons, generates spontaneous network activity patterns, which are similar to experimental data and robust under changes in the model''s primary gain parameters such as excitatory postsynaptic potential and connectivity ratio. Furthermore, it reliably recreates experimental findings and provides mechanistic explanations for data obtained from microelectrode array recordings, such as network burst termination and the effects of pharmacological and genetic manipulations. The model demonstrates how elevated asynchronous release, but not spontaneous release, synchronizes neuronal network activity and reveals that asynchronous release enhances utilization of the recycling vesicle pool to induce the network effect. The model further predicts a positive correlation between vesicle priming at the single-neuron level and burst frequency at the network level; this prediction is supported by experimental findings. Thus, the model is utilized to reveal how synaptic release processes at the neuronal level govern activity patterns and synchronization at the network level.     

Synchronous and asynchronous bursting states: role of intrinsic neural dynamics

Brain signals such as local field potentials often display gamma-band oscillations (30-70 Hz) in a variety of cognitive tasks. These oscillatory activities possibly reflect synchronization of cell assemblies that are engaged in a cognitive function. A type of pyramidal neurons, i.e., chattering neurons, show fast rhythmic bursting (FRB) in the gamma frequency range, and may play an active role in generating the gamma-band oscillations in the cerebral cortex. Our previous phase response analyses have revealed that the synchronization between the coupled bursting neurons significantly depends on the bursting mode that is defined as the number of spikes in each burst. Namely, a network of neurons bursting through a Ca(2+)-dependent mechanism exhibited sharp transitions between synchronous and asynchronous firing states when the neurons exchanged the bursting mode between singlet, doublet and so on. However, whether a broad class of bursting neuron models commonly show such a network behavior remains unclear. Here, we analyze the mechanism underlying this network behavior using a mathematically tractable neuron model. Then we extend our results to a multi-compartment version of the NaP current-based neuron model and prove a similar tight relationship between the bursting mode changes and the network state changes in this model. Thus, the synchronization behavior couples tightly to the bursting mode in a wide class of networks of bursting neurons.     

Slow oscillations in neural networks with facilitating synapses

The synchronous oscillatory activity characterizing many neurons in a network is often considered to be a mechanism for representing, binding, conveying, and organizing information. A number of models have been proposed to explain high-frequency oscillations, but the mechanisms that underlie slow oscillations are still unclear. Here, we show by means of analytical solutions and simulations that facilitating excitatory (E _f) synapses onto interneurons in a neural network play a fundamental role, not only in shaping the frequency of slow oscillations, but also in determining the form of the up and down states observed in electrophysiological measurements. Short time constants and strong E _f synapse-connectivity were found to induce rapid alternations between up and down states, whereas long time constants and weak E _f synapse connectivity prolonged the time between up states and increased the up state duration. These results suggest a novel role for facilitating excitatory synapses onto interneurons in controlling the form and frequency of slow oscillations in neuronal circuits.     

Sleepy dialogues between cortex and hippocampus: who talks to whom?

During NREM sleep, neocortical neurons undergo near-synchronous transitions, every second or so, between UP states, during which they are depolarized and fire actively, and DOWN states, during which they are hyperpolarized and completely silent. In this issue of Neuron, Isomura et al. report that slow oscillations of membrane potential occur near-synchronously not only in neocortex but also in entorhinal cortex and subiculum. Within the hippocampus proper, pyramidal neurons lack the bistability of UP and DOWN states, but their firing is strongly modulated by cortical activity during the UP state. Intriguingly, many hippocampal neurons fire during the cortical DOWN state. Thus, during sleep UP states, the cortex can talk to the hippocampus, but it is unclear whether the hippocampus talks back.     

Sparse gamma rhythms arising through clustering in adapting neuronal networks

Gamma rhythms (30-100 Hz) are an extensively studied synchronous brain state responsible for a number of sensory, memory, and motor processes. Experimental evidence suggests that fast-spiking interneurons are responsible for carrying the high frequency components of the rhythm, while regular-spiking pyramidal neurons fire sparsely. We propose that a combination of spike frequency adaptation and global inhibition may be responsible for this behavior. Excitatory neurons form several clusters that fire every few cycles of the fast oscillation. This is first shown in a detailed biophysical network model and then analyzed thoroughly in an idealized model. We exploit the fact that the timescale of adaptation is much slower than that of the other variables. Singular perturbation theory is used to derive an approximate periodic solution for a single spiking unit. This is then used to predict the relationship between the number of clusters arising spontaneously in the network as it relates to the adaptation time constant. We compare this to a complementary analysis that employs a weak coupling assumption to predict the first Fourier mode to destabilize from the incoherent state of an associated phase model as the external noise is reduced. Both approaches predict the same scaling of cluster number with respect to the adaptation time constant, which is corroborated in numerical simulations of the full system. Thus, we develop several testable predictions regarding the formation and characteristics of gamma rhythms with sparsely firing excitatory neurons.     

Synchronization without oscillatory neurons

Experimental results suggest that neurons in the cortex synchronize their action potentials on the millisecond time scale. More importantly this binding expresses functional relationships between the neurons. A model of neuronal interactions is proposed in which simultaneous discharges of neurons develop through specialized synaptic circuits. As an important prerequisite for this synchronization it is demonstrated that SynFire chains, generating different levels of excitation, propagate their activity waves at distinct velocities. Two chains were coupled by excitatory synapses and their activity was initiated at different times. Due to synaptic interactions, activity in the earlier-initiated chain accelerates propagation in the other chain until the two activity waves are synchronized. Compared with several neural network models with oscillatory units, physiologically more plausible neurons are simulated. It is still under debate whether neurons in the cortex show oscillatory dischargesper se. In particular, a high rate of noise relative to very weak synaptic gains cannot impair our results in the neural network simulations.     

Spontaneously active cells induce state transitions in a model of olfactory cortex

The existence of neurons with intrinsic oscillations does not in itself explain the synchronization of local populations of neurons, but it is likely to pace population rhythms when the neurons are suitably coupled by chemical and/or electrical synapses. In the present study, we have investigated the role of spontaneously active cells as noisy or pacemaker units in setting global oscillations in a three-layered cortical model. The presence of a small number of noisy (spontaneously active) units induce oscillations at the network level in the range of the gamma rhythm. The number of noisy units in the network and their type (excitatory or inhibitory or excitatory and inhibitory together) determines the emergence of regular oscillations or aperiodic (chaotic) behaviour. It also determines the onset of the global behaviour. On replacing a noisy unit by a pacemaker unit, similar gamma oscillations were generated. With both noisy and pacemaker units, we found that certain characteristics of the spontaneous activity determine the delay period for the onset of global activity. Preliminary studies have been carried out with spontaneously active units having a chaotic dynamics but the results are much similar to that with a noisy burst. Different functional roles have been suggested for cortical oscillations, such as determining global functional states and specifying connectivity during development. Oscillations at different frequency bands, in particular in the gamma band (around 40 Hz), have also been associated with memory and attention. The presence of spontaneously active neurons, either with noisy or oscillatory activity, could be responsible for global oscillations in the absence of external stimuli in certain cortical areas in the mature brain.     

How well do mean field theories of spiking quadratic-integrate-and-fire networks work in realistic parameter regimes?

We use mean field techniques to compute the distribution of excitatory and inhibitory firing rates in large networks of randomly connected spiking quadratic integrate and fire neurons. These techniques are based on the assumption that activity is asynchronous and Poisson. For most parameter settings these assumptions are strongly violated; nevertheless, so long as the networks are not too synchronous, we find good agreement between mean field prediction and network simulations. Thus, much of the intuition developed for randomly connected networks in the asynchronous regime applies to mildly synchronous networks.     

The emergence of Up and Down states in cortical networks

The cerebral cortex is continuously active in the absence of external stimuli. An example of this spontaneous activity is the voltage transition between an Up and a Down state, observed simultaneously at individual neurons. Since this phenomenon could be of critical importance for working memory and attention, its explanation could reveal some fundamental properties of cortical organization. To identify a possible scenario for the dynamics of Up–Down states, we analyze a reduced stochastic dynamical system that models an interconnected network of excitatory neurons with activity-dependent synaptic depression. The model reveals that when the total synaptic connection strength exceeds a certain threshold, the phase space of the dynamical system contains two attractors, interpreted as Up and Down states. In that case, synaptic noise causes transitions between the states. Moreover, an external stimulation producing a depolarization increases the time spent in the Up state, as observed experimentally. We therefore propose that the existence of Up–Down states is a fundamental and inherent property of a noisy neural ensemble with sufficiently strong synaptic connections.     

Structure of spontaneous UP and DOWN transitions self-organizing in a cortical network model

Synaptic plasticity is considered to play a crucial role in the experience-dependent self-organization of local cortical networks. In the absence of sensory stimuli, cerebral cortex exhibits spontaneous membrane potential transitions between an UP and a DOWN state. To reveal how cortical networks develop spontaneous activity, or conversely, how spontaneous activity structures cortical networks, we analyze the self-organization of a recurrent network model of excitatory and inhibitory neurons, which is realistic enough to replicate UP–DOWN states, with spike-timing-dependent plasticity (STDP). The individual neurons in the self-organized network exhibit a variety of temporal patterns in the two-state transitions. In addition, the model develops a feed-forward network-like structure that produces a diverse repertoire of precise sequences of the UP state. Our model shows that the self-organized activity well resembles the spontaneous activity of cortical networks if STDP is accompanied by the pruning of weak synapses. These results suggest that the two-state membrane potential transitions play an active role in structuring local cortical circuits.     

Oscillations and Irregular Emission in Networks of Linear Spiking Neurons

The dynamics of a network of randomly connected inhibitory linear integrate and fire (LIF) neurons (with a floor for the depolarization), in the presence of stochastic external afferent input, is considered in various parameter regimes of the neurons and of the network. Applying a technique recently introduced by Brunel and Hakim, we classify the regimes in which such a network has stable stationary states and in which spike emission rates oscillate. In the vicinity of the bifurcation line, the oscillation frequency and its amplitude are computed and compared with simulations. As for leaky IF neurons, the space of parameters can be compacted into two. Yet despite significant technical differences between the two models, related to both the different dynamics of the depolarization as well as to the different boundary conditions, the qualitative behavior is rather similar. The significance of LIF neurons and of the differences with leaky IF neurons is discussed.     

Effect of the topology and delayed interactions in neuronal networks synchronization

As important as the intrinsic properties of an individual nervous cell stands the network of neurons in which it is embedded and by virtue of which it acquires great part of its responsiveness and functionality. In this study we have explored how the topological properties and conduction delays of several classes of neural networks affect the capacity of their constituent cells to establish well-defined temporal relations among firing of their action potentials. This ability of a population of neurons to produce and maintain a millisecond-precise coordinated firing (either evoked by external stimuli or internally generated) is central to neural codes exploiting precise spike timing for the representation and communication of information. Our results, based on extensive simulations of conductance-based type of neurons in an oscillatory regime, indicate that only certain topologies of networks allow for a coordinated firing at a local and long-range scale simultaneously. Besides network architecture, axonal conduction delays are also observed to be another important factor in the generation of coherent spiking. We report that such communication latencies not only set the phase difference between the oscillatory activity of remote neural populations but determine whether the interconnected cells can set in any coherent firing at all. In this context, we have also investigated how the balance between the network synchronizing effects and the dispersive drift caused by inhomogeneities in natural firing frequencies across neurons is resolved. Finally, we show that the observed roles of conduction delays and frequency dispersion are not particular to canonical networks but experimentally measured anatomical networks such as the macaque cortical network can display the same type of behavior.     

Bistable,Irregular Firing and Population Oscillations in a Modular Attractor Memory Network

Attractor neural networks are thought to underlie working memory functions in the cerebral cortex. Several such models have been proposed that successfully reproduce firing properties of neurons recorded from monkeys performing working memory tasks. However, the regular temporal structure of spike trains in these models is often incompatible with experimental data. Here, we show that the in vivo observations of bistable activity with irregular firing at the single cell level can be achieved in a large-scale network model with a modular structure in terms of several connected hypercolumns. Despite high irregularity of individual spike trains, the model shows population oscillations in the beta and gamma band in ground and active states, respectively. Irregular firing typically emerges in a high-conductance regime of balanced excitation and inhibition. Population oscillations can produce such a regime, but in previous models only a non-coding ground state was oscillatory. Due to the modular structure of our network, the oscillatory and irregular firing was maintained also in the active state without fine-tuning. Our model provides a novel mechanistic view of how irregular firing emerges in cortical populations as they go from beta to gamma oscillations during memory retrieval.     

Transient information flow in a network of excitatory and inhibitory model neurons: Role of noise and signal autocorrelation

We investigate the performance of sparsely-connected networks of integrate-and-fire neurons for ultra-short term information processing. We exploit the fact that the population activity of networks with balanced excitation and inhibition can switch from an oscillatory firing regime to a state of asynchronous irregular firing or quiescence depending on the rate of external background spikes. We find that in terms of information buffering the network performs best for a moderate, non-zero, amount of noise. Analogous to the phenomenon of stochastic resonance the performance decreases for higher and lower noise levels. The optimal amount of noise corresponds to the transition zone between a quiescent state and a regime of stochastic dynamics. This provides a potential explanation of the role of non-oscillatory population activity in a simplified model of cortical micro-circuits.     

Synchronous Clusters in a Noisy Inhibitory Neural Network

We study the stability and information encoding capacity of synchronized states in a neuronal network model that represents part of thalamic circuitry. Our model neurons have a Hodgkin-Huxley-type low-threshold calcium channel, display postinhibitory rebound, and are connected via GABAergic inhibitory synapses.We find that there is a threshold in synaptic strength, _c, below which there are no stable spiking network states. Above threshold the stable spiking state is a cluster state, where different groups of neurons fire consecutively, and each neuron fires with the same cluster each time. Weak noise destabilizes this state, but stronger noise drives the system into a different, self-organized, stochastically synchronized state. Neuronal firing is still organized in clusters, but individual neurons can hop from cluster to cluster. Noise can actually induce and sustain such a state below the threshold of synaptic strength. We do find a qualitative difference in the firing patterns between small (10 neurons) and large (1000 neurons) networks.We determine the information content of the spike trains in terms of two separate contributions: the spike-time jitter around cluster firing times, and the hopping from cluster to cluster. We quantify the information loss due to temporally correlated interspike intervals. Recent experiments on the locust olfactory system and striatal neurons suggest that the nervous system may actually use these two channels to encode separate and unique information.     

Active hippocampal networks undergo spontaneous synaptic modification

The brain is self-writable; as the brain voluntarily adapts itself to a changing environment, the neural circuitry rearranges its functional connectivity by referring to its own activity. How the internal activity modifies synaptic weights is largely unknown, however. Here we report that spontaneous activity causes complex reorganization of synaptic connectivity without any external (or artificial) stimuli. Under physiologically relevant ionic conditions, CA3 pyramidal cells in hippocampal slices displayed spontaneous spikes with bistable slow oscillations of membrane potential, alternating between the so-called UP and DOWN states. The generation of slow oscillations did not require fast synaptic transmission, but their patterns were coordinated by local circuit activity. In the course of generating spontaneous activity, individual neurons acquired bidirectional long-lasting synaptic modification. The spontaneous synaptic plasticity depended on a rise in intracellular calcium concentrations of postsynaptic cells, but not on NMDA receptor activity. The direction and amount of the plasticity varied depending on slow oscillation patterns and synapse locations, and thus, they were diverse in a network. Once this global synaptic refinement occurred, the same neurons now displayed different patterns of spontaneous activity, which in turn exhibited different levels of synaptic plasticity. Thus, active networks continuously update their internal states through ongoing synaptic plasticity. With computational simulations, we suggest that with this slow oscillation-induced plasticity, a recurrent network converges on a more specific state, compared to that with spike timing-dependent plasticity alone.     

Cortical Resonance Frequencies Emerge from Network Size and Connectivity

Neural oscillations occur within a wide frequency range with different brain regions exhibiting resonance-like characteristics at specific points in the spectrum. At the microscopic scale, single neurons possess intrinsic oscillatory properties, such that is not yet known whether cortical resonance is consequential to neural oscillations or an emergent property of the networks that interconnect them. Using a network model of loosely-coupled Wilson-Cowan oscillators to simulate a patch of cortical sheet, we demonstrate that the size of the activated network is inversely related to its resonance frequency. Further analysis of the parameter space indicated that the number of excitatory and inhibitory connections, as well as the average transmission delay between units, determined the resonance frequency. The model predicted that if an activated network within the visual cortex increased in size, the resonance frequency of the network would decrease. We tested this prediction experimentally using the steady-state visual evoked potential where we stimulated the visual cortex with different size stimuli at a range of driving frequencies. We demonstrate that the frequency corresponding to peak steady-state response inversely correlated with the size of the network. We conclude that although individual neurons possess resonance properties, oscillatory activity at the macroscopic level is strongly influenced by network interactions, and that the steady-state response can be used to investigate functional networks.