Oscillations and waves in the models of interactive neural populations

The dynamics of activity in interactive neural populations is simulated by the networks of Wilson–Cowan oscillators. Two extreme cases of connection architectures in the networks are considered: (1) 1D and 2D regular and homogeneous grids with local connections and (2) sparse random coupling. Propagating waves in the network have been found under the stationary external input and the regime of partial synchronization has been obtained for the periodic input. It has been shown that in the case of random coupling about 60% of neural populations demonstrate oscillatory activity and some of these oscillations are synchronous. The role of different types of dynamics in information processing is discussed. In particular, we discuss the regime of partial synchronization in the context of cortical microcircuits.     

Oscillations and waves in the models of interactive neural populations

The dynamics of activity in interactive neural populations is simulated by the networks of Wilson-Cowan oscillators. Two extreme cases of connection architectures in the networks are considered: (1) 1D and 2D regular and homogeneous grids with local connections and (2) sparse random coupling. Propagating waves in the network have been found under the stationary external input and the regime of partial synchronization has been obtained for the periodic input. It has been shown that in the case of random coupling about 60% of neural populations demonstrate oscillatory activity and some of these oscillations are synchronous. The role of different types of dynamics in information processing is discussed. In particular, we discuss the regime of partial synchronization in the context of cortical microcircuits.     

Dynamics and bifurcations of two coupled neural oscillators with different connection types

In this paper we present an oscillatory neural network composed of two coupled neural oscillators of the Wilson-Cowan type. Each of the oscillators describes the dynamics of average activities of excitatory and inhibitory populations of neurons. The network serves as a model for several possible network architectures. We study how the type and the strength of the connections between the oscillators affect the dynamics of the neural network. We investigate, separately from each other, four possible connection types (excitatory→excitatory, excitatory→inhibitory, inhibitory→excitatory, and inhibitory→inhibitory) and compute the corresponding bifurcation diagrams. In case of weak connections (small strength), the connection of populations of different types lead to periodicin-phase oscillations, while the connection of populations of the same type lead to periodicanti-phase oscillations. For intermediate connection strengths, the networks can enter quasiperiodic or chaotic regimes, and can also exhibit multistability. More generally, our analysis highlights the great diversity of the response of neural networks to a change of the connection strength, for different connection architectures. In the discussion, we address in particular the problem of information coding in the brain using quasiperiodic and chaotic oscillations. In modeling low levels of information processing, we propose that feature binding should be sought as a temporally coherent phase-locking of neural activity. This phase-locking is provided by one or more interacting convergent zones and does not require a central “top level” subcortical circuit (e.g. the septo-hippocampal system). We build a two layer model to show that although the application of a complex stimulus usually leads to different convergent zones with high frequency oscillations, it is nevertheless possible to synchronize these oscillations at a lower frequency level using envelope oscillations. This is interpreted as a feature binding of a complex stimulus.     

Emergence of Functional Specificity in Balanced Networks with Synaptic Plasticity

In rodent visual cortex, synaptic connections between orientation-selective neurons are unspecific at the time of eye opening, and become to some degree functionally specific only later during development. An explanation for this two-stage process was proposed in terms of Hebbian plasticity based on visual experience that would eventually enhance connections between neurons with similar response features. For this to work, however, two conditions must be satisfied: First, orientation selective neuronal responses must exist before specific recurrent synaptic connections can be established. Second, Hebbian learning must be compatible with the recurrent network dynamics contributing to orientation selectivity, and the resulting specific connectivity must remain stable for unspecific background activity. Previous studies have mainly focused on very simple models, where the receptive fields of neurons were essentially determined by feedforward mechanisms, and where the recurrent network was small, lacking the complex recurrent dynamics of large-scale networks of excitatory and inhibitory neurons. Here we studied the emergence of functionally specific connectivity in large-scale recurrent networks with synaptic plasticity. Our results show that balanced random networks, which already exhibit highly selective responses at eye opening, can develop feature-specific connectivity if appropriate rules of synaptic plasticity are invoked within and between excitatory and inhibitory populations. If these conditions are met, the initial orientation selectivity guides the process of Hebbian learning and, as a result, functionally specific and a surplus of bidirectional connections emerge. Our results thus demonstrate the cooperation of synaptic plasticity and recurrent dynamics in large-scale functional networks with realistic receptive fields, highlight the role of inhibition as a critical element in this process, and paves the road for further computational studies of sensory processing in neocortical network models equipped with synaptic plasticity.     

High-frequency oscillations and sequence generation in two-population models of hippocampal region CA1

Hippocampal sharp wave/ripple oscillations are a prominent pattern of collective activity, which consists of a strong overall increase of activity with superimposed (140 − 200 Hz) ripple oscillations. Despite its prominence and its experimentally demonstrated importance for memory consolidation, the mechanisms underlying its generation are to date not understood. Several models assume that recurrent networks of inhibitory cells alone can explain the generation and main characteristics of the ripple oscillations. Recent experiments, however, indicate that in addition to inhibitory basket cells, the pattern requires in vivo the activity of the local population of excitatory pyramidal cells. Here, we study a model for networks in the hippocampal region CA1 incorporating such a local excitatory population of pyramidal neurons. We start by investigating its ability to generate ripple oscillations using extensive simulations. Using biologically plausible parameters, we find that short pulses of external excitation triggering excitatory cell spiking are required for sharp/wave ripple generation with oscillation patterns similar to in vivo observations. Our model has plausible values for single neuron, synapse and connectivity parameters, random connectivity and no strong feedforward drive to the inhibitory population. Specifically, whereas temporally broad excitation can lead to high-frequency oscillations in the ripple range, sparse pyramidal cell activity is only obtained with pulse-like external CA3 excitation. Further simulations indicate that such short pulses could originate from dendritic spikes in the apical or basal dendrites of CA1 pyramidal cells, which are triggered by coincident spike arrivals from hippocampal region CA3. Finally we show that replay of sequences by pyramidal neurons and ripple oscillations can arise intrinsically in CA1 due to structured connectivity that gives rise to alternating excitatory pulse and inhibitory gap coding; the latter denotes phases of silence in specific basket cell groups, which induce selective disinhibition of groups of pyramidal neurons. This general mechanism for sequence generation leads to sparse pyramidal cell and dense basket cell spiking, does not rely on synfire chain-like feedforward excitation and may be relevant for other brain regions as well.     

Fast and robust image segmentation by small-world neural oscillator networks

Inspired by the temporal correlation theory of brain functions, researchers have presented a number of neural oscillator networks to implement visual scene segmentation problems. Recently, it is shown that many biological neural networks are typical small-world networks. In this paper, we propose and investigate two small-world models derived from the well-known LEGION (locally excitatory and globally inhibitory oscillator network) model. To form a small-world network, we add a proper proportion of unidirectional shortcuts (random long-range connections) to the original LEGION model. With local connections and shortcuts, the neural oscillators can not only communicate with neighbors but also exchange phase information with remote partners. Model 1 introduces excitatory shortcuts to enhance the synchronization within an oscillator group representing the same object. Model 2 goes further to replace the global inhibitor with a sparse set of inhibitory shortcuts. Simulation results indicate that the proposed small-world models could achieve synchronization faster than the original LEGION model and are more likely to bind disconnected image regions belonging together. In addition, we argue that these two models are more biologically plausible.     

Models of cortical networks with long-range patchy projections

The cortex exhibits an intricate vertical and horizontal architecture, the latter often featuring spatially clustered projection patterns, so-called patches. Many network studies of cortical dynamics ignore such spatial structures and assume purely random wiring. Here, we focus on non-random network structures provided by long-range horizontal (patchy) connections that remain inside the gray matter. We investigate how the spatial arrangement of patchy projections influences global network topology and predict its impact on the activity dynamics of the network. Since neuroanatomical data on horizontal projections is rather sparse, we suggest and compare four candidate scenarios of how patchy connections may be established. To identify a set of characteristic network properties that enables us to pin down the differences between the resulting network models, we employ the framework of stochastic graph theory. We find that patchy projections provide an exceptionally efficient way of wiring, as the resulting networks tend to exhibit small-world properties with significantly reduced wiring costs. Furthermore, the eigenvalue spectra, as well as the structure of common in- and output of the networks suggest that different spatial connectivity patterns support distinct types of activity propagation.     

A neural network model for trace conditioning

We studied the dynamics of a neural network that has both recurrent excitatory and random inhibitory connections. Neurons started to become active when a relatively weak transient excitatory signal was presented and the activity was sustained due to the recurrent excitatory connections. The sustained activity stopped when a strong transient signal was presented or when neurons were disinhibited. The random inhibitory connections modulated the activity patterns of neurons so that the patterns evolved without recurrence with time. Hence, a time passage between the onsets of the two transient signals was represented by the sequence of activity patterns. We then applied this model to represent the trace eye blink conditioning, which is mediated by the hippocampus. We assumed this model as CA3 of the hippocampus and considered an output neuron corresponding to a neuron in CA1. The activity pattern of the output neuron was similar to that of CA1 neurons during trace eye blink conditioning, which was experimentally observed.     

Parkinsonian tremor and simplification in network dynamics

We explore the behavior of richly connected inhibitory neural networks under parameter changes that correspond to weakening of synaptic efficacies between network units, and show that transitions from irregular to periodic dynamics are common in such systems. The weakening of these connections leads to a reduction in the number of units that effectively drive the dynamics and thus to simpler behavior. We hypothesize that the multiple interconnecting loops of the brain’s motor circuitry, which involve many inhibitory connections, exhibit such transitions. Normal physiological tremor is irregular while other forms of tremor show more regular oscillations. Tremor in Parkinson’s disease, for example, stems from weakened synaptic efficacies of dopaminergic neurons in the nigro-striatal pathway, as in our general model. The multiplicity of structures involved in the production of symptoms in Parkinson’s disease and the reversibility of symptoms by pharmacological and surgical manipulation of connection parameters suggest that such a neural network model is appropriate. Furthermore, fixed points that can occur in the network models are suggestive of akinesia in Parkinson’s disease. This model is consistent with the view that normal physiological systems can be regulated by robust and richly connected feedback networks with complex dynamics, and that loss of complexity in the feedback structure due to disease leads to more orderly behavior.     

The impact of sparsity in low-rank recurrent neural networks

Neural population dynamics are often highly coordinated, allowing task-related computations to be understood as neural trajectories through low-dimensional subspaces. How the network connectivity and input structure give rise to such activity can be investigated with the aid of low-rank recurrent neural networks, a recently-developed class of computational models which offer a rich theoretical framework linking the underlying connectivity structure to emergent low-dimensional dynamics. This framework has so far relied on the assumption of all-to-all connectivity, yet cortical networks are known to be highly sparse. Here we investigate the dynamics of low-rank recurrent networks in which the connections are randomly sparsified, which makes the network connectivity formally full-rank. We first analyse the impact of sparsity on the eigenvalue spectrum of low-rank connectivity matrices, and use this to examine the implications for the dynamics. We find that in the presence of sparsity, the eigenspectra in the complex plane consist of a continuous bulk and isolated outliers, a form analogous to the eigenspectra of connectivity matrices composed of a low-rank and a full-rank random component. This analogy allows us to characterise distinct dynamical regimes of the sparsified low-rank network as a function of key network parameters. Altogether, we find that the low-dimensional dynamics induced by low-rank connectivity structure are preserved even at high levels of sparsity, and can therefore support rich and robust computations even in networks sparsified to a biologically-realistic extent.     

Dynamical coding of sensory information with competitive networks.

Based on experiments with the locust olfactory system, we demonstrate that model sensory neural networks with lateral inhibition can generate stimulus specific identity-temporal patterns in the form of stimulus-dependent switching among small and dynamically changing neural ensembles (each ensemble being a group of synchronized projection neurons). Networks produce this switching mode of dynamical activity when lateral inhibitory connections are strongly non-symmetric. Such coding uses 'winner-less competitive' (WLC) dynamics. In contrast to the well known winner-take-all competitive (WTA) networks and Hopfield nets, winner-less competition represents sensory information dynamically. Such dynamics are reproducible, robust against intrinsic noise and sensitive to changes in the sensory input. We demonstrate the validity of sensory coding with WLC networks using two different formulations of the dynamics, namely the average and spiking dynamics of projection neurons (PN).     

Emergence and fragmentation of the alpha-band driven by neuronal network dynamics

Rhythmic neuronal network activity underlies brain oscillations. To investigate how connected neuronal networks contribute to the emergence of the α-band and to the regulation of Up and Down states, we study a model based on synaptic short-term depression-facilitation with afterhyperpolarization (AHP). We found that the α-band is generated by the network behavior near the attractor of the Up-state. Coupling inhibitory and excitatory networks by reciprocal connections leads to the emergence of a stable α-band during the Up states, as reflected in the spectrogram. To better characterize the emergence and stability of thalamocortical oscillations containing α and δ rhythms during anesthesia, we model the interaction of two excitatory networks with one inhibitory network, showing that this minimal topology underlies the generation of a persistent α-band in the neuronal voltage characterized by dominant Up over Down states. Finally, we show that the emergence of the α-band appears when external inputs are suppressed, while fragmentation occurs at small synaptic noise or with increasing inhibitory inputs. To conclude, α-oscillations could result from the synaptic dynamics of interacting excitatory neuronal networks with and without AHP, a principle that could apply to other rhythms.     

The dynamics of sparse random networks

Recurrent neural networks with full symmetric connectivity have been extensively studied as associative memories and pattern recognition devices. However, there is considerable evidence that sparse, asymmetrically connected, mainly excitatory networks with broadly directed inhibition are more consistent with biological reality. In this paper, we use the technique of return maps to study the dynamics of random networks with sparse, asymmetric connectivity and nonspecific inhibition. These networks show three qualitatively different kinds of behavior: fixed points, cycles of low period, and extremely long cycles verging on aperiodicity. Using statistical arguments, we relate these behaviors to network parameters and present empirical evidence for the accuracy of this statistical model. The model, in turn, leads to methods for controlling the level of activity in networks. Studying random, untrained networks provides an understanding of the intrinsic dynamics of these systems. Such dynamics could provide a substrate for the much more complex behavior shown when synaptic modification is allowed.     

Effects of Hebbian learning on the dynamics and structure of random networks with inhibitory and excitatory neurons

The aim of the present paper is to study the effects of Hebbian learning in random recurrent neural networks with biological connectivity, i.e. sparse connections and separate populations of excitatory and inhibitory neurons. We furthermore consider that the neuron dynamics may occur at a (shorter) time scale than synaptic plasticity and consider the possibility of learning rules with passive forgetting. We show that the application of such Hebbian learning leads to drastic changes in the network dynamics and structure. In particular, the learning rule contracts the norm of the weight matrix and yields a rapid decay of the dynamics complexity and entropy. In other words, the network is rewired by Hebbian learning into a new synaptic structure that emerges with learning on the basis of the correlations that progressively build up between neurons. We also observe that, within this emerging structure, the strongest synapses organize as a small-world network. The second effect of the decay of the weight matrix spectral radius consists in a rapid contraction of the spectral radius of the Jacobian matrix. This drives the system through the "edge of chaos" where sensitivity to the input pattern is maximal. Taken together, this scenario is remarkably predicted by theoretical arguments derived from dynamical systems and graph theory.     

The locust olfactory system as a case study for modeling dynamics of neurobiological networks: from discrete time neurons to continuous time neurons

Both chaotic and periodic activities are observed in networks of the central nervous systems. We choose the locust olfactory system as a good case study to analyze the relationships between networks' structure and the types of dynamics involved in coding mechanisms. In our modeling approach, we first build a fully connected recurrent network of synchronously updated McCulloch and Pitts neurons (MC-P type). In order to measure the use of the temporal dimension in the complex spatio-temporal patterns produced by the networks, we have defined an index the Normalized Euclidian Distance NED. We find that for appropriate parameters of input and connectivity, when adding some strong connections to the initial random synaptic matrices, it was easy to get the emergence of both robust oscillations and distributed synchrony in the spatiotemporal patterns. Then, in order to validate the MC-P model as a tool for analysis for network properties, we examine the dynamic behavior of networks of continuous time model neuron (Izhikevitch Integrate and Fire model -IFI-), implementing the same network characteristics. In both models, similarly to biological PN, the activity of excitatory neurons are phase-locked to different cycles of oscillations which remind the ones of the local field potential (LFP), and nevertheless exhibit dynamic behavior complex enough to be the basis of spatio-temporal codes.     

Cell Assembly Dynamics of Sparsely-Connected Inhibitory Networks: A Simple Model for the Collective Activity of Striatal Projection Neurons

Striatal projection neurons form a sparsely-connected inhibitory network, and this arrangement may be essential for the appropriate temporal organization of behavior. Here we show that a simplified, sparse inhibitory network of Leaky-Integrate-and-Fire neurons can reproduce some key features of striatal population activity, as observed in brain slices. In particular we develop a new metric to determine the conditions under which sparse inhibitory networks form anti-correlated cell assemblies with time-varying activity of individual cells. We find that under these conditions the network displays an input-specific sequence of cell assembly switching, that effectively discriminates similar inputs. Our results support the proposal that GABAergic connections between striatal projection neurons allow stimulus-selective, temporally-extended sequential activation of cell assemblies. Furthermore, we help to show how altered intrastriatal GABAergic signaling may produce aberrant network-level information processing in disorders such as Parkinson’s and Huntington’s diseases.     

How structure determines correlations in neuronal networks

Networks are becoming a ubiquitous metaphor for the understanding of complex biological systems, spanning the range between molecular signalling pathways, neural networks in the brain, and interacting species in a food web. In many models, we face an intricate interplay between the topology of the network and the dynamics of the system, which is generally very hard to disentangle. A dynamical feature that has been subject of intense research in various fields are correlations between the noisy activity of nodes in a network. We consider a class of systems, where discrete signals are sent along the links of the network. Such systems are of particular relevance in neuroscience, because they provide models for networks of neurons that use action potentials for communication. We study correlations in dynamic networks with arbitrary topology, assuming linear pulse coupling. With our novel approach, we are able to understand in detail how specific structural motifs affect pairwise correlations. Based on a power series decomposition of the covariance matrix, we describe the conditions under which very indirect interactions will have a pronounced effect on correlations and population dynamics. In random networks, we find that indirect interactions may lead to a broad distribution of activation levels with low average but highly variable correlations. This phenomenon is even more pronounced in networks with distance dependent connectivity. In contrast, networks with highly connected hubs or patchy connections often exhibit strong average correlations. Our results are particularly relevant in view of new experimental techniques that enable the parallel recording of spiking activity from a large number of neurons, an appropriate interpretation of which is hampered by the currently limited understanding of structure-dynamics relations in complex networks.     

Emergent Oscillations in a Realistic Network: The Role of Inhibition and the Effect of the Spatiotemporal Distribution of the Input

We have simulated a network of 10,000 two-compartment cells, spatially distributed on a two-dimensional sheet; 15% of the cells were inhibitory. The input to the network was spatially delimited. Global oscillations frequently were achieved with a simple set of connectivity rules. The inhibitory neurons paced the network, whereas the excitatory neurons amplified the input, permitting oscillations at low-input intensities. Inhibitory neurons were active over a greater area than excitatory ones, forming a ring of inhibition. The oscillation frequency was modulated to some extent by the input intensity, as has been shown experimentally in the striate cortex, but predominantly by the properties of the inhibitory neurons and their connections: the membrane and synaptic time constants and the distribution of delays.In networks that showed oscillations and in those that did not, widely distributed inputs could lead to the specific recruitment of the inhibitory neurons and to near zero activity of the excitatory cells. Hence the spatial distribution of excitatory inputs could provide a means of selectively exciting or inhibiting a target network. Finally, neither the presence of oscillations nor the global spike activity provided any reliable indication of the level of excitatory output from the network.     

Emergent oscillations in a realistic network: the role of inhibition and the effect of the spatiotemporal distribution of the input.

We have simulated a network of 10,000 two-compartment cells, spatially distributed on a two-dimensional sheet; 15% of the cells were inhibitory. The input to the network was spatially delimited. Global oscillations frequently were achieved with a simple set of connectivity rules. The inhibitory neurons paced the network, whereas the excitatory neurons amplified the input, permitting oscillations at low-input intensities. Inhibitory neurons were active over a greater area than excitatory ones, forming a ring of inhibition. The oscillation frequency was modulated to some extent by the input intensity, as has been shown experimentally in the striate cortex, but predominantly by the properties of the inhibitory neurons and their connections: the membrane and synaptic time constants and the distribution of delays. In networks that showed oscillations and in those that did not, widely distributed inputs could lead to the specific recruitment of the inhibitory neurons and to near zero activity of the excitatory cells. Hence the spatial distribution of excitatory inputs could provide a means of selectively exciting or inhibiting a target network. Finally, neither the presence of oscillations nor the global spike activity provided any reliable indication of the level of excitatory output from the network.