Effects of Poisson noise in a IF model with STDP and spontaneous replay of periodic spatiotemporal patterns,in absence of cue stimulation

We consider a network of leaky integrate and fire neurons, whose learning mechanism is based on the Spike-Timing-Dependent Plasticity. The spontaneous temporal dynamic of the system is studied, including its storage and replay properties, when a Poissonian noise is added to the post-synaptic potential of the units. The temporal patterns stored in the network are periodic spatiotemporal patterns of spikes. We observe that, even in absence of a cue stimulation, the spontaneous dynamics induced by the noise is a sort of intermittent replay of the patterns stored in the connectivity and a phase transition between a replay and non-replay regime exists at a critical value of the spiking threshold. We characterize this transition by measuring the order parameter and its fluctuations.     

The emergence of Up and Down states in cortical networks

The cerebral cortex is continuously active in the absence of external stimuli. An example of this spontaneous activity is the voltage transition between an Up and a Down state, observed simultaneously at individual neurons. Since this phenomenon could be of critical importance for working memory and attention, its explanation could reveal some fundamental properties of cortical organization. To identify a possible scenario for the dynamics of Up–Down states, we analyze a reduced stochastic dynamical system that models an interconnected network of excitatory neurons with activity-dependent synaptic depression. The model reveals that when the total synaptic connection strength exceeds a certain threshold, the phase space of the dynamical system contains two attractors, interpreted as Up and Down states. In that case, synaptic noise causes transitions between the states. Moreover, an external stimulation producing a depolarization increases the time spent in the Up state, as observed experimentally. We therefore propose that the existence of Up–Down states is a fundamental and inherent property of a noisy neural ensemble with sufficiently strong synaptic connections.     

Escape behavior elicited by single, channelrhodopsin-2-evoked spikes in zebrafish somatosensory neurons

Somatosensory neurons in teleosts and amphibians are sensitive to thermal, mechanical, or nociceptive stimuli [1, 2]. The two main types of such cells in zebrafish--Rohon-Beard and trigeminal neurons--have served as models for neural development [3-6], but little is known about how they encode tactile stimuli. The hindbrain networks that transduce somatosensory stimuli into a motor output encode information by using very few spikes in a small number of cells [7], but it is unclear whether activity in the primary receptor neurons is similarly efficient. To address this question, we manipulated the activity of zebrafish neurons with the light-activated cation channel, Channelrhodopsin-2 (ChR2) [8, 9]. We found that photoactivation of ChR2 in genetically defined populations of somatosensory neurons triggered escape behaviors in 24-hr-old zebrafish. Electrophysiological recordings from ChR2-positive trigeminal neurons in intact fish revealed that these cells have extremely low rates of spontaneous activity and can be induced to fire by brief pulses of blue light. Using this technique, we find that even a single action potential in a single sensory neuron was at times sufficient to evoke an escape behavior. These results establish ChR2 as a powerful tool for the manipulation of neural activity in zebrafish and reveal a degree of efficiency in coding that has not been found in primary sensory neurons.     

One-dimensional dynamics of attention and decision making in LIP

Where we allocate our visual spatial attention depends upon a continual competition between internally generated goals and external distractions. Recently it was shown that single neurons in the macaque lateral intraparietal area (LIP) can predict the amount of time a distractor can shift the locus of spatial attention away from a goal. We propose that this remarkable dynamical correspondence between single neurons and attention can be explained by a network model in which generically high-dimensional firing-rate vectors rapidly decay to a single mode. We find direct experimental evidence for this model, not only in the original attentional task, but also in a very different task involving perceptual decision making. These results confirm a theoretical prediction that slowly varying activity patterns are proportional to spontaneous activity, pose constraints on models of persistent activity, and suggest a network mechanism for the emergence of robust behavioral timing from heterogeneous neuronal populations.     

Noise in attractor networks in the brain produced by graded firing rate representations

Representations in the cortex are often distributed with graded firing rates in the neuronal populations. The firing rate probability distribution of each neuron to a set of stimuli is often exponential or gamma. In processes in the brain, such as decision-making, that are influenced by the noise produced by the close to random spike timings of each neuron for a given mean rate, the noise with this graded type of representation may be larger than with the binary firing rate distribution that is usually investigated. In integrate-and-fire simulations of an attractor decision-making network, we show that the noise is indeed greater for a given sparseness of the representation for graded, exponential, than for binary firing rate distributions. The greater noise was measured by faster escaping times from the spontaneous firing rate state when the decision cues are applied, and this corresponds to faster decision or reaction times. The greater noise was also evident as less stability of the spontaneous firing state before the decision cues are applied. The implication is that spiking-related noise will continue to be a factor that influences processes such as decision-making, signal detection, short-term memory, and memory recall even with the quite large networks found in the cerebral cortex. In these networks there are several thousand recurrent collateral synapses onto each neuron. The greater noise with graded firing rate distributions has the advantage that it can increase the speed of operation of cortical circuitry.     

Management of synchronized network activity by highly active neurons

Increasing evidence supports the idea that spontaneous brain activity may have an important functional role. Cultured neuronal networks provide a suitable model system to search for the mechanisms by which neuronal spontaneous activity is maintained and regulated. This activity is marked by synchronized bursting events (SBEs)--short time windows (hundreds of milliseconds) of rapid neuronal firing separated by long quiescent periods (seconds). However, there exists a special subset of rapidly firing neurons whose activity also persists between SBEs. It has been proposed that these highly active (HA) neurons play an important role in the management (i.e. establishment, maintenance and regulation) of the synchronized network activity. Here, we studied the dynamical properties and the functional role of HA neurons in homogeneous and engineered networks, during early network development, upon recovery from chemical inhibition and in response to electrical stimulations. We found that their sequences of inter-spike intervals (ISI) exhibit long time correlations and a unimodal distribution. During the network's development and under intense inhibition, the observed activity follows a transition period during which mostly HA neurons are active. Studying networks with engineered geometry, we found that HA neurons are precursors (the first to fire) of the spontaneous SBEs and are more responsive to electrical stimulations.     

A neural network model of reliably optimized spike transmission

We studied the detailed structure of a neuronal network model in which the spontaneous spike activity is correctly optimized to match the experimental data and discuss the reliability of the optimized spike transmission. Two stochastic properties of the spontaneous activity were calculated: the spike-count rate and synchrony size. The synchrony size, expected to be an important factor for optimization of spike transmission in the network, represents a percentage of observed coactive neurons within a time bin, whose probability approximately follows a power-law. We systematically investigated how these stochastic properties could matched to those calculated from the experimental data in terms of the log-normally distributed synaptic weights between excitatory and inhibitory neurons and synaptic background activity induced by the input current noise in the network model. To ensure reliably optimized spike transmission, the synchrony size as well as spike-count rate were simultaneously optimized. This required changeably balanced log-normal distributions of synaptic weights between excitatory and inhibitory neurons and appropriately amplified synaptic background activity. Our results suggested that the inhibitory neurons with a hub-like structure driven by intensive feedback from excitatory neurons were a key factor in the simultaneous optimization of the spike-count rate and synchrony size, regardless of different spiking types between excitatory and inhibitory neurons.     

Precritical State Transition Dynamics in the Attractor Landscape of a Molecular Interaction Network Underlying Colorectal Tumorigenesis

From the perspective of systems science, tumorigenesis can be hypothesized as a critical transition (an abrupt shift from one state to another) between proliferative and apoptotic attractors on the state space of a molecular interaction network, for which an attractor is defined as a stable state to which all initial states ultimately converge, and the region of convergence is called the basin of attraction. Before the critical transition, a cellular state might transit between the basin of attraction for an apoptotic attractor and that for a proliferative attractor due to the noise induced by the inherent stochasticity in molecular interactions. Such a flickering state transition (state transition between the basins of attraction for alternative attractors from the impact of noise) would become more frequent as the cellular state approaches near the boundary of the basin of attraction, which can increase the variation in the estimate of the respective basin size. To investigate this for colorectal tumorigenesis, we have constructed a stochastic Boolean network model of the molecular interaction network that contains an important set of proteins known to be involved in cancer. In particular, we considered 100 representative sequences of 20 gene mutations that drive colorectal tumorigenesis. We investigated the appearance of cancerous cells by examining the basin size of apoptotic, quiescent, and proliferative attractors along with the sequential accumulation of gene mutations during colorectal tumorigenesis. We introduced a measure to detect the flickering state transition as the variation in the estimate of the basin sizes for three-phenotype attractors from the impact of noise. Interestingly, we found that this measure abruptly increases before a cell becomes cancerous during colorectal tumorigenesis in most of the gene mutation sequences under a certain level of stochastic noise. This suggests that a frequent flickering state transition can be a precritical phenomenon of colorectal tumorigenesis.     

Structure of spontaneous UP and DOWN transitions self-organizing in a cortical network model

Synaptic plasticity is considered to play a crucial role in the experience-dependent self-organization of local cortical networks. In the absence of sensory stimuli, cerebral cortex exhibits spontaneous membrane potential transitions between an UP and a DOWN state. To reveal how cortical networks develop spontaneous activity, or conversely, how spontaneous activity structures cortical networks, we analyze the self-organization of a recurrent network model of excitatory and inhibitory neurons, which is realistic enough to replicate UP–DOWN states, with spike-timing-dependent plasticity (STDP). The individual neurons in the self-organized network exhibit a variety of temporal patterns in the two-state transitions. In addition, the model develops a feed-forward network-like structure that produces a diverse repertoire of precise sequences of the UP state. Our model shows that the self-organized activity well resembles the spontaneous activity of cortical networks if STDP is accompanied by the pruning of weak synapses. These results suggest that the two-state membrane potential transitions play an active role in structuring local cortical circuits.     

Spontaneous coordinated activity in cultured networks: Analysis of multiple ignition sites,primary circuits,and burst phase delay distributions

All higher order central nervous systems exhibit spontaneous neural activity, though the purpose and mechanistic origin of such activity remains poorly understood. We quantitatively analyzed the ignition and spread of collective spontaneous electrophysiological activity in networks of cultured cortical neurons growing on microelectrode arrays. Leader neurons, which form a mono-synaptically connected primary circuit, and initiate a majority of network bursts were found to be a small subset of recorded neurons. Leader/follower firing delay times formed temporally stable positively skewed distributions. Blocking inhibitory synapses usually resulted in shorter delay times with reduced variance. These distributions are characterizations of general aspects of internal network dynamics and provide estimates of pair-wise synaptic distances. The resulting analysis produced specific quantitative constraints and insights into the activation patterns of collective neuronal activity in self-organized cortical networks, which may prove useful for models emulating spontaneously active systems.     

Inferring network activity from synaptic noise

During intense network activity in vivo, cortical neurons are in a high-conductance state, in which the membrane potential (V(m)) is subject to a tremendous fluctuating activity. Clearly, this "synaptic noise" contains information about the activity of the network, but there are presently no methods available to extract this information. We focus here on this problem from a computational neuroscience perspective, with the aim of drawing methods to analyze experimental data. We start from models of cortical neurons, in which high-conductance states stem from the random release of thousands of excitatory and inhibitory synapses. This highly complex system can be simplified by using global synaptic conductances described by effective stochastic processes. The advantage of this approach is that one can derive analytically a number of properties from the statistics of resulting V(m) fluctuations. For example, the global excitatory and inhibitory conductances can be extracted from synaptic noise, and can be related to the mean activity of presynaptic neurons. We show here that extracting the variances of excitatory and inhibitory synaptic conductances can provide estimates of the mean temporal correlation-or level of synchrony-among thousands of neurons in the network. Thus, "probing the network" through intracellular V(m) activity is possible and constitutes a promising approach, but it will require a continuous effort combining theory, computational models and intracellular physiology.     

Transient information flow in a network of excitatory and inhibitory model neurons: Role of noise and signal autocorrelation

We investigate the performance of sparsely-connected networks of integrate-and-fire neurons for ultra-short term information processing. We exploit the fact that the population activity of networks with balanced excitation and inhibition can switch from an oscillatory firing regime to a state of asynchronous irregular firing or quiescence depending on the rate of external background spikes. We find that in terms of information buffering the network performs best for a moderate, non-zero, amount of noise. Analogous to the phenomenon of stochastic resonance the performance decreases for higher and lower noise levels. The optimal amount of noise corresponds to the transition zone between a quiescent state and a regime of stochastic dynamics. This provides a potential explanation of the role of non-oscillatory population activity in a simplified model of cortical micro-circuits.     

Delay, noise and phase locking in pulse coupled neural networks

This paper studies the effect of several delay times and noise on the stability of the phase-locked state in the lighthouse model and the integrate and fire model of a pulse coupled neural network. The coupling between neurons may be arbitrary. In both models the increase of delay times leads to a weakening of the stability and to the occurrence of relaxation oscillations.     

Self-sustained asynchronous irregular states and Up–Down states in thalamic,cortical and thalamocortical networks of nonlinear integrate-and-fire neurons

Randomly-connected networks of integrate-and-fire (IF) neurons are known to display asynchronous irregular (AI) activity states, which resemble the discharge activity recorded in the cerebral cortex of awake animals. However, it is not clear whether such activity states are specific to simple IF models, or if they also exist in networks where neurons are endowed with complex intrinsic properties similar to electrophysiological measurements. Here, we investigate the occurrence of AI states in networks of nonlinear IF neurons, such as the adaptive exponential IF (Brette-Gerstner-Izhikevich) model. This model can display intrinsic properties such as low-threshold spike (LTS), regular spiking (RS) or fast-spiking (FS). We successively investigate the oscillatory and AI dynamics of thalamic, cortical and thalamocortical networks using such models. AI states can be found in each case, sometimes with surprisingly small network size of the order of a few tens of neurons. We show that the presence of LTS neurons in cortex or in thalamus, explains the robust emergence of AI states for relatively small network sizes. Finally, we investigate the role of spike-frequency adaptation (SFA). In cortical networks with strong SFA in RS cells, the AI state is transient, but when SFA is reduced, AI states can be self-sustained for long times. In thalamocortical networks, AI states are found when the cortex is itself in an AI state, but with strong SFA, the thalamocortical network displays Up and Down state transitions, similar to intracellular recordings during slow-wave sleep or anesthesia. Self-sustained Up and Down states could also be generated by two-layer cortical networks with LTS cells. These models suggest that intrinsic properties such as adaptation and low-threshold bursting activity are crucial for the genesis and control of AI states in thalamocortical networks.     

Towards the virtual brain: network modeling of the intact and the damaged brain

Neurocomputational models of large-scale brain dynamics utilizing realistic connectivity matrices have advanced our understanding of the operational network principles in the brain. In particular, spontaneous or resting state activity has been studied on various scales of spatial and temporal organization including those that relate to physiological, encephalographic and hemodynamic data. In this article we focus on the brain from the perspective of a dynamic network and discuss the role of its network constituents in shaping brain dynamics. These constituents include the brain's structural connectivity, the population dynamics of its network nodes and the time delays involved in signal transmission. In addition, no discussion of brain dynamics would be complete without considering noise and stochastic effects. In fact, there is mounting evidence that the interaction between noise and dynamics plays an important functional role in shaping key brain processes. In particular, we discuss a unifying theoretical framework that explains how structured spatio-temporal resting state patterns emerge from noise driven explorations of unstable or stable oscillatory states. Embracing this perspective, we explore the consequences of network manipulations to understand some of the brain's dysfunctions, as well as network effects that offer new insights into routes towards therapy, recovery and brain repair. These collective insights will be at the core of a new computational environment, the Virtual Brain, which will allow flexible incorporation of empirical data constraining the brain models to integrate, unify and predict network responses to incipient pathological processes.     

Changes of mind in an attractor network of decision-making

Attractor networks successfully account for psychophysical and neurophysiological data in various decision-making tasks. Especially their ability to model persistent activity, a property of many neurons involved in decision-making, distinguishes them from other approaches. Stable decision attractors are, however, counterintuitive to changes of mind. Here we demonstrate that a biophysically-realistic attractor network with spiking neurons, in its itinerant transients towards the choice attractors, can replicate changes of mind observed recently during a two-alternative random-dot motion (RDM) task. Based on the assumption that the brain continues to evaluate available evidence after the initiation of a decision, the network predicts neural activity during changes of mind and accurately simulates reaction times, performance and percentage of changes dependent on difficulty. Moreover, the model suggests a low decision threshold and high incoming activity that drives the brain region involved in the decision-making process into a dynamical regime close to a bifurcation, which up to now lacked evidence for physiological relevance. Thereby, we further affirmed the general conformance of attractor networks with higher level neural processes and offer experimental predictions to distinguish nonlinear attractor from linear diffusion models.     

Synchronization without oscillatory neurons

Experimental results suggest that neurons in the cortex synchronize their action potentials on the millisecond time scale. More importantly this binding expresses functional relationships between the neurons. A model of neuronal interactions is proposed in which simultaneous discharges of neurons develop through specialized synaptic circuits. As an important prerequisite for this synchronization it is demonstrated that SynFire chains, generating different levels of excitation, propagate their activity waves at distinct velocities. Two chains were coupled by excitatory synapses and their activity was initiated at different times. Due to synaptic interactions, activity in the earlier-initiated chain accelerates propagation in the other chain until the two activity waves are synchronized. Compared with several neural network models with oscillatory units, physiologically more plausible neurons are simulated. It is still under debate whether neurons in the cortex show oscillatory dischargesper se. In particular, a high rate of noise relative to very weak synaptic gains cannot impair our results in the neural network simulations.     

Synaptic Plasticity Enables Adaptive Self-Tuning Critical Networks

During rest, the mammalian cortex displays spontaneous neural activity. Spiking of single neurons during rest has been described as irregular and asynchronous. In contrast, recent in vivo and in vitro population measures of spontaneous activity, using the LFP, EEG, MEG or fMRI suggest that the default state of the cortex is critical, manifested by spontaneous, scale-invariant, cascades of activity known as neuronal avalanches. Criticality keeps a network poised for optimal information processing, but this view seems to be difficult to reconcile with apparently irregular single neuron spiking. Here, we simulate a 10,000 neuron, deterministic, plastic network of spiking neurons. We show that a combination of short- and long-term synaptic plasticity enables these networks to exhibit criticality in the face of intrinsic, i.e. self-sustained, asynchronous spiking. Brief external perturbations lead to adaptive, long-term modification of intrinsic network connectivity through long-term excitatory plasticity, whereas long-term inhibitory plasticity enables rapid self-tuning of the network back to a critical state. The critical state is characterized by a branching parameter oscillating around unity, a critical exponent close to -3/2 and a long tail distribution of a self-similarity parameter between 0.5 and 1.