A network of spiking neurons that can represent interval timing: mean field analysis

Despite the vital importance of our ability to accurately process and encode temporal information, the underlying neural mechanisms are largely unknown. We have previously described a theoretical framework that explains how temporal representations, similar to those reported in the visual cortex, can form in locally recurrent cortical networks as a function of reward modulated synaptic plasticity. This framework allows networks of both linear and spiking neurons to learn the temporal interval between a stimulus and paired reward signal presented during training. Here we use a mean field approach to analyze the dynamics of non-linear stochastic spiking neurons in a network trained to encode specific time intervals. This analysis explains how recurrent excitatory feedback allows a network structure to encode temporal representations.     

Impact of adaptation currents on synchronization of coupled exponential integrate-and-fire neurons

The ability of spiking neurons to synchronize their activity in a network depends on the response behavior of these neurons as quantified by the phase response curve (PRC) and on coupling properties. The PRC characterizes the effects of transient inputs on spike timing and can be measured experimentally. Here we use the adaptive exponential integrate-and-fire (aEIF) neuron model to determine how subthreshold and spike-triggered slow adaptation currents shape the PRC. Based on that, we predict how synchrony and phase locked states of coupled neurons change in presence of synaptic delays and unequal coupling strengths. We find that increased subthreshold adaptation currents cause a transition of the PRC from only phase advances to phase advances and delays in response to excitatory perturbations. Increased spike-triggered adaptation currents on the other hand predominantly skew the PRC to the right. Both adaptation induced changes of the PRC are modulated by spike frequency, being more prominent at lower frequencies. Applying phase reduction theory, we show that subthreshold adaptation stabilizes synchrony for pairs of coupled excitatory neurons, while spike-triggered adaptation causes locking with a small phase difference, as long as synaptic heterogeneities are negligible. For inhibitory pairs synchrony is stable and robust against conduction delays, and adaptation can mediate bistability of in-phase and anti-phase locking. We further demonstrate that stable synchrony and bistable in/anti-phase locking of pairs carry over to synchronization and clustering of larger networks. The effects of adaptation in aEIF neurons on PRCs and network dynamics qualitatively reflect those of biophysical adaptation currents in detailed Hodgkin-Huxley-based neurons, which underscores the utility of the aEIF model for investigating the dynamical behavior of networks. Our results suggest neuronal spike frequency adaptation as a mechanism synchronizing low frequency oscillations in local excitatory networks, but indicate that inhibition rather than excitation generates coherent rhythms at higher frequencies.     

Neural dynamics as sampling: a model for stochastic computation in recurrent networks of spiking neurons

The organization of computations in networks of spiking neurons in the brain is still largely unknown, in particular in view of the inherently stochastic features of their firing activity and the experimentally observed trial-to-trial variability of neural systems in the brain. In principle there exists a powerful computational framework for stochastic computations, probabilistic inference by sampling, which can explain a large number of macroscopic experimental data in neuroscience and cognitive science. But it has turned out to be surprisingly difficult to create a link between these abstract models for stochastic computations and more detailed models of the dynamics of networks of spiking neurons. Here we create such a link and show that under some conditions the stochastic firing activity of networks of spiking neurons can be interpreted as probabilistic inference via Markov chain Monte Carlo (MCMC) sampling. Since common methods for MCMC sampling in distributed systems, such as Gibbs sampling, are inconsistent with the dynamics of spiking neurons, we introduce a different approach based on non-reversible Markov chains that is able to reflect inherent temporal processes of spiking neuronal activity through a suitable choice of random variables. We propose a neural network model and show by a rigorous theoretical analysis that its neural activity implements MCMC sampling of a given distribution, both for the case of discrete and continuous time. This provides a step towards closing the gap between abstract functional models of cortical computation and more detailed models of networks of spiking neurons.     

Existence and stability criteria for phase-locked modes in ring neural networks based on the spike time resetting curve method

We developed a systematic and consistent mathematical approach to predicting 1:1 phase-locked modes in ring neural networks of spiking neurons based on the open loop spike time resetting curve (STRC) and its almost equivalent counterpart—the phase resetting curve (PRC). The open loop STRCs/PRCs were obtained by injecting into an isolated model neuron a triangular shaped time-dependent stimulus current closely resembling an actual synaptic input. Among other advantages, the STRC eliminates the confusion regarding the undefined phase for stimuli driving the neuron outside of the unperturbed limit cycle. We derived both open loop PRC and STRC-based existence and stability criteria for 1:1 phase-locked modes developed in ring networks of spiking neurons. Our predictions were in good agreement with the closed loop numerical simulations. Intuitive graphical methods for predicting phase-locked modes were also developed both for half-centers and for larger ring networks.     

Probabilistic inference in general graphical models through sampling in stochastic networks of spiking neurons

An important open problem of computational neuroscience is the generic organization of computations in networks of neurons in the brain. We show here through rigorous theoretical analysis that inherent stochastic features of spiking neurons, in combination with simple nonlinear computational operations in specific network motifs and dendritic arbors, enable networks of spiking neurons to carry out probabilistic inference through sampling in general graphical models. In particular, it enables them to carry out probabilistic inference in Bayesian networks with converging arrows ("explaining away") and with undirected loops, that occur in many real-world tasks. Ubiquitous stochastic features of networks of spiking neurons, such as trial-to-trial variability and spontaneous activity, are necessary ingredients of the underlying computational organization. We demonstrate through computer simulations that this approach can be scaled up to neural emulations of probabilistic inference in fairly large graphical models, yielding some of the most complex computations that have been carried out so far in networks of spiking neurons.     

Cellularly-driven differences in network synchronization propensity are differentially modulated by firing frequency

Spatiotemporal pattern formation in neuronal networks depends on the interplay between cellular and network synchronization properties. The neuronal phase response curve (PRC) is an experimentally obtainable measure that characterizes the cellular response to small perturbations, and can serve as an indicator of cellular propensity for synchronization. Two broad classes of PRCs have been identified for neurons: Type I, in which small excitatory perturbations induce only advances in firing, and Type II, in which small excitatory perturbations can induce both advances and delays in firing. Interestingly, neuronal PRCs are usually attenuated with increased spiking frequency, and Type II PRCs typically exhibit a greater attenuation of the phase delay region than of the phase advance region. We found that this phenomenon arises from an interplay between the time constants of active ionic currents and the interspike interval. As a result, excitatory networks consisting of neurons with Type I PRCs responded very differently to frequency modulation compared to excitatory networks composed of neurons with Type II PRCs. Specifically, increased frequency induced a sharp decrease in synchrony of networks of Type II neurons, while frequency increases only minimally affected synchrony in networks of Type I neurons. These results are demonstrated in networks in which both types of neurons were modeled generically with the Morris-Lecar model, as well as in networks consisting of Hodgkin-Huxley-based model cortical pyramidal cells in which simulated effects of acetylcholine changed PRC type. These results are robust to different network structures, synaptic strengths and modes of driving neuronal activity, and they indicate that Type I and Type II excitatory networks may display two distinct modes of processing information.     

Noise-Driven Neocortical Interaction: A Simple Generation Mechanism for Complex Neuron Spiking

We discuss a generic scenario along which complex spiking behavior evolves in biologically realistic neural networks. Our nonlinear dynamics approach is based directly on rat neocortical in vitro recordings. Using this experimental data, we obtain a full overview on the possible spiking behaviors of pyramidal neurons that are engaged in binary interactions. Universality arguments imply that the observed spiking behaviors are largely independent from the specific properties of individual neurons; theoretical arguments and numerical experiments indicate that they should be observable in in vivo neocortical neuron networks.     

An extended model for a spiking neuron class

This paper proposes an extension to the model of a spiking neuron for information processing in artificial neural networks, developing a new approach for the dynamic threshold of the integrate-and-fire neuron. This new approach invokes characteristics of biological neurons such as the behavior of chemical synapses and the receptor field. We demonstrate how such a digital model of spiking neurons can solve complex nonlinear classification with a single neuron, performing experiments for the classical XOR problem. Compared with rate-coded networks and the classical integrate-and-fire model, the trained network demonstrated faster information processing, requiring fewer neurons and shorter learning periods. The extended model validates all the logic functions of biological neurons when such functions are necessary for the proper flow of binary codes through a neural network.     

A single spiking neuron that can represent interval timing: analysis,plasticity and multi-stability

The ability to represent interval timing is crucial for many common behaviors, such as knowing whether to stop when the light turns from green to yellow. Neural representations of interval timing have been reported in the rat primary visual cortex and we have previously presented a computational framework describing how they can be learned by a network of neurons. Recent experimental and theoretical results in entorhinal cortex have shown that single neurons can exhibit persistent activity, previously thought to be generated by a network of neurons. Motivated by these single neuron results, we propose a single spiking neuron model that can learn to compute and represent interval timing. We show that a simple model, reduced analytically to a single dynamical equation, captures the average behavior of the complete high dimensional spiking model very well. Variants of this model can be used to produce bi-stable or multi-stable persistent activity. We also propose a plasticity rule by which this model can learn to represent different intervals and different levels of persistent activity.     

Predictive Coding of Dynamical Variables in Balanced Spiking Networks

Two observations about the cortex have puzzled neuroscientists for a long time. First, neural responses are highly variable. Second, the level of excitation and inhibition received by each neuron is tightly balanced at all times. Here, we demonstrate that both properties are necessary consequences of neural networks that represent information efficiently in their spikes. We illustrate this insight with spiking networks that represent dynamical variables. Our approach is based on two assumptions: We assume that information about dynamical variables can be read out linearly from neural spike trains, and we assume that neurons only fire a spike if that improves the representation of the dynamical variables. Based on these assumptions, we derive a network of leaky integrate-and-fire neurons that is able to implement arbitrary linear dynamical systems. We show that the membrane voltage of the neurons is equivalent to a prediction error about a common population-level signal. Among other things, our approach allows us to construct an integrator network of spiking neurons that is robust against many perturbations. Most importantly, neural variability in our networks cannot be equated to noise. Despite exhibiting the same single unit properties as widely used population code models (e.g. tuning curves, Poisson distributed spike trains), balanced networks are orders of magnitudes more reliable. Our approach suggests that spikes do matter when considering how the brain computes, and that the reliability of cortical representations could have been strongly underestimated.     

Self-Organization of Microcircuits in Networks of Spiking Neurons with Plastic Synapses

The synaptic connectivity of cortical networks features an overrepresentation of certain wiring motifs compared to simple random-network models. This structure is shaped, in part, by synaptic plasticity that promotes or suppresses connections between neurons depending on their joint spiking activity. Frequently, theoretical studies focus on how feedforward inputs drive plasticity to create this network structure. We study the complementary scenario of self-organized structure in a recurrent network, with spike timing-dependent plasticity driven by spontaneous dynamics. We develop a self-consistent theory for the evolution of network structure by combining fast spiking covariance with a slow evolution of synaptic weights. Through a finite-size expansion of network dynamics we obtain a low-dimensional set of nonlinear differential equations for the evolution of two-synapse connectivity motifs. With this theory in hand, we explore how the form of the plasticity rule drives the evolution of microcircuits in cortical networks. When potentiation and depression are in approximate balance, synaptic dynamics depend on weighted divergent, convergent, and chain motifs. For additive, Hebbian STDP these motif interactions create instabilities in synaptic dynamics that either promote or suppress the initial network structure. Our work provides a consistent theoretical framework for studying how spiking activity in recurrent networks interacts with synaptic plasticity to determine network structure.     

First return maps for the dynamics of synaptically coupled conditional bursters

The pre-Bötzinger complex (preBötc) in the mammalian brainstem has an important role in generating respiratory rhythms. An influential differential equation model for the activity of individual neurons in the preBötc yields transitions from quiescence to bursting to tonic spiking as a parameter is varied. Further, past work has established that bursting dynamics can arise from a pair of tonic model cells coupled with synaptic excitation. In this paper, we analytically derive one- and two-dimensional maps from the differential equations for a self-coupled neuron and a two-neuron network, respectively. Using a combination of analysis and simulations of these maps, we explore the possible forms of dynamics that the model networks can produce as well as which transitions between dynamic regimes are mathematically possible.     

State transitions through inhibitory interneurons in a cortical network model

Inhibitory interneurons shape the spiking characteristics and computational properties of cortical networks. Interneuron subtypes can precisely regulate cortical function but the roles of interneuron subtypes for promoting different regimes of cortical activity remains unclear. Therefore, we investigated the impact of fast spiking and non-fast spiking interneuron subtypes on cortical activity using a network model with connectivity and synaptic properties constrained by experimental data. We found that network properties were more sensitive to modulation of the fast spiking population, with reductions of fast spiking excitability generating strong spike correlations and network oscillations. Paradoxically, reduced fast spiking excitability produced a reduction of global excitation-inhibition balance and features of an inhibition stabilised network, in which firing rates were driven by the activity of excitatory neurons within the network. Further analysis revealed that the synaptic interactions and biophysical features associated with fast spiking interneurons, in particular their rapid intrinsic response properties and short synaptic latency, enabled this state transition by enhancing gain within the excitatory population. Therefore, fast spiking interneurons may be uniquely positioned to control the strength of recurrent excitatory connectivity and the transition to an inhibition stabilised regime. Overall, our results suggest that interneuron subtypes can exert selective control over excitatory gain allowing for differential modulation of global network state.     

The effects of cholinergic neuromodulation on neuronal phase-response curves of modeled cortical neurons

The response of an oscillator to perturbations is described by its phase-response curve (PRC), which is related to the type of bifurcation leading from rest to tonic spiking. In a recent experimental study, we have shown that the type of PRC in cortical pyramidal neurons can be switched by cholinergic neuromodulation from type II (biphasic) to type I (monophasic). We explored how intrinsic mechanisms affected by acetylcholine influence the PRC using three different types of neuronal models: a theta neuron, single-compartment neurons and a multi-compartment neuron. In all of these models a decrease in the amount of a spike-frequency adaptation current was a necessary and sufficient condition for the shape of the PRC to change from biphasic (type II) to purely positive (type I).     

Paradoxical phase response of gamma rhythms facilitates their entrainment in heterogeneous networks

The synchronization of different γ-rhythms arising in different brain areas has been implicated in various cognitive functions. Here, we focus on the effect of the ubiquitous neuronal heterogeneity on the synchronization of ING (interneuronal network gamma) and PING (pyramidal-interneuronal network gamma) rhythms. The synchronization properties of rhythms depends on the response of their collective phase to external input. We therefore determine the macroscopic phase-response curve for finite-amplitude perturbations (fmPRC) of ING- and PING-rhythms in all-to-all coupled networks comprised of linear (IF) or quadratic (QIF) integrate-and-fire neurons. For the QIF networks we complement the direct simulations with the adjoint method to determine the infinitesimal macroscopic PRC (imPRC) within the exact mean-field theory. We show that the intrinsic neuronal heterogeneity can qualitatively modify the fmPRC and the imPRC. Both PRCs can be biphasic and change sign (type II), even though the phase-response curve for the individual neurons is strictly non-negative (type I). Thus, for ING rhythms, say, external inhibition to the inhibitory cells can, in fact, advance the collective oscillation of the network, even though the same inhibition would lead to a delay when applied to uncoupled neurons. This paradoxical advance arises when the external inhibition modifies the internal dynamics of the network by reducing the number of spikes of inhibitory neurons; the advance resulting from this disinhibition outweighs the immediate delay caused by the external inhibition. These results explain how intrinsic heterogeneity allows ING- and PING-rhythms to become synchronized with a periodic forcing or another rhythm for a wider range in the mismatch of their frequencies. Our results identify a potential function of neuronal heterogeneity in the synchronization of coupled γ-rhythms, which may play a role in neural information transfer via communication through coherence.     

Cell Type-Specific Separation of Subicular Principal Neurons during Network Activities

The hippocampal output structure, the subiculum, expresses two major memory relevant network rhythms, sharp wave ripple and gamma frequency oscillations. To this date, it remains unclear how the two distinct types of subicular principal cells, intrinsically bursting and regular spiking neurons, participate in these two network rhythms. Using concomitant local field potential and intracellular recordings in an in vitro mouse model that allows the investigation of both network rhythms, we found a cell type-specific segregation of principal neurons into participating intrinsically bursting and non-participating regular spiking cells. However, if regular spiking cells were kept at a more depolarized level, they did participate in a specific manner, suggesting a potential bimodal working model dependent on the level of excitation. Furthermore, intrinsically bursting and regular spiking cells exhibited divergent intrinsic membrane and synaptic properties in the active network. Thus, our results suggest a cell-type-specific segregation of principal cells into two separate groups during network activities, supporting the idea of two parallel streams of information processing within the subiculum.     

On the Firing Rate Dependency of the Phase Response Curve of Rat Purkinje Neurons In Vitro

Synchronous spiking during cerebellar tasks has been observed across Purkinje cells: however, little is known about the intrinsic cellular mechanisms responsible for its initiation, cessation and stability. The Phase Response Curve (PRC), a simple input-output characterization of single cells, can provide insights into individual and collective properties of neurons and networks, by quantifying the impact of an infinitesimal depolarizing current pulse on the time of occurrence of subsequent action potentials, while a neuron is firing tonically. Recently, the PRC theory applied to cerebellar Purkinje cells revealed that these behave as phase-independent integrators at low firing rates, and switch to a phase-dependent mode at high rates. Given the implications for computation and information processing in the cerebellum and the possible role of synchrony in the communication with its post-synaptic targets, we further explored the firing rate dependency of the PRC in Purkinje cells. We isolated key factors for the experimental estimation of the PRC and developed a closed-loop approach to reliably compute the PRC across diverse firing rates in the same cell. Our results show unambiguously that the PRC of individual Purkinje cells is firing rate dependent and that it smoothly transitions from phase independent integrator to a phase dependent mode. Using computational models we show that neither channel noise nor a realistic cell morphology are responsible for the rate dependent shift in the phase response curve.     

Ensembles of Spiking Neurons with Noise Support Optimal Probabilistic Inference in a Dynamically Changing Environment

It has recently been shown that networks of spiking neurons with noise can emulate simple forms of probabilistic inference through “neural sampling”, i.e., by treating spikes as samples from a probability distribution of network states that is encoded in the network. Deficiencies of the existing model are its reliance on single neurons for sampling from each random variable, and the resulting limitation in representing quickly varying probabilistic information. We show that both deficiencies can be overcome by moving to a biologically more realistic encoding of each salient random variable through the stochastic firing activity of an ensemble of neurons. The resulting model demonstrates that networks of spiking neurons with noise can easily track and carry out basic computational operations on rapidly varying probability distributions, such as the odds of getting rewarded for a specific behavior. We demonstrate the viability of this new approach towards neural coding and computation, which makes use of the inherent parallelism of generic neural circuits, by showing that this model can explain experimentally observed firing activity of cortical neurons for a variety of tasks that require rapid temporal integration of sensory information.     

Oscillations in Large-Scale Cortical Networks: Map-Based Model

We develop a new computationally efficient approach for the analysis of complex large-scale neurobiological networks. Its key element is the use of a new phenomenological model of a neuron capable of replicating important spike pattern characteristics and designed in the form of a system of difference equations (a map). We developed a set of map-based models that replicate spiking activity of cortical fast spiking, regular spiking and intrinsically bursting neurons. Interconnected with synaptic currents these model neurons demonstrated responses very similar to those found with Hodgkin-Huxley models and in experiments. We illustrate the efficacy of this approach in simulations of one- and two-dimensional cortical network models consisting of regular spiking neurons and fast spiking interneurons to model sleep and activated states of the thalamocortical system. Our study suggests that map-based models can be widely used for large-scale simulations and that such models are especially useful for tasks where the modeling of specific firing patterns of different cell classes is important.