From spiking neuron models to linear-nonlinear models

Neurons transform time-varying inputs into action potentials emitted stochastically at a time dependent rate. The mapping from current input to output firing rate is often represented with the help of phenomenological models such as the linear-nonlinear (LN) cascade, in which the output firing rate is estimated by applying to the input successively a linear temporal filter and a static non-linear transformation. These simplified models leave out the biophysical details of action potential generation. It is not a priori clear to which extent the input-output mapping of biophysically more realistic, spiking neuron models can be reduced to a simple linear-nonlinear cascade. Here we investigate this question for the leaky integrate-and-fire (LIF), exponential integrate-and-fire (EIF) and conductance-based Wang-Buzsáki models in presence of background synaptic activity. We exploit available analytic results for these models to determine the corresponding linear filter and static non-linearity in a parameter-free form. We show that the obtained functions are identical to the linear filter and static non-linearity determined using standard reverse correlation analysis. We then quantitatively compare the output of the corresponding linear-nonlinear cascade with numerical simulations of spiking neurons, systematically varying the parameters of input signal and background noise. We find that the LN cascade provides accurate estimates of the firing rates of spiking neurons in most of parameter space. For the EIF and Wang-Buzsáki models, we show that the LN cascade can be reduced to a firing rate model, the timescale of which we determine analytically. Finally we introduce an adaptive timescale rate model in which the timescale of the linear filter depends on the instantaneous firing rate. This model leads to highly accurate estimates of instantaneous firing rates.     

Chaotic solutions in the quadratic integrate-and-fire neuron with adaptation

The quadratic integrate-and-fire (QIF) model with adaptation is commonly used as an elementary neuronal model that reproduces the main characteristics of real neurons. In this paper, we introduce a QIF neuron with a nonlinear adaptive current. This model reproduces the neuron-computational features of real neurons and is analytically tractable. It is shown that under a constant current input chaotic firing is possible. In contrast to previous study the neuron is not sinusoidally forced. We show that the spike-triggered adaptation is a key parameter to understand how chaos is generated.     

Generating oscillatory bursts from a network of regular spiking neurons without inhibition

Avian nucleus isthmi pars parvocellularis (Ipc) neurons are reciprocally connected with the layer 10 (L10) neurons in the optic tectum and respond with oscillatory bursts to visual stimulation. Our in vitro experiments show that both neuron types respond with regular spiking to somatic current injection and that the feedforward and feedback synaptic connections are excitatory, but of different strength and time course. To elucidate mechanisms of oscillatory bursting in this network of regularly spiking neurons, we investigated an experimentally constrained model of coupled leaky integrate-and-fire neurons with spike-rate adaptation. The model reproduces the observed Ipc oscillatory bursting in response to simulated visual stimulation. A scan through the model parameter volume reveals that Ipc oscillatory burst generation can be caused by strong and brief feedforward synaptic conductance changes. The mechanism is sensitive to the parameter values of spike-rate adaptation. In conclusion, we show that a network of regular-spiking neurons with feedforward excitation and spike-rate adaptation can generate oscillatory bursting in response to a constant input.     

Exploring neuronal bistability at the depolarization block

Many neurons display bistability-coexistence of two firing modes such as bursting and tonic spiking or tonic spiking and silence. Bistability has been proposed to endow neurons with richer forms of information processing in general and to be involved in short-term memory in particular by allowing a brief signal to elicit long-lasting changes in firing. In this paper, we focus on bistability that allows for a choice between tonic spiking and depolarization block in a wide range of the depolarization levels. We consider the spike-producing currents in two neurons, models of which differ by the parameter values. Our dopaminergic neuron model displays bistability in a wide range of applied currents at the depolarization block. The Hodgkin-Huxley model of the squid giant axon shows no bistability. We varied parameter values for the model to analyze transitions between the two parameter sets. We show that bistability primarily characterizes the inactivation of the Na(+) current. Our study suggests a connection between the amount of the Na(+) window current and the length of the bistability range. For the dopaminergic neuron we hypothesize that bistability can be linked to a prolonged action of antipsychotic drugs.     

State-Dependent Effects of Na Channel Noise on Neuronal Burst Generation

We explore the effects of stochastic sodium (Na) channel activation on the variability and dynamics of spiking and bursting in a model neuron. The complete model segregates Hodgin-Huxley-type currents into two compartments, and undergoes applied current-dependent bifurcations between regimes of periodic bursting, chaotic bursting, and tonic spiking. Noise is added to simulate variable, finite sizes of the population of Na channels in the fast spiking compartment.During tonic firing, Na channel noise causes variability in interspike intervals (ISIs). The variance, as well as the sensitivity to noise, depend on the model's biophysical complexity. They are smallest in an isolated spiking compartment; increase significantly upon coupling to a passive compartment; and increase again when the second compartment also includes slow-acting currents. In this full model, sufficient noise can convert tonic firing into bursting.During bursting, the actions of Na channel noise are state-dependent. The higher the noise level, the greater the jitter in spike timing within bursts. The noise makes the burst durations of periodic regimes variable, while decreasing burst length duration and variance in a chaotic regime. Na channel noise blurs the sharp transitions of spike time and burst length seen at the bifurcations of the noise-free model. Close to such a bifurcation, the burst behaviors of previously periodic and chaotic regimes become essentially indistinguishable.We discuss biophysical mechanisms, dynamical interpretations and physiological implications. We suggest that noise associated with finite populations of Na channels could evoke very different effects on the intrinsic variability of spiking and bursting discharges, depending on a biological neuron's complexity and applied current-dependent state. We find that simulated channel noise in the model neuron qualitatively replicates the observed variability in burst length and interburst interval in an isolated biological bursting neuron.     

Oscillations in Large-Scale Cortical Networks: Map-Based Model

We develop a new computationally efficient approach for the analysis of complex large-scale neurobiological networks. Its key element is the use of a new phenomenological model of a neuron capable of replicating important spike pattern characteristics and designed in the form of a system of difference equations (a map). We developed a set of map-based models that replicate spiking activity of cortical fast spiking, regular spiking and intrinsically bursting neurons. Interconnected with synaptic currents these model neurons demonstrated responses very similar to those found with Hodgkin-Huxley models and in experiments. We illustrate the efficacy of this approach in simulations of one- and two-dimensional cortical network models consisting of regular spiking neurons and fast spiking interneurons to model sleep and activated states of the thalamocortical system. Our study suggests that map-based models can be widely used for large-scale simulations and that such models are especially useful for tasks where the modeling of specific firing patterns of different cell classes is important.     

Phasic Firing in Vasopressin Cells: Understanding Its Functional Significance through Computational Models

Vasopressin neurons, responding to input generated by osmotic pressure, use an intrinsic mechanism to shift from slow irregular firing to a distinct phasic pattern, consisting of long bursts and silences lasting tens of seconds. With increased input, bursts lengthen, eventually shifting to continuous firing. The phasic activity remains asynchronous across the cells and is not reflected in the population output signal. Here we have used a computational vasopressin neuron model to investigate the functional significance of the phasic firing pattern. We generated a concise model of the synaptic input driven spike firing mechanism that gives a close quantitative match to vasopressin neuron spike activity recorded in vivo, tested against endogenous activity and experimental interventions. The integrate-and-fire based model provides a simple physiological explanation of the phasic firing mechanism involving an activity-dependent slow depolarising afterpotential (DAP) generated by a calcium-inactivated potassium leak current. This is modulated by the slower, opposing, action of activity-dependent dendritic dynorphin release, which inactivates the DAP, the opposing effects generating successive periods of bursting and silence. Model cells are not spontaneously active, but fire when perturbed by random perturbations mimicking synaptic input. We constructed one population of such phasic neurons, and another population of similar cells but which lacked the ability to fire phasically. We then studied how these two populations differed in the way that they encoded changes in afferent inputs. By comparison with the non-phasic population, the phasic population responds linearly to increases in tonic synaptic input. Non-phasic cells respond to transient elevations in synaptic input in a way that strongly depends on background activity levels, phasic cells in a way that is independent of background levels, and show a similar strong linearization of the response. These findings show large differences in information coding between the populations, and apparent functional advantages of asynchronous phasic firing.     

Low dimensional model of bursting neurons

A computationally efficient, biophysically-based model of neuronal behavior is presented; it incorporates ion channel dynamics in its two fast ion channels while preserving simplicity by representing only one slow ion current. The model equations are shown to provide a wide array of physiological dynamics in terms of spiking patterns, bursting, subthreshold oscillations, and chaotic firing. Despite its simplicity, the model is capable of simulating an extensive range of spiking patterns. Several common neuronal behaviors observed in vivo are demonstrated by varying model parameters. These behaviors are classified into dynamical classes using phase diagrams whose boundaries in parameter space prove to be accurately delineated by linear stability analysis. This simple model is suitable for use in large scale simulations involving neural field theory or neuronal networks.     

Predicting single spikes and spike patterns with the Hindmarsh–Rose model

Most simple neuron models are only able to model traditional spiking behavior. As physiologists discover and classify different electrical phenotypes, computational neuroscientists become interested in using simple phenomenological models that can exhibit these different types of spiking patterns. The Hindmarsh–Rose model is a three-dimensional relaxation oscillator which can show both spiking and bursting patterns and has a chaotic regime. We test the predictive powers of the Hindmarsh–Rose model on two different test databases. We show that the Hindmarsh–Rose model can predict the spiking response of rat layer 5 neocortical pyramidal neurons on a stochastic input signal with a precision comparable to the best known spiking models. We also show that the Hindmarsh–Rose model can capture qualitatively the electrical footprints in a database of different types of neocortical interneurons. When the model parameters are fit from sub-threshold measurements only, the model still captures well the electrical phenotype, which suggests that the sub-threshold signals contain information about the firing patterns of the different neurons.     

Neuron firing in driven nonlinear integrate-and-fire models

Statistical properties of neuron firing are studied in the framework of a nonlinear leaky integrate-and-fire model that is driven by a slow periodic subthreshold signal. The firing events are characterized by first passage time densities. The experimentally better accessible interspike interval density generally depends on the sojourn times in a refractory state of the neuron. This aspect is not part of the integrate-and-fire model and must be modelled additionally. For a large class of refractory dynamics, a general expression for the interspike interval density is given and further evaluated for the two cases with an instantaneous resetting (i.e. no refractory state) and a refractory state possessing a deterministic lifetime. First passage time densities and interspike interval densities following from the proposed theory compare favorably with precise numerical simulations.     

Noise in attractor networks in the brain produced by graded firing rate representations

Representations in the cortex are often distributed with graded firing rates in the neuronal populations. The firing rate probability distribution of each neuron to a set of stimuli is often exponential or gamma. In processes in the brain, such as decision-making, that are influenced by the noise produced by the close to random spike timings of each neuron for a given mean rate, the noise with this graded type of representation may be larger than with the binary firing rate distribution that is usually investigated. In integrate-and-fire simulations of an attractor decision-making network, we show that the noise is indeed greater for a given sparseness of the representation for graded, exponential, than for binary firing rate distributions. The greater noise was measured by faster escaping times from the spontaneous firing rate state when the decision cues are applied, and this corresponds to faster decision or reaction times. The greater noise was also evident as less stability of the spontaneous firing state before the decision cues are applied. The implication is that spiking-related noise will continue to be a factor that influences processes such as decision-making, signal detection, short-term memory, and memory recall even with the quite large networks found in the cerebral cortex. In these networks there are several thousand recurrent collateral synapses onto each neuron. The greater noise with graded firing rate distributions has the advantage that it can increase the speed of operation of cortical circuitry.     

Emergence of resonances in neural systems: the interplay between adaptive threshold and short-term synaptic plasticity

In this work we study the detection of weak stimuli by spiking (integrate-and-fire) neurons in the presence of certain level of noisy background neural activity. Our study has focused in the realistic assumption that the synapses in the network present activity-dependent processes, such as short-term synaptic depression and facilitation. Employing mean-field techniques as well as numerical simulations, we found that there are two possible noise levels which optimize signal transmission. This new finding is in contrast with the classical theory of stochastic resonance which is able to predict only one optimal level of noise. We found that the complex interplay between adaptive neuron threshold and activity-dependent synaptic mechanisms is responsible for this new phenomenology. Our main results are confirmed by employing a more realistic FitzHugh-Nagumo neuron model, which displays threshold variability, as well as by considering more realistic stochastic synaptic models and realistic signals such as poissonian spike trains.     

Analysis of bursting in a thalamic neuron model

We extend a quantitative model for low-voltage, slow-wave excitability based on the T-type calcium current (Wang et al. 1991) by juxtaposing it with a Hodgkin-Huxley-like model for fast sodium spiking in the high voltage regime to account for the distinct firing modes of thalamic neurons. We employ bifurcation analysis to illustrate the stimulus-response behavior of the full model under both voltage regimes. The model neuron shows continuous sodium spiking when depolarized sufficiently from rest. Depending on the parameters of calcium current inactivation, there are two types of low-voltage responses to a hyperpolarizing current step: a single rebound low threshold spike (LTS) upon release of the step and periodic LTSs. Bursting is seen as sodium spikes ride the LTS crest. In both cases, we analyze the LTS burst response by projecting its trajectory into a fast/slow phase plane. We also use phase plane methods to show that a potassium A-current shifts the threshold for sodium spikes, reducing the number of fast sodium spikes in an LTS burst. It can also annihilate periodic bursting. We extend the previous work of Rose and Hindmarsh (1989a–c) for a thalamic neuron and propose a simpler model for thalamic activity. We consider burst modulation by using a neuromodulator-dependent potassium leakage conductance as a control parameter. These results correspond with experiments showing that the application of certain neurotransmitters can switch firing modes. Received: 18 July 1993/Accepted in revised form: 22 January 1994     

The Morris–Lecar neuron model embeds a leaky integrate-and-fire model

We show that the stochastic Morris–Lecar neuron, in a neighborhood of its stable point, can be approximated by a two-dimensional Ornstein–Uhlenbeck (OU) modulation of a constant circular motion. The associated radial OU process is an example of a leaky integrate-and-fire (LIF) model prior to firing. A new model constructed from a radial OU process together with a simple firing mechanism based on detailed Morris–Lecar firing statistics reproduces the Morris–Lecar Interspike Interval (ISI) distribution, and has the computational advantages of a LIF. The result justifies the large amount of attention paid to the LIF models.     

Travelling wave patterns in a model of the spinal pattern generator using spiking neurons

The aim of this study is to produce travelling waves in a planar net of artificial spiking neurons. Provided that the parameters of the waves – frequency, wavelength and orientation – can be sufficiently controlled, such a network can serve as a model of the spinal pattern generator for swimming and terrestrial quadruped locomotion. A previous implementation using non-spiking, sigmoid neurons lacked the physiological plausibility that can only be attained using more realistic spiking neurons. Simulations were conducted using three types of spiking neuronal models. First, leaky integrate-and-fire neurons were used. Second, we introduced a phenomenological bursting neuron. And third, a canonical model neuron was implemented which could reproduce the full dynamics of the Hodgkin–Huxley neuron. The conditions necessary to produce appropriate travelling waves corresponded largely to the known anatomy and physiology of the spinal cord. Especially important features for the generation of travelling waves were the topology of the local connections – so-called off-centre connectivity – the availability of dynamic synapses and, to some extent, the availability of bursting cell types. The latter were necessary to produce stable waves at the low frequencies observed in quadruped locomotion. In general, the phenomenon of travelling waves was very robust and largely independent of the network parameters and emulated cell types.     

To Burst or Not to Burst?

It is well known that some neurons tend to fire packets of action potentials followed by periods of quiescence (bursts) while others within the same stage of sensory processing fire in a tonic manner. However, the respective computational advantages of bursting and tonic neurons for encoding time varying signals largely remain a mystery. Weakly electric fish use cutaneous electroreceptors to convey information about sensory stimuli and it has been shown that some electroreceptors exhibit bursting dynamics while others do not. In this study, we compare the neural coding capabilities of tonically firing and bursting electroreceptor model neurons using information theoretic measures. We find that both bursting and tonically firing model neurons efficiently transmit information about the stimulus. However, the decoding mechanisms that must be used for each differ greatly: a non-linear decoder would be required to extract all the available information transmitted by the bursting model neuron whereas a linear one might suffice for the tonically firing model neuron. Further investigations using stimulus reconstruction techniques reveal that, unlike the tonically firing model neuron, the bursting model neuron does not encode the detailed time course of the stimulus. A novel measure of feature detection reveals that the bursting neuron signals certain stimulus features. Finally, we show that feature extraction and stimulus estimation are mutually exclusive computations occurring in bursting and tonically firing model neurons, respectively. Our results therefore suggest that stimulus estimation and feature extraction might be parallel computations in certain sensory systems rather than being sequential as has been previously proposed.     

An extended model for a spiking neuron class

This paper proposes an extension to the model of a spiking neuron for information processing in artificial neural networks, developing a new approach for the dynamic threshold of the integrate-and-fire neuron. This new approach invokes characteristics of biological neurons such as the behavior of chemical synapses and the receptor field. We demonstrate how such a digital model of spiking neurons can solve complex nonlinear classification with a single neuron, performing experiments for the classical XOR problem. Compared with rate-coded networks and the classical integrate-and-fire model, the trained network demonstrated faster information processing, requiring fewer neurons and shorter learning periods. The extended model validates all the logic functions of biological neurons when such functions are necessary for the proper flow of binary codes through a neural network.