Firing-rate models for neurons with a broad repertoire of spiking behaviors

Capturing the response behavior of spiking neuron models with rate-based models facilitates the investigation of neuronal networks using powerful methods for rate-based network dynamics. To this end, we investigate the responses of two widely used neuron model types, the Izhikevich and augmented multi-adapative threshold (AMAT) models, to a range of spiking inputs ranging from step responses to natural spike data. We find (i) that linear-nonlinear firing rate models fitted to test data can be used to describe the firing-rate responses of AMAT and Izhikevich spiking neuron models in many cases; (ii) that firing-rate responses are generally too complex to be captured by first-order low-pass filters but require bandpass filters instead; (iii) that linear-nonlinear models capture the response of AMAT models better than of Izhikevich models; (iv) that the wide range of response types evoked by current-injection experiments collapses to few response types when neurons are driven by stationary or sinusoidally modulated Poisson input; and (v) that AMAT and Izhikevich models show different responses to spike input despite identical responses to current injections. Together, these findings suggest that rate-based models of network dynamics may capture a wider range of neuronal response properties by incorporating second-order bandpass filters fitted to responses of spiking model neurons. These models may contribute to bringing rate-based network modeling closer to the reality of biological neuronal networks.     

A Statistical Model for In Vivo Neuronal Dynamics

Single neuron models have a long tradition in computational neuroscience. Detailed biophysical models such as the Hodgkin-Huxley model as well as simplified neuron models such as the class of integrate-and-fire models relate the input current to the membrane potential of the neuron. Those types of models have been extensively fitted to in vitro data where the input current is controlled. Those models are however of little use when it comes to characterize intracellular in vivo recordings since the input to the neuron is not known. Here we propose a novel single neuron model that characterizes the statistical properties of in vivo recordings. More specifically, we propose a stochastic process where the subthreshold membrane potential follows a Gaussian process and the spike emission intensity depends nonlinearly on the membrane potential as well as the spiking history. We first show that the model has a rich dynamical repertoire since it can capture arbitrary subthreshold autocovariance functions, firing-rate adaptations as well as arbitrary shapes of the action potential. We then show that this model can be efficiently fitted to data without overfitting. We finally show that this model can be used to characterize and therefore precisely compare various intracellular in vivo recordings from different animals and experimental conditions.     

STOCHASTIC RESONANCE MEASURED BY THEMUTUAL INFORMATION IN THE NEURONSTHAT TRANSMIT CHAOTIC SPIKE TRAINS

The spike trains generated by a neuron model are studied by the methods of nonlinear time series analysis. The results show that the spike trains are chaotic. To investigate effect of noise on transmission of chaotic spike trains, this chaotic spike trains are used as a discrete subthreshold input signal to the integrate-and-fire neuronal model and the FitzHugh-Nagumo(FHN) neuronal model working in noisy environment. The mutual information between the input spike trains and the output spike trains is calculated, the result shows that the transformation of information encoded by the chaotic spike trains is optimized by some level of noise, and stochastic resonance(SR) measured by mutual information is a property available for neurons to transmit chaotic spike trains.     

STOCHASTIC RESONANCE MEASURED BY THEMUTUAL INFORMATION IN THE NEURONSTHAT TRANSMIT CHAOTIC SPIKE TRAINS

１ＩｎｔｒｏｄｕｃｔｉｏｎＩｔｉｓｗｅｌｌｋｎｏｗｎｔｈａｔｎｅｒｖｅｃｅｌｌｓｗｏｒｋｉｎｎｏｉｓｙｅｎｖｉｒｏｎｍｅｎｔ,ａｎｄｎｏｉｓｅｓｏｕｒｃｅｓｒａｎｇｉｎｇｆｒｏｍｉｎｔｅｒｎａｌｔｈｅｒｍａｌｎｏｉｓｅｔｏｅｘｔｅｒｎａｌｐｅｒｔｕｒｂａｔｉｏｎ．Ｏｎｅｐｕｚｚｌｉｎｇｐｒｏｂｌｅｍｉｓｈｏｗｄｏｎｅｒｖｅｃｅｌｌｓａｃｃｏｍｍｏｄａｔｅｎｏｉｓｅｉｎｃｏｄｉｎｇａｎｄｔｒａｎｓｆｏｒｍｉｎｇｉｎｆｏｒｍａｔｉｏｎ,ｒｅｃｅｎｔｒｅｓｅａｒｃｈｓｈｏｗｓｔｈａｔｎｏｉｓｅｍａｙｐ…     

Effect of synaptic plasticity on sensory coding and steady-state filtering properties in the electric sense

Our modeling study examines short-term plasticity at the synapse between afferents from electroreceptors and pyramidal cells in the electrosensory lateral lobe (ELL) of the weakly electric fish Apteronotus leptorhynchus. It focusses on steady-state filtering and coherence-based coding properties. While developed for electroreception, our study exposes general functional features for different mixtures of depression and facilitation. Our computational model, constrained by the available in vivo and in vitro data, consists of a synapse onto a deterministic leaky integrate-and-fire (LIF) neuron. The synapse is either depressing (D), facilitating (F) or both (FD), and is driven by a sinusoidally or randomly modulated Poisson process. Due to nonlinearity, numerically computed input-output transfer functions are used to determine the filtering properties. The gain of the response at each sinusoidally modulated frequency is computed by dividing the fitted amplitudes of the input and output cycle histograms of the LIF models. While filtering is always low-pass for F alone, D alone exhibits a gain resonance (non-monotonicity) at a frequency that decreases with increasing recovery time constant of synaptic depression (tau(d)). This resonance is mitigated by the presence of F. For D, F and FD, coherence improves as the synaptic conductance time constant (tau(g)) increases, yet the mutual information per spike decreases. The information per spike for D and F follows opposite trends as their respective time constants increase. The broadband but non-monotonic gain and coherence functions seen in vivo suggest that D and perhaps FD dynamics are involved at this synapse. Our results further predict that the likely synaptic configuration is a slower tau(g), e.g. via a mixture of AMPA and NMDA synapses, and a relatively smaller synaptic facilitation time constant (tau(f)) and larger tau(d) (with tau(f) smaller than tau(d) and tau(g)). These results are compatible with known physiology.     

Feature extraction from spike trains with Bayesian binning: ‘Latency is where the signal starts’

The peristimulus time histogram (PSTH) and its more continuous cousin, the spike density function (SDF) are staples in the analytic toolkit of neurophysiologists. The former is usually obtained by binning spike trains, whereas the standard method for the latter is smoothing with a Gaussian kernel. Selection of a bin width or a kernel size is often done in an relatively arbitrary fashion, even though there have been recent attempts to remedy this situation (DiMatteo et al., Biometrika 88(4):1055–1071, 2001; Shimazaki and Shinomoto 2007a, Neural Comput 19(6):1503–1527, 2007b, c; Cunningham et al. 2008). We develop an exact Bayesian, generative model approach to estimating PSTHs. Advantages of our scheme include automatic complexity control and error bars on its predictions. We show how to perform feature extraction on spike trains in a principled way, exemplified through latency and firing rate posterior distribution evaluations on repeated and single trial data. We also demonstrate using both simulated and real neuronal data that our approach provides a more accurate estimates of the PSTH and the latency than current competing methods. We employ the posterior distributions for an information theoretic analysis of the neural code comprised of latency and firing rate of neurons in high-level visual area STSa. A software implementation of our method is available at the machine learning open source software repository (www.mloss.org, project ‘binsdfc’).     

Emergence of network structure due to spike-timing-dependent plasticity in recurrent neuronal networks IV

In neuronal networks, the changes of synaptic strength (or weight) performed by spike-timing-dependent plasticity (STDP) are hypothesized to give rise to functional network structure. This article investigates how this phenomenon occurs for the excitatory recurrent connections of a network with fixed input weights that is stimulated by external spike trains. We develop a theoretical framework based on the Poisson neuron model to analyze the interplay between the neuronal activity (firing rates and the spike-time correlations) and the learning dynamics, when the network is stimulated by correlated pools of homogeneous Poisson spike trains. STDP can lead to both a stabilization of all the neuron firing rates (homeostatic equilibrium) and a robust weight specialization. The pattern of specialization for the recurrent weights is determined by a relationship between the input firing-rate and correlation structures, the network topology, the STDP parameters and the synaptic response properties. We find conditions for feed-forward pathways or areas with strengthened self-feedback to emerge in an initially homogeneous recurrent network.     

Spectral analysis of input spike trains by spike-timing-dependent plasticity

Spike-timing-dependent plasticity (STDP) has been observed in many brain areas such as sensory cortices, where it is hypothesized to structure synaptic connections between neurons. Previous studies have demonstrated how STDP can capture spiking information at short timescales using specific input configurations, such as coincident spiking, spike patterns and oscillatory spike trains. However, the corresponding computation in the case of arbitrary input signals is still unclear. This paper provides an overarching picture of the algorithm inherent to STDP, tying together many previous results for commonly used models of pairwise STDP. For a single neuron with plastic excitatory synapses, we show how STDP performs a spectral analysis on the temporal cross-correlograms between its afferent spike trains. The postsynaptic responses and STDP learning window determine kernel functions that specify how the neuron "sees" the input correlations. We thus denote this unsupervised learning scheme as 'kernel spectral component analysis' (kSCA). In particular, the whole input correlation structure must be considered since all plastic synapses compete with each other. We find that kSCA is enhanced when weight-dependent STDP induces gradual synaptic competition. For a spiking neuron with a "linear" response and pairwise STDP alone, we find that kSCA resembles principal component analysis (PCA). However, plain STDP does not isolate correlation sources in general, e.g., when they are mixed among the input spike trains. In other words, it does not perform independent component analysis (ICA). Tuning the neuron to a single correlation source can be achieved when STDP is paired with a homeostatic mechanism that reinforces the competition between synaptic inputs. Our results suggest that neuronal networks equipped with STDP can process signals encoded in the transient spiking activity at the timescales of tens of milliseconds for usual STDP.     

Testing of information condensation in a model reverberating spiking neural network

Information about external world is delivered to the brain in the form of structured in time spike trains. During further processing in higher areas, information is subjected to a certain condensation process, which results in formation of abstract conceptual images of external world, apparently, represented as certain uniform spiking activity partially independent on the input spike trains details. Possible physical mechanism of condensation at the level of individual neuron was discussed recently. In a reverberating spiking neural network, due to this mechanism the dynamics should settle down to the same uniform/ periodic activity in response to a set of various inputs. Since the same periodic activity may correspond to different input spike trains, we interpret this as possible candidate for information condensation mechanism in a network. Our purpose is to test this possibility in a network model consisting of five fully connected neurons, particularly, the influence of geometric size of the network, on its ability to condense information. Dynamics of 20 spiking neural networks of different geometric sizes are modelled by means of computer simulation. Each network was propelled into reverberating dynamics by applying various initial input spike trains. We run the dynamics until it becomes periodic. The Shannon's formula is used to calculate the amount of information in any input spike train and in any periodic state found. As a result, we obtain explicit estimate of the degree of information condensation in the networks, and conclude that it depends strongly on the net's geometric size.     

Linear-nonlinear-time-warp-poisson models of neural activity

Prominent models of spike trains assume only one source of variability – stochastic (Poisson) spiking – when stimuli and behavior are fixed. However, spike trains may also reflect variability due to internal processes such as planning. For example, we can plan a movement at one point in time and execute it at some arbitrary later time. Neurons involved in planning may thus share an underlying time course that is not precisely locked to the actual movement. Here we combine the standard Linear-Nonlinear-Poisson (LNP) model with Dynamic Time Warping (DTW) to account for shared temporal variability. When applied to recordings from macaque premotor cortex, we find that time warping considerably improves predictions of neural activity. We suggest that such temporal variability is a widespread phenomenon in the brain which should be modeled.     

A generalized linear model for estimating spectrotemporal receptive fields from responses to natural sounds

In the auditory system, the stimulus-response properties of single neurons are often described in terms of the spectrotemporal receptive field (STRF), a linear kernel relating the spectrogram of the sound stimulus to the instantaneous firing rate of the neuron. Several algorithms have been used to estimate STRFs from responses to natural stimuli; these algorithms differ in their functional models, cost functions, and regularization methods. Here, we characterize the stimulus-response function of auditory neurons using a generalized linear model (GLM). In this model, each cell's input is described by: 1) a stimulus filter (STRF); and 2) a post-spike filter, which captures dependencies on the neuron's spiking history. The output of the model is given by a series of spike trains rather than instantaneous firing rate, allowing the prediction of spike train responses to novel stimuli. We fit the model by maximum penalized likelihood to the spiking activity of zebra finch auditory midbrain neurons in response to conspecific vocalizations (songs) and modulation limited (ml) noise. We compare this model to normalized reverse correlation (NRC), the traditional method for STRF estimation, in terms of predictive power and the basic tuning properties of the estimated STRFs. We find that a GLM with a sparse prior predicts novel responses to both stimulus classes significantly better than NRC. Importantly, we find that STRFs from the two models derived from the same responses can differ substantially and that GLM STRFs are more consistent between stimulus classes than NRC STRFs. These results suggest that a GLM with a sparse prior provides a more accurate characterization of spectrotemporal tuning than does the NRC method when responses to complex sounds are studied in these neurons.     

No parallel fiber volleys in the cerebellar cortex: evidence from cross-correlation analysis between Purkinje cells in a computer model and in recordings from anesthetized rats

Purkinje cells aligned on the medio-lateral axis share a large proportion of their 175,000 parallel fiber inputs. This arrangement has led to the hypothesis that movement timing is coded in the cerebellum by beams of synchronously active parallel fibers. In computer simulations I show that such synchronous activation leads to a narrow spike cross-correlation between pairs of Purkinje cells. This peak was completely absent when shared parallel fiber input was active in an asynchronous mode. To determine the presence of synchronous parallel fiber beams {in vivo} I recorded from pairs of Purkinje cells in crus IIa of anesthetized rats. I found a complete absence of precise spike synchronization, even when both cells were strongly modulated in their spike rate by trains of air-puff stimuli to the face. These results indicate that Purkinje cell spiking is not controlled by volleys of synchronous parallel fiber inputs in the conditions examined. Instead, the data support a model by which granule cells primarily control Purkinje cell spiking via dynamic population rate changes.     

Integrate-and-fire vs Poisson models of LGN input to V1 cortex: noisier inputs reduce orientation selectivity

One of the reasons the visual cortex has attracted the interest of computational neuroscience is that it has well-defined inputs. The lateral geniculate nucleus (LGN) of the thalamus is the source of visual signals to the primary visual cortex (V1). Most large-scale cortical network models approximate the spike trains of LGN neurons as simple Poisson point processes. However, many studies have shown that neurons in the early visual pathway are capable of spiking with high temporal precision and their discharges are not Poisson-like. To gain an understanding of how response variability in the LGN influences the behavior of V1, we study response properties of model V1 neurons that receive purely feedforward inputs from LGN cells modeled either as noisy leaky integrate-and-fire (NLIF) neurons or as inhomogeneous Poisson processes. We first demonstrate that the NLIF model is capable of reproducing many experimentally observed statistical properties of LGN neurons. Then we show that a V1 model in which the LGN input to a V1 neuron is modeled as a group of NLIF neurons produces higher orientation selectivity than the one with Poisson LGN input. The second result implies that statistical characteristics of LGN spike trains are important for V1’s function. We conclude that physiologically motivated models of V1 need to include more realistic LGN spike trains that are less noisy than inhomogeneous Poisson processes.     

Spike-interval triggered averaging reveals a quasi-periodic spiking alternative for stochastic resonance in catfish electroreceptors

Catfish detect and identify invisible prey by sensing their ultra-weak electric fields with electroreceptors. Any neuron that deals with small-amplitude input has to overcome sensitivity limitations arising from inherent threshold non-linearities in spike-generation mechanisms. Many sensory cells solve this issue with stochastic resonance, in which a moderate amount of intrinsic noise causes irregular spontaneous spiking activity with a probability that is modulated by the input signal. Here we show that catfish electroreceptors have adopted a fundamentally different strategy. Using a reverse correlation technique in which we take spike interval durations into account, we show that the electroreceptors generate a supra-threshold bias current that results in quasi-periodically produced spikes. In this regime stimuli modulate the interval between successive spikes rather than the instantaneous probability for a spike. This alternative for stochastic resonance combines threshold-free sensitivity for weak stimuli with similar sensitivity for excitations and inhibitions based on single interspike intervals.     

Repetitive firing: a quantitative study of feedback in model encoders

Recognition of nonlinearities in the neuronal encoding of repetitive spike trains has generated a number of models to explain this behavior. Here we develop the mathematics and a set of tests for two such models: the leaky integrator and the variable-gamma model. Both of these are nearly sufficient to explain the dynamic behavior of a number of repetitively firing, sensory neurons. Model parameters can be related to possible underlying basic mechanisms. Summed and nonsummed, spike- locked negative feedback are examined in conjunction with the models. Transfer functions are formulated to predict responses to steady state, steps, and sinusoidally varying stimuli in which output data are the times of spike-train events only. An electrical analog model for the leaky integrator is tested to verify predicted responses. Curve fitting and parameter variation techniques are explored for the purpose of extracting basic model parameters from spike train data. Sinusoidal analysis of spike trains appear to be a very accurate method for determining spike-locked feedback parameters, and it is to a large extent a model independent method that may also be applied to neuronal responses.     

Information transmission in multi-input-output stochastic neuron models

The Shannon's information theory in multiway channels (Shannon, 1961) is applied to multi-input-output relations of the stochastic automaton models for interaction of excitatory and inhibitory impulse sequences proposed in the previous papers (Tsukada et al., 1977). In these models, the output spike train depends upon several statistical characteristics (mean frequency, standard deviation, form, order-dependence or order-independence, etc.) of the excitatory and inhibitory input spike trains. By the use of the multiple-access channel in information theory, some stochastic properties of temporal pattern discrimination in neurons are analyzed and discussed with biological systems.     

Auditory Nerve Spike Generator Modeled as a Variable Attenuator Based on a Saddle Node on Invariant Circle Bifurcation

Mammalian inner hair cells transduce the sound waves amplified by the cochlear amplifier (CA) into a graded neurotransmitter release that activates channels on auditory nerve fibers (ANF). These synaptic channels then charge its dendritic spike generator. While the outer hair cells of the CA employ positive feedback, poising on Andronov-Hopf type instabilities which make them extremely sensitive to faint sounds and make CA output strongly nonlinear, the ANF appears to be based on different principles and a different type of dynamical instability. Its spike generator “digitizes” CA output into trains of action potentials and behaves as a linear filter, rate-coding sound intensity across a wide dynamic range. Here we model the spike generator as a 3 dimensional version of a saddle node on invariant circle (SNIC) bifurcation. The generic 2d SNIC increases its spike rate as the square root of the input current above its spiking threshold. We add negative feedback in the form of a low voltage-threshold potassium conductance that slows down the generator’s rate of increase of its spike rate. A Poisson random source simulates an inner hair cell, outputting a series of noisy periodic current pulses to the model ANF whose spikes phase lock to these pulses and have a linear frequency to current relation with a wide dynamic range. Also, the spike generator compartment has a cholinergic feedback connection from the olive and experiments show that such feedback is able to alter the amount of H conductance inside the generator compartment. We show that an olive able to decrease H would be able to shift the spike generator’s dynamic range to higher sound intensities. In a quiet environment by increasing H the olive would be able to make spike trains similar to those caused by synaptic input.