Firing-rate models capture essential response dynamics of LGN relay cells

Firing-rate models provide a practical tool for studying signal processing in the early visual system, permitting more thorough mathematical analysis than spike-based models. We show here that essential response properties of relay cells in the lateral geniculate nucleus (LGN) can be captured by surprisingly simple firing-rate models consisting of a low-pass filter and a nonlinear activation function. The starting point for our analysis are two spiking neuron models based on experimental data: a spike-response model fitted to data from macaque (Carandini et al. J. Vis., 20(14), 1–2011, 2007), and a model with conductance-based synapses and afterhyperpolarizing currents fitted to data from cat (Casti et al. J. Comput. Neurosci., 24(2), 235–252, 2008). We obtained the nonlinear activation function by stimulating the model neurons with stationary stochastic spike trains, while we characterized the linear filter by fitting a low-pass filter to responses to sinusoidally modulated stochastic spike trains. To account for the non-Poisson nature of retinal spike trains, we performed all analyses with spike trains with higher-order gamma statistics in addition to Poissonian spike trains. Interestingly, the properties of the low-pass filter depend only on the average input rate, but not on the modulation depth of sinusoidally modulated input. Thus, the response properties of our model are fully specified by just three parameters (low-frequency gain, cutoff frequency, and delay) for a given mean input rate and input regularity. This simple firing-rate model reproduces the response of spiking neurons to a step in input rate very well for Poissonian as well as for non-Poissonian input. We also found that the cutoff frequencies, and thus the filter time constants, of the rate-based model are unrelated to the membrane time constants of the underlying spiking models, in agreement with similar observations for simpler models.     

A Statistical Model for In Vivo Neuronal Dynamics

Single neuron models have a long tradition in computational neuroscience. Detailed biophysical models such as the Hodgkin-Huxley model as well as simplified neuron models such as the class of integrate-and-fire models relate the input current to the membrane potential of the neuron. Those types of models have been extensively fitted to in vitro data where the input current is controlled. Those models are however of little use when it comes to characterize intracellular in vivo recordings since the input to the neuron is not known. Here we propose a novel single neuron model that characterizes the statistical properties of in vivo recordings. More specifically, we propose a stochastic process where the subthreshold membrane potential follows a Gaussian process and the spike emission intensity depends nonlinearly on the membrane potential as well as the spiking history. We first show that the model has a rich dynamical repertoire since it can capture arbitrary subthreshold autocovariance functions, firing-rate adaptations as well as arbitrary shapes of the action potential. We then show that this model can be efficiently fitted to data without overfitting. We finally show that this model can be used to characterize and therefore precisely compare various intracellular in vivo recordings from different animals and experimental conditions.     

Emergence of network structure due to spike-timing-dependent plasticity in recurrent neuronal networks IV

In neuronal networks, the changes of synaptic strength (or weight) performed by spike-timing-dependent plasticity (STDP) are hypothesized to give rise to functional network structure. This article investigates how this phenomenon occurs for the excitatory recurrent connections of a network with fixed input weights that is stimulated by external spike trains. We develop a theoretical framework based on the Poisson neuron model to analyze the interplay between the neuronal activity (firing rates and the spike-time correlations) and the learning dynamics, when the network is stimulated by correlated pools of homogeneous Poisson spike trains. STDP can lead to both a stabilization of all the neuron firing rates (homeostatic equilibrium) and a robust weight specialization. The pattern of specialization for the recurrent weights is determined by a relationship between the input firing-rate and correlation structures, the network topology, the STDP parameters and the synaptic response properties. We find conditions for feed-forward pathways or areas with strengthened self-feedback to emerge in an initially homogeneous recurrent network.     

Spectral analysis of input spike trains by spike-timing-dependent plasticity

Spike-timing-dependent plasticity (STDP) has been observed in many brain areas such as sensory cortices, where it is hypothesized to structure synaptic connections between neurons. Previous studies have demonstrated how STDP can capture spiking information at short timescales using specific input configurations, such as coincident spiking, spike patterns and oscillatory spike trains. However, the corresponding computation in the case of arbitrary input signals is still unclear. This paper provides an overarching picture of the algorithm inherent to STDP, tying together many previous results for commonly used models of pairwise STDP. For a single neuron with plastic excitatory synapses, we show how STDP performs a spectral analysis on the temporal cross-correlograms between its afferent spike trains. The postsynaptic responses and STDP learning window determine kernel functions that specify how the neuron "sees" the input correlations. We thus denote this unsupervised learning scheme as 'kernel spectral component analysis' (kSCA). In particular, the whole input correlation structure must be considered since all plastic synapses compete with each other. We find that kSCA is enhanced when weight-dependent STDP induces gradual synaptic competition. For a spiking neuron with a "linear" response and pairwise STDP alone, we find that kSCA resembles principal component analysis (PCA). However, plain STDP does not isolate correlation sources in general, e.g., when they are mixed among the input spike trains. In other words, it does not perform independent component analysis (ICA). Tuning the neuron to a single correlation source can be achieved when STDP is paired with a homeostatic mechanism that reinforces the competition between synaptic inputs. Our results suggest that neuronal networks equipped with STDP can process signals encoded in the transient spiking activity at the timescales of tens of milliseconds for usual STDP.     

Comparison of different neuron models to conductance-based post-stimulus time histograms obtained in cortical pyramidal cells using dynamic-clamp in vitro

A wide diversity of models have been proposed to account for the spiking response of central neurons, from the integrate-and-fire (IF) model and its quadratic and exponential variants, to multiple-variable models such as the Izhikevich (IZ) model and the well-known Hodgkin–Huxley (HH) type models. Such models can capture different aspects of the spiking response of neurons, but there is few objective comparison of their performance. In this article, we provide such a comparison in the context of well-defined stimulation protocols, including, for each cell, DC stimulation, and a series of excitatory conductance injections, arising in the presence of synaptic background activity. We use the dynamic-clamp technique to characterize the response of regular-spiking neurons from guinea-pig visual cortex by computing families of post-stimulus time histograms (PSTH), for different stimulus intensities, and for two different background activities (low- and high-conductance states). The data obtained are then used to fit different classes of models such as the IF, IZ, or HH types, which are constrained by the whole data set. This analysis shows that HH models are generally more accurate to fit the series of experimental PSTH, but their performance is almost equaled by much simpler models, such as the exponential or pulse-based IF models. Similar conclusions were also reached by performing partial fitting of the data, and examining the ability of different models to predict responses that were not used for the fitting. Although such results must be qualified by using more sophisticated stimulation protocols, they suggest that nonlinear IF models can capture surprisingly well the response of cortical regular-spiking neurons and appear as useful candidates for network simulations with conductance-based synaptic interactions.     

Analysis of Chaotic Resonance in Izhikevich Neuron Model

In stochastic resonance (SR), the presence of noise helps a nonlinear system amplify a weak (sub-threshold) signal. Chaotic resonance (CR) is a phenomenon similar to SR but without stochastic noise, which has been observed in neural systems. However, no study to date has investigated and compared the characteristics and performance of the signal responses of a spiking neural system in some chaotic states in CR. In this paper, we focus on the Izhikevich neuron model, which can reproduce major spike patterns that have been experimentally observed. We examine and classify the chaotic characteristics of this model by using Lyapunov exponents with a saltation matrix and Poincaré section methods in order to address the measurement challenge posed by the state-dependent jump in the resetting process. We found the existence of two distinctive states, a chaotic state involving primarily turbulent movement and an intermittent chaotic state. In order to assess the signal responses of CR in these classified states, we introduced an extended Izhikevich neuron model by considering weak periodic signals, and defined the cycle histogram of neuron spikes as well as the corresponding mutual correlation and information. Through computer simulations, we confirmed that both chaotic states in CR can sensitively respond to weak signals. Moreover, we found that the intermittent chaotic state exhibited a prompter response than the chaotic state with primarily turbulent movement.     

Selectivity of stimulus induced responses in cultured hippocampal networks on microelectrode arrays

Sensory information can be encoded using the average firing rate and spike occurrence times in neuronal network responses to external stimuli. Decoding or retrieving stimulus characteristics from the response pattern generally implies that the corresponding neural network has a selective response to various input signals. The role of various spiking activity characteristics (e.g., spike rate and precise spike timing) for basic information processing was widely investigated on the level of neural populations but gave inconsistent evidence for particular mechanisms. Multisite electrophysiology of cultured neural networks grown on microelectrode arrays is a recently developed tool and currently an active research area. In this study, we analyzed the stimulus responses represented by network-wide bursts evoked from various spatial locations (electrodes). We found that the response characteristics, such as the burst initiation time and the spike rate, can be used to retrieve information about the stimulus location. The best selectivity in the response spiking pattern could be found for a small subpopulation of neurones (electrodes) at relatively short post-stimulus intervals. Such intervals were unique for each culture due to the non-uniform organization of the functional connectivity in the network during spontaneous development.     

Collective behavior of large-scale neural networks with GPU acceleration

In this paper, the collective behaviors of a small-world neuronal network motivated by the anatomy of a mammalian cortex based on both Izhikevich model and Rulkov model are studied. The Izhikevich model can not only reproduce the rich behaviors of biological neurons but also has only two equations and one nonlinear term. Rulkov model is in the form of difference equations that generate a sequence of membrane potential samples in discrete moments of time to improve computational efficiency. These two models are suitable for the construction of large scale neural networks. By varying some key parameters, such as the connection probability and the number of nearest neighbor of each node, the coupled neurons will exhibit types of temporal and spatial characteristics. It is demonstrated that the implementation of GPU can achieve more and more acceleration than CPU with the increasing of neuron number and iterations. These two small-world network models and GPU acceleration give us a new opportunity to reproduce the real biological network containing a large number of neurons.     

Weak electric fields detectability in a noisy neural network

We investigate the detectability of weak electric field in a noisy neural network based on Izhikevich neuron model systematically. The neural network is composed of excitatory and inhibitory neurons with similar ratio as that in the mammalian neocortex, and the axonal conduction delays between neurons are also considered. It is found that the noise intensity can modulate the detectability of weak electric field. Stochastic resonance (SR) phenomenon induced by white noise is observed when the weak electric field is added to the network. It is interesting that SR almost disappeared when the connections between neurons are cancelled, suggesting the amplification effects of the neural coupling on the synchronization of neuronal spiking. Furthermore, the network parameters, such as the connection probability, the synaptic coupling strength, the scale of neuron population and the neuron heterogeneity, can also affect the detectability of the weak electric field. Finally, the model sensitivity is studied in detail, and results show that the neural network model has an optimal region for the detectability of weak electric field signal.     

Exploring how extracellular electric field modulates neuron activity through dynamical analysis of a two-compartment neuron model

To investigate how extracellular electric field modulates neuron activity, a reduced two-compartment neuron model in the presence of electric field is introduced in this study. Depending on neuronal geometric and internal coupling parameters, the behaviors of the model have been studied extensively. The neuron model can exist in quiescent state or repetitive spiking state in response to electric field stimulus. Negative electric field mainly acts as inhibitory stimulus to the neuron, positive weak electric field could modulate spiking frequency and spike timing when the neuron is already active, and positive electric fields with sufficient intensity could directly trigger neuronal spiking in the absence of other stimulations. By bifurcation analysis, it is observed that there is saddle-node on invariant circle bifurcation, supercritical Hopf bifurcation and subcritical Hopf bifurcation appearing in the obtained two parameter bifurcation diagrams. The bifurcation structures and electric field thresholds for triggering neuron firing are determined by neuronal geometric and coupling parameters. The model predicts that the neurons with a nonsymmetric morphology between soma and dendrite, are more sensitive to electric field stimulus than those with the spherical structure. These findings suggest that neuronal geometric features play a crucial role in electric field effects on the polarization of neuronal compartments. Moreover, by determining the electric field threshold of our biophysical model, we could accurately distinguish between suprathreshold and subthreshold electric fields. Our study highlights the effects of extracellular electric field on neuronal activity from the biophysical modeling point of view. These insights into the dynamical mechanism of electric field may contribute to the investigation and development of electromagnetic therapies, and the model in our study could be further extended to a neuronal network in which the effects of electric fields on network activity may be investigated.     

Oscillations in Large-Scale Cortical Networks: Map-Based Model

We develop a new computationally efficient approach for the analysis of complex large-scale neurobiological networks. Its key element is the use of a new phenomenological model of a neuron capable of replicating important spike pattern characteristics and designed in the form of a system of difference equations (a map). We developed a set of map-based models that replicate spiking activity of cortical fast spiking, regular spiking and intrinsically bursting neurons. Interconnected with synaptic currents these model neurons demonstrated responses very similar to those found with Hodgkin-Huxley models and in experiments. We illustrate the efficacy of this approach in simulations of one- and two-dimensional cortical network models consisting of regular spiking neurons and fast spiking interneurons to model sleep and activated states of the thalamocortical system. Our study suggests that map-based models can be widely used for large-scale simulations and that such models are especially useful for tasks where the modeling of specific firing patterns of different cell classes is important.     

From spiking neuron models to linear-nonlinear models

Neurons transform time-varying inputs into action potentials emitted stochastically at a time dependent rate. The mapping from current input to output firing rate is often represented with the help of phenomenological models such as the linear-nonlinear (LN) cascade, in which the output firing rate is estimated by applying to the input successively a linear temporal filter and a static non-linear transformation. These simplified models leave out the biophysical details of action potential generation. It is not a priori clear to which extent the input-output mapping of biophysically more realistic, spiking neuron models can be reduced to a simple linear-nonlinear cascade. Here we investigate this question for the leaky integrate-and-fire (LIF), exponential integrate-and-fire (EIF) and conductance-based Wang-Buzsáki models in presence of background synaptic activity. We exploit available analytic results for these models to determine the corresponding linear filter and static non-linearity in a parameter-free form. We show that the obtained functions are identical to the linear filter and static non-linearity determined using standard reverse correlation analysis. We then quantitatively compare the output of the corresponding linear-nonlinear cascade with numerical simulations of spiking neurons, systematically varying the parameters of input signal and background noise. We find that the LN cascade provides accurate estimates of the firing rates of spiking neurons in most of parameter space. For the EIF and Wang-Buzsáki models, we show that the LN cascade can be reduced to a firing rate model, the timescale of which we determine analytically. Finally we introduce an adaptive timescale rate model in which the timescale of the linear filter depends on the instantaneous firing rate. This model leads to highly accurate estimates of instantaneous firing rates.     

Differences in olfactory bulb mitral cell spiking with ortho- and retronasal stimulation revealed by data-driven models

The majority of olfaction studies focus on orthonasal stimulation where odors enter via the front nasal cavity, while retronasal olfaction, where odors enter the rear of the nasal cavity during feeding, is understudied. The coding of retronasal odors via coordinated spiking of neurons in the olfactory bulb (OB) is largely unknown despite evidence that higher level processing is different than orthonasal. To this end, we use multi-electrode array in vivo recordings of rat OB mitral cells (MC) in response to a food odor with both modes of stimulation, and find significant differences in evoked firing rates and spike count covariances (i.e., noise correlations). Differences in spiking activity often have implications for sensory coding, thus we develop a single-compartment biophysical OB model that is able to reproduce key properties of important OB cell types. Prior experiments in olfactory receptor neurons (ORN) showed retro stimulation yields slower and spatially smaller ORN inputs than with ortho, yet whether this is consequential for OB activity remains unknown. Indeed with these specifications for ORN inputs, our OB model captures the salient trends in our OB data. We also analyze how first and second order ORN input statistics dynamically transfer to MC spiking statistics with a phenomenological linear-nonlinear filter model, and find that retro inputs result in larger linear filters than ortho inputs. Finally, our models show that the temporal profile of ORN is crucial for capturing our data and is thus a distinguishing feature between ortho and retro stimulation, even at the OB. Using data-driven modeling, we detail how ORN inputs result in differences in OB dynamics and MC spiking statistics. These differences may ultimately shape how ortho and retro odors are coded.     

Firing pattern and synchronization property analysis in a network model of the olfactory bulb

In the olfactory system, both the temporal spike structure and spatial distribution of neuronal activity are important for processing odor information. In this paper, a biophysically-detailed, spiking neuronal model is used to simulate the activity of olfactory bulb. It is shown that by varying some key parameters such as maximal conductances of Ks and Nap the spike train of single neuron can exhibit various firing patterns. Synchronization in coupled neurons is also investigated as the coupling strength varying in the situation of two neurons and network. It is illustrated that the coupled neurons can exhibit different types of pattern when the coupling strength varies. These results may be instructive to understand information transmission in olfactory system.     

History-dependent excitability as a single-cell substrate of transient memory for information discrimination

Neurons react differently to incoming stimuli depending upon their previous history of stimulation. This property can be considered as a single-cell substrate for transient memory, or context-dependent information processing: depending upon the current context that the neuron "sees" through the subset of the network impinging on it in the immediate past, the same synaptic event can evoke a postsynaptic spike or just a subthreshold depolarization. We propose a formal definition of History-Dependent Excitability (HDE) as a measure of the propensity to firing in any moment in time, linking the subthreshold history-dependent dynamics with spike generation. This definition allows the quantitative assessment of the intrinsic memory for different single-neuron dynamics and input statistics. We illustrate the concept of HDE by considering two general dynamical mechanisms: the passive behavior of an Integrate and Fire (IF) neuron, and the inductive behavior of a Generalized Integrate and Fire (GIF) neuron with subthreshold damped oscillations. This framework allows us to characterize the sensitivity of different model neurons to the detailed temporal structure of incoming stimuli. While a neuron with intrinsic oscillations discriminates equally well between input trains with the same or different frequency, a passive neuron discriminates better between inputs with different frequencies. This suggests that passive neurons are better suited to rate-based computation, while neurons with subthreshold oscillations are advantageous in a temporal coding scheme. We also address the influence of intrinsic properties in single-cell processing as a function of input statistics, and show that intrinsic oscillations enhance discrimination sensitivity at high input rates. Finally, we discuss how the recognition of these cell-specific discrimination properties might further our understanding of neuronal network computations and their relationships to the distribution and functional connectivity of different neuronal types.     

Effects of phase on homeostatic spike rates

Recent experimental results by Talathi et al. (Neurosci Lett 455:145–149, 2009) showed a divergence in the spike rates of two types of population spike events, representing the putative activity of the excitatory and inhibitory neurons in the CA1 area of an animal model for temporal lobe epilepsy. The divergence in the spike rate was accompanied by a shift in the phase of oscillations between these spike rates leading to a spontaneous epileptic seizure. In this study, we propose a model of homeostatic synaptic plasticity which assumes that the target spike rate of populations of excitatory and inhibitory neurons in the brain is a function of the phase difference between the excitatory and inhibitory spike rates. With this model of homeostatic synaptic plasticity, we are able to simulate the spike rate dynamics seen experimentally by Talathi et al. in a large network of interacting excitatory and inhibitory neurons using two different spiking neuron models. A drift analysis of the spike rates resulting from the homeostatic synaptic plasticity update rule allowed us to determine the type of synapse that may be primarily involved in the spike rate imbalance in the experimental observation by Talathi et al. We find excitatory neurons, particularly those in which the excitatory neuron is presynaptic, have the most influence in producing the diverging spike rates and causing the spike rates to be anti-phase. Our analysis suggests that the excitatory neuronal population, more specifically the excitatory to excitatory synaptic connections, could be implicated in a methodology designed to control epileptic seizures.     

Dynamic Alignment Models for Neural Coding

Recently, there have been remarkable advances in modeling the relationships between the sensory environment, neuronal responses, and behavior. However, most models cannot encompass variable stimulus-response relationships such as varying response latencies and state or context dependence of the neural code. Here, we consider response modeling as a dynamic alignment problem and model stimulus and response jointly by a mixed pair hidden Markov model (MPH). In MPHs, multiple stimulus-response relationships (e.g., receptive fields) are represented by different states or groups of states in a Markov chain. Each stimulus-response relationship features temporal flexibility, allowing modeling of variable response latencies, including noisy ones. We derive algorithms for learning of MPH parameters and for inference of spike response probabilities. We show that some linear-nonlinear Poisson cascade (LNP) models are a special case of MPHs. We demonstrate the efficiency and usefulness of MPHs in simulations of both jittered and switching spike responses to white noise and natural stimuli. Furthermore, we apply MPHs to extracellular single and multi-unit data recorded in cortical brain areas of singing birds to showcase a novel method for estimating response lag distributions. MPHs allow simultaneous estimation of receptive fields, latency statistics, and hidden state dynamics and so can help to uncover complex stimulus response relationships that are subject to variable timing and involve diverse neural codes.