Stochastic models of neuronal dynamics

Cortical activity is the product of interactions among neuronal populations. Macroscopic electrophysiological phenomena are generated by these interactions. In principle, the mechanisms of these interactions afford constraints on biologically plausible models of electrophysiological responses. In other words, the macroscopic features of cortical activity can be modelled in terms of the microscopic behaviour of neurons. An evoked response potential (ERP) is the mean electrical potential measured from an electrode on the scalp, in response to some event. The purpose of this paper is to outline a population density approach to modelling ERPs.We propose a biologically plausible model of neuronal activity that enables the estimation of physiologically meaningful parameters from electrophysiological data. The model encompasses four basic characteristics of neuronal activity and organization: (i) neurons are dynamic units, (ii) driven by stochastic forces, (iii) organized into populations with similar biophysical properties and response characteristics and (iv) multiple populations interact to form functional networks. This leads to a formulation of population dynamics in terms of the Fokker-Planck equation. The solution of this equation is the temporal evolution of a probability density over state-space, representing the distribution of an ensemble of trajectories. Each trajectory corresponds to the changing state of a neuron. Measurements can be modelled by taking expectations over this density, e.g. mean membrane potential, firing rate or energy consumption per neuron. The key motivation behind our approach is that ERPs represent an average response over many neurons. This means it is sufficient to model the probability density over neurons, because this implicitly models their average state. Although the dynamics of each neuron can be highly stochastic, the dynamics of the density is not. This means we can use Bayesian inference and estimation tools that have already been established for deterministic systems. The potential importance of modelling density dynamics (as opposed to more conventional neural mass models) is that they include interactions among the moments of neuronal states (e.g. the mean depolarization may depend on the variance of synaptic currents through nonlinear mechanisms).Here, we formulate a population model, based on biologically informed model-neurons with spike-rate adaptation and synaptic dynamics. Neuronal sub-populations are coupled to form an observation model, with the aim of estimating and making inferences about coupling among sub-populations using real data. We approximate the time-dependent solution of the system using a bi-orthogonal set and first-order perturbation expansion. For didactic purposes, the model is developed first in the context of deterministic input, and then extended to include stochastic effects. The approach is demonstrated using synthetic data, where model parameters are identified using a Bayesian estimation scheme we have described previously.     

In-phase and anti-phase synchronization in noisy Hodgkin–Huxley neurons

We numerically investigate the influence of intrinsic channel noise on the dynamical response of delay-coupling in neuronal systems. The stochastic dynamics of the spiking is modeled within a stochastic modification of the standard Hodgkin–Huxley model wherein the delay-coupling accounts for the finite propagation time of an action potential along the neuronal axon. We quantify this delay-coupling of the Pyragas-type in terms of the difference between corresponding presynaptic and postsynaptic membrane potentials. For an elementary neuronal network consisting of two coupled neurons we detect characteristic stochastic synchronization patterns which exhibit multiple phase-flip bifurcations: The phase-flip bifurcations occur in form of alternate transitions from an in-phase spiking activity towards an anti-phase spiking activity. Interestingly, these phase-flips remain robust for strong channel noise and in turn cause a striking stabilization of the spiking frequency.     

Stochastic behavior of atrial and ventricular intrinsic cardiac neurons.

To quantify the concurrent transduction capabilities of spatially distributed intrinsic cardiac neurons, the activities generated by atrial vs. ventricular intrinsic cardiac neurons were recorded simultaneously in 12 anesthetized dogs at baseline and during alterations in the cardiac milieu. Few (3%) identified atrial and ventricular neurons (2 of 72 characterized neurons) responded solely to regional mechanical deformation, doing so in a tightly coupled fashion (cross-correlation coefficient r = 0.63). The remaining (97%) atrial and ventricular neurons transduced multimodal stimuli to display stochastic behavior. Specifically, ventricular chemosensory inputs modified these populations such that they generated no short-term coherence among their activities (cross-correlation coefficient r = 0.21 +/- 0.07). Regional ventricular ischemia activated most atrial and ventricular neurons in a noncoupled fashion. Nicotinic activation of atrial neurons enhanced ventricular neuronal activity. Acute decentralization of the intrinsic cardiac nervous system obtunded its neuron responsiveness to cardiac sensory stimuli. Most atrial and ventricular intrinsic cardiac neurons generate concurrent stochastic activity that is predicated primarily upon their cardiac chemotransduction. As a consequence, they display relative independent short-term (beat-to-beat) control over regional cardiac indexes. Over longer time scales, their functional interdependence is manifest as the result of interganglionic interconnections and descending inputs.     

Inferring Neuronal Dynamics from Calcium Imaging Data Using Biophysical Models and Bayesian Inference

Calcium imaging has been used as a promising technique to monitor the dynamic activity of neuronal populations. However, the calcium trace is temporally smeared which restricts the extraction of quantities of interest such as spike trains of individual neurons. To address this issue, spike reconstruction algorithms have been introduced. One limitation of such reconstructions is that the underlying models are not informed about the biophysics of spike and burst generations. Such existing prior knowledge might be useful for constraining the possible solutions of spikes. Here we describe, in a novel Bayesian approach, how principled knowledge about neuronal dynamics can be employed to infer biophysical variables and parameters from fluorescence traces. By using both synthetic and in vitro recorded fluorescence traces, we demonstrate that the new approach is able to reconstruct different repetitive spiking and/or bursting patterns with accurate single spike resolution. Furthermore, we show that the high inference precision of the new approach is preserved even if the fluorescence trace is rather noisy or if the fluorescence transients show slow rise kinetics lasting several hundred milliseconds, and inhomogeneous rise and decay times. In addition, we discuss the use of the new approach for inferring parameter changes, e.g. due to a pharmacological intervention, as well as for inferring complex characteristics of immature neuronal circuits.     

Phase-Coherence Transitions and Communication in the Gamma Range between Delay-Coupled Neuronal Populations

Synchronization between neuronal populations plays an important role in information transmission between brain areas. In particular, collective oscillations emerging from the synchronized activity of thousands of neurons can increase the functional connectivity between neural assemblies by coherently coordinating their phases. This synchrony of neuronal activity can take place within a cortical patch or between different cortical regions. While short-range interactions between neurons involve just a few milliseconds, communication through long-range projections between different regions could take up to tens of milliseconds. How these heterogeneous transmission delays affect communication between neuronal populations is not well known. To address this question, we have studied the dynamics of two bidirectionally delayed-coupled neuronal populations using conductance-based spiking models, examining how different synaptic delays give rise to in-phase/anti-phase transitions at particular frequencies within the gamma range, and how this behavior is related to the phase coherence between the two populations at different frequencies. We have used spectral analysis and information theory to quantify the information exchanged between the two networks. For different transmission delays between the two coupled populations, we analyze how the local field potential and multi-unit activity calculated from one population convey information in response to a set of external inputs applied to the other population. The results confirm that zero-lag synchronization maximizes information transmission, although out-of-phase synchronization allows for efficient communication provided the coupling delay, the phase lag between the populations, and the frequency of the oscillations are properly matched.     

Gamma oscillations as a mechanism for selective information transmission

In the past decades, many studies have focussed on the relation between the input and output of neurons with the aim to understand information processing by neurons. A particular aspect of neuronal information, which has not received much attention so far, concerns the problem of information transfer when a neuron or a population of neurons receives input from two or more (populations of) neurons, in particular when these (populations of) neurons carry different types of information. The aim of the present study is to investigate the responses of neurons to multiple inputs modulated in the gamma frequency range. By a combination of theoretical approaches and computer simulations, we test the hypothesis that enhanced modulation of synchronized excitatory neuronal activity in the gamma frequency range provides an advantage over a less synchronized input for various types of neurons. The results of this study show that the spike output of various types of neurons [i.e. the leaky integrate and fire neuron, the quadratic integrate and fire neuron and the Hodgkin–Huxley (HH) neuron] and that of excitatory–inhibitory coupled pairs of neurons, like the Pyramidal Interneuronal Network Gamma (PING) model, is highly phase-locked to the larger of two gamma-modulated input signals. This implies that the neuron selectively responds to the input with the larger gamma modulation if the amplitude of the gamma modulation exceeds that of the other signals by a certain amount. In that case, the output of the neuron is entrained by one of multiple inputs and that other inputs are not represented in the output. This mechanism for selective information transmission is enhanced for short membrane time constants of the neuron.     

Energy efficiency of information transmission by electrically coupled neurons

The generation of spikes by neurons is energetically a costly process. This paper studies the consumption of energy and the information entropy in the signalling activity of a model neuron both when it is supposed isolated and when it is coupled to another neuron by an electrical synapse. The neuron has been modelled by a four-dimensional Hindmarsh–Rose type kinetic model for which an energy function has been deduced. For the isolated neuron values of energy consumption and information entropy at different signalling regimes have been computed. For two neurons coupled by a gap junction we have analyzed the roles of the membrane and synapse in the contribution of the energy that is required for their organized signalling. Computational results are provided for cases of identical and nonidentical neurons coupled by unidirectional and bidirectional gap junctions. One relevant result is that there are values of the coupling strength at which the organized signalling of two neurons induced by the gap junction takes place at relatively low values of energy consumption and the ratio of mutual information to energy consumption is relatively high. Therefore, communicating at these coupling values could be energetically the most efficient option.     

Neural dynamics as sampling: a model for stochastic computation in recurrent networks of spiking neurons

The organization of computations in networks of spiking neurons in the brain is still largely unknown, in particular in view of the inherently stochastic features of their firing activity and the experimentally observed trial-to-trial variability of neural systems in the brain. In principle there exists a powerful computational framework for stochastic computations, probabilistic inference by sampling, which can explain a large number of macroscopic experimental data in neuroscience and cognitive science. But it has turned out to be surprisingly difficult to create a link between these abstract models for stochastic computations and more detailed models of the dynamics of networks of spiking neurons. Here we create such a link and show that under some conditions the stochastic firing activity of networks of spiking neurons can be interpreted as probabilistic inference via Markov chain Monte Carlo (MCMC) sampling. Since common methods for MCMC sampling in distributed systems, such as Gibbs sampling, are inconsistent with the dynamics of spiking neurons, we introduce a different approach based on non-reversible Markov chains that is able to reflect inherent temporal processes of spiking neuronal activity through a suitable choice of random variables. We propose a neural network model and show by a rigorous theoretical analysis that its neural activity implements MCMC sampling of a given distribution, both for the case of discrete and continuous time. This provides a step towards closing the gap between abstract functional models of cortical computation and more detailed models of networks of spiking neurons.     

Population models for the health effects of ionizing radiation

In this paper we review recently-developed extension frailty, quadratic hazard, stochastic process, microsimulation, and linear latent structure models, which have the potential to describe the health effects of human populations exposed to ionizing radiation. We discuss the most common situations for which such models are appropriate. We also provide examples of how to estimate the parameters of these models from datasets of various designs. Carcinogenesis models are reviewed in context of application to epidemiologic data of population exposed to ionizing radiation. We also discuss the ways of how to generalize stochastic process and correlated frailty models for longitudinal and family analyses in radiation epidemiology.     

One picture is worth at least a million neurons

How many neurons participate in the representation of a single visual image? Answering this question is critical for constraining biologically inspired models of object recognition, which vary greatly in their assumptions from few "grandmother cells" to numerous neurons in widely distributed networks. Functional imaging techniques, such as fMRI, provide an opportunity to explore this issue, since they allow the simultaneous detection of the entire neuronal population responding to each stimulus. Several studies have shown that fMRI BOLD signal is approximately proportional to neuronal activity. However, since it provides an indirect measure of this activity, obtaining a realistic estimate of the number of activated neurons requires several intervening steps. Here, we used the extensive knowledge of primate V1 to yield a conservative estimate of the ratio between hemodynamic response and neuronal firing. This ratio was then used, in addition to several cautious assumptions, to assess the number of neurons responding to a single-object image in the entire visual cortex and particularly in object-related areas. Our results show that at least a million neurons in object-related cortex and about two hundred million neurons in the entire visual cortex are involved in the representation of a single-object image.     

神经元信息编码的代谢消耗：动作电位与能量效率

人脑是一个高效、可靠的信息处理系统,它主导着个体的认知、情感、意识与行为,这些功能的实现需要不断地消耗代谢能量.大脑的能量需求主要被神经元信息编码所消耗,相应的亚细胞过程包括产生和传导动作电位、维持静息电位以及突触传递.神经元编码信息的主要载体是动作电位序列,它的产生与传导贡献了大脑的大部分代谢消耗.动作电位的能量消耗受离子通道的生物物理特性控制.生物物理特性的细胞特异性和空间异质性使得动作电位对代谢能量的利用效率呈现高度可变性,它为理解神经元代谢消耗的规律、起因与结果带来了挑战.本文首先介绍参与神经元编码的亚细胞过程及它们在大脑和小脑皮层中的代谢消耗,然后详细梳理近年来关于动作电位代谢消耗的研究成果,重点讨论影响其能量效率的生物物理因素和放电形状特性,并归纳总结放电消耗的特点,最后对未来神经元编码的代谢消耗研究进行展望.     

Dynamical estimation of neuron and network properties II: path integral Monte Carlo methods

Hodgkin–Huxley (HH) models of neuronal membrane dynamics consist of a set of nonlinear differential equations that describe the time-varying conductance of various ion channels. Using observations of voltage alone we show how to estimate the unknown parameters and unobserved state variables of an HH model in the expected circumstance that the measurements are noisy, the model has errors, and the state of the neuron is not known when observations commence. The joint probability distribution of the observed membrane voltage and the unobserved state variables and parameters of these models is a path integral through the model state space. The solution to this integral allows estimation of the parameters and thus a characterization of many biological properties of interest, including channel complement and density, that give rise to a neuron’s electrophysiological behavior. This paper describes a method for directly evaluating the path integral using a Monte Carlo numerical approach. This provides estimates not only of the expected values of model parameters but also of their posterior uncertainty. Using test data simulated from neuronal models comprising several common channels, we show that short (<50 ms) intracellular recordings from neurons stimulated with a complex time-varying current yield accurate and precise estimates of the model parameters as well as accurate predictions of the future behavior of the neuron. We also show that this method is robust to errors in model specification, supporting model development for biological preparations in which the channel expression and other biophysical properties of the neurons are not fully known.     

Signal propagation in feedforward neuronal networks with unreliable synapses

In this paper, we systematically investigate both the synfire propagation and firing rate propagation in feedforward neuronal network coupled in an all-to-all fashion. In contrast to most earlier work, where only reliable synaptic connections are considered, we mainly examine the effects of unreliable synapses on both types of neural activity propagation in this work. We first study networks composed of purely excitatory neurons. Our results show that both the successful transmission probability and excitatory synaptic strength largely influence the propagation of these two types of neural activities, and better tuning of these synaptic parameters makes the considered network support stable signal propagation. It is also found that noise has significant but different impacts on these two types of propagation. The additive Gaussian white noise has the tendency to reduce the precision of the synfire activity, whereas noise with appropriate intensity can enhance the performance of firing rate propagation. Further simulations indicate that the propagation dynamics of the considered neuronal network is not simply determined by the average amount of received neurotransmitter for each neuron in a time instant, but also largely influenced by the stochastic effect of neurotransmitter release. Second, we compare our results with those obtained in corresponding feedforward neuronal networks connected with reliable synapses but in a random coupling fashion. We confirm that some differences can be observed in these two different feedforward neuronal network models. Finally, we study the signal propagation in feedforward neuronal networks consisting of both excitatory and inhibitory neurons, and demonstrate that inhibition also plays an important role in signal propagation in the considered networks.     

Firing-rate model of a population of adaptive neurons

A firing rate (FR) model for a population of adaptive leaky integrate-and-fire neurons has been proposed. Unlike known FR models, it describes more precisely the unsteady firing regimes and takes into account the effect of slow potassium currents of spike adaptation. Approximations of the adaptive channel conductances are rewritten from voltage-dependent to spike-dependent and then to rate-dependent ones. The proposed FR model is compared with a very detailed population model, namely, the conductance-based Refractory Density model. This comparison shows the coincidence of the first peak of activity after the start of stimulation as well as of the stationary state. As an example of simulation of coupled adaptive neuronal populations, a ring model has been constructed, which reproduces a visual illusion known as tilt after-effect. The FR model is recommended for mathematical analysis of neuronal population activity as well as for computationally expensive large-scale network simulations.     

A model of stochastic variations of postsynaptic activity

Stochastic oscillations imitating postsynaptic activity in the excitatory neurons are produced by a nonlinear difference equation which does not contain any sources of noise. The given back inhibition via inhibitory interneurons presents a negative feedback loop due to which oscillations in the model system are realized. By means of variation of parameters of the system the patterns of stochastic oscillations can be changed in wide range of physiologically meaningful patterns of the neuronal activity.     

Macroscopic Equations Governing Noisy Spiking Neuronal Populations with Linear Synapses

Deriving tractable reduced equations of biological neural networks capturing the macroscopic dynamics of sub-populations of neurons has been a longstanding problem in computational neuroscience. In this paper, we propose a reduction of large-scale multi-population stochastic networks based on the mean-field theory. We derive, for a wide class of spiking neuron models, a system of differential equations of the type of the usual Wilson-Cowan systems describing the macroscopic activity of populations, under the assumption that synaptic integration is linear with random coefficients. Our reduction involves one unknown function, the effective non-linearity of the network of populations, which can be analytically determined in simple cases, and numerically computed in general. This function depends on the underlying properties of the cells, and in particular the noise level. Appropriate parameters and functions involved in the reduction are given for different models of neurons: McKean, Fitzhugh-Nagumo and Hodgkin-Huxley models. Simulations of the reduced model show a precise agreement with the macroscopic dynamics of the networks for the first two models.     

Stochastic Ion Channel Gating in Dendritic Neurons: Morphology Dependence and Probabilistic Synaptic Activation of Dendritic Spikes

Neuronal activity is mediated through changes in the probability of stochastic transitions between open and closed states of ion channels. While differences in morphology define neuronal cell types and may underlie neurological disorders, very little is known about influences of stochastic ion channel gating in neurons with complex morphology. We introduce and validate new computational tools that enable efficient generation and simulation of models containing stochastic ion channels distributed across dendritic and axonal membranes. Comparison of five morphologically distinct neuronal cell types reveals that when all simulated neurons contain identical densities of stochastic ion channels, the amplitude of stochastic membrane potential fluctuations differs between cell types and depends on sub-cellular location. For typical neurons, the amplitude of membrane potential fluctuations depends on channel kinetics as well as open probability. Using a detailed model of a hippocampal CA1 pyramidal neuron, we show that when intrinsic ion channels gate stochastically, the probability of initiation of dendritic or somatic spikes by dendritic synaptic input varies continuously between zero and one, whereas when ion channels gate deterministically, the probability is either zero or one. At physiological firing rates, stochastic gating of dendritic ion channels almost completely accounts for probabilistic somatic and dendritic spikes generated by the fully stochastic model. These results suggest that the consequences of stochastic ion channel gating differ globally between neuronal cell-types and locally between neuronal compartments. Whereas dendritic neurons are often assumed to behave deterministically, our simulations suggest that a direct consequence of stochastic gating of intrinsic ion channels is that spike output may instead be a probabilistic function of patterns of synaptic input to dendrites.     

Des sources neuronales aux signaux EEG : modèle et interprétation des activités épileptiques

This work deals with the interpretation of electrophysiological patients recorded in epileptic patients candidate to surgery. This issue is addressed through a physiologically relevant model for the generation of scalp and intracerebral electroencephalographic (EEG) signals. The proposed model is based on a spatiotemporal representation of the sources of brain activity, which combines a distributed dipole source model and a model of coupled neuronal populations. Signals recorded by sensors (scalp and intracerebral) are then computed by solving the forward problem in the head volume conductor. In this paper, the EEG generation model is used to study the influence of some source-related parameters (spatial extent, position, synchronization) on simulated signals, during epileptic transient activity (interictal spikes). Results show that the model allows for studying, on the one hand, the relationship between the spatiotemporal organization of neuronal sources and the properties of the observed signals and, on the other hand, the relationship between surface and depth EEG signals.     

Conductance Ratios and Cellular Identity

Recent experimental evidence suggests that coordinated expression of ion channels plays a role in constraining neuronal electrical activity. In particular, each neuronal cell type of the crustacean stomatogastric ganglion exhibits a unique set of positive linear correlations between ionic membrane conductances. These data suggest a causal relationship between expressed conductance correlations and features of cellular identity, namely electrical activity type. To test this idea, we used an existing database of conductance-based model neurons. We partitioned this database based on various measures of intrinsic activity, to approximate distinctions between biological cell types. We then tested individual conductance pairs for linear dependence to identify correlations. Contrary to experimental evidence, in which all conductance correlations are positive, 32% of correlations seen in this database were negative relationships. In addition, 80% of correlations seen here involved at least one calcium conductance, which have been difficult to measure experimentally. Similar to experimental results, each activity type investigated had a unique combination of correlated conductances. Finally, we found that populations of models that conform to a specific conductance correlation have a higher likelihood of exhibiting a particular feature of electrical activity. We conclude that regulating conductance ratios can support proper electrical activity of a wide range of cell types, particularly when the identity of the cell is well-defined by one or two features of its activity. Furthermore, we predict that previously unseen negative correlations and correlations involving calcium conductances are biologically plausible.