Regulation of spike timing in visual cortical circuits

A train of action potentials (a spike train) can carry information in both the average firing rate and the pattern of spikes in the train. But can such a spike-pattern code be supported by cortical circuits? Neurons in vitro produce a spike pattern in response to the injection of a fluctuating current. However, cortical neurons in vivo are modulated by local oscillatory neuronal activity and by top-down inputs. In a cortical circuit, precise spike patterns thus reflect the interaction between internally generated activity and sensory information encoded by input spike trains. We review the evidence for precise and reliable spike timing in the cortex and discuss its computational role.     

Efficient and Accurate Time-Stepping Schemes for Integrate-and-Fire Neuronal Networks

To avoid the numerical errors associated with resetting the potential following a spike in simulations of integrate-and-fire neuronal networks, Hansel et al. and Shelley independently developed a modified time-stepping method. Their particular scheme consists of second-order Runge-Kutta time-stepping, a linear interpolant to find spike times, and a recalibration of postspike potential using the spike times. Here we show analytically that such a scheme is second order, discuss the conditions under which efficient, higher-order algorithms can be constructed to treat resets, and develop a modified fourth-order scheme. To support our analysis, we simulate a system of integrate-and-fire conductance-based point neurons with all-to-all coupling. For six-digit accuracy, our modified Runge-Kutta fourth-order scheme needs a time-step of t = 0.5 × 10^–3 seconds, whereas to achieve comparable accuracy using a recalibrated second-order or a first-order algorithm requires time-steps of 10^–5 seconds or 10^–9 seconds, respectively. Furthermore, since the cortico-cortical conductances in standard integrate-and-fire neuronal networks do not depend on the value of the membrane potential, we can attain fourth-order accuracy with computational costs normally associated with second-order schemes.     

An integrate-and-fire model to generate spike trains with long-range dependence

Long-range dependence (LRD) has been observed in a variety of phenomena in nature, and for several years also in the spiking activity of neurons. Often, this is interpreted as originating from a non-Markovian system. Here we show that a purely Markovian integrate-and-fire (IF) model, with a noisy slow adaptation term, can generate interspike intervals (ISIs) that appear as having LRD. However a proper analysis shows that this is not the case asymptotically. For comparison, we also consider a new model of individual IF neuron with fractional (non-Markovian) noise. The correlations of its spike trains are studied and proven to have LRD, unlike classical IF models. On the other hand, to correctly measure long-range dependence, it is usually necessary to know if the data are stationary. Thus, a methodology to evaluate stationarity of the ISIs is presented and applied to the various IF models. We explain that Markovian IF models may seem to have LRD because of non-stationarities.     

Neuronal Spike Timing Adaptation Described with a Fractional Leaky Integrate-and-Fire Model

The voltage trace of neuronal activities can follow multiple timescale dynamics that arise from correlated membrane conductances. Such processes can result in power-law behavior in which the membrane voltage cannot be characterized with a single time constant. The emergent effect of these membrane correlations is a non-Markovian process that can be modeled with a fractional derivative. A fractional derivative is a non-local process in which the value of the variable is determined by integrating a temporal weighted voltage trace, also called the memory trace. Here we developed and analyzed a fractional leaky integrate-and-fire model in which the exponent of the fractional derivative can vary from 0 to 1, with 1 representing the normal derivative. As the exponent of the fractional derivative decreases, the weights of the voltage trace increase. Thus, the value of the voltage is increasingly correlated with the trajectory of the voltage in the past. By varying only the fractional exponent, our model can reproduce upward and downward spike adaptations found experimentally in neocortical pyramidal cells and tectal neurons in vitro. The model also produces spikes with longer first-spike latency and high inter-spike variability with power-law distribution. We further analyze spike adaptation and the responses to noisy and oscillatory input. The fractional model generates reliable spike patterns in response to noisy input. Overall, the spiking activity of the fractional leaky integrate-and-fire model deviates from the spiking activity of the Markovian model and reflects the temporal accumulated intrinsic membrane dynamics that affect the response of the neuron to external stimulation.     

Variability and coding efficiency of noisy neural spike encoders

Encoding synaptic inputs as a train of action potentials is a fundamental function of nerve cells. Although spike trains recorded in vivo have been shown to be highly variable, it is unclear whether variability in spike timing represents faithful encoding of temporally varying synaptic inputs or noise inherent in the spike encoding mechanism. It has been reported that spike timing variability is more pronounced for constant, unvarying inputs than for inputs with rich temporal structure. This could have significant implications for the nature of neural coding, particularly if precise timing of spikes and temporal synchrony between neurons is used to represent information in the nervous system. To study the potential functional role of spike timing variability, we estimate the fraction of spike timing variability which conveys information about the input for two types of noisy spike encoders--an integrate and fire model with randomly chosen thresholds and a model of a patch of neuronal membrane containing stochastic Na(+) and K(+) channels obeying Hodgkin-Huxley kinetics. The quality of signal encoding is assessed by reconstructing the input stimuli from the output spike trains using optimal linear mean square estimation. A comparison of the estimation performance of noisy neuronal models of spike generation enables us to assess the impact of neuronal noise on the efficacy of neural coding. The results for both models suggest that spike timing variability reduces the ability of spike trains to encode rapid time-varying stimuli. Moreover, contrary to expectations based on earlier studies, we find that the noisy spike encoding models encode slowly varying stimuli more effectively than rapidly varying ones.     

STOCHASTIC RESONANCE MEASURED BY THEMUTUAL INFORMATION IN THE NEURONSTHAT TRANSMIT CHAOTIC SPIKE TRAINS

The spike trains generated by a neuron model are studied by the methods of nonlinear time series analysis. The results show that the spike trains are chaotic. To investigate effect of noise on transmission of chaotic spike trains, this chaotic spike trains are used as a discrete subthreshold input signal to the integrate-and-fire neuronal model and the FitzHugh-Nagumo(FHN) neuronal model working in noisy environment. The mutual information between the input spike trains and the output spike trains is calculated, the result shows that the transformation of information encoded by the chaotic spike trains is optimized by some level of noise, and stochastic resonance(SR) measured by mutual information is a property available for neurons to transmit chaotic spike trains.     

STOCHASTIC RESONANCE MEASURED BY THEMUTUAL INFORMATION IN THE NEURONSTHAT TRANSMIT CHAOTIC SPIKE TRAINS

１ＩｎｔｒｏｄｕｃｔｉｏｎＩｔｉｓｗｅｌｌｋｎｏｗｎｔｈａｔｎｅｒｖｅｃｅｌｌｓｗｏｒｋｉｎｎｏｉｓｙｅｎｖｉｒｏｎｍｅｎｔ,ａｎｄｎｏｉｓｅｓｏｕｒｃｅｓｒａｎｇｉｎｇｆｒｏｍｉｎｔｅｒｎａｌｔｈｅｒｍａｌｎｏｉｓｅｔｏｅｘｔｅｒｎａｌｐｅｒｔｕｒｂａｔｉｏｎ．Ｏｎｅｐｕｚｚｌｉｎｇｐｒｏｂｌｅｍｉｓｈｏｗｄｏｎｅｒｖｅｃｅｌｌｓａｃｃｏｍｍｏｄａｔｅｎｏｉｓｅｉｎｃｏｄｉｎｇａｎｄｔｒａｎｓｆｏｒｍｉｎｇｉｎｆｏｒｍａｔｉｏｎ,ｒｅｃｅｎｔｒｅｓｅａｒｃｈｓｈｏｗｓｔｈａｔｎｏｉｓｅｍａｙｐ…     

Firing-rate model of a population of adaptive neurons

A firing rate (FR) model for a population of adaptive leaky integrate-and-fire neurons has been proposed. Unlike known FR models, it describes more precisely the unsteady firing regimes and takes into account the effect of slow potassium currents of spike adaptation. Approximations of the adaptive channel conductances are rewritten from voltage-dependent to spike-dependent and then to rate-dependent ones. The proposed FR model is compared with a very detailed population model, namely, the conductance-based Refractory Density model. This comparison shows the coincidence of the first peak of activity after the start of stimulation as well as of the stationary state. As an example of simulation of coupled adaptive neuronal populations, a ring model has been constructed, which reproduces a visual illusion known as tilt after-effect. The FR model is recommended for mathematical analysis of neuronal population activity as well as for computationally expensive large-scale network simulations.     

Effects of phase on homeostatic spike rates

Recent experimental results by Talathi et al. (Neurosci Lett 455:145–149, 2009) showed a divergence in the spike rates of two types of population spike events, representing the putative activity of the excitatory and inhibitory neurons in the CA1 area of an animal model for temporal lobe epilepsy. The divergence in the spike rate was accompanied by a shift in the phase of oscillations between these spike rates leading to a spontaneous epileptic seizure. In this study, we propose a model of homeostatic synaptic plasticity which assumes that the target spike rate of populations of excitatory and inhibitory neurons in the brain is a function of the phase difference between the excitatory and inhibitory spike rates. With this model of homeostatic synaptic plasticity, we are able to simulate the spike rate dynamics seen experimentally by Talathi et al. in a large network of interacting excitatory and inhibitory neurons using two different spiking neuron models. A drift analysis of the spike rates resulting from the homeostatic synaptic plasticity update rule allowed us to determine the type of synapse that may be primarily involved in the spike rate imbalance in the experimental observation by Talathi et al. We find excitatory neurons, particularly those in which the excitatory neuron is presynaptic, have the most influence in producing the diverging spike rates and causing the spike rates to be anti-phase. Our analysis suggests that the excitatory neuronal population, more specifically the excitatory to excitatory synaptic connections, could be implicated in a methodology designed to control epileptic seizures.     

Elimination of response latency variability in neuronal spike trains

 Neuronal activity in the mammalian cortex exhibits a considerable amount of trial-by-trial variability. This may be reflected by the magnitude of the activity as well as by the response latency with respect to an external event, such as the onset of a sensory stimulus, or a behavioral event. Here we present a novel nonparametric method for estimating trial-by-trial differences in response latency from neuronal spike trains. The method makes use of the dynamic rate profile for each single trial and maximizes their total pairwise correlation by appropriately shifting all trials in time. The result is a new alignment of trials that largely eliminates the variability in response latency and provides a new internal trigger that is independent of experiment time. To calibrate the method, we simulated spike trains based on stochastic point processes using a parametric model for phasic response profiles. We illustrate the method by an application to simultaneous recordings from a pair of neurons in the motor cortex of a behaving monkey. It is demonstrated how the method can be used to study the temporal relation of the neuronal response to the experiment, to investigate whether neurons share the same dynamics, and to improve spike correlation analysis. Differences between this and other previously published methods are discussed. Received: 8 April 2002 / Accepted: 26 November 2002 / Published online: 7 April 2003 Correspondence to: Stefan Rotter (e-mail: rotter@biologie.uni-freiburg.de), Tel.: +49-761-2032862, Fax: +49-761-2032860 Acknowledgements. We are grateful to Alexa Riehle for providing us with the monkey data and for valuable discussions. We also thank Felix Kümmell, Hiroyuki Nakahara, and Shun-ichi Amari for helpful discussions. Partial funding was received by the Deutsche Forschungsgemeinschaft (DFG, SFB 505) and the German-Israeli Foundation (GIF). Additional support was provided by the RIKEN Brain Science Institute.     

Spike correlation measures that eliminate stimulus effects in response to white noise

When measured in response to non-repeating white noise, standard covariance measures of two neuronal spike trains contain components due simply to a shared stimulus. We argue that, without stimulus repeats, model-free measures cannot in general remove these stimulus-induced components. We present spike correlation measures that eliminate them when the neural response can be approximated by a linear-nonlinear system. One of these measures fully characterizes the correlations in the special case that all remaining correlations are due to small reciprocal connections between the neurons. In addition, we demonstrate that the proposed measures can give accurate results with a more realistic, integrate-and-fire model of neural response, provided that it is driven like a linear-nonlinear system.     

The response of cortical neurons to in vivo-like input current: theory and experiment

The study of several aspects of the collective dynamics of interacting neurons can be highly simplified if one assumes that the statistics of the synaptic input is the same for a large population of similarly behaving neurons (mean field approach). In particular, under such an assumption, it is possible to determine and study all the equilibrium points of the network dynamics when the neuronal response to noisy, in vivo-like, synaptic currents is known. The response function can be computed analytically for simple integrate-and-fire neuron models and it can be measured directly in experiments in vitro. Here we review theoretical and experimental results about the neural response to noisy inputs with stationary statistics. These response functions are important to characterize the collective neural dynamics that are proposed to be the neural substrate of working memory, decision making and other cognitive functions. Applications to the case of time-varying inputs are reviewed in a companion paper (Giugliano et al. in Biol Cybern, 2008). We conclude that modified integrate-and-fire neuron models are good enough to reproduce faithfully many of the relevant dynamical aspects of the neuronal response measured in experiments on real neurons in vitro.     

On a phase diagram for random neural networks with embedded spike timing dependent plasticity

This paper presents an original mathematical framework based on graph theory which is a first attempt to investigate the dynamics of a model of neural networks with embedded spike timing dependent plasticity. The neurons correspond to integrate-and-fire units located at the vertices of a finite subset of 2D lattice. There are two types of vertices, corresponding to the inhibitory and the excitatory neurons. The edges are directed and labelled by the discrete values of the synaptic strength. We assume that there is an initial firing pattern corresponding to a subset of units that generate a spike. The number of activated externally vertices is a small fraction of the entire network. The model presented here describes how such pattern propagates throughout the network as a random walk on graph. Several results are compared with computational simulations and new data are presented for identifying critical parameters of the model.     

Shaping Neuronal Network Activity by Presynaptic Mechanisms

Neuronal microcircuits generate oscillatory activity, which has been linked to basic functions such as sleep, learning and sensorimotor gating. Although synaptic release processes are well known for their ability to shape the interaction between neurons in microcircuits, most computational models do not simulate the synaptic transmission process directly and hence cannot explain how changes in synaptic parameters alter neuronal network activity. In this paper, we present a novel neuronal network model that incorporates presynaptic release mechanisms, such as vesicle pool dynamics and calcium-dependent release probability, to model the spontaneous activity of neuronal networks. The model, which is based on modified leaky integrate-and-fire neurons, generates spontaneous network activity patterns, which are similar to experimental data and robust under changes in the model''s primary gain parameters such as excitatory postsynaptic potential and connectivity ratio. Furthermore, it reliably recreates experimental findings and provides mechanistic explanations for data obtained from microelectrode array recordings, such as network burst termination and the effects of pharmacological and genetic manipulations. The model demonstrates how elevated asynchronous release, but not spontaneous release, synchronizes neuronal network activity and reveals that asynchronous release enhances utilization of the recycling vesicle pool to induce the network effect. The model further predicts a positive correlation between vesicle priming at the single-neuron level and burst frequency at the network level; this prediction is supported by experimental findings. Thus, the model is utilized to reveal how synaptic release processes at the neuronal level govern activity patterns and synchronization at the network level.     

Spike Triggered Hormone Secretion in Vasopressin Cells; a Model Investigation of Mechanism and Heterogeneous Population Function

Vasopressin neurons generate distinctive phasic patterned spike activity in response to elevated extracellular osmotic pressure. These spikes are generated in the cell body and are conducted down the axon to the axonal terminals where they trigger Ca²⁺ entry and subsequent exocytosis of hormone-containing vesicles and secretion of vasopressin. This mechanism is highly non-linear, subject to both frequency facilitation and fatigue, such that the rate of secretion depends on both the rate and patterning of the spike activity. Here we used computational modelling to investigate this relationship and how it shapes the overall response of the neuronal population. We generated a concise single compartment model of the secretion mechanism, fitted to experimentally observed profiles of facilitation and fatigue, and based on representations of the hypothesised underlying mechanisms. These mechanisms include spike broadening, Ca²⁺ channel inactivation, a Ca²⁺ sensitive K⁺ current, and releasable and reserve pools of vesicles. We coupled the secretion model to an existing integrate-and-fire based spiking model in order to study the secretion response to increasing synaptic input, and compared phasic and non-phasic spiking models to assess the functional value of the phasic spiking pattern. The secretory response of individual phasic cells is very non-linear, but the response of a heterogeneous population of phasic cells shows a much more linear response to increasing input, matching the linear response we observe experimentally, though in this respect, phasic cells have no apparent advantage over non-phasic cells. Another challenge for the cells is maintaining this linear response during chronic stimulation, and we show that the activity-dependent fatigue mechanism has a potentially useful function in helping to maintain secretion despite depletion of stores. Without this mechanism, secretion in response to a steady stimulus declines as the stored content declines.     

Analysis,classification, and coding of multielectrode spike trains with hidden Markov models

It is shown that hidden Markov models (HMMs) are a powerful tool in the analysis of multielectrode data. This is demonstrated for a 30-electrode measurement of neuronal spike activity in the monkey's visual cortex during the application of different visual stimuli. HMMs with optimized parameters code the information contained in the spatiotemporal discharge patterns as a probabilistic function of a Markov process and thus provide abstract dynamical models of the pattern-generating process. We compare HMMs obtained from vector-quantized data with models in which parametrized output processes such as multivariate Poisson or binomial distributions are assumed. In the latter cases the visual stimuli are recognized at rates of more than 90% from the neuronal spike patterns. An analysis of the models obtained reveals important aspects of the coding of information in the brain. For example, we identify relevant time scales and characterize the degree and nature of the spatiotemporal variations on these scales.     

Exact digital simulation of time-invariant linear systems with applications to neuronal modeling

An efficient new method for the exact digital simulation of time-invariant linear systems is presented. Such systems are frequently encountered as models for neuronal systems, or as submodules of such systems. The matrix exponential is used to construct a matrix iteration, which propagates the dynamic state of the system step by step on a regular time grid. A large and general class of dynamic inputs to the system, including trains of δ-pulses, can be incorporated into the exact simulation scheme. An extension of the proposed scheme presents an attractive alternative for the approximate simulation of networks of integrate-and-fire neurons with linear sub-threshold integration and non-linear spike generation. The performance of the proposed method is analyzed in comparison with a number of multi-purpose solvers. In simulations of integrate-and-fire neurons, Exact Integration systematically generates the smallest error with respect to both sub-threshold dynamics and spike timing. For the simulation of systems where precise spike timing is important, this results in a practical advantage in particular at moderate integration step sizes. Received: 3 October 1998 / Accepted in revised form: 19 March 1999     

State-space analysis of time-varying higher-order spike correlation for multiple neural spike train data

Precise spike coordination between the spiking activities of multiple neurons is suggested as an indication of coordinated network activity in active cell assemblies. Spike correlation analysis aims to identify such cooperative network activity by detecting excess spike synchrony in simultaneously recorded multiple neural spike sequences. Cooperative activity is expected to organize dynamically during behavior and cognition; therefore currently available analysis techniques must be extended to enable the estimation of multiple time-varying spike interactions between neurons simultaneously. In particular, new methods must take advantage of the simultaneous observations of multiple neurons by addressing their higher-order dependencies, which cannot be revealed by pairwise analyses alone. In this paper, we develop a method for estimating time-varying spike interactions by means of a state-space analysis. Discretized parallel spike sequences are modeled as multi-variate binary processes using a log-linear model that provides a well-defined measure of higher-order spike correlation in an information geometry framework. We construct a recursive Bayesian filter/smoother for the extraction of spike interaction parameters. This method can simultaneously estimate the dynamic pairwise spike interactions of multiple single neurons, thereby extending the Ising/spin-glass model analysis of multiple neural spike train data to a nonstationary analysis. Furthermore, the method can estimate dynamic higher-order spike interactions. To validate the inclusion of the higher-order terms in the model, we construct an approximation method to assess the goodness-of-fit to spike data. In addition, we formulate a test method for the presence of higher-order spike correlation even in nonstationary spike data, e.g., data from awake behaving animals. The utility of the proposed methods is tested using simulated spike data with known underlying correlation dynamics. Finally, we apply the methods to neural spike data simultaneously recorded from the motor cortex of an awake monkey and demonstrate that the higher-order spike correlation organizes dynamically in relation to a behavioral demand.