The Influence of Spike Rate and Stimulus Duration on Noradrenergic Neurons

We model spiking neurons in locus coeruleus (LC), a brain nucleus involved in modulating cognitive performance, and compare with recent experimental data. Extracellular recordings from LC of monkeys performing target detection and selective attention tasks show varying responses dependent on stimuli and performance accuracy. From membrane voltage and ion channel equations, we derive a phase oscillator model for LC neurons. Average spiking probabilities of a pool of cells over many trials are then computed via a probability density formulation. These show that: (1) Post-stimulus response is elevated in populations with lower spike rates; (2) Responses decay exponentially due to noise and variable pre-stimulus spike rates; and (3) Shorter stimuli preferentially cause depressed post-activation spiking. These results allow us to propose mechanisms for the different LC responses observed across behavioral and task conditions, and to make explicit the role of baseline firing rates and the duration of task-related inputs in determining LC response.     

Why spikes? Hebbian learning and retrieval of time-resolved excitation patterns

Hebbian learning allows a network of spiking neurons to store and retrieve spatio-temporal patterns with a time resolution of 1 ms, despite the long postsynaptic and dendritic integration times. To show this, we introduce and analyze a model of spiking neurons, the spike response model, with a realistic distribution of axonal delays and with realistic postsynaptic potentials. Learning is performed by a local Hebbian rule which is based on the synchronism of presynaptic neurotransmitter release and some short-acting postsynaptic process. The time window of this synchronism determines the temporal resolution of pattern retrieval, which can be initiated by applying a short external stimulus pattern. Furthermore, a rate quantization is found in dependence upon the threshold value of the neurons, i.e., in a given time a pattern runsn times as often as learned, wheren is a positive integer (n 0). We show that all information about the spike pattern is lost if only mean firing rates (temporal average) or ensemble activities (spatial average) are considered. An average over several retrieval runs in order to generate a post-stimulus time histogram may also deteriorate the signal. The full information on a pattern is contained in the spike raster of a single run. Our results stress the importance, and advantage, of coding by spatio-temporal spike patterns instead of firing rates and average ensemble activity. The implications regarding modelling and experimental data analysis are discussed.     

State-Dependent Effects of Na Channel Noise on Neuronal Burst Generation

We explore the effects of stochastic sodium (Na) channel activation on the variability and dynamics of spiking and bursting in a model neuron. The complete model segregates Hodgin-Huxley-type currents into two compartments, and undergoes applied current-dependent bifurcations between regimes of periodic bursting, chaotic bursting, and tonic spiking. Noise is added to simulate variable, finite sizes of the population of Na channels in the fast spiking compartment.During tonic firing, Na channel noise causes variability in interspike intervals (ISIs). The variance, as well as the sensitivity to noise, depend on the model's biophysical complexity. They are smallest in an isolated spiking compartment; increase significantly upon coupling to a passive compartment; and increase again when the second compartment also includes slow-acting currents. In this full model, sufficient noise can convert tonic firing into bursting.During bursting, the actions of Na channel noise are state-dependent. The higher the noise level, the greater the jitter in spike timing within bursts. The noise makes the burst durations of periodic regimes variable, while decreasing burst length duration and variance in a chaotic regime. Na channel noise blurs the sharp transitions of spike time and burst length seen at the bifurcations of the noise-free model. Close to such a bifurcation, the burst behaviors of previously periodic and chaotic regimes become essentially indistinguishable.We discuss biophysical mechanisms, dynamical interpretations and physiological implications. We suggest that noise associated with finite populations of Na channels could evoke very different effects on the intrinsic variability of spiking and bursting discharges, depending on a biological neuron's complexity and applied current-dependent state. We find that simulated channel noise in the model neuron qualitatively replicates the observed variability in burst length and interburst interval in an isolated biological bursting neuron.     

The effects of various spatial distributions of weak noise on rhythmic spiking

We consider the response of the classical Hodgkin–Huxley (HH) spatial system in the weak to intermediate noise regime near the bifurcation to repetitive spiking. The deterministic component of the input (signal) is restricted to a small segment near the origin whereas noise, with parameter σ, occurs either only in the signal region or throughout the whole neuron. In both cases small noise inhibits the spiking and there is a minimum in the spike counts at σ ≈ 0.15. At the same value of σ, the variance of the spike counts undergoes a pronounced maximum. For spatially restricted noise, the spike count continues to increase beyond the minimum until σ = 0.5, but in the case of spatially extended noise the spike count begins to decline around σ = 0.35 to give a local maximum. For both spatial distributions of noise, the variance of the spike count is found to also have a local minimum at about σ = 0.4. Examples are given of the probability distributions of the spike counts and the spatial distributions of spikes with varying noise level. The differences in behaviours of the spike counts as noise increases beyond 0.3 are attributable to noise-induced spiking outside the signal region, which has a larger probability of occurrence when the noise is over an extended region. This aspect is investigated by ascertaining the probability of noise-induced spiking as a function of noise level and examination of the corresponding latency distributions. These findings prompt a definition of weak noise in the standard HH model as that for which the probability of secondary phenomena is negligible, which occurs when σ is less than about 0.3. Finally, if signal and weak (σ < 0.3) noise are applied on disjoint intervals, then the noise has no effect on the instigation or propagation of spikes, no matter how large its region of application. These results are expected to apply to type 2 neurons in general, including the majority of cortical pyramidal cells.     

Relative spike timing in stochastic oscillator networks of the Hermissenda eye

The role of relative spike timing on sensory coding and stochastic dynamics of small pulse-coupled oscillator networks is investigated physiologically and mathematically, based on the small biological eye network of the marine invertebrate Hermissenda. Without network interactions, the five inhibitory photoreceptors of the eye network exhibit quasi-regular rhythmic spiking; in contrast, within the active network, they display more irregular spiking but collective network rhythmicity. We investigate the source of this emergent network behavior first analyzing the role of relative input to spike–timing relationships in individual cells. We use a stochastic phase oscillator equation to model photoreceptor spike sequences in response to sequences of inhibitory current pulses. Although spike sequences can be complex and irregular in response to inputs, we show that spike timing is better predicted if relative timing of spikes to inputs is accounted for in the model. Further, we establish that greater noise levels in the model serve to destroy network phase-locked states that induce non-monotonic stimulus rate-coding, as predicted in Butson and Clark (J Neurophysiol 99:146–154, 2008a; J Neurophysiol 99:155–165, 2008b). Hence, rate-coding can function better in noisy spiking cells relative to non-noisy cells. We then study how relative input to spike–timing dynamics of single oscillators contribute to network-level dynamics. Relative timing interactions in the network sharpen the stimulus window that can trigger a spike, affecting stimulus encoding. Also, we derive analytical inter-spike interval distributions of cells in the model network, revealing that irregular Poisson-like spike emission and collective network rhythmicity are emergent properties of network dynamics, consistent with experimental observations. Our theoretical results generate experimental predictions about the nature of spike patterns in the Hermissenda eye.     

Spiking regularity in a noisy small-world neuronal network

The regularity of spiking oscillations is studied in the networks with different topological structures. The network is composed of coupled Fitz-Hugh-Nagumo neurons driven by colored noise. The investigation illustrates that the spike train in both the regular and the Watts-Strogatz small-world neuronal networks can show the best regularity at a moderate noise intensity, indicating the existence of coherence resonance. Moreover, the temporal coherence of the spike train in the small-world network is superior to that in a regular network due to the increase of the randomness of the network topology. Besides the noise intensity, the spiking regularity can be optimized by tuning the randomness of the network topological structure or by tuning the correlation time of the colored noise. In particular, under the cooperation of the small-world topology and the correlation time, the spike train with good regularity could sustain a large magnitude of the local noise.     

Spike-interval triggered averaging reveals a quasi-periodic spiking alternative for stochastic resonance in catfish electroreceptors

Catfish detect and identify invisible prey by sensing their ultra-weak electric fields with electroreceptors. Any neuron that deals with small-amplitude input has to overcome sensitivity limitations arising from inherent threshold non-linearities in spike-generation mechanisms. Many sensory cells solve this issue with stochastic resonance, in which a moderate amount of intrinsic noise causes irregular spontaneous spiking activity with a probability that is modulated by the input signal. Here we show that catfish electroreceptors have adopted a fundamentally different strategy. Using a reverse correlation technique in which we take spike interval durations into account, we show that the electroreceptors generate a supra-threshold bias current that results in quasi-periodically produced spikes. In this regime stimuli modulate the interval between successive spikes rather than the instantaneous probability for a spike. This alternative for stochastic resonance combines threshold-free sensitivity for weak stimuli with similar sensitivity for excitations and inhibitions based on single interspike intervals.     

Proposed mechanisms for coincidence detection in the auditory brainstem

Sound localization in mammals uses two distinct neural circuits, one for low- and one for high-frequency bands. Recent experiments call for revision of the theory explaining how the direction of incoming sound is calculated. We propose such a revised theory. Our theory is based on probabilistic spiking and probabilistic delay of spikes from both sides. We have applied the mechanism originally proposed as an operation on spike trains resulting in multiplication of firing rates. We have adapted this mechanism for the case of synchronous spike trains. The mechanism has to detect spikes from both sides within a short time window. Therefore, in both circuits neurons act as coincidence detectors. In the excitatory low-frequency circuit we call the mechanism the excitatory coincidence detection, to distinguish it from the mechanism of the inhibitory coincidence detection in the high-frequency circuit. The times to first spike and gains of the two mechanisms are calculated. We show how the output gains of the mechanisms predict the dip within the human frequency sensitivity range. This dip has been described in human psychophysical experiments.     

Firing-rate models capture essential response dynamics of LGN relay cells

Firing-rate models provide a practical tool for studying signal processing in the early visual system, permitting more thorough mathematical analysis than spike-based models. We show here that essential response properties of relay cells in the lateral geniculate nucleus (LGN) can be captured by surprisingly simple firing-rate models consisting of a low-pass filter and a nonlinear activation function. The starting point for our analysis are two spiking neuron models based on experimental data: a spike-response model fitted to data from macaque (Carandini et al. J. Vis., 20(14), 1–2011, 2007), and a model with conductance-based synapses and afterhyperpolarizing currents fitted to data from cat (Casti et al. J. Comput. Neurosci., 24(2), 235–252, 2008). We obtained the nonlinear activation function by stimulating the model neurons with stationary stochastic spike trains, while we characterized the linear filter by fitting a low-pass filter to responses to sinusoidally modulated stochastic spike trains. To account for the non-Poisson nature of retinal spike trains, we performed all analyses with spike trains with higher-order gamma statistics in addition to Poissonian spike trains. Interestingly, the properties of the low-pass filter depend only on the average input rate, but not on the modulation depth of sinusoidally modulated input. Thus, the response properties of our model are fully specified by just three parameters (low-frequency gain, cutoff frequency, and delay) for a given mean input rate and input regularity. This simple firing-rate model reproduces the response of spiking neurons to a step in input rate very well for Poissonian as well as for non-Poissonian input. We also found that the cutoff frequencies, and thus the filter time constants, of the rate-based model are unrelated to the membrane time constants of the underlying spiking models, in agreement with similar observations for simpler models.     

Spike-based population coding and working memory

Compelling behavioral evidence suggests that humans can make optimal decisions despite the uncertainty inherent in perceptual or motor tasks. A key question in neuroscience is how populations of spiking neurons can implement such probabilistic computations. In this article, we develop a comprehensive framework for optimal, spike-based sensory integration and working memory in a dynamic environment. We propose that probability distributions are inferred spike-per-spike in recurrently connected networks of integrate-and-fire neurons. As a result, these networks can combine sensory cues optimally, track the state of a time-varying stimulus and memorize accumulated evidence over periods much longer than the time constant of single neurons. Importantly, we propose that population responses and persistent working memory states represent entire probability distributions and not only single stimulus values. These memories are reflected by sustained, asynchronous patterns of activity which make relevant information available to downstream neurons within their short time window of integration. Model neurons act as predictive encoders, only firing spikes which account for new information that has not yet been signaled. Thus, spike times signal deterministically a prediction error, contrary to rate codes in which spike times are considered to be random samples of an underlying firing rate. As a consequence of this coding scheme, a multitude of spike patterns can reliably encode the same information. This results in weakly correlated, Poisson-like spike trains that are sensitive to initial conditions but robust to even high levels of external neural noise. This spike train variability reproduces the one observed in cortical sensory spike trains, but cannot be equated to noise. On the contrary, it is a consequence of optimal spike-based inference. In contrast, we show that rate-based models perform poorly when implemented with stochastically spiking neurons.     

Effect of cross-trial nonstationarity on joint-spike events

Common to most correlation analysis techniques for neuronal spiking activity are assumptions of stationarity with respect to various parameters. However, experimental data may fail to be compatible with these assumptions. This failure can lead to falsely assigned significant outcomes. Here we study the effect of nonstationarity of spike rate across trials in a model-based approach. Using a two-rate-state model, where rates are drawn independently for trials and neurons, we show in detail that nonstationarity across trials induces apparent covariation of spike rates identified as the generator of false positives. This finding has specific implications for the "shuffle predictor." Within the framework developed for our model, covariation of spike rates and the mechanism by which the shuffle predictor leads to wrong interpretation of the data can be discussed. Corrections for the influence of nonstationarity across trials by improvements of the predictor are presented.     

No parallel fiber volleys in the cerebellar cortex: evidence from cross-correlation analysis between Purkinje cells in a computer model and in recordings from anesthetized rats

Purkinje cells aligned on the medio-lateral axis share a large proportion of their 175,000 parallel fiber inputs. This arrangement has led to the hypothesis that movement timing is coded in the cerebellum by beams of synchronously active parallel fibers. In computer simulations I show that such synchronous activation leads to a narrow spike cross-correlation between pairs of Purkinje cells. This peak was completely absent when shared parallel fiber input was active in an asynchronous mode. To determine the presence of synchronous parallel fiber beams {in vivo} I recorded from pairs of Purkinje cells in crus IIa of anesthetized rats. I found a complete absence of precise spike synchronization, even when both cells were strongly modulated in their spike rate by trains of air-puff stimuli to the face. These results indicate that Purkinje cell spiking is not controlled by volleys of synchronous parallel fiber inputs in the conditions examined. Instead, the data support a model by which granule cells primarily control Purkinje cell spiking via dynamic population rate changes.     

An Efficient Supervised Training Algorithm for Multilayer Spiking Neural Networks

The spiking neural networks (SNNs) are the third generation of neural networks and perform remarkably well in cognitive tasks such as pattern recognition. The spike emitting and information processing mechanisms found in biological cognitive systems motivate the application of the hierarchical structure and temporal encoding mechanism in spiking neural networks, which have exhibited strong computational capability. However, the hierarchical structure and temporal encoding approach require neurons to process information serially in space and time respectively, which reduce the training efficiency significantly. For training the hierarchical SNNs, most existing methods are based on the traditional back-propagation algorithm, inheriting its drawbacks of the gradient diffusion and the sensitivity on parameters. To keep the powerful computation capability of the hierarchical structure and temporal encoding mechanism, but to overcome the low efficiency of the existing algorithms, a new training algorithm, the Normalized Spiking Error Back Propagation (NSEBP) is proposed in this paper. In the feedforward calculation, the output spike times are calculated by solving the quadratic function in the spike response model instead of detecting postsynaptic voltage states at all time points in traditional algorithms. Besides, in the feedback weight modification, the computational error is propagated to previous layers by the presynaptic spike jitter instead of the gradient decent rule, which realizes the layer-wised training. Furthermore, our algorithm investigates the mathematical relation between the weight variation and voltage error change, which makes the normalization in the weight modification applicable. Adopting these strategies, our algorithm outperforms the traditional SNN multi-layer algorithms in terms of learning efficiency and parameter sensitivity, that are also demonstrated by the comprehensive experimental results in this paper.     

Calculation of local Hurst exponents in the Ca(2+)-activated K(+)-channel dwell time

A novel method based on the maximum overlap wavelet transform of dwell time series is proposed. Information on local multifractal properties of the series, namely local Hurst exponents or Holder exponents, was obtained. The results confirm the presence of multifractality and intrinsic correlations in the Ca(2+)-activated K+ channel dwell time series. The data on the local multifractal structure of the series can be interpreted in terms of processes having self-organized criticality. The proposed approach allows one to widen the store of methods for the analysis of single ion channel activity.     

Stochastic versus deterministic variability in simple neuronal circuits: II. Hippocampal slice.

Long time series of Schaffer collateral to CA1 pyramidal cell presynaptic volleys (stratum radiatum) and population spikes (stratum pyramidale) were evoked (driven) in rat hippocampal slices. From the driven CA1 region in normal [K+] perfusate, both population spike amplitude and an input-output function consisting of population spike amplitude divided by the presynaptic volley amplitude were analyzed. Raising [K+] in the perfusion medium to 8.5 mM, slices were induced to spontaneously burst fire in CA3 and long time series of inter-burst intervals were recorded. Three tests for determinism were applied to these series: a discrete adaptation of a local flow approach, a local dispersion approach, and nonlinear prediction. Surrogate data were generated to serve as mathematical and statistical controls. All of the population spike (6/6) and input-output (6/6) time series from the normal [K+] driven circuitry were stochastic by all three methods. Although most of the time series (5/6) from the autonomously bursting high [K+] state failed to demonstrate evidence of determinism, one (1/6) of these time series did demonstrate significant determinism. This single instance of predictability could not be accounted for by the linear correlation in these data.     

Spike Triggered Hormone Secretion in Vasopressin Cells; a Model Investigation of Mechanism and Heterogeneous Population Function

Vasopressin neurons generate distinctive phasic patterned spike activity in response to elevated extracellular osmotic pressure. These spikes are generated in the cell body and are conducted down the axon to the axonal terminals where they trigger Ca²⁺ entry and subsequent exocytosis of hormone-containing vesicles and secretion of vasopressin. This mechanism is highly non-linear, subject to both frequency facilitation and fatigue, such that the rate of secretion depends on both the rate and patterning of the spike activity. Here we used computational modelling to investigate this relationship and how it shapes the overall response of the neuronal population. We generated a concise single compartment model of the secretion mechanism, fitted to experimentally observed profiles of facilitation and fatigue, and based on representations of the hypothesised underlying mechanisms. These mechanisms include spike broadening, Ca²⁺ channel inactivation, a Ca²⁺ sensitive K⁺ current, and releasable and reserve pools of vesicles. We coupled the secretion model to an existing integrate-and-fire based spiking model in order to study the secretion response to increasing synaptic input, and compared phasic and non-phasic spiking models to assess the functional value of the phasic spiking pattern. The secretory response of individual phasic cells is very non-linear, but the response of a heterogeneous population of phasic cells shows a much more linear response to increasing input, matching the linear response we observe experimentally, though in this respect, phasic cells have no apparent advantage over non-phasic cells. Another challenge for the cells is maintaining this linear response during chronic stimulation, and we show that the activity-dependent fatigue mechanism has a potentially useful function in helping to maintain secretion despite depletion of stores. Without this mechanism, secretion in response to a steady stimulus declines as the stored content declines.     

Added astroglia promote greater synapse density and higher activity in neuronal networks

Astroglia are known to potentiate individual synapses, but their contribution to networks is unclear. Here we examined the effect of adding either astroglia or media conditioned by astroglia on entire networks of rat hippocampal neurons cultured on microelectrode arrays. Added astroglia increased spontaneous spike rates nearly two-fold and glutamate-stimulated spiking by six-fold, with desensitization eliminated for bath addition of 25 microM glutamate. Astrocyte-conditioned medium partly mimicked the effects of added astroglia. Bursting behavior was largely unaffected by added astroglia except with added glutamate. Addition of the GABA(A) receptor antagonist bicuculline also increased spike rates but with more subtle differences between networks without or with added astroglia. This indicates that networks without added astroglia were inhibited greatly. In all conditions, the log-log distribution of spike rates fit well to linear distributions over three orders of magnitude. Networks with added astroglia shifted consistently toward higher spike rates. Immunostaining for GFAP revealed a linear increase with added astroglia, which also increased neuronal survival. The increased spike rates with added astroglia correlated with a 1.7-fold increase in immunoreactive synaptophysin puncta, and increases of six-fold for GABA(Abeta), two-fold for NMDA-R1 and two-fold for Glu-R1 puncta, with receptor clustering that indicated synaptic scaling. Together, these results indicate that added astroglia increase the density of synapses and receptors, and facilitate higher spike rates for many elements in the network. These effects are reproduced by glia-conditioned media, with the exception of glutamate-mediated transmission.     

State-space analysis of time-varying higher-order spike correlation for multiple neural spike train data

Precise spike coordination between the spiking activities of multiple neurons is suggested as an indication of coordinated network activity in active cell assemblies. Spike correlation analysis aims to identify such cooperative network activity by detecting excess spike synchrony in simultaneously recorded multiple neural spike sequences. Cooperative activity is expected to organize dynamically during behavior and cognition; therefore currently available analysis techniques must be extended to enable the estimation of multiple time-varying spike interactions between neurons simultaneously. In particular, new methods must take advantage of the simultaneous observations of multiple neurons by addressing their higher-order dependencies, which cannot be revealed by pairwise analyses alone. In this paper, we develop a method for estimating time-varying spike interactions by means of a state-space analysis. Discretized parallel spike sequences are modeled as multi-variate binary processes using a log-linear model that provides a well-defined measure of higher-order spike correlation in an information geometry framework. We construct a recursive Bayesian filter/smoother for the extraction of spike interaction parameters. This method can simultaneously estimate the dynamic pairwise spike interactions of multiple single neurons, thereby extending the Ising/spin-glass model analysis of multiple neural spike train data to a nonstationary analysis. Furthermore, the method can estimate dynamic higher-order spike interactions. To validate the inclusion of the higher-order terms in the model, we construct an approximation method to assess the goodness-of-fit to spike data. In addition, we formulate a test method for the presence of higher-order spike correlation even in nonstationary spike data, e.g., data from awake behaving animals. The utility of the proposed methods is tested using simulated spike data with known underlying correlation dynamics. Finally, we apply the methods to neural spike data simultaneously recorded from the motor cortex of an awake monkey and demonstrate that the higher-order spike correlation organizes dynamically in relation to a behavioral demand.     

Orientation and direction selectivity of synaptic inputs in visual cortical neurons: a diversity of combinations produces spike tuning

This intracellular study investigates synaptic mechanisms of orientation and direction selectivity in cat area 17. Visually evoked inhibition was analyzed in 88 cells by detecting spike suppression, hyperpolarization, and reduction of trial-to-trial variability of membrane potential. In 25 of these cells, inhibition visibility was enhanced by depolarization and spike inactivation and by direct measurement of synaptic conductances. We conclude that excitatory and inhibitory inputs share the tuning preference of spiking output in 60% of cases, whereas inhibition is tuned to a different orientation in 40% of cases. For this latter type of cells, conductance measurements showed that excitation shared either the preference of the spiking output or that of the inhibition. This diversity of input combinations may reflect inhomogeneities in functional intracortical connectivity regulated by correlation-based activity-dependent processes.     

Running as fast as it can: How spiking dynamics form object groupings in the laminar circuits of visual cortex

How spiking neurons cooperate to control behavioral processes is a fundamental problem in computational neuroscience. Such cooperative dynamics are required during visual perception when spatially distributed image fragments are grouped into emergent boundary contours. Perceptual grouping is a challenge for spiking cells because its properties of collinear facilitation and analog sensitivity occur in response to binary spikes with irregular timing across many interacting cells. Some models have demonstrated spiking dynamics in recurrent laminar neocortical circuits, but not how perceptual grouping occurs. Other models have analyzed the fast speed of certain percepts in terms of a single feedforward sweep of activity, but cannot explain other percepts, such as illusory contours, wherein perceptual ambiguity can take hundreds of milliseconds to resolve by integrating multiple spikes over time. The current model reconciles fast feedforward with slower feedback processing, and binary spikes with analog network-level properties, in a laminar cortical network of spiking cells whose emergent properties quantitatively simulate parametric data from neurophysiological experiments, including the formation of illusory contours; the structure of non-classical visual receptive fields; and self-synchronizing gamma oscillations. These laminar dynamics shed new light on how the brain resolves local informational ambiguities through the use of properly designed nonlinear feedback spiking networks which run as fast as they can, given the amount of uncertainty in the data that they process.