The stochastic properties of input spike trains control neuronal arithmetic

In the nervous system, the representation of signals is based predominantly on the rate and timing of neuronal discharges. In most everyday tasks, the brain has to carry out a variety of mathematical operations on the discharge patterns. Recent findings show that even single neurons are capable of performing basic arithmetic on the sequences of spikes. However, the interaction of the two spike trains, and thus the resulting arithmetic operation may be influenced by the stochastic properties of the interacting spike trains. If we represent the individual discharges as events of a random point process, then an arithmetical operation is given by the interaction of two point processes. Employing a probabilistic model based on detection of coincidence of random events and complementary computer simulations, we show that the point process statistics control the arithmetical operation being performed and, particularly, that it is possible to switch from subtraction to division solely by changing the distribution of the inter-event intervals of the processes. Consequences of the model for evaluation of binaural information in the auditory brainstem are demonstrated. The results accentuate the importance of the stochastic properties of neuronal discharge patterns for information processing in the brain; further studies related to neuronal arithmetic should therefore consider the statistics of the interacting spike trains.     

Balanced synaptic input shapes the correlation between neural spike trains

Stimulus properties, attention, and behavioral context influence correlations between the spike times produced by a pair of neurons. However, the biophysical mechanisms that modulate these correlations are poorly understood. With a combined theoretical and experimental approach, we show that the rate of balanced excitatory and inhibitory synaptic input modulates the magnitude and timescale of pairwise spike train correlation. High rate synaptic inputs promote spike time synchrony rather than long timescale spike rate correlations, while low rate synaptic inputs produce opposite results. This correlation shaping is due to a combination of enhanced high frequency input transfer and reduced firing rate gain in the high input rate state compared to the low state. Our study extends neural modulation from single neuron responses to population activity, a necessary step in understanding how the dynamics and processing of neural activity change across distinct brain states.     

Multiplying with neurons: Compensation for irregular input spike trains by using time-dependent synaptic efficiencies

A leaky integrate-and-fire (LIF) neurons can act as multipliers by detecting coincidences of input spikes. However, in case of input spike trains with irregular interspike delays, false coincidences are also detected and the operation as a multiplier is degraded. This problem can be solved by using time dependent synaptic weights which are set to zero after each input spike and recover with the same time constant as the decay time of the corresponding excitatory postsynaptic potentials (EPSP). Such a mechanism results in EPSP's with amplitudes independent on the input interspike delays. Neuronal computation is then performed without frequency decoding.     

Sequential interval histogram analysis of non-stationary neuronal spike trains

The spike interval histogram, a commonly used tool for the analysis of neuronal spike trains, is evaluated as a statistical estimator of the probability density function (pdf) ofinterspike intervals. Using a mean square error criterion, it is concluded that a Parzen convolution estimate of the pdf is superior to the conventional histogram procedure. The Parzen estimate using a Gaussian weighting function reduces the number of intervals required to achieve a given error by a factor of 5–10. The Parzen estimation procedure has been implemented in the sequential interval histogram (SQIH) procedure for analysis of non-stationary spike trains. Segments of the spike train are defined using a moving window and the pdf for each segment is estimated sequentially. The procedure which we have found most practical is interactive with the user and utlizes the theoretical results of the error analysis as guidelines for the evolution of an estimation strategy. The SQIH procedure appears useful both as a criterion for stationarity and as a means to characterize non-stationary activity.Portions of this work were presented at the Symposium on Computer Technology in Neuroscience Research, West Virginia University Medical Center, Morgantown, West Virginia, USA, April, 1975.     

Spike timing dependent plasticity finds the start of repeating patterns in continuous spike trains

Experimental studies have observed Long Term synaptic Potentiation (LTP) when a presynaptic neuron fires shortly before a postsynaptic neuron, and Long Term Depression (LTD) when the presynaptic neuron fires shortly after, a phenomenon known as Spike Timing Dependent Plasticity (STDP). When a neuron is presented successively with discrete volleys of input spikes STDP has been shown to learn 'early spike patterns', that is to concentrate synaptic weights on afferents that consistently fire early, with the result that the postsynaptic spike latency decreases, until it reaches a minimal and stable value. Here, we show that these results still stand in a continuous regime where afferents fire continuously with a constant population rate. As such, STDP is able to solve a very difficult computational problem: to localize a repeating spatio-temporal spike pattern embedded in equally dense 'distractor' spike trains. STDP thus enables some form of temporal coding, even in the absence of an explicit time reference. Given that the mechanism exposed here is simple and cheap it is hard to believe that the brain did not evolve to use it.     

Neuronal spike trains and stochastic point processes. II. Simultaneous spike trains

The statistical analysis of two simultaneously observed trains of neuronal spikes is described, using as a conceptual framework the theory of stochastic point processes.The first statistical question that arises is whether the observed trains are independent; statistical techniques for testing independence are developed around the notion that, under the null hypothesis, the times of spike occurrence in one train represent random instants in time with respect to the other. If the null hypothesis is rejected—if dependence is attributed to the trains—the problem then becomes that of characterizing the nature and source of the observed dependencies. Statistical signs of various classes of dependencies, including direct interaction and shared input, are discussed and illustrated through computer simulations of interacting neurons. The effects of nonstationarities on the statistical measures for simultaneous spike trains are also discussed. For two-train comparisons of irregularly discharging nerve cells, moderate nonstationarities are shown to have little effect on the detection of interactions.Combining repetitive stimulation and simultaneous recording of spike trains from two (or more) neurons yields additional clues as to possible modes of interaction among the monitored neurons; the theory presented is illustrated by an application to experimentally obtained data from auditory neurons.A companion paper covers the analysis of single spike trains.     

Formation of feedforward networks and frequency synchrony by spike-timing-dependent plasticity

Spike-timing-dependent plasticity (STDP) with asymmetric learning windows is commonly found in the brain and useful for a variety of spike-based computations such as input filtering and associative memory. A natural consequence of STDP is establishment of causality in the sense that a neuron learns to fire with a lag after specific presynaptic neurons have fired. The effect of STDP on synchrony is elusive because spike synchrony implies unitary spike events of different neurons rather than a causal delayed relationship between neurons. We explore how synchrony can be facilitated by STDP in oscillator networks with a pacemaker. We show that STDP with asymmetric learning windows leads to self-organization of feedforward networks starting from the pacemaker. As a result, STDP drastically facilitates frequency synchrony. Even though differences in spike times are lessened as a result of synaptic plasticity, the finite time lag remains so that perfect spike synchrony is not realized. In contrast to traditional mechanisms of large-scale synchrony based on mutual interaction of coupled neurons, the route to synchrony discovered here is enslavement of downstream neurons by upstream ones. Facilitation of such feedforward synchrony does not occur for STDP with symmetric learning windows. Action Editor: Wulfram Gerstner     

Neuromodulators control the polarity of spike-timing-dependent synaptic plasticity

Near coincidental pre- and postsynaptic action potentials induce associative long-term potentiation (LTP) or long-term depression (LTD), depending on the order of their timing. Here, we show that in visual cortex the rules of this spike-timing-dependent plasticity are not rigid, but shaped by neuromodulator receptors coupled to adenylyl cyclase (AC) and phospholipase C (PLC) signaling cascades. Activation of the AC and PLC cascades results in phosphorylation of postsynaptic glutamate receptors at sites that serve as specific "tags" for LTP and LTD. As a consequence, the outcome (i.e., whether LTP or LTD) of a given pattern of pre- and postsynaptic firing depends not only on the order of the timing, but also on the relative activation of neuromodulator receptors coupled to AC and PLC. These findings indicate that cholinergic and adrenergic neuromodulation associated with the behavioral state of the animal can control the gating and the polarity of cortical plasticity.     

Model based decoding of spike trains

Reliably decoding neuronal responses requires knowing what aspects of neuronal responses are stimulus related, and which aspects act as noise. Recent work shows that spike trains can be viewed as stochastic samples from the rate variation function, as estimated by the time dependent spike density function (or normalized peristimulus time histogram). Such spike trains are exactly described by order statistics, and can be decoded millisecond-by-millisecond by iterative application of order statistics.     

Alias-free sampling of neuronal spike trains

Summary Spectral analysis provides powerful techniques for describing the lower order moments of a stochastic process and interactions between two or more stochastic processes. A major problem in the application of spectral analysis to neuronal spike trains is how to obtain equispaced samples of the spike trains which will give unbiased and alias-free spectral estimates. Various sampling methods, which treat the spike train as a continuous signal, a point process and as a series of Dirac delta-functions, are reviewed and their limitations discussed. A new sampling technique, which gives unbiased and alias-free estimates, is described. This technique treats the spike train as a series of delta functions and generates samples by digital filtering. Implementation of this technique on a small computer is simple and virtually on-line.     

Recurrence plots of neuronal spike trains

The recently developed qualitative method of diagnosis of dynamical systems — recurrence plots has been applied to the analysis of dynamics of neuronal spike trains recorded from cerebellum and red nucleus of anesthetized cats. Recurrence plots revealed robust and common changes in the similarity structure of interspike interval sequences as well as significant deviations from randomness in serial ordering of intervals. Recurring episodes of alike, quasi-deterministic firing patterns suggest the spontaneous modulation of the dynamical complexity of the trajectories of observed neurons. These modulations are associated with changing dynamical properties of a neuronal spike-train-generating system. Their existence is compatible with the information processing paradigm of attractor neural networks.     

Use of `relative-phase' analysis to assess correlation between neuronal spike trains

 We propose a new method of studying the correlation between neuronal spike trains. This technique is based on the analysis of relative phase between two point processes. Relative phase here is defined as the relative timing difference between two spike trains normalized by the associated interspike interval of one cell. This phase measurement is intended to reveal the relative timing relationship between spike trains atdifferent firing rates. We apply this method to a numerical example and an example from two cerebellar neuronal spike trains of a behaving rat. The results are compared with classical cross-correlation analysis. We show that the technique can avoid some of the limitations of cross-correlation methods, reveal certain statistical dependencies that cannot be shown by cross correlation, and provide information as to the direction of influence between two spike trains. Received: 8 November 2001 / Accepted: 30 September 2002 / Published online: 24 January 2003 Correspondence to: Y. Chen (e-mail: chen@nsi.edu, Fax: + 1-858-626-2099) Acknowledgements. Research for this paper was supported by the Alafi Family Foundation and the Neurosciences Research Foundation.     

Transmission of spike trains by nerve fibers after near-threshold stimulation

Spike trains in group A nerve fibers were studied in anesthetized cats in response to stimulation of the hind-limb nerves by random (Poisson) and regular sequences of stimuli. In response to above-threshold stimulation spike trains in the nerve fibers were shown to differ from the stimulating trains purely in the absence of intervals less than 1–1.5 msec in duration, as a result of the presence of a refractory period. With near-threshold stimulation with an average frequency of over 10 per second, spike trains differed significantly from the stimulating trains, as reflected in histograms of interspike intervals, the shape of the intensity function, and the magnitude of the coefficient of correlation for successive intervals. It is postulated that changes in the structure of the spike trains conveyed by a nerve fiber are attributable to the presence of after-activity.A. A. Bogomolets Institute of Physiology, Academy of Sciences of the Ukrainian SSR, Kiev. Translated from Neirofiziologiya, Vol. 8, No. 1, pp. 91–98, January–February, 1976.     

Reading spike timing without a clock: intrinsic decoding of spike trains

The precise timing of action potentials of sensory neurons relative to the time of stimulus presentation carries substantial sensory information that is lost or degraded when these responses are summed over longer time windows. However, it is unclear whether and how downstream networks can access information in precise time-varying neural responses. Here, we review approaches to test the hypothesis that the activity of neural populations provides the temporal reference frames needed to decode temporal spike patterns. These approaches are based on comparing the single-trial stimulus discriminability obtained from neural codes defined with respect to network-intrinsic reference frames to the discriminability obtained from codes defined relative to the experimenter''s computer clock. Application of this formalism to auditory, visual and somatosensory data shows that information carried by millisecond-scale spike times can be decoded robustly even with little or no independent external knowledge of stimulus time. In cortex, key components of such intrinsic temporal reference frames include dedicated neural populations that signal stimulus onset with reliable and precise latencies, and low-frequency oscillations that can serve as reference for partitioning extended neuronal responses into informative spike patterns.     

Recurring discharge patterns in multiple spike trains

Neural networks are parallel processing structures that provide the capability to perform various pattern recognition tasks. A network is typically trained over a set of exemplars by adjusting the weights of the interconnections using a back propagation algorithm. This gradient search converges to locally optimal solutions which may be far removed from the global optimum. In this paper, evolutionary programming is analyzed as a technique for training a general neural network. This approach can yield faster, more efficient yet robust training procedures that accommodate arbitrary interconnections and neurons possessing additional processing capabilities.     

Recurring discharge patterns in multiple spike trains

Simultaneously recorded spike trains were obtained using microwire bundles from unrestrained, drug-free cats during different sleep-waking states in forebrain areas associated with cardiac and respiratory activity. Cardiac and respiratory activity was simultaneously recorded with the spike trains. We applied the recurring discharge patterns detection procedure described in a companion paper (Frostig et al. 1990) to the spike and cardiorespiratory trains. The pattern detection procedure was applied to detect only precise (in time and structure) recurring patterns. Recurring discharge patterns were detected in all simultaneously recorded groups. Recurring discharge patterns were composed of up to ten spikes per pattern and involved up to four simultaneously recorded spike trains. Fourty-two percent of the recurring patterns contained cardiac and/or respiratory events in addition to neuronal spikes. When patterns were compared over different sleep-waking states it was found the the same units produced different patterns in different states, that patterns were significantly more compact in time during quiet sleep, and that changes in the discharge rates accompanying changes in sleep-waking states were not correlated with changes in pattern rate.     

Visualisation of synchronous firing in multi-dimensional spike trains

The gravity transform algorithm is used to study the dependencies in firing of multi-dimensional spike trains. The pros and cons of this algorithm are discussed and the necessity for improved representation of output data is demonstrated. Parallel coordinates are introduced to visualise the results of the gravity transform and principal component analysis (PCA) is used to reduce the quantity of data represented whilst minimising loss of information.