Information transmission in multi-input-output stochastic neuron models

The Shannon's information theory in multiway channels (Shannon, 1961) is applied to multi-input-output relations of the stochastic automaton models for interaction of excitatory and inhibitory impulse sequences proposed in the previous papers (Tsukada et al., 1977). In these models, the output spike train depends upon several statistical characteristics (mean frequency, standard deviation, form, order-dependence or order-independence, etc.) of the excitatory and inhibitory input spike trains. By the use of the multiple-access channel in information theory, some stochastic properties of temporal pattern discrimination in neurons are analyzed and discussed with biological systems.     

Synchronization and sensitivity enhancement of the Hodgkin-Huxley neurons due to inhibitory inputs

Recent experimental results imply that inhibitory postsynaptic potentials can play a functional role in realizing synchronization of neuronal firing in the brain. In order to examine the relation between inhibition and synchronous firing of neurons theoretically, we analyze possible effects of synchronization and sensitivity enhancement caused by inhibitory inputs to neurons with a biologically realistic model of the Hodgkin-Huxley equations. The result shows that, after an inhibitory spike, the firing probability of a single postsynaptic neuron exposed to random excitatory background activity oscillates with time. The oscillation of the firing probability can be related to synchronous firing of neurons receiving an inhibitory spike simultaneously. Further, we show that when an inhibitory spike input precedes an excitatory spike input, the presence of such preceding inhibition raises the firing probability peak of the neuron after the excitatory input. The result indicates that an inhibitory spike input can enhance the sensitivity of the postsynaptic neuron to the following excitatory spike input. Two neural network models based on these effects on postsynaptic neurons caused by inhibitory inputs are proposed to demonstrate possible mechanisms of detecting particular spatiotemporal spike patterns. Received: 15 April 1999 /Accepted in revised form: 25 November 1999     

Effects of phase on homeostatic spike rates

Recent experimental results by Talathi et al. (Neurosci Lett 455:145–149, 2009) showed a divergence in the spike rates of two types of population spike events, representing the putative activity of the excitatory and inhibitory neurons in the CA1 area of an animal model for temporal lobe epilepsy. The divergence in the spike rate was accompanied by a shift in the phase of oscillations between these spike rates leading to a spontaneous epileptic seizure. In this study, we propose a model of homeostatic synaptic plasticity which assumes that the target spike rate of populations of excitatory and inhibitory neurons in the brain is a function of the phase difference between the excitatory and inhibitory spike rates. With this model of homeostatic synaptic plasticity, we are able to simulate the spike rate dynamics seen experimentally by Talathi et al. in a large network of interacting excitatory and inhibitory neurons using two different spiking neuron models. A drift analysis of the spike rates resulting from the homeostatic synaptic plasticity update rule allowed us to determine the type of synapse that may be primarily involved in the spike rate imbalance in the experimental observation by Talathi et al. We find excitatory neurons, particularly those in which the excitatory neuron is presynaptic, have the most influence in producing the diverging spike rates and causing the spike rates to be anti-phase. Our analysis suggests that the excitatory neuronal population, more specifically the excitatory to excitatory synaptic connections, could be implicated in a methodology designed to control epileptic seizures.     

Redundancy reducing processes in single neurons

Interaction mechanisms between excitatory and inhibitory impulse sequences operating on neurons play an important role for the processing of information by the nervous system. For instance, the convergence of excitatory and inhibitory influences on retinal ganglion cells to form their receptive fields has been taken as an example for the process of neuronal sharpening by lateral inhibition. In order to analyze quantitatively the functional behavior of such a system, Shannon's entropy method for multiple access channels has been applied to biological two-inputs-one-output systems using the theoretical model developed by Tsukada et al. (1979). Here we give an extension of this procedure from the point of view to reduce redundancy of information in the input signal space of single neurons and attempt to obtain a new interpretation for the information processing of the system. The concept for the redundancy reducing mechanism in single neurons is examined and discussed for the following two processes. The first process is concerned with a signal space formed by superposing two random sequences on the input of a neuron. In this process, we introduce a coding technique to encode the inhibitory sequence by using the timing of the excitatory sequence, which is closely related to an encoding technique of multiple access channels with a correlated source (Marko, 1966, 1970, 1973; Slepian and Wolf, 1973) and which is an invariant transformation in the input signal space without changing the information contents of the input. The second process is concerned with a procedure of reducing redundant signals in the signal space mentioned before. In this connection, it is an important point to see how single neurons reduce the dimensionality of the signal space via transformation with a minimum loss of effective information. For this purpose we introduce the criterion that average transmission of information from signal space to the output does not change when redundant signals are added. This assumption is based on the fact that two signals are equivalent if and only if they have identical input-output behavior. The mechanism is examined and estimated by using a computer-simulated model. As the result of such a simulation we can estimate the minimal segmentation in the signal space which is necessary and sufficient for temporal pattern sensitivity in neurons.     

Neural spike generator entrainment by regularly spaced synaptic input

 It has been known for 30 years that the output of a repetitively firing neuron or pacemaker can be synchronized (locked) to regularly spaced inhibitory or excitatory postsynaptic input potentials. Conditions for stable locking have been determined mathematically, demonstrated in computer simulation, and locking has been observed in vivo. We have developed a neural spike generator circuit model which exhibits stable locking to externally derived simulated inhibitory or excitatory post-synaptic inputs. Conditions for stable 1 : 1 lock, in which pacemaker output frequency matches that of the periodic input, are derived. These take the form of expressions for stable delay and convergence factor which incorporate known or measurable parameters of the circuit model. The expressions have been evaluated and shown to compare satisfactorily with experimental observations of locking by our circuit model. Received: 28 March 1996 / Accepted in revised form: 18 February 1997     

Statistical Analysis of Membrane Potential Fluctuations: Relation with Presynaptic Spike Train

In a study of integration at the single neuron level, the relationships between the postsynaptic membrane potential and the presynaptic spike train were analyzed. Fluctuations in membrane potential of neurons in the visceral ganglion of Aplysia were measured and described by histograms. The histogram estimates the probability density function of the membrane potential. Comparisons were made among histograms when there was no synaptic input, and when there was a single input in which variations were made in the PSP (postsynaptic potential) sign, i.e. excitatory or inhibitory, and arrival statistics, e.g. slow or fast, regular, Poisson-like, or patterned. This was examined in cells where the membrane potential was constant and in cells in which there was spontaneous pacemaker activity. The form of the histogram depended on whether the neuron was spontaneously quiescent or a pacemaker, or whether it received presynaptic input and, if it did, on the sign and temporal characteristics of such input. From such histograms the mean firing rate of output spike trains can be predicted; additional information of a temporal nature is required, however, to predict features of the interval structure of the output train. Suggestions are made concerning the way the nervous system might utilize the information summarized in the membrane potential histogram.     

Gamma oscillations as a mechanism for selective information transmission

In the past decades, many studies have focussed on the relation between the input and output of neurons with the aim to understand information processing by neurons. A particular aspect of neuronal information, which has not received much attention so far, concerns the problem of information transfer when a neuron or a population of neurons receives input from two or more (populations of) neurons, in particular when these (populations of) neurons carry different types of information. The aim of the present study is to investigate the responses of neurons to multiple inputs modulated in the gamma frequency range. By a combination of theoretical approaches and computer simulations, we test the hypothesis that enhanced modulation of synchronized excitatory neuronal activity in the gamma frequency range provides an advantage over a less synchronized input for various types of neurons. The results of this study show that the spike output of various types of neurons [i.e. the leaky integrate and fire neuron, the quadratic integrate and fire neuron and the Hodgkin–Huxley (HH) neuron] and that of excitatory–inhibitory coupled pairs of neurons, like the Pyramidal Interneuronal Network Gamma (PING) model, is highly phase-locked to the larger of two gamma-modulated input signals. This implies that the neuron selectively responds to the input with the larger gamma modulation if the amplitude of the gamma modulation exceeds that of the other signals by a certain amount. In that case, the output of the neuron is entrained by one of multiple inputs and that other inputs are not represented in the output. This mechanism for selective information transmission is enhanced for short membrane time constants of the neuron.     

Multimodal interval distributions

Summary A mathematical model is presented that is supposed to describe certain types of multimodal interval distributions of neuronal discharges. Basically it consits of the selective interaction between an excitatory and an inhibitory impulse sequence. The theoretical results are compared with nerve cell interval distributions reported in the literature, and with distributions from simulation studies. A possible relationship between the properties of this model and longtailed interval distributions is indicated. Several extensions are discussed.     

Mechanisms of dendritic integration underlying gain control in fly motion-sensitive interneurons

In the compensatory optomotor response of the fly the interesting phenomenon of gain control has been observed by Reichardt and colleagues (Reichardt et al., 1983): The amplitude of the response tends to saturate with increasing stimulus size, but different saturation plateaus are assumed with different velocities at which the stimulus is moving. This characteristic can already be found in the motion-sensitive large field neurons of the fly optic lobes that play a role in mediating this behavioral response (Hausen, 1982; Reichardt et al, 1983; Egelhaaf, 1985; Haag et al., 1992). To account for gain control a model was proposed involving shunting inhibition of these cells by another cell, the so-called pool cell (Reichardt et al., 1983), both cells sharing common input from an array of local motion detectors. This article describes an alternative model which only requires dendritic integration of the output signals of two types of local motion detectors with opposite polarity. The explanation of gain control relies on recent findings that these input elements are not perfectly directionally selective and that their direction selectivity is a function of pattern velocity. As a consequence, the resulting postsynaptic potential in the dendrite of the integrating cell saturates with increasing pattern size at a level between the excitatory and inhibitory reversal potentials. The exact value of saturation is then set by the activation ratio of excitatory and inhibitory input elements which in turn is a function of other stimulus parameters such as pattern velocity. Thus, the apparently complex phenomenon of gain control can be simply explained by the biophysics of dendritic integration in conjunction with the properties of the motion-sensitive input elements.     

A neural network model of reliably optimized spike transmission

We studied the detailed structure of a neuronal network model in which the spontaneous spike activity is correctly optimized to match the experimental data and discuss the reliability of the optimized spike transmission. Two stochastic properties of the spontaneous activity were calculated: the spike-count rate and synchrony size. The synchrony size, expected to be an important factor for optimization of spike transmission in the network, represents a percentage of observed coactive neurons within a time bin, whose probability approximately follows a power-law. We systematically investigated how these stochastic properties could matched to those calculated from the experimental data in terms of the log-normally distributed synaptic weights between excitatory and inhibitory neurons and synaptic background activity induced by the input current noise in the network model. To ensure reliably optimized spike transmission, the synchrony size as well as spike-count rate were simultaneously optimized. This required changeably balanced log-normal distributions of synaptic weights between excitatory and inhibitory neurons and appropriately amplified synaptic background activity. Our results suggested that the inhibitory neurons with a hub-like structure driven by intensive feedback from excitatory neurons were a key factor in the simultaneous optimization of the spike-count rate and synchrony size, regardless of different spiking types between excitatory and inhibitory neurons.     

Firing statistics of inhibitory neuron with delayed feedback. I. Output ISI probability density

Activity of inhibitory neuron with delayed feedback is considered in the framework of point stochastic processes. The neuron receives excitatory input impulses from a Poisson stream, and inhibitory impulses from the feedback line with a delay. We investigate here, how does the presence of inhibitory feedback affect the output firing statistics. Using binding neuron (BN) as a model, we derive analytically the exact expressions for the output interspike intervals (ISI) probability density, mean output ISI and coefficient of variation as functions of model's parameters for the case of threshold 2. Using the leaky integrate-and-fire (LIF) model, as well as the BN model with higher thresholds, these statistical quantities are found numerically. In contrast to the previously studied situation of no feedback, the ISI probability densities found here both for BN and LIF neuron become bimodal and have discontinuity of jump type. Nevertheless, the presence of inhibitory delayed feedback was not found to affect substantially the output ISI coefficient of variation. The ISI coefficient of variation found ranges between 0.5 and 1. It is concluded that introduction of delayed inhibitory feedback can radically change neuronal output firing statistics. This statistics is as well distinct from what was found previously (Vidybida and Kravchuk, 2009) by a similar method for excitatory neuron with delayed feedback.     

Firing-rate models capture essential response dynamics of LGN relay cells

Firing-rate models provide a practical tool for studying signal processing in the early visual system, permitting more thorough mathematical analysis than spike-based models. We show here that essential response properties of relay cells in the lateral geniculate nucleus (LGN) can be captured by surprisingly simple firing-rate models consisting of a low-pass filter and a nonlinear activation function. The starting point for our analysis are two spiking neuron models based on experimental data: a spike-response model fitted to data from macaque (Carandini et al. J. Vis., 20(14), 1–2011, 2007), and a model with conductance-based synapses and afterhyperpolarizing currents fitted to data from cat (Casti et al. J. Comput. Neurosci., 24(2), 235–252, 2008). We obtained the nonlinear activation function by stimulating the model neurons with stationary stochastic spike trains, while we characterized the linear filter by fitting a low-pass filter to responses to sinusoidally modulated stochastic spike trains. To account for the non-Poisson nature of retinal spike trains, we performed all analyses with spike trains with higher-order gamma statistics in addition to Poissonian spike trains. Interestingly, the properties of the low-pass filter depend only on the average input rate, but not on the modulation depth of sinusoidally modulated input. Thus, the response properties of our model are fully specified by just three parameters (low-frequency gain, cutoff frequency, and delay) for a given mean input rate and input regularity. This simple firing-rate model reproduces the response of spiking neurons to a step in input rate very well for Poissonian as well as for non-Poissonian input. We also found that the cutoff frequencies, and thus the filter time constants, of the rate-based model are unrelated to the membrane time constants of the underlying spiking models, in agreement with similar observations for simpler models.     

On some properties of stochastic information processes in neurons and neuron populations

The information in the nervous spike trains and its processing by neural units are discussed. In these problems, our attention is focused on the stochastic properties of neurons and neuron populations. There are three subjects in this paper, which are the spontaneous type neuron, the forced type neuron and the reciprocal inhibitory pairs.

1. The spontaneous type neuron produces spikes without excitatory inputs. The mathematical model has the following assumptions. The neuron potential (NP) has the fluctuation and obeys the Ornstein-Uhlenbeck process, because the N P is not so perfectly random as that of the Wiener process but has an attraction to the rest value. The threshold varies exponentially and the NP has the constant lower limit. When the NP reaches the threshold, the neuron fires and the NP is reset to a certain position. After a firing, an absolute refractory period exists. In discussing the stochastic properties of neurons, the transition probability density function and the first passage time density function are the important quantities, which are governed by the Kolmogorov's equations. Although they can be set up easily, we can rarely obtain the analytical solutions in time domain. Moreover, they cover only simple properties. Hence the numerical analysis is performed and a good deal of fair results are obtained and discussed.
2. The forced type neuron has input pulse trains which are assumed to be based on the Poisson process. Other assumptions and methods are almost the same as above except the diffusion approximation of the stochastic process. In this case, we encounter the inhomogeneous process due to the pulse-frequency-modulation, whose first passage time density reveals the multimodal distribution. The numerical analysis is also tried, and the output spike interval density is further discussed in the case of the periodic modulation.
3. Two types of reciprocal inhibitory pairs are discussed. The first type has two excitatory driving inputs which are mutually independent. The second type has one common excitatory input but it advances in two ways, one of which has a time lag. The neuron dynamics is the same as that of the forced type neuron and each neuron has an identical structure. The inputs are assumed to be based on the Poisson process and the inhibition occurs when the companion neuron fires. In this case, the equations of the probability density functions are not obtained. Hence the computer simulation is tried and it is observed that the stochastic rhythm emerges in spite of the temporally homogeneous inputs. Furthermore, the case of inhomogeneous inputs is discussed.

     

Predicting the synaptic information efficacy in cortical layer 5 pyramidal neurons using a minimal integrate-and-fire model

Synaptic information efficacy (SIE) is a statistical measure to quantify the efficacy of a synapse. It measures how much information is gained, on the average, about the output spike train of a postsynaptic neuron if the input spike train is known. It is a particularly appropriate measure for assessing the input–output relationship of neurons receiving dynamic stimuli. Here, we compare the SIE of simulated synaptic inputs measured experimentally in layer 5 cortical pyramidal neurons in vitro with the SIE computed from a minimal model constructed to fit the recorded data. We show that even with a simple model that is far from perfect in predicting the precise timing of the output spikes of the real neuron, the SIE can still be accurately predicted. This arises from the ability of the model to predict output spikes influenced by the input more accurately than those driven by the background current. This indicates that in this context, some spikes may be more important than others. Lastly we demonstrate another aspect where using mutual information could be beneficial in evaluating the quality of a model, by measuring the mutual information between the model’s output and the neuron’s output. The SIE, thus, could be a useful tool for assessing the quality of models of single neurons in preserving input–output relationship, a property that becomes crucial when we start connecting these reduced models to construct complex realistic neuronal networks.     

A model for neuron firing with exponential decay of potential resulting in diffusion equations for probability density

A neuron is assumed to receive synaptic input of both excitatory and inhibitory natures from a large number of neighboring neurons; it is also assumed that a large number of such impulses are required to raise the neuron’s transmembrane potential to its threshold potential, at which it “fires” or “spikes”. The model is similar to one of Gerstein and Mandelbrot, except that in the absence of input an exponential decay of potential toward a resting level is introduced. Computational methods of determining the spike timeinterval distribution are discussed, along with the inverse problem of estimating the parameters of the system from observed spike time-interval data.     

Temperature compensation in the nervous system of the grasshopper

Abstract The wind-sensitive head hair neurones of the grasshopper Schistocerca americana (Drury) are influenced by temperature, increasing the number of spikes fired in response to a given hair deflection as temperature increases. Because these neurones show similar increases in spike output for greater hair deflections, an interneurone which receives their input would not be able to distinguish changes in stimulus strength from changes in temperature, unless the effects of temperature were compensated or independently measured. This study examines the effects of temperature on the output of the tritocerebral commissure giant (TCG), an interneurone that receives wind hair input. Some wind hairs provide excitatory input to the TCG, while others are inhibitory (Bacon & Möhl, 1983). Temperature variations similar to those measured in freely moving animals were applied to the wind hairs and TCG while the interneurone's spike output was recorded. Two manipulations resulted in temperature compensated outputs from the TCG: (1) When both excitatory and inhibitory hair fields were stimulated simultaneously, the temperature sensitivity of the interneurone's spike output was significantly lower than when the excitatory hairs alone were stimulated. (2) The spike output of the TCG showed very little sensitivity to temperature changes which occurred only at its wind hair inputs, the temperature of the interneurone itself remaining constant. It is therefore possible for the output of a neural circuit to be temperature compensated even though the circuit itself may be composed of temperature-sensitive units. Possible mechanisms by which temperature compensation may be produced in the TCG are discussed, and the behavioural relevance of the conditions under which TCG output is temperature compensated is considered.     

A review of the integrate-and-fire neuron model: II. Inhomogeneous synaptic input and network properties

The integrate-and-fire neuron model describes the state of a neuron in terms of its membrane potential, which is determined by the synaptic inputs and the injected current that the neuron receives. When the membrane potential reaches a threshold, an action potential (spike) is generated. This review considers the model in which the synaptic input varies periodically and is described by an inhomogeneous Poisson process, with both current and conductance synapses. The focus is on the mathematical methods that allow the output spike distribution to be analyzed, including first passage time methods and the Fokker–Planck equation. Recent interest in the response of neurons to periodic input has in part arisen from the study of stochastic resonance, which is the noise-induced enhancement of the signal-to-noise ratio. Networks of integrate-and-fire neurons behave in a wide variety of ways and have been used to model a variety of neural, physiological, and psychological phenomena. The properties of the integrate-and-fire neuron model with synaptic input described as a temporally homogeneous Poisson process are reviewed in an accompanying paper (Burkitt in Biol Cybern, 2006).     

What the mantis shrimp's eye (possibly) tells its raptorial appendages

On the distal lamina surface of stomatoped eyes a matrix of horizontal and vertical nerve fibers processes the complex input patterns. The output of these integrating fibers is a spike discharge pattern correlated to the input pattern. Here we introduce a ± neuron which either subtracts or sums the outputs from the set of horizontal and vertical fibers activated at that moment. The output pattern of spike frequencies of the ± neuron locates a target in space. Over a parallel channel outputs from the vertical fibers pass a bandpass filter and constitute one of the inputs for a decision neuron. The other input derives from specialized ommatidia at the center of the eye. If both inputs arrive within a short time interval, they sum, the threshold is reached and the decision neuron fires. Spikes from the decision neuron are the final cue for the muscles of the raptorial appendages. The appendages shoot forward and hit the prey with high precision.