A review of the integrate-and-fire neuron model: II. Inhomogeneous synaptic input and network properties

The integrate-and-fire neuron model describes the state of a neuron in terms of its membrane potential, which is determined by the synaptic inputs and the injected current that the neuron receives. When the membrane potential reaches a threshold, an action potential (spike) is generated. This review considers the model in which the synaptic input varies periodically and is described by an inhomogeneous Poisson process, with both current and conductance synapses. The focus is on the mathematical methods that allow the output spike distribution to be analyzed, including first passage time methods and the Fokker–Planck equation. Recent interest in the response of neurons to periodic input has in part arisen from the study of stochastic resonance, which is the noise-induced enhancement of the signal-to-noise ratio. Networks of integrate-and-fire neurons behave in a wide variety of ways and have been used to model a variety of neural, physiological, and psychological phenomena. The properties of the integrate-and-fire neuron model with synaptic input described as a temporally homogeneous Poisson process are reviewed in an accompanying paper (Burkitt in Biol Cybern, 2006).     

Effects of active versus passive dendritic membranes on the transfer properties of a simulated neuron

In a simulated neuron with a dendritic tree, the relative effects of active and passive dendritic membranes on transfer properties were studied. The simulations were performed by means of a digital computer. The computations calculated the changes in transmembrane voltages of many compartments over time as a function of other biophysical variables. These variables were synaptic input intensity, critical firing threshold, rate of leakage of current across the membrane, and rate of longitudinal current spread between compartments. For both passive and active dendrites, the transfer properties of the soma studied for different rates of longitudinal current spread. With low rates of current spread, graded changes in firing threshold produced correspondingly graded changes in output discharge. With high rates of current spread, the neuron became a bistable operator where spiking was enhanced if the threshold was below a certain level and suppressed if the threshold was above that level. Since alterations in firing threshold were shown to have the same effect on firing rate as alterations in synaptic input intensity, the neuron can be said to change from graded to contrast-enhancing in its response to stimuli of different intensities. The presence or absence of dendritic spiking was found to have a significant effect on the integrative properties of the simulated neuron. In particular, contrast enhancement was considerably more pronounced in neurons with passive than with active dendrites in that somatic spike rates reached a higher maximum when dendrites were passive. With active dendrites, a less intense input was needed to initiate somatic spiking than with passive dendrites because a distal dendritic spike could easily propagate by means of longitudinal current spread to the soma. Once somatic spiking was initiated, though, spike rates tended to be lower with active than with passive dendrites because the soma recovered more slowly from its post-spike refractory period if it was also influenced by refractory periods in the dendrites. The experiment of comparing neurons with active and passive dendrites was repeated at a different, higher value of synaptic input. The same differences in transfer properties between the active and passive cases emerged as before. Spiking patterns in neurons with active dendrites were also affected by the time distribution of synaptic inputs. In a previous study, inputs had been random over both space and time, varying about a predetermined mean, whereas in the present study, inputs were random over space but uniform over time. When inputs were made uniform over time, spiking became more difficult to initiate and the transition from graded to bistable response became less sharp.     

What the mantis shrimp's eye (possibly) tells its raptorial appendages

On the distal lamina surface of stomatoped eyes a matrix of horizontal and vertical nerve fibers processes the complex input patterns. The output of these integrating fibers is a spike discharge pattern correlated to the input pattern. Here we introduce a ± neuron which either subtracts or sums the outputs from the set of horizontal and vertical fibers activated at that moment. The output pattern of spike frequencies of the ± neuron locates a target in space. Over a parallel channel outputs from the vertical fibers pass a bandpass filter and constitute one of the inputs for a decision neuron. The other input derives from specialized ommatidia at the center of the eye. If both inputs arrive within a short time interval, they sum, the threshold is reached and the decision neuron fires. Spikes from the decision neuron are the final cue for the muscles of the raptorial appendages. The appendages shoot forward and hit the prey with high precision.     

The Role of Thalamic Population Synchrony in the Emergence of Cortical Feature Selectivity

In a wide range of studies, the emergence of orientation selectivity in primary visual cortex has been attributed to a complex interaction between feed-forward thalamic input and inhibitory mechanisms at the level of cortex. Although it is well known that layer 4 cortical neurons are highly sensitive to the timing of thalamic inputs, the role of the stimulus-driven timing of thalamic inputs in cortical orientation selectivity is not well understood. Here we show that the synchronization of thalamic firing contributes directly to the orientation tuned responses of primary visual cortex in a way that optimizes the stimulus information per cortical spike. From the recorded responses of geniculate X-cells in the anesthetized cat, we synthesized thalamic sub-populations that would likely serve as the synaptic input to a common layer 4 cortical neuron based on anatomical constraints. We used this synchronized input as the driving input to an integrate-and-fire model of cortical responses and demonstrated that the tuning properties match closely to those measured in primary visual cortex. By modulating the overall level of synchronization at the preferred orientation, we show that efficiency of information transmission in the cortex is maximized for levels of synchronization which match those reported in thalamic recordings in response to naturalistic stimuli, a property which is relatively invariant to the orientation tuning width. These findings indicate evidence for a more prominent role of the feed-forward thalamic input in cortical feature selectivity based on thalamic synchronization.     

Sharpening of directional selectivity from neural output of rabbit retina

The estimation of motion direction from time varying retinal images is a fundamental task of visual systems. Neurons that selectively respond to directional visual motion are found in almost all species. In many of them already in the retina direction selective neurons signal their preferred direction of movement. Scientific evidences suggest that direction selectivity is carried from the retina to higher brain areas. Here we adopt a simple integrate-and-fire neuron model, inspired by recent work of Casti et al. (2008), to investigate how directional selectivity changes in cells postsynaptic to directional selective retinal ganglion cells (DSRGC). Our model analysis shows that directional selectivity in the postsynaptic cells increases over a wide parameter range. The degree of directional selectivity positively correlates with the probability of burst-like firing of presynaptic DSRGCs. Postsynaptic potentials summation and spike threshold act together as a temporal filter upon the input spike train. Prior to the intricacy of neural circuitry between retina and higher brain areas, we suggest that sharpening is a straightforward result of the intrinsic spiking pattern of the DSRGCs combined with the summation of excitatory postsynaptic potentials and the spike threshold in postsynaptic neurons.     

Synchronization and sensitivity enhancement of the Hodgkin-Huxley neurons due to inhibitory inputs

Recent experimental results imply that inhibitory postsynaptic potentials can play a functional role in realizing synchronization of neuronal firing in the brain. In order to examine the relation between inhibition and synchronous firing of neurons theoretically, we analyze possible effects of synchronization and sensitivity enhancement caused by inhibitory inputs to neurons with a biologically realistic model of the Hodgkin-Huxley equations. The result shows that, after an inhibitory spike, the firing probability of a single postsynaptic neuron exposed to random excitatory background activity oscillates with time. The oscillation of the firing probability can be related to synchronous firing of neurons receiving an inhibitory spike simultaneously. Further, we show that when an inhibitory spike input precedes an excitatory spike input, the presence of such preceding inhibition raises the firing probability peak of the neuron after the excitatory input. The result indicates that an inhibitory spike input can enhance the sensitivity of the postsynaptic neuron to the following excitatory spike input. Two neural network models based on these effects on postsynaptic neurons caused by inhibitory inputs are proposed to demonstrate possible mechanisms of detecting particular spatiotemporal spike patterns. Received: 15 April 1999 /Accepted in revised form: 25 November 1999     

Direction selectivity of excitation and inhibition in simple cells of the cat primary visual cortex

Direction selectivity in simple cells of primary visual cortex, defined from their spike responses, cannot be predicted using linear models. It has been suggested that the shunting inhibition evoked by visual stimulation is responsible for the nonlinear component of direction selectivity. Cortical inhibition would suppress a neuron's firing when stimuli move in the nonpreferred direction, but would allow responses to stimuli in the preferred direction. Models of direction selectivity based solely on input from the lateral geniculate nucleus, however, propose that the nonlinear response is caused by spike threshold. By extracting excitatory and inhibitory components of synaptic inputs from intracellular records obtained in vivo, we demonstrate that excitation and inhibition are tuned for the same direction, but differ in relative timing. Further, membrane potential responses combine in a linear fashion. Spike threshold, however, quantitatively accounts for the nonlinear component of direction selectivity, amplifying the direction selectivity of spike output relative to that of synaptic inputs.     

Adaptation of transient responses of a movement-sensitive neuron in the visual system of the blowfly Calliphora erythrocephala

We studied temporal response properties of the H1 neuron by extracellular recording. This neuron is a wide-field movement-sensitive element in the visual system of the blowfly (Calliphora erythrocephala). If the neuron is stimulated with a stepwise pattern displacement in its preferred direction, it responds with a burst of action potentials. By repeating the stimulus step one obtains the average of the step response: a 20ms latency time followed by a sharp increase in average firing rate and a slower decay to the resting activity. We report that the characteristic decay time of the step response depends on the stimulus history. If the stimulus moved prior to the step, the higher the pattern velocity, the faster was the decay of the step response to the resting level. In quantitative terms, for velocities in the range 0.4–100°/s, the decay time-constant varies from 300–10ms and is smaller for higher velocities. The time-constant is only weakly affected by other stimulus parameters such as modulation depth or spatial wavelength, and is set independently in different areas of the visual field where it is tuned to the local velocity. We discuss a possible advantage of this form of adaptation for the processing of visual signals: The performance of the nolinear operations that extract information from the visual input can be optimized by prefiltering signals in the individual visual columns with a time-constant that decreases with stimulus velocity. It will be shown that both the test step response and the response to continuous movement can be described reasonably well by a correlation model with input filters that adapt their time-constants.     

The response of cortical neurons to in vivo-like input current: theory and experiment: II. Time-varying and spatially distributed inputs

The response of a population of neurons to time-varying synaptic inputs can show a rich phenomenology, hardly predictable from the dynamical properties of the membrane’s inherent time constants. For example, a network of neurons in a state of spontaneous activity can respond significantly more rapidly than each single neuron taken individually. Under the assumption that the statistics of the synaptic input is the same for a population of similarly behaving neurons (mean field approximation), it is possible to greatly simplify the study of neural circuits, both in the case in which the statistics of the input are stationary (reviewed in La Camera et al. in Biol Cybern, 2008) and in the case in which they are time varying and unevenly distributed over the dendritic tree. Here, we review theoretical and experimental results on the single-neuron properties that are relevant for the dynamical collective behavior of a population of neurons. We focus on the response of integrate-and-fire neurons and real cortical neurons to long-lasting, noisy, in vivo-like stationary inputs and show how the theory can predict the observed rhythmic activity of cultures of neurons. We then show how cortical neurons adapt on multiple time scales in response to input with stationary statistics in vitro. Next, we review how it is possible to study the general response properties of a neural circuit to time-varying inputs by estimating the response of single neurons to noisy sinusoidal currents. Finally, we address the dendrite–soma interactions in cortical neurons leading to gain modulation and spike bursts, and show how these effects can be captured by a two-compartment integrate-and-fire neuron. Most of the experimental results reviewed in this article have been successfully reproduced by simple integrate-and-fire model neurons.     

A computational model of cellular mechanisms of temporal coding in the medial geniculate body (MGB)

Acoustic stimuli are often represented in the early auditory pathway as patterns of neural activity synchronized to time-varying features. This phase-locking predominates until the level of the medial geniculate body (MGB), where previous studies have identified two main, largely segregated response types: Stimulus-synchronized responses faithfully preserve the temporal coding from its afferent inputs, and Non-synchronized responses, which are not phase locked to the inputs, represent changes in temporal modulation by a rate code. The cellular mechanisms underlying this transformation from phase-locked to rate code are not well understood. We use a computational model of a MGB thalamocortical neuron to test the hypothesis that these response classes arise from inferior colliculus (IC) excitatory afferents with divergent properties similar to those observed in brain slice studies. Large-conductance inputs exhibiting synaptic depression preserved input synchrony as short as 12.5 ms interclick intervals, while maintaining low firing rates and low-pass filtering responses. By contrast, small-conductance inputs with Mixed plasticity (depression of AMPA-receptor component and facilitation of NMDA-receptor component) desynchronized afferent inputs, generated a click-rate dependent increase in firing rate, and high-pass filtered the inputs. Synaptic inputs with facilitation often permitted band-pass synchrony along with band-pass rate tuning. These responses could be tuned by changes in membrane potential, strength of the NMDA component, and characteristics of synaptic plasticity. These results demonstrate how the same synchronized input spike trains from the inferior colliculus can be transformed into different representations of temporal modulation by divergent synaptic properties.     

Gamma oscillations as a mechanism for selective information transmission

In the past decades, many studies have focussed on the relation between the input and output of neurons with the aim to understand information processing by neurons. A particular aspect of neuronal information, which has not received much attention so far, concerns the problem of information transfer when a neuron or a population of neurons receives input from two or more (populations of) neurons, in particular when these (populations of) neurons carry different types of information. The aim of the present study is to investigate the responses of neurons to multiple inputs modulated in the gamma frequency range. By a combination of theoretical approaches and computer simulations, we test the hypothesis that enhanced modulation of synchronized excitatory neuronal activity in the gamma frequency range provides an advantage over a less synchronized input for various types of neurons. The results of this study show that the spike output of various types of neurons [i.e. the leaky integrate and fire neuron, the quadratic integrate and fire neuron and the Hodgkin–Huxley (HH) neuron] and that of excitatory–inhibitory coupled pairs of neurons, like the Pyramidal Interneuronal Network Gamma (PING) model, is highly phase-locked to the larger of two gamma-modulated input signals. This implies that the neuron selectively responds to the input with the larger gamma modulation if the amplitude of the gamma modulation exceeds that of the other signals by a certain amount. In that case, the output of the neuron is entrained by one of multiple inputs and that other inputs are not represented in the output. This mechanism for selective information transmission is enhanced for short membrane time constants of the neuron.     

Spike timing and reliability in cortical pyramidal neurons: effects of EPSC kinetics, input synchronization and background noise on spike timing

In vivo studies have shown that neurons in the neocortex can generate action potentials at high temporal precision. The mechanisms controlling timing and reliability of action potential generation in neocortical neurons, however, are still poorly understood. Here we investigated the temporal precision and reliability of spike firing in cortical layer V pyramidal cells at near-threshold membrane potentials. Timing and reliability of spike responses were a function of EPSC kinetics, temporal jitter of population excitatory inputs, and of background synaptic noise. We used somatic current injection to mimic population synaptic input events and measured spike probability and spike time precision (STP), the latter defined as the time window (Deltat) holding 80% of response spikes. EPSC rise and decay times were varied over the known physiological spectrum. At spike threshold level, EPSC decay time had a stronger influence on STP than rise time. Generally, STP was highest (6 ms) triggered spikes at lower temporal precision (>or=6.58 ms). We found an overall linear relationship between STP and spike delay. The difference in STP between fast and slow compound EPSCs could be reduced by incrementing the amplitude of slow compound EPSCs. The introduction of a temporal jitter to compound EPSCs had a comparatively small effect on STP, with a tenfold increase in jitter resulting in only a five fold decrease in STP. In the presence of simulated synaptic background activity, precisely timed spikes could still be induced by fast EPSCs, but not by slow EPSCs.     

Dendritic Spikes Amplify the Synaptic Signal to Enhance Detection of Motion in a Simulation of the Direction-Selective Ganglion Cell

The On-Off direction-selective ganglion cell (DSGC) in mammalian retinas responds most strongly to a stimulus moving in a specific direction. The DSGC initiates spikes in its dendritic tree, which are thought to propagate to the soma with high probability. Both dendritic and somatic spikes in the DSGC display strong directional tuning, whereas somatic PSPs (postsynaptic potentials) are only weakly directional, indicating that spike generation includes marked enhancement of the directional signal. We used a realistic computational model based on anatomical and physiological measurements to determine the source of the enhancement. Our results indicate that the DSGC dendritic tree is partitioned into separate electrotonic regions, each summing its local excitatory and inhibitory synaptic inputs to initiate spikes. Within each local region the local spike threshold nonlinearly amplifies the preferred response over the null response on the basis of PSP amplitude. Using inhibitory conductances previously measured in DSGCs, the simulation results showed that inhibition is only sufficient to prevent spike initiation and cannot affect spike propagation. Therefore, inhibition will only act locally within the dendritic arbor. We identified the role of three mechanisms that generate directional selectivity (DS) in the local dendritic regions. First, a mechanism for DS intrinsic to the dendritic structure of the DSGC enhances DS on the null side of the cell''s dendritic tree and weakens it on the preferred side. Second, spatially offset postsynaptic inhibition generates robust DS in the isolated dendritic tips but weak DS near the soma. Third, presynaptic DS is apparently necessary because it is more robust across the dendritic tree. The pre- and postsynaptic mechanisms together can overcome the local intrinsic DS. These local dendritic mechanisms can perform independent nonlinear computations to make a decision, and there could be analogous mechanisms within cortical circuitry.     

Predicting the synaptic information efficacy in cortical layer 5 pyramidal neurons using a minimal integrate-and-fire model

Synaptic information efficacy (SIE) is a statistical measure to quantify the efficacy of a synapse. It measures how much information is gained, on the average, about the output spike train of a postsynaptic neuron if the input spike train is known. It is a particularly appropriate measure for assessing the input–output relationship of neurons receiving dynamic stimuli. Here, we compare the SIE of simulated synaptic inputs measured experimentally in layer 5 cortical pyramidal neurons in vitro with the SIE computed from a minimal model constructed to fit the recorded data. We show that even with a simple model that is far from perfect in predicting the precise timing of the output spikes of the real neuron, the SIE can still be accurately predicted. This arises from the ability of the model to predict output spikes influenced by the input more accurately than those driven by the background current. This indicates that in this context, some spikes may be more important than others. Lastly we demonstrate another aspect where using mutual information could be beneficial in evaluating the quality of a model, by measuring the mutual information between the model’s output and the neuron’s output. The SIE, thus, could be a useful tool for assessing the quality of models of single neurons in preserving input–output relationship, a property that becomes crucial when we start connecting these reduced models to construct complex realistic neuronal networks.     

The Possible Role of Spike Patterns in Cortical Information Processing

When the same visual stimulus is presented across many trials, neurons in the visual cortex receive stimulus-related synaptic inputs that are reproducible across trials (S) and inputs that are not (N). The variability of spike trains recorded in the visual cortex and their apparent lack of spike-to-spike correlations beyond that implied by firing rate fluctuations, has been taken as evidence for a low S/N ratio. A recent re-analysis of in vivo cortical data revealed evidence for spike-to-spike correlations in the form of spike patterns. We examine neural dynamics at a higher S/N in order to determine what possible role spike patterns could play in cortical information processing. In vivo-like spike patterns were obtained in model simulations. Superpositions of multiple sinusoidal driving currents were especially effective in producing stable long-lasting patterns. By applying current pulses that were either short and strong or long and weak, neurons could be made to switch from one pattern to another. Cortical neurons with similar stimulus preferences are located near each other, have similar biophysical properties and receive a large number of common synaptic inputs. Hence, recordings of a single neuron across multiple trials are usually interpreted as the response of an ensemble of these neurons during one trial. In the presence of distinct spike patterns across trials there is ambiguity in what would be the corresponding ensemble, it could consist of the same spike pattern for each neuron or a set of patterns across neurons. We found that the spiking response of a neuron receiving these ensemble inputs was determined by the spike-pattern composition, which, in turn, could be modulated dynamically as a means for cortical information processing.     

Testing of information condensation in a model reverberating spiking neural network

Information about external world is delivered to the brain in the form of structured in time spike trains. During further processing in higher areas, information is subjected to a certain condensation process, which results in formation of abstract conceptual images of external world, apparently, represented as certain uniform spiking activity partially independent on the input spike trains details. Possible physical mechanism of condensation at the level of individual neuron was discussed recently. In a reverberating spiking neural network, due to this mechanism the dynamics should settle down to the same uniform/ periodic activity in response to a set of various inputs. Since the same periodic activity may correspond to different input spike trains, we interpret this as possible candidate for information condensation mechanism in a network. Our purpose is to test this possibility in a network model consisting of five fully connected neurons, particularly, the influence of geometric size of the network, on its ability to condense information. Dynamics of 20 spiking neural networks of different geometric sizes are modelled by means of computer simulation. Each network was propelled into reverberating dynamics by applying various initial input spike trains. We run the dynamics until it becomes periodic. The Shannon's formula is used to calculate the amount of information in any input spike train and in any periodic state found. As a result, we obtain explicit estimate of the degree of information condensation in the networks, and conclude that it depends strongly on the net's geometric size.     

Emergence of network structure due to spike-timing-dependent plasticity in recurrent neuronal networks. I. Input selectivity–strengthening correlated input pathways

Spike-timing-dependent plasticity (STDP) determines the evolution of the synaptic weights according to their pre- and post-synaptic activity, which in turn changes the neuronal activity. In this paper, we extend previous studies of input selectivity induced by (STDP) for single neurons to the biologically interesting case of a neuronal network with fixed recurrent connections and plastic connections from external pools of input neurons. We use a theoretical framework based on the Poisson neuron model to analytically describe the network dynamics (firing rates and spike-time correlations) and thus the evolution of the synaptic weights. This framework incorporates the time course of the post-synaptic potentials and synaptic delays. Our analysis focuses on the asymptotic states of a network stimulated by two homogeneous pools of “steady” inputs, namely Poisson spike trains which have fixed firing rates and spike-time correlations. The (STDP) model extends rate-based learning in that it can implement, at the same time, both a stabilization of the individual neuron firing rates and a slower weight specialization depending on the input spike-time correlations. When one input pathway has stronger within-pool correlations, the resulting synaptic dynamics induced by (STDP) are shown to be similar to those arising in the case of a purely feed-forward network: the weights from the more correlated inputs are potentiated at the expense of the remaining input connections.     

Firing-rate models capture essential response dynamics of LGN relay cells

Firing-rate models provide a practical tool for studying signal processing in the early visual system, permitting more thorough mathematical analysis than spike-based models. We show here that essential response properties of relay cells in the lateral geniculate nucleus (LGN) can be captured by surprisingly simple firing-rate models consisting of a low-pass filter and a nonlinear activation function. The starting point for our analysis are two spiking neuron models based on experimental data: a spike-response model fitted to data from macaque (Carandini et al. J. Vis., 20(14), 1–2011, 2007), and a model with conductance-based synapses and afterhyperpolarizing currents fitted to data from cat (Casti et al. J. Comput. Neurosci., 24(2), 235–252, 2008). We obtained the nonlinear activation function by stimulating the model neurons with stationary stochastic spike trains, while we characterized the linear filter by fitting a low-pass filter to responses to sinusoidally modulated stochastic spike trains. To account for the non-Poisson nature of retinal spike trains, we performed all analyses with spike trains with higher-order gamma statistics in addition to Poissonian spike trains. Interestingly, the properties of the low-pass filter depend only on the average input rate, but not on the modulation depth of sinusoidally modulated input. Thus, the response properties of our model are fully specified by just three parameters (low-frequency gain, cutoff frequency, and delay) for a given mean input rate and input regularity. This simple firing-rate model reproduces the response of spiking neurons to a step in input rate very well for Poissonian as well as for non-Poissonian input. We also found that the cutoff frequencies, and thus the filter time constants, of the rate-based model are unrelated to the membrane time constants of the underlying spiking models, in agreement with similar observations for simpler models.