A single spiking neuron that can represent interval timing: analysis,plasticity and multi-stability

The ability to represent interval timing is crucial for many common behaviors, such as knowing whether to stop when the light turns from green to yellow. Neural representations of interval timing have been reported in the rat primary visual cortex and we have previously presented a computational framework describing how they can be learned by a network of neurons. Recent experimental and theoretical results in entorhinal cortex have shown that single neurons can exhibit persistent activity, previously thought to be generated by a network of neurons. Motivated by these single neuron results, we propose a single spiking neuron model that can learn to compute and represent interval timing. We show that a simple model, reduced analytically to a single dynamical equation, captures the average behavior of the complete high dimensional spiking model very well. Variants of this model can be used to produce bi-stable or multi-stable persistent activity. We also propose a plasticity rule by which this model can learn to represent different intervals and different levels of persistent activity.     

Independent Component Analysis in Spiking Neurons

Although models based on independent component analysis (ICA) have been successful in explaining various properties of sensory coding in the cortex, it remains unclear how networks of spiking neurons using realistic plasticity rules can realize such computation. Here, we propose a biologically plausible mechanism for ICA-like learning with spiking neurons. Our model combines spike-timing dependent plasticity and synaptic scaling with an intrinsic plasticity rule that regulates neuronal excitability to maximize information transmission. We show that a stochastically spiking neuron learns one independent component for inputs encoded either as rates or using spike-spike correlations. Furthermore, different independent components can be recovered, when the activity of different neurons is decorrelated by adaptive lateral inhibition.     

Spontaneously emerging direction selectivity maps in visual cortex through STDP

It is still an open question as to whether, and how, direction-selective neuronal responses in primary visual cortex are generated by feedforward thalamocortical or recurrent intracortical connections, or a combination of both. Here we present an investigation that concentrates on and, only for the sake of simplicity, restricts itself to intracortical circuits, in particular, with respect to the developmental aspects of direction selectivity through spike-timing-dependent synaptic plasticity. We show that directional responses can emerge in a recurrent network model of visual cortex with spiking neurons that integrate inputs mainly from a particular direction, thus giving rise to an asymmetrically shaped receptive field. A moving stimulus that enters the receptive field from this (preferred) direction will activate a neuron most strongly because of the increased number and/or strength of inputs from this direction and since delayed isotropic inhibition will neither overlap with, nor cancel excitation, as would be the case for other stimulus directions. It is demonstrated how direction-selective responses result from spatial asymmetries in the distribution of synaptic contacts or weights of inputs delivered to a neuron by slowly conducting intracortical axonal delay lines. By means of spike-timing-dependent synaptic plasticity with an asymmetric learning window this kind of coupling asymmetry develops naturally in a recurrent network of stochastically spiking neurons in a scenario where the neurons are activated by unidirectionally moving bar stimuli and even when only intrinsic spontaneous activity drives the learning process. We also present simulation results to show the ability of this model to produce direction preference maps similar to experimental findings     

Self-sustained asynchronous irregular states and Up–Down states in thalamic,cortical and thalamocortical networks of nonlinear integrate-and-fire neurons

Randomly-connected networks of integrate-and-fire (IF) neurons are known to display asynchronous irregular (AI) activity states, which resemble the discharge activity recorded in the cerebral cortex of awake animals. However, it is not clear whether such activity states are specific to simple IF models, or if they also exist in networks where neurons are endowed with complex intrinsic properties similar to electrophysiological measurements. Here, we investigate the occurrence of AI states in networks of nonlinear IF neurons, such as the adaptive exponential IF (Brette-Gerstner-Izhikevich) model. This model can display intrinsic properties such as low-threshold spike (LTS), regular spiking (RS) or fast-spiking (FS). We successively investigate the oscillatory and AI dynamics of thalamic, cortical and thalamocortical networks using such models. AI states can be found in each case, sometimes with surprisingly small network size of the order of a few tens of neurons. We show that the presence of LTS neurons in cortex or in thalamus, explains the robust emergence of AI states for relatively small network sizes. Finally, we investigate the role of spike-frequency adaptation (SFA). In cortical networks with strong SFA in RS cells, the AI state is transient, but when SFA is reduced, AI states can be self-sustained for long times. In thalamocortical networks, AI states are found when the cortex is itself in an AI state, but with strong SFA, the thalamocortical network displays Up and Down state transitions, similar to intracellular recordings during slow-wave sleep or anesthesia. Self-sustained Up and Down states could also be generated by two-layer cortical networks with LTS cells. These models suggest that intrinsic properties such as adaptation and low-threshold bursting activity are crucial for the genesis and control of AI states in thalamocortical networks.     

Activity dynamics and propagation of synchronous spiking in locally connected random networks

Random network models have been a popular tool for investigating cortical network dynamics. On the scale of roughly a cubic millimeter of cortex, containing about 100,000 neurons, cortical anatomy suggests a more realistic architecture. In this locally connected random network, the connection probability decreases in a Gaussian fashion with the distance between neurons. Here we present three main results from a simulation study of the activity dynamics in such networks. First, for a broad range of parameters these dynamics exhibit a stationary state of asynchronous network activity with irregular single-neuron spiking. This state can be used as a realistic model of ongoing network activity. Parametric dependence of this state and the nature of the network dynamics in other regimes are described. Second, a synchronous excitatory stimulus to a fraction of the neurons results in a strong activity response that easily dominates the network dynamics. And third, due to that activity response an embedding of a divergent-convergent feed-forward subnetwork (as in synfire chains) does not naturally lead to a stable propagation of synchronous activity in the subnetwork; this is in contrast to our earlier findings in isolated subnetworks of that type. Possible mechanisms for stabilizing the interplay of volleys of synchronous spikes and network dynamics by specific learning rules or generalizations of the subnetworks are discussed.     

视觉编码的快速学习

活动依赖的神经可塑性在视觉皮层信息处理过程中起着很重要的作用。该文将讲述几个关于视觉刺激引起皮层反应发生快速变化的研究工作。在体膜片钳的实验结果表明,将视觉刺激与能够诱发孽个视皮层神经元发放动作电位的电刺激相偶联可以改变神经元的感受野特性。单电极和多电极胞外记录的实验结果显示,反复地给予自然图形电影刺激,不仅能增加视皮层神经元反应的可靠性,而且能造成之后的自发活动中存在“记忆的痕迹”。最后,用电压敏感染料成像的方法对群体细胞活动进行考察,结果提示视觉活动之后的皮层回放可能是由皮层波介导的。     

Traveling Waves and the Processing of Weakly Tuned Inputs in a Cortical Network Module

Recent studies have shown that local cortical feedback can havean important effect on the response of neurons in primary visualcortex to the orientation of visual stimuli. In this work, westudy the role of the cortical feedback in shaping thespatiotemporal patterns of activity in cortex. Two questionsare addressed: one, what are the limitations on the ability ofcortical neurons to lock their activity to rotatingoriented stimuli within a single receptive field? Two, can thelocal architecture of visual cortex lead to the generation ofspontaneous traveling pulses of activity? We study theseissues analytically by a population-dynamic model of ahypercolumn in visual cortex. The order parameter thatdescribes the macroscopic behavior of the network is thetime-dependent population vector of the network. We firststudy the network dynamics under the influence of a weakly tunedinput that slowly rotates within the receptive field. We showthat if the cortical interactions have strong spatialmodulation, the network generates a sharply tuned activityprofile that propagates across the hypercolumn in a path thatis completely locked to the stimulus rotation. The resultantrotating population vector maintains a constant angular lagrelative to the stimulus, the magnitude of which grows with thestimulus rotation frequency. Beyond a critical frequency thepopulation vector does not lock to the stimulus but executes aquasi-periodic motion with an average frequency that is smallerthan that of the stimulus. In the second part we consider thestable intrinsic state of the cortex under the influence of isotropic stimulation. We show that if the local inhibitoryfeedback is sufficiently strong, the network does not settleinto a stationary state but develops spontaneous travelingpulses of activity. Unlike recent models of wave propagation incortical networks, the connectivity pattern in our model isspatially symmetric, hence the direction of propagation ofthese waves is arbitrary. The interaction of these waves withan external-oriented stimulus is studied. It is shown that thesystem can lock to a weakly tuned rotating stimulus if thestimulus frequency is close to the frequency of the intrinsic wave.     

Role of GABAA-Mediated Inhibition and Functional Assortment of Synapses onto Individual Layer 4 Neurons in Regulating Plasticity Expression in Visual Cortex

Layer 4 (L4) of primary visual cortex (V1) is the main recipient of thalamocortical fibers from the dorsal lateral geniculate nucleus (LGN_d). Thus, it is considered the main entry point of visual information into the neocortex and the first anatomical opportunity for intracortical visual processing before information leaves L4 and reaches supra- and infragranular cortical layers. The strength of monosynaptic connections from individual L4 excitatory cells onto adjacent L4 cells (unitary connections) is highly malleable, demonstrating that the initial stage of intracortical synaptic transmission of thalamocortical information can be altered by previous activity. However, the inhibitory network within L4 of V1 may act as an internal gate for induction of excitatory synaptic plasticity, thus providing either high fidelity throughput to supragranular layers or transmittal of a modified signal subject to recent activity-dependent plasticity. To evaluate this possibility, we compared the induction of synaptic plasticity using classical extracellular stimulation protocols that recruit a combination of excitatory and inhibitory synapses with stimulation of a single excitatory neuron onto a L4 cell. In order to induce plasticity, we paired pre- and postsynaptic activity (with the onset of postsynaptic spiking leading the presynaptic activation by 10ms) using extracellular stimulation (ECS) in acute slices of primary visual cortex and comparing the outcomes with our previously published results in which an identical protocol was used to induce synaptic plasticity between individual pre- and postsynaptic L4 excitatory neurons. Our results indicate that pairing of ECS with spiking in a L4 neuron fails to induce plasticity in L4-L4 connections if synaptic inhibition is intact. However, application of a similar pairing protocol under GABA_ARs inhibition by bath application of 2μM bicuculline does induce robust synaptic plasticity, long term potentiation (LTP) or long term depression (LTD), similar to our results with pairing of pre- and postsynaptic activation between individual excitatory L4 neurons in which inhibitory connections are not activated. These results are consistent with the well-established observation that inhibition limits the capacity for induction of plasticity at excitatory synapses and that pre- and postsynaptic activation at a fixed time interval can result in a variable range of plasticity outcomes. However, in the current study by virtue of having two sets of experimental data, we have provided a new insight into these processes. By randomly mixing the assorting of individual L4 neurons according to the frequency distribution of the experimentally determined plasticity outcome distribution based on the calculated convergence of multiple individual L4 neurons onto a single postsynaptic L4 neuron, we were able to compare then actual ECS plasticity outcomes to those predicted by randomly mixing individual pairs of neurons. Interestingly, the observed plasticity profiles with ECS cannot account for the random assortment of plasticity behaviors of synaptic connections between individual cell pairs. These results suggest that connections impinging onto a single postsynaptic cell may be grouped according to plasticity states.     

Role of delayed nonsynaptic neuronal plasticity in long-term associative memory

BACKGROUND: It is now well established that persistent nonsynaptic neuronal plasticity occurs after learning and, like synaptic plasticity, it can be the substrate for long-term memory. What still remains unclear, though, is how nonsynaptic plasticity contributes to the altered neural network properties on which memory depends. Understanding how nonsynaptic plasticity is translated into modified network and behavioral output therefore represents an important objective of current learning and memory research. RESULTS: By using behavioral single-trial classical conditioning together with electrophysiological analysis and calcium imaging, we have explored the cellular mechanisms by which experience-induced nonsynaptic electrical changes in a neuronal soma remote from the synaptic region are translated into synaptic and circuit level effects. We show that after single-trial food-reward conditioning in the snail Lymnaea stagnalis, identified modulatory neurons that are extrinsic to the feeding network become persistently depolarized between 16 and 24 hr after training. This is delayed with respect to early memory formation but concomitant with the establishment and duration of long-term memory. The persistent nonsynaptic change is extrinsic to and maintained independently of synaptic effects occurring within the network directly responsible for the generation of feeding. Artificial membrane potential manipulation and calcium-imaging experiments suggest a novel mechanism whereby the somal depolarization of an extrinsic neuron recruits command-like intrinsic neurons of the circuit underlying the learned behavior. CONCLUSIONS: We show that nonsynaptic plasticity in an extrinsic modulatory neuron encodes information that enables the expression of long-term associative memory, and we describe how this information can be translated into modified network and behavioral output.     

Efficient Transmission of Subthreshold Signals in Complex Networks of Spiking Neurons

We investigate the efficient transmission and processing of weak, subthreshold signals in a realistic neural medium in the presence of different levels of the underlying noise. Assuming Hebbian weights for maximal synaptic conductances—that naturally balances the network with excitatory and inhibitory synapses—and considering short-term synaptic plasticity affecting such conductances, we found different dynamic phases in the system. This includes a memory phase where population of neurons remain synchronized, an oscillatory phase where transitions between different synchronized populations of neurons appears and an asynchronous or noisy phase. When a weak stimulus input is applied to each neuron, increasing the level of noise in the medium we found an efficient transmission of such stimuli around the transition and critical points separating different phases for well-defined different levels of stochasticity in the system. We proved that this intriguing phenomenon is quite robust, as it occurs in different situations including several types of synaptic plasticity, different type and number of stored patterns and diverse network topologies, namely, diluted networks and complex topologies such as scale-free and small-world networks. We conclude that the robustness of the phenomenon in different realistic scenarios, including spiking neurons, short-term synaptic plasticity and complex networks topologies, make very likely that it could also occur in actual neural systems as recent psycho-physical experiments suggest.     

Structure of spontaneous UP and DOWN transitions self-organizing in a cortical network model

Synaptic plasticity is considered to play a crucial role in the experience-dependent self-organization of local cortical networks. In the absence of sensory stimuli, cerebral cortex exhibits spontaneous membrane potential transitions between an UP and a DOWN state. To reveal how cortical networks develop spontaneous activity, or conversely, how spontaneous activity structures cortical networks, we analyze the self-organization of a recurrent network model of excitatory and inhibitory neurons, which is realistic enough to replicate UP–DOWN states, with spike-timing-dependent plasticity (STDP). The individual neurons in the self-organized network exhibit a variety of temporal patterns in the two-state transitions. In addition, the model develops a feed-forward network-like structure that produces a diverse repertoire of precise sequences of the UP state. Our model shows that the self-organized activity well resembles the spontaneous activity of cortical networks if STDP is accompanied by the pruning of weak synapses. These results suggest that the two-state membrane potential transitions play an active role in structuring local cortical circuits.     

Firing patterns in the adaptive exponential integrate-and-fire model

For simulations of large spiking neuron networks, an accurate, simple and versatile single-neuron modeling framework is required. Here we explore the versatility of a simple two-equation model: the adaptive exponential integrate-and-fire neuron. We show that this model generates multiple firing patterns depending on the choice of parameter values, and present a phase diagram describing the transition from one firing type to another. We give an analytical criterion to distinguish between continuous adaption, initial bursting, regular bursting and two types of tonic spiking. Also, we report that the deterministic model is capable of producing irregular spiking when stimulated with constant current, indicating low-dimensional chaos. Lastly, the simple model is fitted to real experiments of cortical neurons under step current stimulation. The results provide support for the suitability of simple models such as the adaptive exponential integrate-and-fire neuron for large network simulations.     

Pattern recall in networks of chaotic neurons

This research investigates the potential utility of chaotic dynamics in neural information processing. A novel chaotic spiking neural network model is presented which is composed of non-linear dynamic state (NDS) neurons. The activity of each NDS neuron is driven by a set of non-linear equations coupled with a threshold based spike output mechanism. If time-delayed self-connections are enabled then the network stabilises to a periodic pattern of activation. Previous publications of this work have demonstrated that the chaotic dynamics which drive the network activity ensure that an extremely large number of such periodic patterns can be generated by this network. This paper presents a major extension to this model which enables the network to recall a pattern of activity from a selection of previously stabilised patterns.     

Variability of bursting patterns in a neuron model in the presence of noise

Spiking and bursting patterns of neurons are characterized by a high degree of variability. A single neuron can demonstrate endogenously various bursting patterns, changing in response to external disturbances due to synapses, or to intrinsic factors such as channel noise. We argue that in a model of the leech heart interneuron existing variations of bursting patterns are significantly enhanced by a small noise. In the absence of noise this model shows periodic bursting with fixed numbers of interspikes for most parameter values. As the parameter of activation kinetics of a slow potassium current is shifted to more hyperpolarized values of the membrane potential, the model undergoes a sequence of incremental spike adding transitions accumulating towards a periodic tonic spiking activity. Within a narrow parameter window around every spike adding transition, spike alteration of bursting is deterministically chaotic due to homoclinic bifurcations of a saddle periodic orbit. We have found that near these transitions the interneuron model becomes extremely sensitive to small random perturbations that cause a wide expansion and overlapping of the chaotic windows. The chaotic behavior is characterized by positive values of the largest Lyapunov exponent, and of the Shannon entropy of probability distribution of spike numbers per burst. The windows of chaotic dynamics resemble the Arnold tongues being plotted in the parameter plane, where the noise intensity serves as a second control parameter. We determine the critical noise intensities above which the interneuron model generates only irregular bursting within the overlapped windows.     

Sensory experience modifies spontaneous state dynamics in a large-scale barrel cortical model

Experimental evidence suggests that spontaneous neuronal activity may shape and be shaped by sensory experience. However, we lack information on how sensory experience modulates the underlying synaptic dynamics and how such modulation influences the response of the network to future events. Here we study whether spike-timing-dependent plasticity (STDP) can mediate sensory-induced modifications in the spontaneous dynamics of a new large-scale model of layers II, III and IV of the rodent barrel cortex. Our model incorporates significant physiological detail, including the types of neurons present, the probabilities and delays of connections, and the STDP profiles at each excitatory synapse. We stimulated the neuronal network with a protocol of repeated sensory inputs resembling those generated by the protraction-retraction motion of whiskers when rodents explore their environment, and studied the changes in network dynamics. By applying dimensionality reduction techniques to the synaptic weight space, we show that the initial spontaneous state is modified by each repetition of the stimulus and that this reverberation of the sensory experience induces long-term, structured modifications in the synaptic weight space. The post-stimulus spontaneous state encodes a memory of the stimulus presented, since a different dynamical response is observed when the network is presented with shuffled stimuli. These results suggest that repeated exposure to the same sensory experience could induce long-term circuitry modifications via 'Hebbian' STDP plasticity.     

A learning theory for reward-modulated spike-timing-dependent plasticity with application to biofeedback

Reward-modulated spike-timing-dependent plasticity (STDP) has recently emerged as a candidate for a learning rule that could explain how behaviorally relevant adaptive changes in complex networks of spiking neurons could be achieved in a self-organizing manner through local synaptic plasticity. However, the capabilities and limitations of this learning rule could so far only be tested through computer simulations. This article provides tools for an analytic treatment of reward-modulated STDP, which allows us to predict under which conditions reward-modulated STDP will achieve a desired learning effect. These analytical results imply that neurons can learn through reward-modulated STDP to classify not only spatial but also temporal firing patterns of presynaptic neurons. They also can learn to respond to specific presynaptic firing patterns with particular spike patterns. Finally, the resulting learning theory predicts that even difficult credit-assignment problems, where it is very hard to tell which synaptic weights should be modified in order to increase the global reward for the system, can be solved in a self-organizing manner through reward-modulated STDP. This yields an explanation for a fundamental experimental result on biofeedback in monkeys by Fetz and Baker. In this experiment monkeys were rewarded for increasing the firing rate of a particular neuron in the cortex and were able to solve this extremely difficult credit assignment problem. Our model for this experiment relies on a combination of reward-modulated STDP with variable spontaneous firing activity. Hence it also provides a possible functional explanation for trial-to-trial variability, which is characteristic for cortical networks of neurons but has no analogue in currently existing artificial computing systems. In addition our model demonstrates that reward-modulated STDP can be applied to all synapses in a large recurrent neural network without endangering the stability of the network dynamics.     

Exploring how extracellular electric field modulates neuron activity through dynamical analysis of a two-compartment neuron model

To investigate how extracellular electric field modulates neuron activity, a reduced two-compartment neuron model in the presence of electric field is introduced in this study. Depending on neuronal geometric and internal coupling parameters, the behaviors of the model have been studied extensively. The neuron model can exist in quiescent state or repetitive spiking state in response to electric field stimulus. Negative electric field mainly acts as inhibitory stimulus to the neuron, positive weak electric field could modulate spiking frequency and spike timing when the neuron is already active, and positive electric fields with sufficient intensity could directly trigger neuronal spiking in the absence of other stimulations. By bifurcation analysis, it is observed that there is saddle-node on invariant circle bifurcation, supercritical Hopf bifurcation and subcritical Hopf bifurcation appearing in the obtained two parameter bifurcation diagrams. The bifurcation structures and electric field thresholds for triggering neuron firing are determined by neuronal geometric and coupling parameters. The model predicts that the neurons with a nonsymmetric morphology between soma and dendrite, are more sensitive to electric field stimulus than those with the spherical structure. These findings suggest that neuronal geometric features play a crucial role in electric field effects on the polarization of neuronal compartments. Moreover, by determining the electric field threshold of our biophysical model, we could accurately distinguish between suprathreshold and subthreshold electric fields. Our study highlights the effects of extracellular electric field on neuronal activity from the biophysical modeling point of view. These insights into the dynamical mechanism of electric field may contribute to the investigation and development of electromagnetic therapies, and the model in our study could be further extended to a neuronal network in which the effects of electric fields on network activity may be investigated.     

Self-Organization of Microcircuits in Networks of Spiking Neurons with Plastic Synapses

The synaptic connectivity of cortical networks features an overrepresentation of certain wiring motifs compared to simple random-network models. This structure is shaped, in part, by synaptic plasticity that promotes or suppresses connections between neurons depending on their joint spiking activity. Frequently, theoretical studies focus on how feedforward inputs drive plasticity to create this network structure. We study the complementary scenario of self-organized structure in a recurrent network, with spike timing-dependent plasticity driven by spontaneous dynamics. We develop a self-consistent theory for the evolution of network structure by combining fast spiking covariance with a slow evolution of synaptic weights. Through a finite-size expansion of network dynamics we obtain a low-dimensional set of nonlinear differential equations for the evolution of two-synapse connectivity motifs. With this theory in hand, we explore how the form of the plasticity rule drives the evolution of microcircuits in cortical networks. When potentiation and depression are in approximate balance, synaptic dynamics depend on weighted divergent, convergent, and chain motifs. For additive, Hebbian STDP these motif interactions create instabilities in synaptic dynamics that either promote or suppress the initial network structure. Our work provides a consistent theoretical framework for studying how spiking activity in recurrent networks interacts with synaptic plasticity to determine network structure.     

Local field potentials indicate network state and account for neuronal response variability

Multineuronal recordings have revealed that neurons in primary visual cortex (V1) exhibit coordinated fluctuations of spiking activity in the absence and in the presence of visual stimulation. From the perspective of understanding a single cell’s spiking activity relative to a behavior or stimulus, these network fluctuations are typically considered to be noise. We show that these events are highly correlated with another commonly recorded signal, the local field potential (LFP), and are also likely related to global network state phenomena which have been observed in a number of neural systems. Moreover, we show that attributing a component of cell firing to these network fluctuations via explicit modeling of the LFP improves the recovery of cell properties. This suggests that the impact of network fluctuations may be estimated using the LFP, and that a portion of this network activity is unrelated to the stimulus and instead reflects ongoing cortical activity. Thus, the LFP acts as an easily accessible bridge between the network state and the spiking activity.