Signal propagation in feedforward neuronal networks with unreliable synapses

In this paper, we systematically investigate both the synfire propagation and firing rate propagation in feedforward neuronal network coupled in an all-to-all fashion. In contrast to most earlier work, where only reliable synaptic connections are considered, we mainly examine the effects of unreliable synapses on both types of neural activity propagation in this work. We first study networks composed of purely excitatory neurons. Our results show that both the successful transmission probability and excitatory synaptic strength largely influence the propagation of these two types of neural activities, and better tuning of these synaptic parameters makes the considered network support stable signal propagation. It is also found that noise has significant but different impacts on these two types of propagation. The additive Gaussian white noise has the tendency to reduce the precision of the synfire activity, whereas noise with appropriate intensity can enhance the performance of firing rate propagation. Further simulations indicate that the propagation dynamics of the considered neuronal network is not simply determined by the average amount of received neurotransmitter for each neuron in a time instant, but also largely influenced by the stochastic effect of neurotransmitter release. Second, we compare our results with those obtained in corresponding feedforward neuronal networks connected with reliable synapses but in a random coupling fashion. We confirm that some differences can be observed in these two different feedforward neuronal network models. Finally, we study the signal propagation in feedforward neuronal networks consisting of both excitatory and inhibitory neurons, and demonstrate that inhibition also plays an important role in signal propagation in the considered networks.     

Spontaneously emerging direction selectivity maps in visual cortex through STDP

It is still an open question as to whether, and how, direction-selective neuronal responses in primary visual cortex are generated by feedforward thalamocortical or recurrent intracortical connections, or a combination of both. Here we present an investigation that concentrates on and, only for the sake of simplicity, restricts itself to intracortical circuits, in particular, with respect to the developmental aspects of direction selectivity through spike-timing-dependent synaptic plasticity. We show that directional responses can emerge in a recurrent network model of visual cortex with spiking neurons that integrate inputs mainly from a particular direction, thus giving rise to an asymmetrically shaped receptive field. A moving stimulus that enters the receptive field from this (preferred) direction will activate a neuron most strongly because of the increased number and/or strength of inputs from this direction and since delayed isotropic inhibition will neither overlap with, nor cancel excitation, as would be the case for other stimulus directions. It is demonstrated how direction-selective responses result from spatial asymmetries in the distribution of synaptic contacts or weights of inputs delivered to a neuron by slowly conducting intracortical axonal delay lines. By means of spike-timing-dependent synaptic plasticity with an asymmetric learning window this kind of coupling asymmetry develops naturally in a recurrent network of stochastically spiking neurons in a scenario where the neurons are activated by unidirectionally moving bar stimuli and even when only intrinsic spontaneous activity drives the learning process. We also present simulation results to show the ability of this model to produce direction preference maps similar to experimental findings     

Modulation of the dynamics of cerebellar Purkinje cells through the interaction of excitatory and inhibitory feedforward pathways

The dynamics of cerebellar neuronal networks is controlled by the underlying building blocks of neurons and synapses between them. For which, the computation of Purkinje cells (PCs), the only output cells of the cerebellar cortex, is implemented through various types of neural pathways interactively routing excitation and inhibition converged to PCs. Such tuning of excitation and inhibition, coming from the gating of specific pathways as well as short-term plasticity (STP) of the synapses, plays a dominant role in controlling the PC dynamics in terms of firing rate and spike timing. PCs receive cascade feedforward inputs from two major neural pathways: the first one is the feedforward excitatory pathway from granule cells (GCs) to PCs; the second one is the feedforward inhibition pathway from GCs, via molecular layer interneurons (MLIs), to PCs. The GC-PC pathway, together with short-term dynamics of excitatory synapses, has been a focus over past decades, whereas recent experimental evidence shows that MLIs also greatly contribute to controlling PC activity. Therefore, it is expected that the diversity of excitation gated by STP of GC-PC synapses, modulated by strong inhibition from MLI-PC synapses, can promote the computation performed by PCs. However, it remains unclear how these two neural pathways are interacted to modulate PC dynamics. Here using a computational model of PC network installed with these two neural pathways, we addressed this question to investigate the change of PC firing dynamics at the level of single cell and network. We show that the nonlinear characteristics of excitatory STP dynamics can significantly modulate PC spiking dynamics mediated by inhibition. The changes in PC firing rate, firing phase, and temporal spike pattern, are strongly modulated by these two factors in different ways. MLIs mainly contribute to variable delays in the postsynaptic action potentials of PCs while modulated by excitation STP. Notably, the diversity of synchronization and pause response in the PC network is governed not only by the balance of excitation and inhibition, but also by the synaptic STP, depending on input burst patterns. Especially, the pause response shown in the PC network can only emerge with the interaction of both pathways. Together with other recent findings, our results show that the interaction of feedforward pathways of excitation and inhibition, incorporated with synaptic short-term dynamics, can dramatically regulate the PC activities that consequently change the network dynamics of the cerebellar circuit.     

Changing excitation and inhibition in simulated neural networks: effects on induced bursting behavior

 The development of synchronous bursting in neuronal ensembles represents an important change in network behavior. To determine the influences on development of such synchronous bursting behavior we study the dynamics of small networks of sparsely connected excitatory and inhibitory neurons using numerical simulations. The synchronized bursting activities in networks evoked by background spikes are investigated. Specifically, patterns of bursting activity are examined when the balance between excitation and inhibition on neuronal inputs is varied and the fraction of inhibitory neurons in the network is changed. For quantitative comparison of bursting activities in networks, measures of the degree of synchrony are used. We demonstrate how changes in the strength of excitation on inputs of neurons can be compensated by changes in the strength of inhibition without changing the degree of synchrony in the network. The effects of changing several network parameters on the network activity are analyzed and discussed. These changes may underlie the transition of network activity from normal to potentially pathologic (e.g., epileptic) states. Received: 21 May 2002 / Accepted in revised form: 3 December 2002 / Published online: 7 March 2003 Correspondence to: P. Kudela (e-mail: pkudela@jhmi.edu) Acknowledgements. This research was supported by NIH grant NS 38958.     

Brief Bursts Self-Inhibit and Correlate the Pyramidal Network

Inhibitory pathways are an essential component in the function of the neocortical microcircuitry. Despite the relatively small fraction of inhibitory neurons in the neocortex, these neurons are strongly activated due to their high connectivity rate and the intricate manner in which they interconnect with pyramidal cells (PCs). One prominent pathway is the frequency-dependent disynaptic inhibition (FDDI) formed between layer 5 PCs and mediated by Martinotti cells (MCs). Here, we show that simultaneous short bursts in four PCs are sufficient to exert FDDI in all neighboring PCs within the dimensions of a cortical column. This powerful inhibition is mediated by few interneurons, leading to strongly correlated membrane fluctuations and synchronous spiking between PCs simultaneously receiving FDDI. Somatic integration of such inhibition is independent and electrically isolated from monosynaptic excitation formed between the same PCs. FDDI is strongly shaped by I(h) in PC dendrites, which determines the effective integration time window for inhibitory and excitatory inputs. We propose a key disynaptic mechanism by which brief bursts generated by a few PCs can synchronize the activity in the pyramidal network.     

Sparse balance: Excitatory-inhibitory networks with small bias currents and broadly distributed synaptic weights

Cortical circuits generate excitatory currents that must be cancelled by strong inhibition to assure stability. The resulting excitatory-inhibitory (E-I) balance can generate spontaneous irregular activity but, in standard balanced E-I models, this requires that an extremely strong feedforward bias current be included along with the recurrent excitation and inhibition. The absence of experimental evidence for such large bias currents inspired us to examine an alternative regime that exhibits asynchronous activity without requiring unrealistically large feedforward input. In these networks, irregular spontaneous activity is supported by a continually changing sparse set of neurons. To support this activity, synaptic strengths must be drawn from high-variance distributions. Unlike standard balanced networks, these sparse balance networks exhibit robust nonlinear responses to uniform inputs and non-Gaussian input statistics. Interestingly, the speed, not the size, of synaptic fluctuations dictates the degree of sparsity in the model. In addition to simulations, we provide a mean-field analysis to illustrate the properties of these networks.     

Induction and propagation of transient synchronous activity in neural networks endowed with short-term plasticity

Transient, task related synchronous activity within neural populations has been recognized as the substrate of temporal coding in the brain. The mechanisms underlying inducing and propagation of transient synchronous activity are still unknown, and we propose that short-term plasticity (STP) of neural circuits may serve as a supplemental mechanism therein. By computational modeling, we showed that short-term facilitation greatly increases the reactivation rate of population spikes and decreases the latency of response to reactivation stimuli in local recurrent neural networks. Meanwhile, the timing of population spike reactivation is controlled by the memory effect of STP, and it is mediated primarily by the facilitation time constant. Furthermore, we demonstrated that synaptic facilitation dramatically enhances synchrony propagation in feedforward neural networks and that response timing mediated by synaptic facilitation offers a scheme for information routing. In addition, we verified that synaptic strengthening of intralayer or interlayer coupling enhances synchrony propagation, and we verified that other factors such as the delay of synaptic transmission and the mode of synaptic connectivity are also involved in regulating synchronous activity propagation. Overall, our results highlight the functional role of STP in regulating the inducing and propagation of transient synchronous activity, and they may inspire testable hypotheses for future experimental studies.     

Variable synaptic strengths controls the firing rate distribution in feedforward neural networks

Heterogeneity of firing rate statistics is known to have severe consequences on neural coding. Recent experimental recordings in weakly electric fish indicate that the distribution-width of superficial pyramidal cell firing rates (trial- and time-averaged) in the electrosensory lateral line lobe (ELL) depends on the stimulus, and also that network inputs can mediate changes in the firing rate distribution across the population. We previously developed theoretical methods to understand how two attributes (synaptic and intrinsic heterogeneity) interact and alter the firing rate distribution in a population of integrate-and-fire neurons with random recurrent coupling. Inspired by our experimental data, we extend these theoretical results to a delayed feedforward spiking network that qualitatively capture the changes of firing rate heterogeneity observed in in-vivo recordings. We demonstrate how heterogeneous neural attributes alter firing rate heterogeneity, accounting for the effect with various sensory stimuli. The model predicts how the strength of the effective network connectivity is related to intrinsic heterogeneity in such delayed feedforward networks: the strength of the feedforward input is positively correlated with excitability (threshold value for spiking) when firing rate heterogeneity is low and is negatively correlated with excitability with high firing rate heterogeneity. We also show how our theory can be used to predict effective neural architecture. We demonstrate that neural attributes do not interact in a simple manner but rather in a complex stimulus-dependent fashion to control neural heterogeneity and discuss how it can ultimately shape population codes.     

Hippocampal Feedforward Inhibition Focuses Excitatory Synaptic Signals into Distinct Dendritic Compartments

Feedforward inhibition controls the time window for synaptic integration and ensures temporal precision in cortical circuits. There is little information whether feedforward inhibition affects neurons uniformly, or whether it contributes to computational refinement within the dendritic tree. Here we demonstrate that feedforward inhibition crucially shapes the integration of synaptic signals in pyramidal cell dendrites. Using voltage-sensitive dye imaging we studied the transmembrane voltage patterns in CA1 pyramidal neurons after Schaffer collateral stimulation in acute brain slices from mice. We observed a high degree of variability in the excitation-inhibition ratio between different branches of the dendritic tree. Many dendritic segments showed no depolarizing signal at all, especially the basal dendrites that received predominantly inhibitory signals. Application of the GABA_A receptor antagonist bicuculline resulted in the spread of depolarizing signals throughout the dendritic tree. Tetanic stimulation of Schaffer collateral inputs induced significant alterations in the patterns of excitation/inhibition, indicating that they are modified by synaptic plasticity. In summary, we show that feedforward inhibition restricts the occurrence of depolarizing signals within the dendritic tree of CA1 pyramidal neurons and thus refines signal integration spatially.     

Inhibitory Control of Linear and Supralinear Dendritic Excitation in CA1 Pyramidal Neurons

The transformation of dendritic excitatory synaptic inputs to axonal action potential output is the fundamental computation performed by all principal neurons. We show that in the hippocampus this transformation is potently controlled by recurrent inhibitory microcircuits. However, excitatory input on highly excitable dendritic branches could resist inhibitory?control by generating strong dendritic spikes and?trigger precisely timed action potential output. Furthermore, we show that inhibition-sensitive branches can be transformed into inhibition-resistant, strongly spiking branches by intrinsic plasticity of branch excitability. In addition, we demonstrate that the inhibitory control of spatially defined dendritic excitation is strongly regulated by network activity patterns. Our findings suggest that dendritic spikes may serve to transform correlated branch input into reliable and temporally precise output even in the presence of inhibition.     

Avalanches in a Stochastic Model of Spiking Neurons

Neuronal avalanches are a form of spontaneous activity widely observed in cortical slices and other types of nervous tissue, both in vivo and in vitro. They are characterized by irregular, isolated population bursts when many neurons fire together, where the number of spikes per burst obeys a power law distribution. We simulate, using the Gillespie algorithm, a model of neuronal avalanches based on stochastic single neurons. The network consists of excitatory and inhibitory neurons, first with all-to-all connectivity and later with random sparse connectivity. Analyzing our model using the system size expansion, we show that the model obeys the standard Wilson-Cowan equations for large network sizes ( neurons). When excitation and inhibition are closely balanced, networks of thousands of neurons exhibit irregular synchronous activity, including the characteristic power law distribution of avalanche size. We show that these avalanches are due to the balanced network having weakly stable functionally feedforward dynamics, which amplifies some small fluctuations into the large population bursts. Balanced networks are thought to underlie a variety of observed network behaviours and have useful computational properties, such as responding quickly to changes in input. Thus, the appearance of avalanches in such functionally feedforward networks indicates that avalanches may be a simple consequence of a widely present network structure, when neuron dynamics are noisy. An important implication is that a network need not be “critical” for the production of avalanches, so experimentally observed power laws in burst size may be a signature of noisy functionally feedforward structure rather than of, for example, self-organized criticality.     

Neural Sequence Generation Using Spatiotemporal Patterns of Inhibition

Stereotyped sequences of neural activity are thought to underlie reproducible behaviors and cognitive processes ranging from memory recall to arm movement. One of the most prominent theoretical models of neural sequence generation is the synfire chain, in which pulses of synchronized spiking activity propagate robustly along a chain of cells connected by highly redundant feedforward excitation. But recent experimental observations in the avian song production pathway during song generation have shown excitatory activity interacting strongly with the firing patterns of inhibitory neurons, suggesting a process of sequence generation more complex than feedforward excitation. Here we propose a model of sequence generation inspired by these observations in which a pulse travels along a spatially recurrent excitatory chain, passing repeatedly through zones of local feedback inhibition. In this model, synchrony and robust timing are maintained not through redundant excitatory connections, but rather through the interaction between the pulse and the spatiotemporal pattern of inhibition that it creates as it circulates the network. These results suggest that spatially and temporally structured inhibition may play a key role in sequence generation.     

Top-Down Modulation on Perceptual Decision with Balanced Inhibition through Feedforward and Feedback Inhibitory Neurons

Recent physiological studies have shown that neurons in various regions of the central nervous systems continuously receive noisy excitatory and inhibitory synaptic inputs in a balanced and covaried fashion. While this balanced synaptic input (BSI) is typically described in terms of maintaining the stability of neural circuits, a number of experimental and theoretical studies have suggested that BSI plays a proactive role in brain functions such as top-down modulation for executive control. Two issues have remained unclear in this picture. First, given the noisy nature of neuronal activities in neural circuits, how do the modulatory effects change if the top-down control implements BSI with different ratios between inhibition and excitation? Second, how is a top-down BSI realized via only excitatory long-range projections in the neocortex? To address the first issue, we systematically tested how the inhibition/excitation ratio affects the accuracy and reaction times of a spiking neural circuit model of perceptual decision. We defined an energy function to characterize the network dynamics, and found that different ratios modulate the energy function of the circuit differently and form two distinct functional modes. To address the second issue, we tested BSI with long-distance projection to inhibitory neurons that are either feedforward or feedback, depending on whether these inhibitory neurons do or do not receive inputs from local excitatory cells, respectively. We found that BSI occurs in both cases. Furthermore, when relying on feedback inhibitory neurons, through the recurrent interactions inside the circuit, BSI dynamically and automatically speeds up the decision by gradually reducing its inhibitory component in the course of a trial when a decision process takes too long.     

Modeling different regimes of bioelectrical activity in the brain in normal subjects and in "increased readiness" in a network of neuron-like elements

Desynchronous (low voltage fast activity), synchronous (high voltage slow waves) as well as convulsive brain activities were stimulated by a computer model of neuronal population. Network excitatory and inhibitory elements possessed fundamental dynamic properties of real neurones. Being independent both of the excitability of elements and of external influence efficacy, synchronous (desynchronous) network activity resulted from the increase (decrease) of the average power of "neuronal" interconnections which imitated mutual and recurrent excitation and inhibition. The inhibition efficacy being reduced as compared with excitation, synchronization of elements became intensified. As a consequence, the rhythmic activity amplitude increased and the appearance of self-sustained oscillations simulating convulsive activity was facilitated. The probable mechanism of EEG activation by virtue of the reduction of mutual and recurrent excitation and inhibition efficacy as well as the significance of inhibitory mechanism deficiency for epileptogenesis are discussed.     

Local cortical circuit model inferred from power-law distributed neuronal avalanches

How cortical neurons process information crucially depends on how their local circuits are organized. Spontaneous synchronous neuronal activity propagating through neocortical slices displays highly diverse, yet repeatable, activity patterns called “neuronal avalanches”. They obey power-law distributions of the event sizes and lifetimes, presumably reflecting the structure of local circuits developed in slice cultures. However, the explicit network structure underlying the power-law statistics remains unclear. Here, we present a neuronal network model of pyramidal and inhibitory neurons that enables stable propagation of avalanche-like spiking activity. We demonstrate a neuronal wiring rule that governs the formation of mutually overlapping cell assemblies during the development of this network. The resultant network comprises a mixture of feedforward chains and recurrent circuits, in which neuronal avalanches are stable if the former structure is predominant. Interestingly, the recurrent synaptic connections formed by this wiring rule limit the number of cell assemblies embeddable in a neuron pool of given size. We investigate how the resultant power laws depend on the details of the cell-assembly formation as well as on the inhibitory feedback. Our model suggests that local cortical circuits may have a more complex topological design than has previously been thought. Competing financial interests: The authors declare that they have no competing financial interests. Action Editor: Peter Latham     

Synconset Waves and Chains: Spiking Onsets in Synchronous Populations Predict and Are Predicted by Network Structure

Synfire waves are propagating spike packets in synfire chains, which are feedforward chains embedded in random networks. Although synfire waves have proved to be effective quantification for network activity with clear relations to network structure, their utilities are largely limited to feedforward networks with low background activity. To overcome these shortcomings, we describe a novel generalisation of synfire waves, and define ‘synconset wave’ as a cascade of first spikes within a synchronisation event. Synconset waves would occur in ‘synconset chains’, which are feedforward chains embedded in possibly heavily recurrent networks with heavy background activity. We probed the utility of synconset waves using simulation of single compartment neuron network models with biophysically realistic conductances, and demonstrated that the spread of synconset waves directly follows from the network connectivity matrix and is modulated by top-down inputs and the resultant oscillations. Such synconset profiles lend intuitive insights into network organisation in terms of connection probabilities between various network regions rather than an adjacency matrix. To test this intuition, we develop a Bayesian likelihood function that quantifies the probability that an observed synfire wave was caused by a given network. Further, we demonstrate it''s utility in the inverse problem of identifying the network that caused a given synfire wave. This method was effective even in highly subsampled networks where only a small subset of neurons were accessible, thus showing it''s utility in experimental estimation of connectomes in real neuronal-networks. Together, we propose synconset chains/waves as an effective framework for understanding the impact of network structure on function, and as a step towards developing physiology-driven network identification methods. Finally, as synconset chains extend the utilities of synfire chains to arbitrary networks, we suggest utilities of our framework to several aspects of network physiology including cell assemblies, population codes, and oscillatory synchrony.     

Mechanisms of Seizure Propagation in 2-Dimensional Centre-Surround Recurrent Networks

Understanding how seizures spread throughout the brain is an important problem in the treatment of epilepsy, especially for implantable devices that aim to avert focal seizures before they spread to, and overwhelm, the rest of the brain. This paper presents an analysis of the speed of propagation in a computational model of seizure-like activity in a 2-dimensional recurrent network of integrate-and-fire neurons containing both excitatory and inhibitory populations and having a difference of Gaussians connectivity structure, an approximation to that observed in cerebral cortex. In the same computational model network, alternative mechanisms are explored in order to simulate the range of seizure-like activity propagation speeds (0.1–100 mm/s) observed in two animal-slice-based models of epilepsy: (1) low extracellular , which creates excess excitation and (2) introduction of gamma-aminobutyric acid (GABA) antagonists, which reduce inhibition. Moreover, two alternative connection topologies are considered: excitation broader than inhibition, and inhibition broader than excitation. It was found that the empirically observed range of propagation velocities can be obtained for both connection topologies. For the case of the GABA antagonist model simulation, consistent with other studies, it was found that there is an effective threshold in the degree of inhibition below which waves begin to propagate. For the case of the low extracellular model simulation, it was found that activity-dependent reductions in inhibition provide a potential explanation for the emergence of slowly propagating waves. This was simulated as a depression of inhibitory synapses, but it may also be achieved by other mechanisms. This work provides a localised network understanding of the propagation of seizures in 2-dimensional centre-surround networks that can be tested empirically.     

A minimal mechanistic model for temporal signal processing in the lateral geniculate nucleus

The receptive fields of cells in the lateral geniculate nucleus (LGN) are shaped by their diverse set of impinging inputs: feedforward synaptic inputs stemming from retina, and feedback inputs stemming from the visual cortex and the thalamic reticular nucleus. To probe the possible roles of these feedforward and feedback inputs in shaping the temporal receptive-field structure of LGN relay cells, we here present and investigate a minimal mechanistic firing-rate model tailored to elucidate their disparate features. The model for LGN relay ON cells includes feedforward excitation and inhibition (via interneurons) from retinal ON cells and excitatory and inhibitory (via thalamic reticular nucleus cells and interneurons) feedback from cortical ON and OFF cells. From a general firing-rate model formulated in terms of Volterra integral equations, we derive a single delay differential equation with absolute delay governing the dynamics of the system. A freely available and easy-to-use GUI-based MATLAB version of this minimal mechanistic LGN circuit model is provided. We particularly investigate the LGN relay-cell impulse response and find through thorough explorations of the model’s parameter space that both purely feedforward models and feedback models with feedforward excitation only, can account quantitatively for previously reported experimental results. We find, however, that the purely feedforward model predicts two impulse response measures, the time to first peak and the biphasic index (measuring the relative weight of the rebound phase) to be anticorrelated. In contrast, the models with feedback predict different correlations between these two measures. This suggests an experimental test assessing the relative importance of feedforward and feedback connections in shaping the impulse response of LGN relay cells.     

Analysis of Homeostatic Mechanisms in Biochemical Networks

Cell metabolism is an extremely complicated dynamical system that maintains important cellular functions despite large changes in inputs. This “homeostasis” does not mean that the dynamical system is rigid and fixed. Typically, large changes in external variables cause large changes in some internal variables so that, through various regulatory mechanisms, certain other internal variables (concentrations or velocities) remain approximately constant over a finite range of inputs. Outside that range, the mechanisms cease to function and concentrations change rapidly with changes in inputs. In this paper we analyze four different common biochemical homeostatic mechanisms: feedforward excitation, feedback inhibition, kinetic homeostasis, and parallel inhibition. We show that all four mechanisms can occur in a single biological network, using folate and methionine metabolism as an example. Golubitsky and Stewart have proposed a method to find homeostatic nodes in networks. We show that their method works for two of these mechanisms but not the other two. We discuss the many interesting mathematical and biological questions that emerge from this analysis, and we explain why understanding homeostatic control is crucial for precision medicine.