A Model for Representing the Dynamics of a System of Synfire Chains

Competitive synchronization among synfire chains may model the dynamics of binding and compositionality. Typically, such models require simulations of hundreds of thousands of neurons. Here we show that the behavior of such large systems can be numerically analyzed by representing the neuronal activity in a synfire chain as a wave. The position and velocity of waves are the only parameters needed to represent the neural activity within a synfire chain. With this wave model we describe how waves are generated, decay, interact within a single chain and among chains. The behavior of the wave model is compared to the behavior of detailed simulations of synfire chains with no qualitative difference. We show that interacting waves tend to become locked to each other (wave synchronization). Finally we prove that: (1) Within a system of many synfire chains with symmetric interchain connections, as long as waves do not fade away or become fully synchronized, the total synchrony among waves can only increase (or stay constant), but never decrease. (2) A wave that increases its speed during the synchronization process becomes more stable.     

Graded,Dynamically Routable Information Processing with Synfire-Gated Synfire Chains

Coherent neural spiking and local field potentials are believed to be signatures of the binding and transfer of information in the brain. Coherent activity has now been measured experimentally in many regions of mammalian cortex. Recently experimental evidence has been presented suggesting that neural information is encoded and transferred in packets, i.e., in stereotypical, correlated spiking patterns of neural activity. Due to their relevance to coherent spiking, synfire chains are one of the main theoretical constructs that have been appealed to in order to describe coherent spiking and information transfer phenomena. However, for some time, it has been known that synchronous activity in feedforward networks asymptotically either approaches an attractor with fixed waveform and amplitude, or fails to propagate. This has limited the classical synfire chain’s ability to explain graded neuronal responses. Recently, we have shown that pulse-gated synfire chains are capable of propagating graded information coded in mean population current or firing rate amplitudes. In particular, we showed that it is possible to use one synfire chain to provide gating pulses and a second, pulse-gated synfire chain to propagate graded information. We called these circuits synfire-gated synfire chains (SGSCs). Here, we present SGSCs in which graded information can rapidly cascade through a neural circuit, and show a correspondence between this type of transfer and a mean-field model in which gating pulses overlap in time. We show that SGSCs are robust in the presence of variability in population size, pulse timing and synaptic strength. Finally, we demonstrate the computational capabilities of SGSC-based information coding by implementing a self-contained, spike-based, modular neural circuit that is triggered by streaming input, processes the input, then makes a decision based on the processed information and shuts itself down.     

Synchronization without oscillatory neurons

Experimental results suggest that neurons in the cortex synchronize their action potentials on the millisecond time scale. More importantly this binding expresses functional relationships between the neurons. A model of neuronal interactions is proposed in which simultaneous discharges of neurons develop through specialized synaptic circuits. As an important prerequisite for this synchronization it is demonstrated that SynFire chains, generating different levels of excitation, propagate their activity waves at distinct velocities. Two chains were coupled by excitatory synapses and their activity was initiated at different times. Due to synaptic interactions, activity in the earlier-initiated chain accelerates propagation in the other chain until the two activity waves are synchronized. Compared with several neural network models with oscillatory units, physiologically more plausible neurons are simulated. It is still under debate whether neurons in the cortex show oscillatory dischargesper se. In particular, a high rate of noise relative to very weak synaptic gains cannot impair our results in the neural network simulations.     

A neurocomputational model for optimal temporal processing

Humans can estimate the duration of intervals of time, and psychophysical experiments show that these estimations are subject to timing errors. According to standard theories of timing, these errors increase linearly with the interval to be estimated (Weber's law), and both at longer and shorter intervals, deviations from linearity are reported. This is not easily reconciled with the accumulation of neuronal noise, which would only lead to an increase with the square root of the interval. Here, we offer a neuronal model which explains the form of the error function as a result of a constrained optimization process. The model consists of a number of synfire chains with different transmission times, which project onto a set of readout neurons. We show that an increase in the transmission time corresponds to a superlinear increase of the timing errors. Under the assumption of a fixed chain length, the experimentally observed error function emerges from optimal selection of chains for each given interval. Furthermore, we show how this optimal selection could be implemented by competitive spike-timing dependent plasticity in the connections from the chains to the readout network, and discuss implications of our model on selective temporal learning and possible neural architectures of interval timing.     

High-capacity embedding of synfire chains in a cortical network model

Synfire chains, sequences of pools linked by feedforward connections, support the propagation of precisely timed spike sequences, or synfire waves. An important question remains, how synfire chains can efficiently be embedded in cortical architecture. We present a model of synfire chain embedding in a cortical scale recurrent network using conductance-based synapses, balanced chains, and variable transmission delays. The network attains substantially higher embedding capacities than previous spiking neuron models and allows all its connections to be used for embedding. The number of waves in the model is regulated by recurrent background noise. We computationally explore the embedding capacity limit, and use a mean field analysis to describe the equilibrium state. Simulations confirm the mean field analysis over broad ranges of pool sizes and connectivity levels; the number of pools embedded in the system trades off against the firing rate and the number of waves. An optimal inhibition level balances the conflicting requirements of stable synfire propagation and limited response to background noise. A simplified analysis shows that the present conductance-based synapses achieve higher contrast between the responses to synfire input and background noise compared to current-based synapses, while regulation of wave numbers is traced to the use of variable transmission delays.     

Compositionality of arm movements can be realized by propagating synchrony

We present a biologically plausible spiking neuronal network model of free monkey scribbling that reproduces experimental findings on cortical activity and the properties of the scribbling trajectory. The model is based on the idea that synfire chains can encode movement primitives. Here, we map the propagation of activity in a chain to a linearly evolving preferred velocity, which results in parabolic segments that fulfill the two-thirds power law. Connections between chains that match the final velocity of one encoded primitive to the initial velocity of the next allow the composition of random sequences of primitives with smooth transitions. The model provides an explanation for the segmentation of the trajectory and the experimentally observed deviations of the trajectory from the parabolic shape at primitive transition sites. Furthermore, the model predicts low frequency oscillations (<10 Hz) of the motor cortex local field potential during ongoing movements and increasing firing rates of non-specific motor cortex neurons before movement onset.     

Neural Sequence Generation Using Spatiotemporal Patterns of Inhibition

Stereotyped sequences of neural activity are thought to underlie reproducible behaviors and cognitive processes ranging from memory recall to arm movement. One of the most prominent theoretical models of neural sequence generation is the synfire chain, in which pulses of synchronized spiking activity propagate robustly along a chain of cells connected by highly redundant feedforward excitation. But recent experimental observations in the avian song production pathway during song generation have shown excitatory activity interacting strongly with the firing patterns of inhibitory neurons, suggesting a process of sequence generation more complex than feedforward excitation. Here we propose a model of sequence generation inspired by these observations in which a pulse travels along a spatially recurrent excitatory chain, passing repeatedly through zones of local feedback inhibition. In this model, synchrony and robust timing are maintained not through redundant excitatory connections, but rather through the interaction between the pulse and the spatiotemporal pattern of inhibition that it creates as it circulates the network. These results suggest that spatially and temporally structured inhibition may play a key role in sequence generation.     

Modeling Compositionality by Dynamic Binding of Synfire Chains

This paper examines the feasibility of manifesting compositionality by a system of synfire chains. Compositionality is the ability to construct mental representations, hierarchically, in terms of parts and their relations. We show that synfire chains may synchronize their waves when a few orderly cross links are available. We propose that synchronization among synfire chains can be used for binding component into a whole. Such synchronization is shown both for detailed simulations, and by numerical analysis of the propagation of a wave along a synfire chain. We show that global inhibition may prevent spurious synchronization among synfire chains. We further show that selecting which synfire chains may synchronize to which others may be improved by including inhibitory neurons in the synfire pools. Finally we show that in a hierarchical system of synfire chains, a part-binding problem may be resolved, and that such a system readily demonstrates the property of priming. We compare the properties of our system with the general requirements for neural networks that demonstrate compositionality.     

Two’s company,three (or more) is a simplex

As a candidate mechanism of neural representation, large numbers of synfire chains can efficiently be embedded in a balanced recurrent cortical network model. Here we study a model in which multiple synfire chains of variable strength are randomly coupled together to form a recurrent system. The system can be implemented both as a large-scale network of integrate-and-fire neurons and as a reduced model. The latter has binary-state pools as basic units but is otherwise isomorphic to the large-scale model, and provides an efficient tool for studying its behavior. Both the large-scale system and its reduced counterpart are able to sustain ongoing endogenous activity in the form of synfire waves, the proliferation of which is regulated by negative feedback caused by collateral noise. Within this equilibrium, diverse repertoires of ongoing activity are observed, including meta-stability and multiple steady states. These states arise in concert with an effective connectivity structure (ECS). The ECS admits a family of effective connectivity graphs (ECGs), parametrized by the mean global activity level. Of these graphs, the strongly connected components and their associated out-components account to a large extent for the observed steady states of the system. These results imply a notion of dynamic effective connectivity as governing neural computation with synfire chains, and related forms of cortical circuitry with complex topologies.     

Signal propagation in feedforward neuronal networks with unreliable synapses

In this paper, we systematically investigate both the synfire propagation and firing rate propagation in feedforward neuronal network coupled in an all-to-all fashion. In contrast to most earlier work, where only reliable synaptic connections are considered, we mainly examine the effects of unreliable synapses on both types of neural activity propagation in this work. We first study networks composed of purely excitatory neurons. Our results show that both the successful transmission probability and excitatory synaptic strength largely influence the propagation of these two types of neural activities, and better tuning of these synaptic parameters makes the considered network support stable signal propagation. It is also found that noise has significant but different impacts on these two types of propagation. The additive Gaussian white noise has the tendency to reduce the precision of the synfire activity, whereas noise with appropriate intensity can enhance the performance of firing rate propagation. Further simulations indicate that the propagation dynamics of the considered neuronal network is not simply determined by the average amount of received neurotransmitter for each neuron in a time instant, but also largely influenced by the stochastic effect of neurotransmitter release. Second, we compare our results with those obtained in corresponding feedforward neuronal networks connected with reliable synapses but in a random coupling fashion. We confirm that some differences can be observed in these two different feedforward neuronal network models. Finally, we study the signal propagation in feedforward neuronal networks consisting of both excitatory and inhibitory neurons, and demonstrate that inhibition also plays an important role in signal propagation in the considered networks.     

Cortical songs revisited: a lesson in statistics

Recordings from single neurons in the cortex have revealed precisely repeating patterns of synaptic events. These repeats are known as cortical "motifs" and have been suggested to reflect the precise replay of spatiotemporal firing sequences ("synfire" chains). In this issue of Neuron, Mokeichev et al. use compelling statistical analysis to show that, rather than being evidence of deterministic synfire chains, such cortical motifs are bound to appear by chance due to the natural dynamics of voltage fluctuations in neurons.     

Multiple forms of activity-dependent competition refine hippocampal circuits in vivo

Efficient memory formation relies on the establishment of functional hippocampal circuits. It has been proposed that synaptic connections are refined by neural activity to form functional brain circuitry. However, it is not known whether and how hippocampal connections are refined by neural activity in vivo. Using a mouse genetic system in which restricted populations of neurons in the hippocampal circuit are inactivated, we show that inactive axons are eliminated after they develop through a competition with active axons. Remarkably, in the dentate gyrus, which undergoes neurogenesis throughout life, axon refinement is achieved by a competition between mature and young neurons. These results demonstrate that activity-dependent competition plays multiple roles in the establishment of functional memory circuits in vivo.     

A membrane glycoprotein associated with the limbic system mediates the formation of the septo-hippocampal pathway in vitro

The ability of a neuronal surface glycoprotein to mediate the formation of neuronal connections was tested in an explant culture system. A monoclonal antibody against the limbic system-associated membrane protein (LAMP) was used in co-cultures containing cholinergic neurons of the septum and their hippocampal target neurons. Antibody treatment had no effect on general axon outgrowth, but significantly diminished the ability of septal cholinergic axons to invade and collateralize in the hippocampus. The results suggest that factors regulating general axon outgrowth may be distinct from those regulating the patterns of outgrowth that define the formation of neural circuits.     

Network Self-Organization Explains the Statistics and Dynamics of Synaptic Connection Strengths in Cortex

The information processing abilities of neural circuits arise from their synaptic connection patterns. Understanding the laws governing these connectivity patterns is essential for understanding brain function. The overall distribution of synaptic strengths of local excitatory connections in cortex and hippocampus is long-tailed, exhibiting a small number of synaptic connections of very large efficacy. At the same time, new synaptic connections are constantly being created and individual synaptic connection strengths show substantial fluctuations across time. It remains unclear through what mechanisms these properties of neural circuits arise and how they contribute to learning and memory. In this study we show that fundamental characteristics of excitatory synaptic connections in cortex and hippocampus can be explained as a consequence of self-organization in a recurrent network combining spike-timing-dependent plasticity (STDP), structural plasticity and different forms of homeostatic plasticity. In the network, associative synaptic plasticity in the form of STDP induces a rich-get-richer dynamics among synapses, while homeostatic mechanisms induce competition. Under distinctly different initial conditions, the ensuing self-organization produces long-tailed synaptic strength distributions matching experimental findings. We show that this self-organization can take place with a purely additive STDP mechanism and that multiplicative weight dynamics emerge as a consequence of network interactions. The observed patterns of fluctuation of synaptic strengths, including elimination and generation of synaptic connections and long-term persistence of strong connections, are consistent with the dynamics of dendritic spines found in rat hippocampus. Beyond this, the model predicts an approximately power-law scaling of the lifetimes of newly established synaptic connection strengths during development. Our results suggest that the combined action of multiple forms of neuronal plasticity plays an essential role in the formation and maintenance of cortical circuits.     

Axon guidance: asymmetric signaling orients polarized outgrowth

A network of connections is established as neural circuits form between neurons. To make these connections, neurons initiate asymmetric axon outgrowth in response to extracellular guidance cues. Within the specialized growth cones of migrating axons, F-actin and microtubules asymmetrically accumulate where an axon projects forward. Although many guidance cues, receptors and intracellular signaling components that are required for axon guidance have been identified, the means by which the asymmetry is established and maintained is unclear. Here, we discuss recent studies in invertebrate and vertebrate organisms that define a signaling module comprising UNC-6 (the Caenorhabditis elegans ortholog of netrin), UNC-40 (the C. elegans ortholog of DCC), PI3K, Rac and MIG-10 (the C. elegans ortholog of lamellipodin) and we consider how this module could establish polarized outgrowth in response to guidance cues.     

Neuronal chains for actions in the parietal lobe: a computational model

The inferior part of the parietal lobe (IPL) is known to play a very important role in sensorimotor integration. Neurons in this region code goal-related motor acts performed with the mouth, with the hand and with the arm. It has been demonstrated that most IPL motor neurons coding a specific motor act (e.g., grasping) show markedly different activation patterns according to the final goal of the action sequence in which the act is embedded (grasping for eating or grasping for placing). Some of these neurons (parietal mirror neurons) show a similar selectivity also during the observation of the same action sequences when executed by others. Thus, it appears that the neuronal response occurring during the execution and the observation of a specific grasping act codes not only the executed motor act, but also the agent's final goal (intention).In this work we present a biologically inspired neural network architecture that models mechanisms of motor sequences execution and recognition. In this network, pools composed of motor and mirror neurons that encode motor acts of a sequence are arranged in form of action goal-specific neuronal chains. The execution and the recognition of actions is achieved through the propagation of activity bursts along specific chains modulated by visual and somatosensory inputs.The implemented spiking neuron network is able to reproduce the results found in neurophysiological recordings of parietal neurons during task performance and provides a biologically plausible implementation of the action selection and recognition process.Finally, the present paper proposes a mechanism for the formation of new neural chains by linking together in a sequential manner neurons that represent subsequent motor acts, thus producing goal-directed sequences.     

Towards understanding of the cortical network underlying associative memory

Declarative knowledge and experiences are represented in the association cortex and are recalled by reactivation of the neural representation. Electrophysiological experiments have revealed that associations between semantically linked visual objects are formed in neural representations in the temporal and limbic cortices. Memory traces are created by the reorganization of neural circuits. These regions are reactivated during retrieval and contribute to the contents of a memory. Two different types of retrieval signals are suggested as follows: automatic and active. One flows backward from the medial temporal lobe during the automatic retrieval process, whereas the other is conveyed as a top-down signal from the prefrontal cortex to the temporal cortex during the active retrieval process. By sending the top-down signal, the prefrontal cortex manipulates and organizes to-be-remembered information, devises strategies for retrieval and monitors the outcome. To further understand the neural mechanism of memory, the following two complementary views are needed: how the multiple cortical areas in the brain-wide network interact to orchestrate cognitive functions and how the properties of single neurons and their synaptic connections with neighbouring neurons combine to form local circuits and to exhibit the function of each cortical area. We will discuss some new methodological innovations that tackle these challenges.     

A zonal model of cortical functions

A model of cortical functions is developed with the object of simulating the observed behavior of individual neurons organized in unit circuits and functional systems of the cerebellum, the cerebrum and the hippocampal formation. The neuronal model is capable of representing refractory and potentiated states, as well as the firing and lowest resting states. The unit circuits of each system consist of all common types of cells with known synaptic connections. In the cerebral system these unit circuits are interconnected to form columns as well as zones. A new discrete neural network equation, which takes account of interactions with the extracellular field, is proposed to simulate electrical activity in these circuits. A coherent theory of cortical activity and functions is derived that accounts for many of the observed phenomena, including those associated with the development of long-term potentiation and sequential memory. Three appendices are devoted to the theory of extracellular interactions, the derivation of non-linear network equations, and a computer program to simulate learning in the cortex.     

Caldesmon regulates axon extension through interaction with myosin II

To begin the process of forming neural circuits, new neurons first establish their polarity and extend their axon. Axon extension is guided and regulated by highly coordinated cytoskeletal dynamics. Here we demonstrate that in hippocampal neurons, the actin-binding protein caldesmon accumulates in distal axons, and its N-terminal interaction with myosin II enhances axon extension. In cortical neural progenitor cells, caldesmon knockdown suppresses axon extension and neuronal polarity. These results indicate that caldesmon is an important regulator of axon development.     

Dissecting cascade computational components in spiking neural networks

Finding out the physical structure of neuronal circuits that governs neuronal responses is an important goal for brain research. With fast advances for large-scale recording techniques, identification of a neuronal circuit with multiple neurons and stages or layers becomes possible and highly demanding. Although methods for mapping the connection structure of circuits have been greatly developed in recent years, they are mostly limited to simple scenarios of a few neurons in a pairwise fashion; and dissecting dynamical circuits, particularly mapping out a complete functional circuit that converges to a single neuron, is still a challenging question. Here, we show that a recent method, termed spike-triggered non-negative matrix factorization (STNMF), can address these issues. By simulating different scenarios of spiking neural networks with various connections between neurons and stages, we demonstrate that STNMF is a persuasive method to dissect functional connections within a circuit. Using spiking activities recorded at neurons of the output layer, STNMF can obtain a complete circuit consisting of all cascade computational components of presynaptic neurons, as well as their spiking activities. For simulated simple and complex cells of the primary visual cortex, STNMF allows us to dissect the pathway of visual computation. Taken together, these results suggest that STNMF could provide a useful approach for investigating neuronal systems leveraging recorded functional neuronal activity.