Emergence of network structure due to spike-timing-dependent plasticity in recurrent neuronal networks. I. Input selectivity–strengthening correlated input pathways

Spike-timing-dependent plasticity (STDP) determines the evolution of the synaptic weights according to their pre- and post-synaptic activity, which in turn changes the neuronal activity. In this paper, we extend previous studies of input selectivity induced by (STDP) for single neurons to the biologically interesting case of a neuronal network with fixed recurrent connections and plastic connections from external pools of input neurons. We use a theoretical framework based on the Poisson neuron model to analytically describe the network dynamics (firing rates and spike-time correlations) and thus the evolution of the synaptic weights. This framework incorporates the time course of the post-synaptic potentials and synaptic delays. Our analysis focuses on the asymptotic states of a network stimulated by two homogeneous pools of “steady” inputs, namely Poisson spike trains which have fixed firing rates and spike-time correlations. The (STDP) model extends rate-based learning in that it can implement, at the same time, both a stabilization of the individual neuron firing rates and a slower weight specialization depending on the input spike-time correlations. When one input pathway has stronger within-pool correlations, the resulting synaptic dynamics induced by (STDP) are shown to be similar to those arising in the case of a purely feed-forward network: the weights from the more correlated inputs are potentiated at the expense of the remaining input connections.     

The correlation grid: analysis of synchronous spiking in multi-dimensional spike train data and identification of feasible connection architectures

This paper presents a visualization technique specifically designed to support the analysis of synchronous firings in multiple, simultaneously recorded, spike trains. This technique, called the correlation grid, enables investigators to identify groups of spike trains, where each pair of spike trains has a high probability of generating spikes approximately simultaneously or within a constant time shift. Moreover, the correlation grid was developed to help solve the following reverse problem: identification of the connection architecture between spike train generating units, which may produce a spike train dataset similar to the one under analysis. To demonstrate the efficacy of this approach, results are presented from a study of three simulated, noisy, spike train datasets. The parameters of the simulated neurons were chosen to reflect the typical characteristics of cortical pyramidal neurons. The schemes of neuronal connections were not known to the analysts. Nevertheless, the correlation grid enabled the analysts to find the correct connection architecture for each of these three data sets.     

Lateral spike conduction velocity in the visual cortex affects spatial range of synchronization and receptive field size without visual experience: a learning model with spiking neurons

Classical receptive fields (cRF) increase in size from the retina to higher visual centers. The present work shows how temporal properties, in particular lateral spike velocity and spike input correlation, can affect cRF size and position without visual experience. We demonstrate how these properties are related to the spatial range of cortical synchronization if Hebbian learning dominates early development. For this, a largely reduced model of two successive levels of the visual cortex is developed (e.g., areas V1 and V2). It consists of retinotopic networks of spiking neurons with constant spike velocity in lateral connections. Feedforward connections between level 1 and 2 are additive and determine cRF size and shape, while lateral connections within level 1 are modulatory and affect the cortical range of synchronization. Input during development is mimicked by spike trains with spatially homogeneous properties and a confined temporal correlation width. During learning, the homogeneous lateral coupling shrinks to limited coupling structures defining synchronization and related association fields (AF). The size of level-1 synchronization fields determines the lateral coupling range of developing level-1-to-2 connections and, thus, the size of level-2 cRFs, even if the feedforward connections have distance-independent delays. AFs and cRFs increase with spike velocity in the lateral network and temporal correlation width of the input. Our results suggest that AF size of V1 and cRF size of V2 neurons are confined during learning by the temporal width of input correlations and the spike velocity in lateral connections without the need of visual experience. During learning from visual experience, a similar influence of AF size on the cRF size may be operative at successive levels of processing, including other parts of the visual system.     

Spike propagation synchronized by temporally asymmetric Hebbian learning

 Synchronously spiking neurons have been observed in the cerebral cortex and the hippocampus. In computer models, synchronous spike volleys may be propagated across appropriately connected neuron populations. However, it is unclear how the appropriate synaptic connectivity is set up during development and maintained during adult learning. We performed computer simulations to investigate the influence of temporally asymmetric Hebbian synaptic plasticity on the propagation of spike volleys. In addition to feedforward connections, recurrent connections were included between and within neuron populations and spike transmission delays varied due to axonal, synaptic and dendritic transmission. We found that repeated presentations of input volleys decreased the synaptic conductances of intragroup and feedback connections while synaptic conductances of feedforward connections with short delays became stronger than those of connections with longer delays. These adaptations led to the synchronization of spike volleys as they propagated across neuron populations. The findings suggests that temporally asymmetric Hebbian learning may enhance synchronized spiking within small populations of neurons in cortical and hippocampal areas and familiar stimuli may produce synchronized spike volleys that are rapidly propagated across neural tissue. Received: 28 May 2002 / Accepted: 3 June 2002 RID="*" ID="*" Correspondence to: R. E. Suri Intelligent Optical Systems (IOS), 2520 W 237th St, Torrance, CA 90505-5217, USA (e-mail: rsuri@intopsys.com, Tel.: +1-310-5307130 ext. 108, Fax: +1-210-5307417)     

Emergence of network structure due to spike-timing-dependent plasticity in recurrent neuronal networks IV

In neuronal networks, the changes of synaptic strength (or weight) performed by spike-timing-dependent plasticity (STDP) are hypothesized to give rise to functional network structure. This article investigates how this phenomenon occurs for the excitatory recurrent connections of a network with fixed input weights that is stimulated by external spike trains. We develop a theoretical framework based on the Poisson neuron model to analyze the interplay between the neuronal activity (firing rates and the spike-time correlations) and the learning dynamics, when the network is stimulated by correlated pools of homogeneous Poisson spike trains. STDP can lead to both a stabilization of all the neuron firing rates (homeostatic equilibrium) and a robust weight specialization. The pattern of specialization for the recurrent weights is determined by a relationship between the input firing-rate and correlation structures, the network topology, the STDP parameters and the synaptic response properties. We find conditions for feed-forward pathways or areas with strengthened self-feedback to emerge in an initially homogeneous recurrent network.     

Nonuniformity in the linear network model of the oculomotor integrator produces approximately fractional-order dynamics and more realistic neuron behavior

The oculomotor integrator is a network that is composed of neurons in the medial vestibular nuclei and nuclei prepositus hypoglossi in the brainstem. Those neurons act approximately as fractional integrators of various orders, converting eye velocity commands into signals that are intermediate between velocity and position. The oculomotor integrator has been modeled as a network of linear neural elements, the time constants of which are lengthened by positive feedback through reciprocal inhibition. In this model, in which each neuron reciprocally inhibits its neighbors with the same Gaussian profile, all model neurons behave as identical, first-order, low-pass filters with dynamics that do not match the variable, approximately fractional-order dynamics of the neurons that compose the actual oculomotor integrator. Fractional-order integrators can be approximated by weighted sums of first-order, low-pass filters with diverse, broadly distributed time constants. Dynamic systems analysis reveals that the model integrator indeed has many broadly distributed time constants. However, only one time constant is expressed in the model due to the uniformity of its network connections. If the model network is made nonuniform by removing the reciprocal connections to and from a small number of neurons, then many more time constants are expressed. The dynamics of the neurons in the nonuniform network model are variable, approximately fractional-order, and resemble those of the neurons that compose the actual oculomotor integrator. Completely removing the connections to and from a neuron is equivalent to eliminating it, an operation done previously to demonstrate the robustness of the integrator network model. Ironically, the resulting nonuniform network model, previously supposed to represent a pathological integrator, may in fact represent a healthy integrator containing neurons with realistically variable, approximately fractional-order dynamics. Received: 8 August 1997 / Accepted in revised form: 18 June 1998     

The Possible Role of Spike Patterns in Cortical Information Processing

When the same visual stimulus is presented across many trials, neurons in the visual cortex receive stimulus-related synaptic inputs that are reproducible across trials (S) and inputs that are not (N). The variability of spike trains recorded in the visual cortex and their apparent lack of spike-to-spike correlations beyond that implied by firing rate fluctuations, has been taken as evidence for a low S/N ratio. A recent re-analysis of in vivo cortical data revealed evidence for spike-to-spike correlations in the form of spike patterns. We examine neural dynamics at a higher S/N in order to determine what possible role spike patterns could play in cortical information processing. In vivo-like spike patterns were obtained in model simulations. Superpositions of multiple sinusoidal driving currents were especially effective in producing stable long-lasting patterns. By applying current pulses that were either short and strong or long and weak, neurons could be made to switch from one pattern to another. Cortical neurons with similar stimulus preferences are located near each other, have similar biophysical properties and receive a large number of common synaptic inputs. Hence, recordings of a single neuron across multiple trials are usually interpreted as the response of an ensemble of these neurons during one trial. In the presence of distinct spike patterns across trials there is ambiguity in what would be the corresponding ensemble, it could consist of the same spike pattern for each neuron or a set of patterns across neurons. We found that the spiking response of a neuron receiving these ensemble inputs was determined by the spike-pattern composition, which, in turn, could be modulated dynamically as a means for cortical information processing.     

Computational simulation: astrocyte-induced depolarization of neighboring neurons mediates synchronous UP states in a neural network

Although recent reports have suggested that synchronous neuronal UP states are mediated by astrocytic activity, the mechanism responsible for this remains unknown. Astrocytic glutamate release synchronously depolarizes adjacent neurons, while synaptic transmissions are blocked. The purpose of this study was to confirm that astrocytic depolarization, propagated through synaptic connections, can lead to synchronous neuronal UP states. We applied astrocytic currents to local neurons in a neural network consisting of model cortical neurons. Our results show that astrocytic depolarization may generate synchronous UP states for hundreds of milliseconds in neurons even if they do not directly receive glutamate release from the activated astrocyte.     

Neuron classification based on temporal firing patterns by the dynamical analysis with changing time resolution (DCT) method

Spike train data of many neurons can be obtained by multirecording techniques; however, the data make it difficult to estimate the connective structure in a large network. Neuron classification should be helpful in that regard, assuming that multiple neurons having similar connections with other neurons show a similar temporal firing pattern. We propose a novel method for classifying neurons based on temporal firing patterns of spike train data called the dynamical analysis with changing time resolution (DCT) method. The DCT method can evaluate temporal firing patterns by a simple algorithm with few arbitrary factors and automatically classify neurons by similarity of temporal firing patterns. In the DCT method, temporal firing patterns were objectively evaluated by analyzing their dependence on temporal resolution. We confirmed the effectiveness of the DCT method using actual spike train data.     

Order-Based Representation in Random Networks of Cortical Neurons

The wide range of time scales involved in neural excitability and synaptic transmission might lead to ongoing change in the temporal structure of responses to recurring stimulus presentations on a trial-to-trial basis. This is probably the most severe biophysical constraint on putative time-based primitives of stimulus representation in neuronal networks. Here we show that in spontaneously developing large-scale random networks of cortical neurons in vitro the order in which neurons are recruited following each stimulus is a naturally emerging representation primitive that is invariant to significant temporal changes in spike times. With a relatively small number of randomly sampled neurons, the information about stimulus position is fully retrievable from the recruitment order. The effective connectivity that makes order-based representation invariant to time warping is characterized by the existence of stations through which activity is required to pass in order to propagate further into the network. This study uncovers a simple invariant in a noisy biological network in vitro; its applicability under in vivo constraints remains to be seen.     

Complex evolution of spike patterns during burst propagation through feed-forward networks

Stable signal transmission is crucial for information processing by the brain. Synfire-chains, defined as feed-forward networks of spiking neurons, are a well-studied class of circuit structure that can propagate a packet of single spikes while maintaining a fixed packet profile. Here, we studied the stable propagation of spike bursts, rather than single spike activities, in a feed-forward network of a general class of excitable bursting neurons. In contrast to single spikes, bursts can propagate stably without converging to any fixed profiles. Spike timings of bursts continue to change cyclically or irregularly during propagation depending on intrinsic properties of the neurons and the coupling strength of the network. To find the conditions under which bursts lose fixed profiles, we propose an analysis based on timing shifts of burst spikes similar to the phase response analysis of limit-cycle oscillators.     

Variability v.s. synchronicity of neuronal activity in local cortical network models with different wiring topologies

Dynamical behavior of a biological neuronal network depends significantly on the spatial pattern of synaptic connections among neurons. While neuronal network dynamics has extensively been studied with simple wiring patterns, such as all-to-all or random synaptic connections, not much is known about the activity of networks with more complicated wiring topologies. Here, we examined how different wiring topologies may influence the response properties of neuronal networks, paying attention to irregular spike firing, which is known as a characteristic of in vivo cortical neurons, and spike synchronicity. We constructed a recurrent network model of realistic neurons and systematically rewired the recurrent synapses to change the network topology, from a localized regular and a “small-world” network topology to a distributed random network topology. Regular and small-world wiring patterns greatly increased the irregularity or the coefficient of variation (Cv) of output spike trains, whereas such an increase was small in random connectivity patterns. For given strength of recurrent synapses, the firing irregularity exhibited monotonous decreases from the regular to the random network topology. By contrast, the spike coherence between an arbitrary neuron pair exhibited a non-monotonous dependence on the topological wiring pattern. More precisely, the wiring pattern to maximize the spike coherence varied with the strength of recurrent synapses. In a certain range of the synaptic strength, the spike coherence was maximal in the small-world network topology, and the long-range connections introduced in this wiring changed the dependence of spike synchrony on the synaptic strength moderately. However, the effects of this network topology were not really special in other properties of network activity. Action Editor: Xiao-Jing Wang     

Implementing Gaussian process inference with neural networks

Gaussian processes compare favourably with backpropagation neural networks as a tool for regression, and Bayesian neural networks have Gaussian process behaviour when the number of hidden neurons tends to infinity. We describe a simple recurrent neural network with connection weights trained by one-shot Hebbian learning. This network amounts to a dynamical system which relaxes to a stable state in which it generates predictions identical to those of Gaussian process regression. In effect an infinite number of hidden units in a feed-forward architecture can be replaced by a merely finite number, together with recurrent connections.     

Mixed Signal Learning by Spike Correlation Propagation in Feedback Inhibitory Circuits

The brain can learn and detect mixed input signals masked by various types of noise, and spike-timing-dependent plasticity (STDP) is the candidate synaptic level mechanism. Because sensory inputs typically have spike correlation, and local circuits have dense feedback connections, input spikes cause the propagation of spike correlation in lateral circuits; however, it is largely unknown how this secondary correlation generated by lateral circuits influences learning processes through STDP, or whether it is beneficial to achieve efficient spike-based learning from uncertain stimuli. To explore the answers to these questions, we construct models of feedforward networks with lateral inhibitory circuits and study how propagated correlation influences STDP learning, and what kind of learning algorithm such circuits achieve. We derive analytical conditions at which neurons detect minor signals with STDP, and show that depending on the origin of the noise, different correlation timescales are useful for learning. In particular, we show that non-precise spike correlation is beneficial for learning in the presence of cross-talk noise. We also show that by considering excitatory and inhibitory STDP at lateral connections, the circuit can acquire a lateral structure optimal for signal detection. In addition, we demonstrate that the model performs blind source separation in a manner similar to the sequential sampling approximation of the Bayesian independent component analysis algorithm. Our results provide a basic understanding of STDP learning in feedback circuits by integrating analyses from both dynamical systems and information theory.     

A dynamic neural network with temporal coding and functional connectivity

A neural network model capable of altering its pattern classifying properties by program input is proposed. Here the “program input” is another source of input besides the pattern input. Unlike most neural network models, this model runs as a deterministic point process of spikes in continuous time; connections among neurons have finite delays, which are set randomly according to a normal distribution. Furthermore, this model utilizes functional connectivity which is dynamic connectivity among neurons peculiar to temporal-coding neural networks with short neuronal decay time constants. Computer simulation of the proposed network has been performed, and the results are considered in light of experimental results shown recently for correlated firings of neurons. Received: 6 December 1996 / Accepted in revised form: 15 September 1997     

Spike correlations in a songbird agree with a simple markov population model

The relationships between neural activity at the single-cell and the population levels are of central importance for understanding neural codes. In many sensory systems, collective behaviors in large cell groups can be described by pairwise spike correlations. Here, we test whether in a highly specialized premotor system of songbirds, pairwise spike correlations themselves can be seen as a simple corollary of an underlying random process. We test hypotheses on connectivity and network dynamics in the motor pathway of zebra finches using a high-level population model that is independent of detailed single-neuron properties. We assume that neural population activity evolves along a finite set of states during singing, and that during sleep population activity randomly switches back and forth between song states and a single resting state. Individual spike trains are generated by associating with each of the population states a particular firing mode, such as bursting or tonic firing. With an overall modification of one or two simple control parameters, the Markov model is able to reproduce observed firing statistics and spike correlations in different neuron types and behavioral states. Our results suggest that song- and sleep-related firing patterns are identical on short time scales and result from random sampling of a unique underlying theme. The efficiency of our population model may apply also to other neural systems in which population hypotheses can be tested on recordings from small neuron groups.     

A case for spiking neural network simulation based on configurable multiple-FPGA systems

Recent neuropsychological research has begun to reveal that neurons encode information in the timing of spikes. Spiking neural network simulations are a flexible and powerful method for investigating the behaviour of neuronal systems. Simulation of the spiking neural networks in software is unable to rapidly generate output spikes in large-scale of neural network. An alternative approach, hardware implementation of such system, provides the possibility to generate independent spikes precisely and simultaneously output spike waves in real time, under the premise that spiking neural network can take full advantage of hardware inherent parallelism. We introduce a configurable FPGA-oriented hardware platform for spiking neural network simulation in this work. We aim to use this platform to combine the speed of dedicated hardware with the programmability of software so that it might allow neuroscientists to put together sophisticated computation experiments of their own model. A feed-forward hierarchy network is developed as a case study to describe the operation of biological neural systems (such as orientation selectivity of visual cortex) and computational models of such systems. This model demonstrates how a feed-forward neural network constructs the circuitry required for orientation selectivity and provides platform for reaching a deeper understanding of the primate visual system. In the future, larger scale models based on this framework can be used to replicate the actual architecture in visual cortex, leading to more detailed predictions and insights into visual perception phenomenon.     

Correlations and Functional Connections in a Population of Grid Cells

We study the statistics of spike trains of simultaneously recorded grid cells in freely behaving rats. We evaluate pairwise correlations between these cells and, using a maximum entropy kinetic pairwise model (kinetic Ising model), study their functional connectivity. Even when we account for the covariations in firing rates due to overlapping fields, both the pairwise correlations and functional connections decay as a function of the shortest distance between the vertices of the spatial firing pattern of pairs of grid cells, i.e. their phase difference. They take positive values between cells with nearby phases and approach zero or negative values for larger phase differences. We find similar results also when, in addition to correlations due to overlapping fields, we account for correlations due to theta oscillations and head directional inputs. The inferred connections between neurons in the same module and those from different modules can be both negative and positive, with a mean close to zero, but with the strongest inferred connections found between cells of the same module. Taken together, our results suggest that grid cells in the same module do indeed form a local network of interconnected neurons with a functional connectivity that supports a role for attractor dynamics in the generation of grid pattern.     

Organization of neocortical neuronal networks

Multiple unit activity in deep layers of the frontal and motor cortices was recorded by chronically implanted semimicroelectrodes in waking cats with different levels of food motivation. From four to seven neuronal spike trains were selected from the recorded multiunit activity. Interactions between neighbouring neurons in the motor and frontal areas of the neocortex (within the local neuronal networks) and between the neurons of these areas (distributed neuronal networks) were estimated by means of statistical crosscorrelation analysis of spike trains within the range of delays from 0 to 100 ms. Neurons in the local networks were divided in two subgroups: the neurons with higher spike amplitudes with the dominance of divergent connections and neurons with lower spike amplitudes with the dominance of convergent connections. Strong monosynaptic connections (discharges with a delay of less than 2 ms) between the neurons with high- and low-amplitude spikes formed the background of the local networks. Connections between low-amplitude neurons in the frontal cortex and high-amplitude neurons in the motor cortex dominated in the distributed networks. A 24-hour food deprivation predominantly altered the late interneuronal crosscorrelations with time delays within the range of 2-100 ms in both local and distributed networks.