Structure of spontaneous UP and DOWN transitions self-organizing in a cortical network model

Synaptic plasticity is considered to play a crucial role in the experience-dependent self-organization of local cortical networks. In the absence of sensory stimuli, cerebral cortex exhibits spontaneous membrane potential transitions between an UP and a DOWN state. To reveal how cortical networks develop spontaneous activity, or conversely, how spontaneous activity structures cortical networks, we analyze the self-organization of a recurrent network model of excitatory and inhibitory neurons, which is realistic enough to replicate UP–DOWN states, with spike-timing-dependent plasticity (STDP). The individual neurons in the self-organized network exhibit a variety of temporal patterns in the two-state transitions. In addition, the model develops a feed-forward network-like structure that produces a diverse repertoire of precise sequences of the UP state. Our model shows that the self-organized activity well resembles the spontaneous activity of cortical networks if STDP is accompanied by the pruning of weak synapses. These results suggest that the two-state membrane potential transitions play an active role in structuring local cortical circuits.     

Functional Calcium Imaging in Developing Cortical Networks

A hallmark pattern of activity in developing nervous systems is spontaneous, synchronized network activity. Synchronized activity has been observed in intact spinal cord, brainstem, retina, cortex and dissociated neuronal culture preparations. During periods of spontaneous activity, neurons depolarize to fire single or bursts of action potentials, activating many ion channels. Depolarization activates voltage-gated calcium channels on dendrites and spines that mediate calcium influx. Highly synchronized electrical activity has been measured from local neuronal networks using field electrodes. This technique enables high temporal sampling rates but lower spatial resolution due to integrated read-out of multiple neurons at one electrode. Single cell resolution of neuronal activity is possible using patch-clamp electrophysiology on single neurons to measure firing activity. However, the ability to measure from a network is limited to the number of neurons patched simultaneously, and typically is only one or two neurons. The use of calcium-dependent fluorescent indicator dyes has enabled the measurement of synchronized activity across a network of cells. This technique gives both high spatial resolution and sufficient temporal sampling to record spontaneous activity of the developing network.A key feature of newly-forming cortical and hippocampal networks during pre- and early postnatal development is spontaneous, synchronized neuronal activity (Katz & Shatz, 1996; Khaziphov & Luhmann, 2006). This correlated network activity is believed to be essential for the generation of functional circuits in the developing nervous system (Spitzer, 2006). In both primate and rodent brain, early electrical and calcium network waves are observed pre- and postnatally in vivo and in vitro (Adelsberger et al., 2005; Garaschuk et al., 2000; Lamblin et al., 1999). These early activity patterns, which are known to control several developmental processes including neuronal differentiation, synaptogenesis and plasticity (Rakic & Komuro, 1995; Spitzer et al., 2004) are of critical importance for the correct development and maturation of the cortical circuitry.In this JoVE video, we demonstrate the methods used to image spontaneous activity in developing cortical networks. Calcium-sensitive indicators, such as Fura 2-AM ester diffuse across the cell membrane where intracellular esterase activity cleaves the AM esters to leave the cell-impermeant form of indicator dye. The impermeant form of indicator has carboxylic acid groups which are able to then detect and bind calcium ions intracellularly.. The fluorescence of the calcium-sensitive dye is transiently altered upon binding to calcium. Single or multi-photon imaging techniques are used to measure the change in photons being emitted from the dye, and thus indicate an alteration in intracellular calcium. Furthermore, these calcium-dependent indicators can be combined with other fluorescent markers to investigate cell types within the active network.     

Microelectrode array-based system for neuropharmacological applications with cortical neurons cultured in vitro

Microelectrode arrays (MEAs) provide a means to investigate the electrophysiological behavior of neuronal systems through the measurements from neuronal culture preparations. Changes in activity patterns of neuronal networks are usually detected by applying neural chemicals. Because of the difficulties of fabricating the arrays, and the delicate and less reliable properties of cortical neurons, MEA-based systems with cortical neuronal networks for neurophamacological applications are technically difficult, therefore restricting their utility. Here, we report a new approach to the development of such MEA-based system with sensitive and durable MEAs conveniently fabricated and the culture conditions optimized. Upon growth differentiation, cortical neurons, cultured directly on MEAs, reach a developmentally stable and reliable activity state. With this system, we monitored the global spontaneous activities of neuronal networks and demonstrated the fine discrimination for specific substances and unique property of cortical neurons, which validated both the applicability and necessity of such system in pharmacological bioassay.     

Plasticity of recurring spatiotemporal activity patterns in cortical networks

How do neurons encode and store information for long periods of time? Recurring patterns of activity have been reported in various cortical structures and were suggested to play a role in information processing and memory. To study the potential role of bursts of action potentials in memory mechanisms, we investigated patterns of spontaneous multi-single-unit activity in dissociated rat cortical cultures in vitro. Spontaneous spikes were recorded from networks of approximately 50 000 neurons and glia cultured on a grid of 60 extracellular substrate- embedded electrodes (multi-electrode arrays). These networks expressed spontaneous culture- wide bursting from approximately one week in vitro. During bursts, a large portion of the active electrodes showed elevated levels of firing. Spatiotemporal activity patterns within spontaneous bursts were clustered using a correlation-based clustering algorithm, and the occurrences of these burst clusters were tracked over several hours. This analysis revealed spatiotemporally diverse bursts occurring in well-defined patterns, which remained stable for several hours. Activity evoked by strong local tetanic stimulation resulted in significant changes in the occurrences of spontaneous bursts belonging to different clusters, indicating that the dynamical flow of information in the neuronal network had been altered. The diversity of spatiotemporal structure and long-term stability of spontaneous bursts together with their plastic nature strongly suggests that such network patterns could be used as codes for information transfer and the expression of memories stored in cortical networks.     

Bayesian Computation Emerges in Generic Cortical Microcircuits through Spike-Timing-Dependent Plasticity

The principles by which networks of neurons compute, and how spike-timing dependent plasticity (STDP) of synaptic weights generates and maintains their computational function, are unknown. Preceding work has shown that soft winner-take-all (WTA) circuits, where pyramidal neurons inhibit each other via interneurons, are a common motif of cortical microcircuits. We show through theoretical analysis and computer simulations that Bayesian computation is induced in these network motifs through STDP in combination with activity-dependent changes in the excitability of neurons. The fundamental components of this emergent Bayesian computation are priors that result from adaptation of neuronal excitability and implicit generative models for hidden causes that are created in the synaptic weights through STDP. In fact, a surprising result is that STDP is able to approximate a powerful principle for fitting such implicit generative models to high-dimensional spike inputs: Expectation Maximization. Our results suggest that the experimentally observed spontaneous activity and trial-to-trial variability of cortical neurons are essential features of their information processing capability, since their functional role is to represent probability distributions rather than static neural codes. Furthermore it suggests networks of Bayesian computation modules as a new model for distributed information processing in the cortex.     

Stochastic Computations in Cortical Microcircuit Models

Experimental data from neuroscience suggest that a substantial amount of knowledge is stored in the brain in the form of probability distributions over network states and trajectories of network states. We provide a theoretical foundation for this hypothesis by showing that even very detailed models for cortical microcircuits, with data-based diverse nonlinear neurons and synapses, have a stationary distribution of network states and trajectories of network states to which they converge exponentially fast from any initial state. We demonstrate that this convergence holds in spite of the non-reversibility of the stochastic dynamics of cortical microcircuits. We further show that, in the presence of background network oscillations, separate stationary distributions emerge for different phases of the oscillation, in accordance with experimentally reported phase-specific codes. We complement these theoretical results by computer simulations that investigate resulting computation times for typical probabilistic inference tasks on these internally stored distributions, such as marginalization or marginal maximum-a-posteriori estimation. Furthermore, we show that the inherent stochastic dynamics of generic cortical microcircuits enables them to quickly generate approximate solutions to difficult constraint satisfaction problems, where stored knowledge and current inputs jointly constrain possible solutions. This provides a powerful new computing paradigm for networks of spiking neurons, that also throws new light on how networks of neurons in the brain could carry out complex computational tasks such as prediction, imagination, memory recall and problem solving.     

On the synthesis of DNA error correcting codes

Regeneration of damaged central nervous systems (CNS) is an important topic in neuroscience and neuroengineering. Grafting new neurons derived from pluripotent stem cells into damaged regions can be done to restore functions after injury. Little is known, however, about network-wide interactions between stem-cell-derived neurons and CNS neurons. In this study, we developed a co-culture method of stem cell-derived neuronal networks and CNS networks and observed spontaneous activity in the co-culture samples. By using a microfabricated poly(dimethylsiloxane) device having two culture compartments and 20 connecting microconduits, we are able to compartmentalize P19-derived neurons and mouse cortical neurons and connect them via the microconduits. Furthermore, we combined the co-culture device and a microelectrode array (MEA)-based recording system and recorded spontaneous activity in the co-cultured networks. We found that periodic synchronized bursting spreading over both neuronal networks occurred during the second week in vitro and that P19-derived neurons in the co-cultured networks had different developmental processes compared with those grown in monoculture. These findings suggest that functional interactions form between P19-dervived neurons and mouse cortical neurons and that the co-culture method is useful for exploring the network-wide integrations between stem cell-derived neurons and CNS neurons.     

An integrate-and-fire model for synchronized bursting in a network of cultured cortical neurons

It has been suggested that spontaneous synchronous neuronal activity is an essential step in the formation of functional networks in the central nervous system. The key features of this type of activity consist of bursts of action potentials with associated spikes of elevated cytoplasmic calcium. These features are also observed in networks of rat cortical neurons that have been formed in culture. Experimental studies of these cultured networks have led to several hypotheses for the mechanisms underlying the observed synchronized oscillations. In this paper, bursting integrate-and-fire type mathematical models for regular spiking (RS) and intrinsic bursting (IB) neurons are introduced and incorporated through a small-world connection scheme into a two-dimensional excitatory network similar to those in the cultured network. This computer model exhibits spontaneous synchronous activity through mechanisms similar to those hypothesized for the cultured experimental networks. Traces of the membrane potential and cytoplasmic calcium from the model closely match those obtained from experiments. We also consider the impact on network behavior of the IB neurons, the geometry and the small world connection scheme. Action Editor: David Golomb     

Coemergence of regularity and complexity during neural network development

With the growing recognition that rhythmic and oscillatory patterns are widespread in the brain and play important roles in all aspects of the function of our nervous system, there has been a resurgence of interest in neuronal synchronized bursting activity. Here, we were interested in understanding the development of synchronized bursts as information-bearing neuronal activity patterns. For that, we have monitored the morphological organization and spontaneous activity of neuronal networks cultured on multielectrode-arrays during their self-executed evolvement from a mixture of dissociated cells into an active network. Complex collective network electrical activity evolved from sporadic firing patterns of the single neurons. On the system (network) level, the activity was marked by bursting events with interneuronal synchronization and nonarbitrary temporal ordering. We quantified these individual-to-collective activity transitions using newly-developed system level quantitative measures of time series regularity and complexity. We found that individual neuronal activity before synchronization was characterized by high regularity and low complexity. During neuronal wiring, there was a transient period of reorganization marked by low regularity, which then leads to coemergence of elevated regularity and functional (nonstochastic) complexity. We further investigated the morphology-activity interplay by modeling artificial neuronal networks with different topological organizations and connectivity schemes. The simulations support our experimental results by showing increased levels of complexity of neuronal activity patterns when neurons are wired up and organized in clusters (similar to mature real networks), as well as network-level activity regulation once collective activity forms.     

On the dynamics of the spontaneous activity in neuronal networks

Most neuronal networks, even in the absence of external stimuli, produce spontaneous bursts of spikes separated by periods of reduced activity. The origin and functional role of these neuronal events are still unclear. The present work shows that the spontaneous activity of two very different networks, intact leech ganglia and dissociated cultures of rat hippocampal neurons, share several features. Indeed, in both networks: i) the inter-spike intervals distribution of the spontaneous firing of single neurons is either regular or periodic or bursting, with the fraction of bursting neurons depending on the network activity; ii) bursts of spontaneous spikes have the same broad distributions of size and duration; iii) the degree of correlated activity increases with the bin width, and the power spectrum of the network firing rate has a 1/f behavior at low frequencies, indicating the existence of long-range temporal correlations; iv) the activity of excitatory synaptic pathways mediated by NMDA receptors is necessary for the onset of the long-range correlations and for the presence of large bursts; v) blockage of inhibitory synaptic pathways mediated by GABA(A) receptors causes instead an increase in the correlation among neurons and leads to a burst distribution composed only of very small and very large bursts. These results suggest that the spontaneous electrical activity in neuronal networks with different architectures and functions can have very similar properties and common dynamics.     

Dynamics of spontaneous activity in neocortical slices.

The flow of activity in the cortical microcircuitry is poorly understood. We use calcium imaging to reconstruct, with millisecond and single-cell resolution, the spontaneous activity of populations of neurons in unstimulated slices from mouse visual cortex. We find spontaneous activity correlated among networks of layer 5 pyramidal cells. Synchronous ensembles occupy overlapping territories, often share neurons, and are repeatedly activated. Sets of neurons are also sequentially activated numerous times. Network synchronization and sequential correlations are blocked by glutamatergic antagonists, even though spontaneous firing persists in many "autonomously active" neurons. This autonomous activity is periodic and depends on hyperpolarization-activated cationic (H) and persistent sodium (Na(p)) currents. We conclude that the isolated neocortical microcircuit generates spontaneous activity, mediated by a combination of intrinsic and circuit mechanisms, and that this activity can be temporally precise.     

Self-sustained asynchronous irregular states and Up–Down states in thalamic,cortical and thalamocortical networks of nonlinear integrate-and-fire neurons

Randomly-connected networks of integrate-and-fire (IF) neurons are known to display asynchronous irregular (AI) activity states, which resemble the discharge activity recorded in the cerebral cortex of awake animals. However, it is not clear whether such activity states are specific to simple IF models, or if they also exist in networks where neurons are endowed with complex intrinsic properties similar to electrophysiological measurements. Here, we investigate the occurrence of AI states in networks of nonlinear IF neurons, such as the adaptive exponential IF (Brette-Gerstner-Izhikevich) model. This model can display intrinsic properties such as low-threshold spike (LTS), regular spiking (RS) or fast-spiking (FS). We successively investigate the oscillatory and AI dynamics of thalamic, cortical and thalamocortical networks using such models. AI states can be found in each case, sometimes with surprisingly small network size of the order of a few tens of neurons. We show that the presence of LTS neurons in cortex or in thalamus, explains the robust emergence of AI states for relatively small network sizes. Finally, we investigate the role of spike-frequency adaptation (SFA). In cortical networks with strong SFA in RS cells, the AI state is transient, but when SFA is reduced, AI states can be self-sustained for long times. In thalamocortical networks, AI states are found when the cortex is itself in an AI state, but with strong SFA, the thalamocortical network displays Up and Down state transitions, similar to intracellular recordings during slow-wave sleep or anesthesia. Self-sustained Up and Down states could also be generated by two-layer cortical networks with LTS cells. These models suggest that intrinsic properties such as adaptation and low-threshold bursting activity are crucial for the genesis and control of AI states in thalamocortical networks.     

Dense Neuron Clustering Explains Connectivity Statistics in Cortical Microcircuits

Local cortical circuits appear highly non-random, but the underlying connectivity rule remains elusive. Here, we analyze experimental data observed in layer 5 of rat neocortex and suggest a model for connectivity from which emerge essential observed non-random features of both wiring and weighting. These features include lognormal distributions of synaptic connection strength, anatomical clustering, and strong correlations between clustering and connection strength. Our model predicts that cortical microcircuits contain large groups of densely connected neurons which we call clusters. We show that such a cluster contains about one fifth of all excitatory neurons of a circuit which are very densely connected with stronger than average synapses. We demonstrate that such clustering plays an important role in the network dynamics, namely, it creates bistable neural spiking in small cortical circuits. Furthermore, introducing local clustering in large-scale networks leads to the emergence of various patterns of persistent local activity in an ongoing network activity. Thus, our results may bridge a gap between anatomical structure and persistent activity observed during working memory and other cognitive processes.     

A fluctuation-driven mechanism for slow decision processes in reverberant networks

The spike activity of cells in some cortical areas has been found to be correlated with reaction times and behavioral responses during two-choice decision tasks. These experimental findings have motivated the study of biologically plausible winner-take-all network models, in which strong recurrent excitation and feedback inhibition allow the network to form a categorical choice upon stimulation. Choice formation corresponds in these models to the transition from the spontaneous state of the network to a state where neurons selective for one of the choices fire at a high rate and inhibit the activity of the other neurons. This transition has been traditionally induced by an increase in the external input that destabilizes the spontaneous state of the network and forces its relaxation to a decision state. Here we explore a different mechanism by which the system can undergo such transitions while keeping the spontaneous state stable, based on an escape induced by finite-size noise from the spontaneous state. This decision mechanism naturally arises for low stimulus strengths and leads to exponentially distributed decision times when the amount of noise in the system is small. Furthermore, we show using numerical simulations that mean decision times follow in this regime an exponential dependence on the amplitude of noise. The escape mechanism provides thus a dynamical basis for the wide range and variability of decision times observed experimentally.     

Neural Avalanches at the Critical Point between Replay and Non-Replay of Spatiotemporal Patterns

We model spontaneous cortical activity with a network of coupled spiking units, in which multiple spatio-temporal patterns are stored as dynamical attractors. We introduce an order parameter, which measures the overlap (similarity) between the activity of the network and the stored patterns. We find that, depending on the excitability of the network, different working regimes are possible. For high excitability, the dynamical attractors are stable, and a collective activity that replays one of the stored patterns emerges spontaneously, while for low excitability, no replay is induced. Between these two regimes, there is a critical region in which the dynamical attractors are unstable, and intermittent short replays are induced by noise. At the critical spiking threshold, the order parameter goes from zero to one, and its fluctuations are maximized, as expected for a phase transition (and as observed in recent experimental results in the brain). Notably, in this critical region, the avalanche size and duration distributions follow power laws. Critical exponents are consistent with a scaling relationship observed recently in neural avalanches measurements. In conclusion, our simple model suggests that avalanche power laws in cortical spontaneous activity may be the effect of a network at the critical point between the replay and non-replay of spatio-temporal patterns.     

The Influence of Synaptic Weight Distribution on Neuronal Population Dynamics

The manner in which different distributions of synaptic weights onto cortical neurons shape their spiking activity remains open. To characterize a homogeneous neuronal population, we use the master equation for generalized leaky integrate-and-fire neurons with shot-noise synapses. We develop fast semi-analytic numerical methods to solve this equation for either current or conductance synapses, with and without synaptic depression. We show that its solutions match simulations of equivalent neuronal networks better than those of the Fokker-Planck equation and we compute bounds on the network response to non-instantaneous synapses. We apply these methods to study different synaptic weight distributions in feed-forward networks. We characterize the synaptic amplitude distributions using a set of measures, called tail weight numbers, designed to quantify the preponderance of very strong synapses. Even if synaptic amplitude distributions are equated for both the total current and average synaptic weight, distributions with sparse but strong synapses produce higher responses for small inputs, leading to a larger operating range. Furthermore, despite their small number, such synapses enable the network to respond faster and with more stability in the face of external fluctuations.     

Feedforward architectures driven by inhibitory interactions

Directed information transmission is paramount for many social, physical, and biological systems. For neural systems, scientists have studied this problem under the paradigm of feedforward networks for decades. In most models of feedforward networks, activity is exclusively driven by excitatory neurons and the wiring patterns between them, while inhibitory neurons play only a stabilizing role for the network dynamics. Motivated by recent experimental discoveries of hippocampal circuitry, cortical circuitry, and the diversity of inhibitory neurons throughout the brain, here we illustrate that one can construct such networks even if the connectivity between the excitatory units in the system remains random. This is achieved by endowing inhibitory nodes with a more active role in the network. Our findings demonstrate that apparent feedforward activity can be caused by a much broader network-architectural basis than often assumed.     

Long-Term Relationships between Synaptic Tenacity, Synaptic Remodeling, and Network Activity

Synaptic plasticity is widely believed to constitute a key mechanism for modifying functional properties of neuronal networks. This belief implicitly implies, however, that synapses, when not driven to change their characteristics by physiologically relevant stimuli, will maintain these characteristics over time. How tenacious are synapses over behaviorally relevant time scales? To begin to address this question, we developed a system for continuously imaging the structural dynamics of individual synapses over many days, while recording network activity in the same preparations. We found that in spontaneously active networks, distributions of synaptic sizes were generally stable over days. Following individual synapses revealed, however, that the apparently static distributions were actually steady states of synapses exhibiting continual and extensive remodeling. In active networks, large synapses tended to grow smaller, whereas small synapses tended to grow larger, mainly during periods of particularly synchronous activity. Suppression of network activity only mildly affected the magnitude of synaptic remodeling, but dependence on synaptic size was lost, leading to the broadening of synaptic size distributions and increases in mean synaptic size. From the perspective of individual neurons, activity drove changes in the relative sizes of their excitatory inputs, but such changes continued, albeit at lower rates, even when network activity was blocked. Our findings show that activity strongly drives synaptic remodeling, but they also show that significant remodeling occurs spontaneously. Whereas such spontaneous remodeling provides an explanation for “synaptic homeostasis” like processes, it also raises significant questions concerning the reliability of individual synapses as sites for persistently modifying network function.     

Ongoing spontaneous activity controls access to consciousness: a neuronal model for inattentional blindness

Even in the absence of sensory inputs, cortical and thalamic neurons can show structured patterns of ongoing spontaneous activity, whose origins and functional significance are not well understood. We use computer simulations to explore the conditions under which spontaneous activity emerges from a simplified model of multiple interconnected thalamocortical columns linked by long-range, top-down excitatory axons, and to examine its interactions with stimulus-induced activation. Simulations help characterize two main states of activity. First, spontaneous gamma-band oscillations emerge at a precise threshold controlled by ascending neuromodulator systems. Second, within a spontaneously active network, we observe the sudden “ignition” of one out of many possible coherent states of high-level activity amidst cortical neurons with long-distance projections. During such an ignited state, spontaneous activity can block external sensory processing. We relate those properties to experimental observations on the neural bases of endogenous states of consciousness, and particularly the blocking of access to consciousness that occurs in the psychophysical phenomenon of “inattentional blindness,” in which normal subjects intensely engaged in mental activity fail to notice salient but irrelevant sensory stimuli. Although highly simplified, the generic properties of a minimal network may help clarify some of the basic cerebral phenomena underlying the autonomy of consciousness.     

Reciprocal inhibition and slow calcium decay in perigeniculate interneurons explain changes of spontaneous firing of thalamic cells caused by cortical inactivation

The role of cortical feedback in the thalamocortical processing loop has been extensively investigated over the last decades. With an exception of several cases, these searches focused on the cortical feedback exerted onto thalamo-cortical relay (TC) cells of the dorsal lateral geniculate nucleus (LGN). In a previous, physiological study, we showed in the cat visual system that cessation of cortical input, despite decrease of spontaneous activity of TC cells, increased spontaneous firing of their recurrent inhibitory interneurons located in the perigeniculate nucleus (PGN). To identify mechanisms underlying such functional changes we conducted a modeling study in NEURON on several networks of point neurons with varied model parameters, such as membrane properties, synaptic weights and axonal delays. We considered six network topologies of the retino-geniculo-cortical system. All models were robust against changes of axonal delays except for the delay between the LGN feed-forward interneuron and the TC cell. The best representation of physiological results was obtained with models containing reciprocally connected PGN cells driven by the cortex and with relatively slow decay of intracellular calcium. This strongly indicates that the thalamic reticular nucleus plays an essential role in the cortical influence over thalamo-cortical relay cells while the thalamic feed-forward interneurons are not essential in this process. Further, we suggest that the dependence of the activity of PGN cells on the rate of calcium removal can be one of the key factors determining individual cell response to elimination of cortical input.