Emergent dynamics in a model of visual cortex

This paper proposes that the network dynamics of the mammalian visual cortex are highly structured and strongly shaped by temporally localized barrages of excitatory and inhibitory firing we call ‘multiple-firing events’ (MFEs). Our proposal is based on careful study of a network of spiking neurons built to reflect the coarse physiology of a small patch of layer 2/3 of V1. When appropriately benchmarked this network is capable of reproducing the qualitative features of a range of phenomena observed in the real visual cortex, including spontaneous background patterns, orientation-specific responses, surround suppression and gamma-band oscillations. Detailed investigation into the relevant regimes reveals causal relationships among dynamical events driven by a strong competition between the excitatory and inhibitory populations. It suggests that along with firing rates, MFE characteristics can be a powerful signature of a regime. Testable predictions based on model observations and dynamical analysis are proposed.     

Distribution of correlated spiking events in a population-based approach for Integrate-and-Fire networks

Randomly connected populations of spiking neurons display a rich variety of dynamics. However, much of the current modeling and theoretical work has focused on two dynamical extremes: on one hand homogeneous dynamics characterized by weak correlations between neurons, and on the other hand total synchrony characterized by large populations firing in unison. In this paper we address the conceptual issue of how to mathematically characterize the partially synchronous “multiple firing events” (MFEs) which manifest in between these two dynamical extremes. We further develop a geometric method for obtaining the distribution of magnitudes of these MFEs by recasting the cascading firing event process as a first-passage time problem, and deriving an analytical approximation of the first passage time density valid for large neuron populations. Thus, we establish a direct link between the voltage distributions of excitatory and inhibitory neurons and the number of neurons firing in an MFE that can be easily integrated into population–based computational methods, thereby bridging the gap between homogeneous firing regimes and total synchrony.     

A coarse-grained framework for spiking neuronal networks: between homogeneity and synchrony

Homogeneously structured networks of neurons driven by noise can exhibit a broad range of dynamic behavior. This dynamic behavior can range from homogeneity to synchrony, and often incorporates brief spurts of collaborative activity which we call multiple-firing-events (MFEs). These multiple-firing-events depend on neither structured architecture nor structured input, and are an emergent property of the system. Although these MFEs likely play a major role in the neuronal avalanches observed in culture and in vivo, the mechanisms underlying these MFEs cannot easily be captured using current population-dynamics models. In this work we introduce a coarse-grained framework which illustrates certain dynamics responsible for the generation of MFEs. By using a new kind of ensemble-average, this coarse-grained framework can not only address the nucleation of MFEs, but can also faithfully capture a broad range of dynamic regimes ranging from homogeneity to synchrony.     

Network Events on Multiple Space and Time Scales in Cultured Neural Networks and in a Stochastic Rate Model

Cortical networks, in-vitro as well as in-vivo, can spontaneously generate a variety of collective dynamical events such as network spikes, UP and DOWN states, global oscillations, and avalanches. Though each of them has been variously recognized in previous works as expression of the excitability of the cortical tissue and the associated nonlinear dynamics, a unified picture of the determinant factors (dynamical and architectural) is desirable and not yet available. Progress has also been partially hindered by the use of a variety of statistical measures to define the network events of interest. We propose here a common probabilistic definition of network events that, applied to the firing activity of cultured neural networks, highlights the co-occurrence of network spikes, power-law distributed avalanches, and exponentially distributed ‘quasi-orbits’, which offer a third type of collective behavior. A rate model, including synaptic excitation and inhibition with no imposed topology, synaptic short-term depression, and finite-size noise, accounts for all these different, coexisting phenomena. We find that their emergence is largely regulated by the proximity to an oscillatory instability of the dynamics, where the non-linear excitable behavior leads to a self-amplification of activity fluctuations over a wide range of scales in space and time. In this sense, the cultured network dynamics is compatible with an excitation-inhibition balance corresponding to a slightly sub-critical regime. Finally, we propose and test a method to infer the characteristic time of the fatigue process, from the observed time course of the network’s firing rate. Unlike the model, possessing a single fatigue mechanism, the cultured network appears to show multiple time scales, signalling the possible coexistence of different fatigue mechanisms.     

Metastable spiking networks in the replica-mean-field limit

Characterizing metastable neural dynamics in finite-size spiking networks remains a daunting challenge. We propose to address this challenge in the recently introduced replica-mean-field (RMF) limit. In this limit, networks are made of infinitely many replicas of the finite network of interest, but with randomized interactions across replicas. Such randomization renders certain excitatory networks fully tractable at the cost of neglecting activity correlations, but with explicit dependence on the finite size of the neural constituents. However, metastable dynamics typically unfold in networks with mixed inhibition and excitation. Here, we extend the RMF computational framework to point-process-based neural network models with exponential stochastic intensities, allowing for mixed excitation and inhibition. Within this setting, we show that metastable finite-size networks admit multistable RMF limits, which are fully characterized by stationary firing rates. Technically, these stationary rates are determined as the solutions of a set of delayed differential equations under certain regularity conditions that any physical solutions shall satisfy. We solve this original problem by combining the resolvent formalism and singular-perturbation theory. Importantly, we find that these rates specify probabilistic pseudo-equilibria which accurately capture the neural variability observed in the original finite-size network. We also discuss the emergence of metastability as a stochastic bifurcation, which can be interpreted as a static phase transition in the RMF limits. In turn, we expect to leverage the static picture of RMF limits to infer purely dynamical features of metastable finite-size networks, such as the transition rates between pseudo-equilibria.     

A Spike-Timing Pattern Based Neural Network Model for the Study of Memory Dynamics

It is well accepted that the brain''s computation relies on spatiotemporal activity of neural networks. In particular, there is growing evidence of the importance of continuously and precisely timed spiking activity. Therefore, it is important to characterize memory states in terms of spike-timing patterns that give both reliable memory of firing activities and precise memory of firing timings. The relationship between memory states and spike-timing patterns has been studied empirically with large-scale recording of neuron population in recent years. Here, by using a recurrent neural network model with dynamics at two time scales, we construct a dynamical memory network model which embeds both fast neural and synaptic variation and slow learning dynamics. A state vector is proposed to describe memory states in terms of spike-timing patterns of neural population, and a distance measure of state vector is defined to study several important phenomena of memory dynamics: partial memory recall, learning efficiency, learning with correlated stimuli. We show that the distance measure can capture the timing difference of memory states. In addition, we examine the influence of network topology on learning ability, and show that local connections can increase the network''s ability to embed more memory states. Together theses results suggest that the proposed system based on spike-timing patterns gives a productive model for the study of detailed learning and memory dynamics.     

Increased Firing Irregularity as an Emergent Property of Neural-State Transition in Monkey Prefrontal Cortex

Flexible behaviors are organized by complex neural networks in the prefrontal cortex. Recent studies have suggested that such networks exhibit multiple dynamical states, and can switch rapidly from one state to another. In many complex systems such as the brain, the early-warning signals that may predict whether a critical threshold for state transitions is approaching are extremely difficult to detect. We hypothesized that increases in firing irregularity are a crucial measure for predicting state transitions in the underlying neuronal circuits of the prefrontal cortex. We used both experimental and theoretical approaches to test this hypothesis. Experimentally, we analyzed activities of neurons in the prefrontal cortex while monkeys performed a maze task that required them to perform actions to reach a goal. We observed increased firing irregularity before the activity changed to encode goal-to-action information. Theoretically, we constructed theoretical generic neural networks and demonstrated that changes in neuronal gain on functional connectivity resulted in a loss of stability and an altered state of the networks, accompanied by increased firing irregularity. These results suggest that assessing the temporal pattern of neuronal fluctuations provides important clues regarding the state stability of the prefrontal network. We also introduce a novel scheme that the prefrontal cortex functions in a metastable state near the critical point of bifurcation. According to this scheme, firing irregularity in the prefrontal cortex indicates that the system is about to change its state and the flow of information in a flexible manner, which is essential for executive functions. This metastable and/or critical dynamical state of the prefrontal cortex may account for distractibility and loss of flexibility in the prefrontal cortex in major mental illnesses such as schizophrenia.     

Management of synchronized network activity by highly active neurons

Increasing evidence supports the idea that spontaneous brain activity may have an important functional role. Cultured neuronal networks provide a suitable model system to search for the mechanisms by which neuronal spontaneous activity is maintained and regulated. This activity is marked by synchronized bursting events (SBEs)--short time windows (hundreds of milliseconds) of rapid neuronal firing separated by long quiescent periods (seconds). However, there exists a special subset of rapidly firing neurons whose activity also persists between SBEs. It has been proposed that these highly active (HA) neurons play an important role in the management (i.e. establishment, maintenance and regulation) of the synchronized network activity. Here, we studied the dynamical properties and the functional role of HA neurons in homogeneous and engineered networks, during early network development, upon recovery from chemical inhibition and in response to electrical stimulations. We found that their sequences of inter-spike intervals (ISI) exhibit long time correlations and a unimodal distribution. During the network's development and under intense inhibition, the observed activity follows a transition period during which mostly HA neurons are active. Studying networks with engineered geometry, we found that HA neurons are precursors (the first to fire) of the spontaneous SBEs and are more responsive to electrical stimulations.     

Bursting dynamics remarkably improve the performance of neural networks on liquid computing

Burst firings are functionally important behaviors displayed by neural circuits, which plays a primary role in reliable transmission of electrical signals for neuronal communication. However, with respect to the computational capability of neural networks, most of relevant studies are based on the spiking dynamics of individual neurons, while burst firing is seldom considered. In this paper, we carry out a comprehensive study to compare the performance of spiking and bursting dynamics on the capability of liquid computing, which is an effective approach for intelligent computation of neural networks. The results show that neural networks with bursting dynamic have much better computational performance than those with spiking dynamics, especially for complex computational tasks. Further analysis demonstrate that the fast firing pattern of bursting dynamics can obviously enhance the efficiency of synaptic integration from pre-neurons both temporally and spatially. This indicates that bursting dynamic can significantly enhance the complexity of network activity, implying its high efficiency in information processing.     

Emergence of Slow-Switching Assemblies in Structured Neuronal Networks

Unraveling the interplay between connectivity and spatio-temporal dynamics in neuronal networks is a key step to advance our understanding of neuronal information processing. Here we investigate how particular features of network connectivity underpin the propensity of neural networks to generate slow-switching assembly (SSA) dynamics, i.e., sustained epochs of increased firing within assemblies of neurons which transition slowly between different assemblies throughout the network. We show that the emergence of SSA activity is linked to spectral properties of the asymmetric synaptic weight matrix. In particular, the leading eigenvalues that dictate the slow dynamics exhibit a gap with respect to the bulk of the spectrum, and the associated Schur vectors exhibit a measure of block-localization on groups of neurons, thus resulting in coherent dynamical activity on those groups. Through simple rate models, we gain analytical understanding of the origin and importance of the spectral gap, and use these insights to develop new network topologies with alternative connectivity paradigms which also display SSA activity. Specifically, SSA dynamics involving excitatory and inhibitory neurons can be achieved by modifying the connectivity patterns between both types of neurons. We also show that SSA activity can occur at multiple timescales reflecting a hierarchy in the connectivity, and demonstrate the emergence of SSA in small-world like networks. Our work provides a step towards understanding how network structure (uncovered through advancements in neuroanatomy and connectomics) can impact on spatio-temporal neural activity and constrain the resulting dynamics.     

The mechanism of abrupt transition between theta and hyper-excitable spiking activity in medial entorhinal cortex layer II stellate cells

Recent studies have shown that stellate cells (SCs) of the medial entorhinal cortex become hyper-excitable in animal models of temporal lobe epilepsy. These studies have also demonstrated the existence of recurrent connections among SCs, reduced levels of recurrent inhibition in epileptic networks as compared to control ones, and comparable levels of recurrent excitation among SCs in both network types. In this work, we investigate the biophysical and dynamic mechanism of generation of the fast time scale corresponding to hyper-excitable firing and the transition between theta and fast firing frequency activity in SCs. We show that recurrently connected minimal networks of SCs exhibit abrupt, threshold-like transition between theta and hyper-excitable firing frequencies as the result of small changes in the maximal synaptic (AMPAergic) conductance. The threshold required for this transition is modulated by synaptic inhibition. Similar abrupt transition between firing frequency regimes can be observed in single, self-coupled SCs, which represent a network of recurrently coupled neurons synchronized in phase, but not in synaptically isolated SCs as the result of changes in the levels of the tonic drive. Using dynamical systems tools (phase-space analysis), we explain the dynamic mechanism underlying the genesis of the fast time scale and the abrupt transition between firing frequency regimes, their dependence on the intrinsic SC's currents and synaptic excitation. This abrupt transition is mechanistically different from others observed in similar networks with different cell types. Most notably, there is no bistability involved. 'In vitro' experiments using single SCs self-coupled with dynamic clamp show the abrupt transition between firing frequency regimes, and demonstrate that our theoretical predictions are not an artifact of the model. In addition, these experiments show that high-frequency firing is burst-like with a duration modulated by an M-current.     

Lyapunov exponents computation for hybrid neurons

Lyapunov exponents are a basic and powerful tool to characterise the long-term behaviour of dynamical systems. The computation of Lyapunov exponents for continuous time dynamical systems is straightforward whenever they are ruled by vector fields that are sufficiently smooth to admit a variational model. Hybrid neurons do not belong to this wide class of systems since they are intrinsically non-smooth owing to the impact and sometimes switching model used to describe the integrate-and-fire (I&F) mechanism. In this paper we show how a variational model can be defined also for this class of neurons by resorting to saltation matrices. This extension allows the computation of Lyapunov exponent spectrum of hybrid neurons and of networks made up of them through a standard numerical approach even in the case of neurons firing synchronously.     

On the sensitive dependence on initial conditions of the dynamics of networks of spiking neurons

We have previously formulated an abstract dynamical system for networks of spiking neurons and derived a formal result that identifies the criterion for its dynamics, without inputs, to be “sensitive to initial conditions”. Since formal results are applicable only to the extent to which their assumptions are valid, we begin this article by demonstrating that the assumptions are indeed reasonable for a wide range of networks, particularly those that lack overarching structure. A notable aspect of the criterion is the finding that sensitivity does not necessarily arise from randomness of connectivity or of connection strengths, in networks. The criterion guides us to cases that decouple these aspects: we present two instructive examples of networks, one with random connectivity and connection strengths, yet whose dynamics is insensitive, and another with structured connectivity and connection strengths, yet whose dynamics is sensitive. We then argue based on the criterion and the gross electrophysiology of the cortex that the dynamics of cortical networks ought to be almost surely sensitive under conditions typically found there. We supplement this with two examples of networks modeling cortical columns with widely differing qualitative dynamics, yet with both exhibiting sensitive dependence. Next, we use the criterion to construct a network that undergoes bifurcation from sensitive dynamics to insensitive dynamics when the value of a control parameter is varied. Finally, we extend the formal result to networks driven by stationary input spike trains, deriving a superior criterion than previously reported. Action Editor: John Rinzel     

Phase resetting curves and oscillatory stability in interneurons of rat somatosensory cortex

Synchronous oscillations in neural activity are found over wide areas of the cortex. Specific populations of interneurons are believed to play a significant role in generating these synchronized oscillations through mutual synaptic and gap-junctional interactions. Little is known, though, about the mechanism of how oscillations are maintained stably by particular types of interneurons and by their local networks. To obtain more insight into this, we measured membrane-potential responses to small current-pulse perturbations during regular firing, to construct phase resetting curves (PRCs) for three types of interneurons: nonpyramidal regular-spiking (NPRS), low-threshold spiking (LTS), and fast-spiking (FS) cells. Within each cell type, both monophasic and biphasic PRCs were observed, but the proportions and sensitivities to perturbation amplitude were clearly correlated to cell type. We then analyzed the experimentally measured PRCs to predict oscillation stability, or firing reliability, of cells for a complex stochastic input, as occurs in vivo. To do this, we used a method from random dynamical system theory to estimate Lyapunov exponents of the simplified phase model on the circle. The results indicated that LTS and NPRS cells have greater oscillatory stability (are more reliably entrained) in small noisy inputs than FS cells, which is consistent with their distinct types of threshold dynamics.     

Mechanobiology in cortical waves and oscillations

Cortical actin waves have emerged as a widely prevalent phenomena and brought pattern formation to many fields of cell biology. Cortical excitabilities, reminiscent of the electric excitability in neurons, are likely fundamental property of the cell cortex. Although they have been mostly considered to be biochemical in nature, accumulating evidence support the role of mechanics in the pattern formation process. Both pattern formation and mechanobiology approach biological phenomena at the collective level, either by looking at the mesoscale dynamical behavior of molecular networks or by using collective physical properties to characterize biological systems. As such they are very different from the traditional reductionist, bottom-up view of biology, which brings new challenges and potential opportunities. In this essay, we aim to provide our perspectives on what the proposed mechanochemical feedbacks are and open questions regarding their role in cortical excitable and oscillatory dynamics.     

The control of seizure-like activity in the rat hippocampal slice

The sudden and transient hypersynchrony of neuronal firing that characterizes epileptic seizures can be considered as the transitory stabilization of metastable states present within the dynamical repertoire of a neuronal network. Using an in vitro model of recurrent spontaneous seizures in the rat horizontal hippocampal slice preparation, we present an approach to characterize the dynamics of the transition to seizure, and to use this information to control the activity and avoid the occurrence of seizure-like events. The transition from the interictal activity (between seizures) to the seizure-like event is aborted by brief (20-50 s) low-frequency (0.5 Hz) periodic forcing perturbations, applied via an extracellular stimulating electrode to the mossy fibers, the axons of the dentate neurons that synapse onto the CA3 pyramidal cells. This perturbation results in the stabilization of an interictal-like low-frequency firing pattern in the hippocampal slice. The results derived from this work shed light on the dynamics of the transition to seizure and will further the development of algorithms that can be used in automated devices to stop seizure occurrence.     

Neural coding for the retrieval of multiple memory patterns

We investigate the retrieval dynamics in a feature-based semantic memory model, in which the features are coded by neurons of the Hindmarsh-Rose type in the chaotic regime. We consider the retrieval process as consisting of the synchronized firing activity of the neurons coding for the same memory pattern. The retrieval dynamics is investigated for multiple patterns, with particular attention to the case of overlapping memories. In this case, we hypothesize a dynamical nontransitive mechanism based on synchronization, that allows for a shared feature to participate in multiple memory representations. The problem of the choice of a cognitive plausible time-scale for the retrieval analysis is investigated by analyzing the information that can be inferred from finite-time analyses. Different types of indicators are proposed in order to evaluate the temporal dynamics of the neurons engaged in the retrieval process. We interpret the simulation results as suggestive of a role for chaotic dynamics in allowing for flexible composition of elementary meaningful units in memory representations.     

Turning On and Off with Excitation: The Role of Spike-Timing Asynchrony and Synchrony in Sustained Neural Activity

Delay-related sustained activity in the prefrontal cortex of primates, a neurological analogue of working memory, has been proposed to arise from synaptic interactions in local cortical circuits. The implication is that memories are coded by spatially localized foci of sustained activity. We investigate the mechanisms by which sustained foci are initiated, maintained, and extinguished by excitation in networks of Hodgkin-Huxley neurons coupled with biophysical spatially structured synaptic connections. For networks with a balance between excitation and inhibition, a localized transient stimulus robustly initiates a localized focus of activity. The activity is then maintained by recurrent excitatory AMPA-like synapses. We find that to maintain the focus, the firing must be asynchronous. Consequently, inducing transient synchrony through an excitatory stimulus extinguishes the sustained activity. Such a monosynaptic excitatory turn-off mechanism is compatible with the working memory being wiped clean by an efferent copy of the motor command. The activity that codes working memories may be structured so that the motor command is both the read-out and a direct clearing signal. We show examples of data that is compatible with our theory.