Recurrence plots of neuronal spike trains

The recently developed qualitative method of diagnosis of dynamical systems — recurrence plots has been applied to the analysis of dynamics of neuronal spike trains recorded from cerebellum and red nucleus of anesthetized cats. Recurrence plots revealed robust and common changes in the similarity structure of interspike interval sequences as well as significant deviations from randomness in serial ordering of intervals. Recurring episodes of alike, quasi-deterministic firing patterns suggest the spontaneous modulation of the dynamical complexity of the trajectories of observed neurons. These modulations are associated with changing dynamical properties of a neuronal spike-train-generating system. Their existence is compatible with the information processing paradigm of attractor neural networks.     

A method for constructing data-based models of spiking neurons using a dynamic linear-static nonlinear cascade

This paper describes a general nonlinear dynamical model for neural system identification. It describes an algorithm for fitting a simple form of the model to spike train data, and reports on this algorithm's performance in identifying the structure and parameters of simulated neurons. The central element of the model is a Wiener-Bose dynamic nonlinearity that ensures that the model is able to approximate the behaviour of an arbitrary nonlinear dynamical system. Nonlinearities associated with spike generation and transmission are treated by placing the Wiener-Bose system in cascade with pulse frequency modulators and demodulators, and the static nonlinearity at the output of the Wiener-Bose system is decomposed into a rectifier and a multinomial. This simplifies the model without reducing its generality for neuronal system identification. Model elements can be characterised using standard methods of dynamical systems analysis, and the model has a simple form that can be implemented and simulated efficiently. This model bears a structural resemblance to real neurons; it may be regarded as a connectionist neuron that has been generalized in a realistic way to enable it to mimic the behaviour of an arbitrary nonlinear system, or conversely as a general nonlinear model that has been constrained to make it easy to fit to spike train data. Tests with simulated data show that the identification algorithm can accurately estimate the structure and parameters of neuron-like nonlinear dynamical systems using data sets containing only a few hundred spikes.     

Pseudo-Lyapunov exponents and predictability of Hodgkin-Huxley neuronal network dynamics

We present a numerical analysis of the dynamics of all-to-all coupled Hodgkin-Huxley (HH) neuronal networks with Poisson spike inputs. It is important to point out that, since the dynamical vector of the system contains discontinuous variables, we propose a so-called pseudo-Lyapunov exponent adapted from the classical definition using only continuous dynamical variables, and apply it in our numerical investigation. The numerical results of the largest Lyapunov exponent using this new definition are consistent with the dynamical regimes of the network. Three typical dynamical regimes—asynchronous, chaotic and synchronous, are found as the synaptic coupling strength increases from weak to strong. We use the pseudo-Lyapunov exponent and the power spectrum analysis of voltage traces to characterize the types of the network behavior. In the nonchaotic (asynchronous or synchronous) dynamical regimes, i.e., the weak or strong coupling limits, the pseudo-Lyapunov exponent is negative and there is a good numerical convergence of the solution in the trajectory-wise sense by using our numerical methods. Consequently, in these regimes the evolution of neuronal networks is reliable. For the chaotic dynamical regime with an intermediate strong coupling, the pseudo-Lyapunov exponent is positive, and there is no numerical convergence of the solution and only statistical quantifications of the numerical results are reliable. Finally, we present numerical evidence that the value of pseudo-Lyapunov exponent coincides with that of the standard Lyapunov exponent for systems we have been able to examine.     

A dynamical neural network model for motor cortical activity during movement: population coding of movement trajectories

As a dynamical model for motor cortical activity during hand movement we consider an artificial neural network that consists of extensively interconnected neuron-like units and performs the neuronal population vector operations. Local geometrical parameters of a desired curve are introduced into the network as an external input. The output of the model is a time-dependent direction and length of the neuronal population vector which is calculated as a sum of the activity of directionally tuned neurons in the ensemble. The main feature of the model is that dynamical behavior of the neuronal population vector is the result of connections between directionally tuned neurons rather than being imposed externally. The dynamics is governed by a system of coupled nonlinear differential equations. Connections between neurons are assigned in the simplest and most common way so as to fulfill basic requirements stemming from experimental findings concerning the directional tuning of individual neurons and the stabilization of the neuronal population vector, as well as from previous theoretical studies. The dynamical behavior of the model reveals a close similarity with the experimentally observed dynamics of the neuronal population vector. Specifically, in the framework of the model it is possible to describe a geometrical curve in terms of the time series of the population vector. A correlation between the dynamical behavior of the direction and the length of the population vector entails a dependence of the neural velocity on the curvature of the tracing trajectory that corresponds well to the experimentally measured covariation between tangential velocity and curvature in drawing tasks.On leave of absencefrom the Institute of Molecular Genetics, Russian Academy of Sciences, Moscow, Russia.     

Dynamics of period-doubling bifurcation to chaos in the spontaneous neural firing patterns

Period-doubling bifurcation to chaos were discovered in spontaneous firings of Onchidium pacemaker neurons. In this paper, we provide three cases of bifurcation processes related to period-doubling bifurcation cascades to chaos observed in the spontaneous firing patterns recorded from an injured site of rat sciatic nerve as a pacemaker. Period-doubling bifurcation cascades to period-4 (π(2,2)) firstly, and then to chaos, at last to a periodicity, which can be period-5, period-4 (π(4)) and period-3, respectively, in different pacemakers. The three bifurcation processes are labeled as case I, II and III, respectively, manifesting procedures different to those of period-adding bifurcation. Higher-dimensional unstable periodic orbits (UPOs) can be detected in the chaos, built close relationships to the periodic firing patterns. Case III bifurcation process is similar to that discovered in the Onchidium pacemaker neurons and simulated in theoretical model-Chay model. The extra-large Feigenbaum constant manifesting in the period-doubling bifurcation process, induced by quasi-discontinuous characteristics exhibited in the first return maps of both ISI series and slow variable of Chay model, shows that higher-dimensional periodic behaviors appeared difficult within the period-doubling bifurcation cascades. The results not only provide examples of period-doubling bifurcation to chaos and chaos with higher-dimensional UPOs, but also reveal the dynamical features of the period-doubling bifurcation cascades to chaos.     

Dynamical aspects of P systems

A dynamical analysis of P systems is given that is focused on basic phenomena of biological relevance. After a short presentation of a new kind of P systems (PB systems), membrane systems with environment, called PBE systems, are introduced that are more suitable for modeling complex membrane interactions. Some types of periodicity and non-periodicity are considered for PBE systems by showing some "minimal" examples of systems that exhibit these properties. In particular, a discrete formulation of the Belousov-Zhabotinsky (BZ) reaction is given in terms of PBE systems. Some questions and open problems for future research are indicated.     

Untangling Brain-Wide Dynamics in Consciousness by Cross-Embedding

Brain-wide interactions generating complex neural dynamics are considered crucial for emergent cognitive functions. However, the irreducible nature of nonlinear and high-dimensional dynamical interactions challenges conventional reductionist approaches. We introduce a model-free method, based on embedding theorems in nonlinear state-space reconstruction, that permits a simultaneous characterization of complexity in local dynamics, directed interactions between brain areas, and how the complexity is produced by the interactions. We demonstrate this method in large-scale electrophysiological recordings from awake and anesthetized monkeys. The cross-embedding method captures structured interaction underlying cortex-wide dynamics that may be missed by conventional correlation-based analysis, demonstrating a critical role of time-series analysis in characterizing brain state. The method reveals a consciousness-related hierarchy of cortical areas, where dynamical complexity increases along with cross-area information flow. These findings demonstrate the advantages of the cross-embedding method in deciphering large-scale and heterogeneous neuronal systems, suggesting a crucial contribution by sensory-frontoparietal interactions to the emergence of complex brain dynamics during consciousness.     

Six types of multistability in a neuronal model based on slow calcium current

Background

Multistability of oscillatory and silent regimes is a ubiquitous phenomenon exhibited by excitable systems such as neurons and cardiac cells. Multistability can play functional roles in short-term memory and maintaining posture. It seems to pose an evolutionary advantage for neurons which are part of multifunctional Central Pattern Generators to possess multistability. The mechanisms supporting multistability of bursting regimes are not well understood or classified.

Methodology/Principal Findings

Our study is focused on determining the bio-physical mechanisms underlying different types of co-existence of the oscillatory and silent regimes observed in a neuronal model. We develop a low-dimensional model typifying the dynamics of a single leech heart interneuron. We carry out a bifurcation analysis of the model and show that it possesses six different types of multistability of dynamical regimes. These types are the co-existence of 1) bursting and silence, 2) tonic spiking and silence, 3) tonic spiking and subthreshold oscillations, 4) bursting and subthreshold oscillations, 5) bursting, subthreshold oscillations and silence, and 6) bursting and tonic spiking. These first five types of multistability occur due to the presence of a separating regime that is either a saddle periodic orbit or a saddle equilibrium. We found that the parameter range wherein multistability is observed is limited by the parameter values at which the separating regimes emerge and terminate.

Conclusions

We developed a neuronal model which exhibits a rich variety of different types of multistability. We described a novel mechanism supporting the bistability of bursting and silence. This neuronal model provides a unique opportunity to study the dynamics of networks with neurons possessing different types of multistability.     

Olfactory system gamma oscillations: the physiological dissection of a cognitive neural system

Oscillatory phenomena have been a focus of dynamical systems research since the time of the classical studies on the pendulum by Galileo. Fast cortical oscillations also have a long and storied history in neurophysiology, and olfactory oscillations have led the way with a depth of explanation not present in the literature of most other cortical systems. From the earliest studies of odor-evoked oscillations by Adrian, many reports have focused on mechanisms and functional associations of these oscillations, in particular for the so-called gamma oscillations. As a result, much information is now available regarding the biophysical mechanisms that underlie the oscillations in the mammalian olfactory system. Recent studies have expanded on these and addressed functionality directly in mammals and in the analogous insect system. Sub-bands within the rodent gamma oscillatory band associated with specific behavioral and cognitive states have also been identified. All this makes oscillatory neuronal networks a unique interdisciplinary platform from which to study neurocognitive and dynamical phenomena in intact, freely behaving animals. We present here a summary of what has been learned about the functional role and mechanisms of gamma oscillations in the olfactory system as a guide for similar studies in other cortical systems.

A distance-based dynamical transition analysis of time series signals and application to biological systems

This study demonstrates an application of distance-based numerical measures to the phase space of time series signals, in order to obtain a temporal analysis of complex dynamical systems. This method is capable of detecting alterations appearing in the characters of the deterministic dynamical systems and provides a simple tool for the real-time analysis of time series data obtained from a complex dynamical system even with black box functionality. The study presents a possible application of the method in the dynamical transition analysis of real EEG records from epilepsy patients.     

Surfing the wave of oxyfunctionalization chemistry by engineering fungal unspecific peroxygenases

The selective insertion of oxygen into non-activated organic molecules has to date been considered of utmost importance to synthesize existing and next generation industrial chemicals or pharmaceuticals. In this respect, the minimal requirements and high activity of fungal unspecific peroxygenases (UPOs) situate them as the jewel in the crown of C–H oxyfunctionalization biocatalysts. Although their limited availability and development has hindered their incorporation into industry, the conjunction of directed evolution and computational design is approaching UPOs to practical applications. In this review, we will address the most recent advances in UPO engineering, both of the long and short UPO families, while discussing the future prospects in this fast-moving field of research.     

Detection of deterministic behavior within the tissue injury-induced persistent firing of nociceptive neurons in the dorsal horn of the rat spinal cord

To unravel the temporal features of the peripheral tissue injury induced persistent nociceptive discharge, single wide dynamic range (WDR) unit activity was recorded extracellularly in lumbar dorsal horn of anesthetized rats and interspike interval (ISI) series were obtained. Subcutaneous (s.c.) bee venom (BV) injection induced persistent discharge of spinal WDR neurons and has been well established to be a good model in evaluation of tissue injury induced pain. By applying a more novel approach, i.e., the unstable periodic orbit (UPO) identification method, we detected a family of significant separate UPOs (period-1, 2 and 3 orbits) within the ISI series of BV-induced nociceptive discharge, but not spontaneous background activity of spinal WDR neuron. Furthermore, temporally dynamic changes of UPOs at lower period-1, 2 and 3 for 4 successive time segments within 1 h time course of WDR unit firing showed temporally dynamic changes, i.e., new orbits with longer ISIs emerged and those with shorter ISIs vanished with time change. By using this method we suggest that BV-induced nociceptive discharge of spinal WDR neuron be a kind of deterministic activity and various UPOs may play some role in temporal coding of sensory information.     

In-phase and anti-phase synchronization in noisy Hodgkin–Huxley neurons

We numerically investigate the influence of intrinsic channel noise on the dynamical response of delay-coupling in neuronal systems. The stochastic dynamics of the spiking is modeled within a stochastic modification of the standard Hodgkin–Huxley model wherein the delay-coupling accounts for the finite propagation time of an action potential along the neuronal axon. We quantify this delay-coupling of the Pyragas-type in terms of the difference between corresponding presynaptic and postsynaptic membrane potentials. For an elementary neuronal network consisting of two coupled neurons we detect characteristic stochastic synchronization patterns which exhibit multiple phase-flip bifurcations: The phase-flip bifurcations occur in form of alternate transitions from an in-phase spiking activity towards an anti-phase spiking activity. Interestingly, these phase-flips remain robust for strong channel noise and in turn cause a striking stabilization of the spiking frequency.     

Slow manifolds within network dynamics encode working memory efficiently and robustly

Working memory is a cognitive function involving the storage and manipulation of latent information over brief intervals of time, thus making it crucial for context-dependent computation. Here, we use a top-down modeling approach to examine network-level mechanisms of working memory, an enigmatic issue and central topic of study in neuroscience. We optimize thousands of recurrent rate-based neural networks on a working memory task and then perform dynamical systems analysis on the ensuing optimized networks, wherein we find that four distinct dynamical mechanisms can emerge. In particular, we show the prevalence of a mechanism in which memories are encoded along slow stable manifolds in the network state space, leading to a phasic neuronal activation profile during memory periods. In contrast to mechanisms in which memories are directly encoded at stable attractors, these networks naturally forget stimuli over time. Despite this seeming functional disadvantage, they are more efficient in terms of how they leverage their attractor landscape and paradoxically, are considerably more robust to noise. Our results provide new hypotheses regarding how working memory function may be encoded within the dynamics of neural circuits.     

Design,Surface Treatment,Cellular Plating,and Culturing of Modular Neuronal Networks Composed of Functionally Inter-connected Circuits

The brain operates through the coordinated activation and the dynamic communication of neuronal assemblies. A major open question is how a vast repertoire of dynamical motifs, which underlie most diverse brain functions, can emerge out of a fixed topological and modular organization of brain circuits. Compared to in vivo studies of neuronal circuits which present intrinsic experimental difficulties, in vitro preparations offer a much larger possibility to manipulate and probe the structural, dynamical and chemical properties of experimental neuronal systems. This work describes an in vitro experimental methodology which allows growing of modular networks composed by spatially distinct, functionally interconnected neuronal assemblies. The protocol allows controlling the two-dimensional (2D) architecture of the neuronal network at different levels of topological complexity.A desired network patterning can be achieved both on regular cover slips and substrate embedded micro electrode arrays. Micromachined structures are embossed on a silicon wafer and used to create biocompatible polymeric stencils, which incorporate the negative features of the desired network architecture. The stencils are placed on the culturing substrates during the surface coating procedure with a molecular layer for promoting cellular adhesion. After removal of the stencils, neurons are plated and they spontaneously redirected to the coated areas. By decreasing the inter-compartment distance, it is possible to obtain either isolated or interconnected neuronal circuits. To promote cell survival, cells are co-cultured with a supporting neuronal network which is located at the periphery of the culture dish. Electrophysiological and optical recordings of the activity of modular networks obtained respectively by using substrate embedded micro electrode arrays and calcium imaging are presented. While each module shows spontaneous global synchronizations, the occurrence of inter-module synchronization is regulated by the density of connection among the circuits.     

Network mechanism for insect olfaction

Early olfactory pathway responses to the presentation of an odor exhibit remarkably similar dynamical behavior across phyla from insects to mammals, and frequently involve transitions among quiescence, collective network oscillations, and asynchronous firing. We hypothesize that the time scales of fast excitation and fast and slow inhibition present in these networks may be the essential element underlying this similar behavior, and design an idealized, conductance-based integrate-and-fire model to verify this hypothesis via numerical simulations. To better understand the mathematical structure underlying the common dynamical behavior across species, we derive a firing-rate model and use it to extract a slow passage through a saddle-node-on-an-invariant-circle bifurcation structure. We expect this bifurcation structure to provide new insights into the understanding of the dynamical behavior of neuronal assemblies and that a similar structure can be found in other sensory systems.     

Practical limits for reverse engineering of dynamical systems: a statistical analysis of sensitivity and parameter inferability in systems biology models

The size and complexity of cellular systems make building predictive models an extremely difficult task. In principle dynamical time-course data can be used to elucidate the structure of the underlying molecular mechanisms, but a central and recurring problem is that many and very different models can be fitted to experimental data, especially when the latter are limited and subject to noise. Even given a model, estimating its parameters remains challenging in real-world systems. Here we present a comprehensive analysis of 180 systems biology models, which allows us to classify the parameters with respect to their contribution to the overall dynamical behaviour of the different systems. Our results reveal candidate elements of control in biochemical pathways that differentially contribute to dynamics. We introduce sensitivity profiles that concisely characterize parameter sensitivity and demonstrate how this can be connected to variability in data. Systematically linking data and model sloppiness allows us to extract features of dynamical systems that determine how well parameters can be estimated from time-course measurements, and associates the extent of data required for parameter inference with the model structure, and also with the global dynamical state of the system. The comprehensive analysis of so many systems biology models reaffirms the inability to estimate precisely most model or kinetic parameters as a generic feature of dynamical systems, and provides safe guidelines for performing better inferences and model predictions in the context of reverse engineering of mathematical models for biological systems.     

A novel bursting mechanism of type a neurons in injured dorsal root ganglia

Using intracellular recording in vivo, the bursting behaviors were investigated in the neurons of chronically compressed dorsal root ganglia of the adult rat. In most cases, the first spike of a burst emerged from amplitude-increasing damped subthreshold membrane potential oscillation (SMPO) and the discharge terminated by an amplitude-decreasing damped SMPO. The rhythms of these bursting behaviors are all irregular. Since some researchers found that the stochastic dynamics can also produce similar bursting pattern, the deterministic dynamics of interevent interval (IEI) series obtained from raw membrane potential recording was detected by extraction of the hierarchy of unstable periodic orbits (UPOs) in the windowed IEI series. The results showed a number of statistically significant UPOs of order-one, order-two, and order-three. These orbits form a complex but predictable lattice of regions in which the dynamics of the bursting occurrence is deterministic. Based on a complete classification scheme, the investigated bursting can be depicted by the elliptic bursting dynamics. The significance of the finding that a neuron in the injured dorsal root ganglion has such dynamics is also discussed.     

Criticality enhances the multilevel reliability of stimulus responses in cortical neural networks

Cortical neural networks exhibit high internal variability in spontaneous dynamic activities and they can robustly and reliably respond to external stimuli with multilevel features–from microscopic irregular spiking of neurons to macroscopic oscillatory local field potential. A comprehensive study integrating these multilevel features in spontaneous and stimulus–evoked dynamics with seemingly distinct mechanisms is still lacking. Here, we study the stimulus–response dynamics of biologically plausible excitation–inhibition (E–I) balanced networks. We confirm that networks around critical synchronous transition states can maintain strong internal variability but are sensitive to external stimuli. In this dynamical region, applying a stimulus to the network can reduce the trial-to-trial variability and shift the network oscillatory frequency while preserving the dynamical criticality. These multilevel features widely observed in different experiments cannot simultaneously occur in non-critical dynamical states. Furthermore, the dynamical mechanisms underlying these multilevel features are revealed using a semi-analytical mean-field theory that derives the macroscopic network field equations from the microscopic neuronal networks, enabling the analysis by nonlinear dynamics theory and linear noise approximation. The generic dynamical principle revealed here contributes to a more integrative understanding of neural systems and brain functions and incorporates multimodal and multilevel experimental observations. The E–I balanced neural network in combination with the effective mean-field theory can serve as a mechanistic modeling framework to study the multilevel neural dynamics underlying neural information and cognitive processes.     

Undersampled Critical Branching Processes on Small-World and Random Networks Fail to Reproduce the Statistics of Spike Avalanches

The power-law size distributions obtained experimentally for neuronal avalanches are an important evidence of criticality in the brain. This evidence is supported by the fact that a critical branching process exhibits the same exponent . Models at criticality have been employed to mimic avalanche propagation and explain the statistics observed experimentally. However, a crucial aspect of neuronal recordings has been almost completely neglected in the models: undersampling. While in a typical multielectrode array hundreds of neurons are recorded, in the same area of neuronal tissue tens of thousands of neurons can be found. Here we investigate the consequences of undersampling in models with three different topologies (two-dimensional, small-world and random network) and three different dynamical regimes (subcritical, critical and supercritical). We found that undersampling modifies avalanche size distributions, extinguishing the power laws observed in critical systems. Distributions from subcritical systems are also modified, but the shape of the undersampled distributions is more similar to that of a fully sampled system. Undersampled supercritical systems can recover the general characteristics of the fully sampled version, provided that enough neurons are measured. Undersampling in two-dimensional and small-world networks leads to similar effects, while the random network is insensitive to sampling density due to the lack of a well-defined neighborhood. We conjecture that neuronal avalanches recorded from local field potentials avoid undersampling effects due to the nature of this signal, but the same does not hold for spike avalanches. We conclude that undersampled branching-process-like models in these topologies fail to reproduce the statistics of spike avalanches.