Construction of an associative memory using unstable periodic orbits of a chaotic attractor

Unstable periodic orbits are the skeleton of a chaotic attractor. We constructed an associative memory based on the chaotic attractor of an artificial neural network, which associates input patterns to unstable periodic orbits. By processing an input, the system is driven out of the ground state to one of the pre-defined disjunctive areas of the attractor. Each of these areas is associated with a different unstable periodic orbit. We call an input pattern learned if the control mechanism keeps the system on the unstable periodic orbit during the response. Otherwise, the system relaxes back to the ground state on a chaotic trajectory. The major benefits of this memory device are its high capacity and low-energy consumption. In addition, new information can be simply added by linking a new input to a new unstable periodic orbit.     

Phase locking,period doubling bifurcations and chaos in a mathematical model of a periodically driven oscillator: A theory for the entrainment of biological oscillators and the generation of cardiac dysrhythmias

A mathematical model for the perturbation of a biological oscillator by single and periodic impulses is analyzed. In response to a single stimulus the phase of the oscillator is changed. If the new phase following a stimulus is plotted against the old phase the resulting curve is called the phase transition curve or PTC (Pavlidis, 1973). There are two qualitatively different types of phase resetting. Using the terminology of Winfree (1977, 1980), large perturbations give a type 0 PTC (average slope of the PTC equals zero), whereas small perturbations give a type 1 PTC. The effects of periodic inputs can be analyzed by using the PTC to construct the Poincaré or phase advance map. Over a limited range of stimulation frequency and amplitude, the Poincaré map can be reduced to an interval map possessing a single maximum. Over this range there are period doubling bifurcations as well as chaotic dynamics. Numerical and analytical studies of the Poincaré map show that both phase locked and non-phase locked dynamics occur. We propose that cardiac dysrhythmias may arise from desynchronization of two or more spontaneously oscillating regions of the heart. This hypothesis serves to account for the various forms of atrioventricular (AV) block clinically observed. In particular 22 and 42 AV block can arise by period doubling bifurcations, and intermittent or variable AV block may be due to the complex irregular behavior associated with chaotic dynamics.     

The dynamics of infectious diseases in orchards with roguing and replanting as control strategy

 Roguing and replanting is a widely adopted control strategy of infectious diseases in orchards. Little is known about the effect of this type of management on the dynamics of the infectious disease. In this paper we analyze a structured population model for the dynamics of an S-I-R type epidemic under roguing and replanting management. The model is structured with respect to the total number of infections and the number of post-infectious infections on a tree. Trees are assumed to be rogued, and replaced by uninfected trees, when the total number of infections on the tree reaches a threshold value. Stability analysis and numerical exploration of the model show that for specific parameter combinations the internal equilibrium can become unstable and large amplitude periodic fluctuations arise. Several hypothesis on the mechanism causing the destabilisation of the steady-state are considered. The mechanism leading to the large amplitude fluctuations is identified and biologically interpreted. Received 2 September 1994     

Synchronizing a multicellular system by external input: an artificial control strategy

MOTIVATION: Although there are significant advances on elucidating the collective behaviors on biological organisms in recent years, the essential mechanisms by which the collective rhythms arise remain to be fully understood, and further how to synchronize multicellular networks by artificial control strategy has not yet been well explored. RESULTS: A control strategy is developed to synchronize gene regulatory networks in a multicellular system when spontaneous synchronization cannot be achieved. We first construct an impulsive control system to model the process of periodically injecting coupling substances with constant or random impulsive control amounts into the common extracellular medium, and further study its effects on the dynamics of individual cells. We derive the threshold of synchronization induced by the periodic substance input. Therefore, we can synchronize the multicellular network to a specific collective behavior by changing the frequency and amplitude of the periodic stimuli. Moreover, a two-stage scheme is proposed to facilitate the synchronization in this paper. We show that the presence of the external input may also initiate different dynamics. The multicellular network of coupled repressilators is used to show the effectiveness of the proposed method. The results not only provide a perspective to understand the interactions between external stimuli and intrinsic physiological rhythms, but also may lead to development of realistic artificial control strategy and medical therapy. AVAILABILITY: CONTACT: aihara@sat.t.u-tokyo.ac.jp.     

A Cell Derived Active Contour (CDAC) Method for Robust Tracking in Low Frame Rate,Low Contrast Phase Microscopy - an Example: The Human hNT Astrocyte

The problem of automated segmenting and tracking of the outlines of cells in microscope images is the subject of active research. While great progress has been made on recognizing cells that are of high contrast and of predictable shape, many situations arise in practice where these properties do not exist and thus many interesting potential studies - such as the migration patterns of astrocytes to scratch wounds - have been relegated to being largely qualitative in nature. Here we analyse a select number of recent developments in this area, and offer an algorithm based on parametric active contours and formulated by taking into account cell movement dynamics. This Cell-Derived Active Contour (CDAC) method is compared with two state-of-the-art segmentation methods for phase-contrast microscopy. Specifically, we tackle a very difficult segmentation problem: human astrocytes that are very large, thin, and irregularly-shaped. We demonstrate quantitatively better results for CDAC as compared to similar segmentation methods, and we also demonstrate the reliable segmentation of qualitatively different data sets that were not possible using existing methods. We believe this new method will enable new and improved automatic cell migration and movement studies to be made.     

Density dependent dispersal decisions and the Allee effect

The decision to move between patches in the environment is among the most important life history choices an organism can make. I derive a new density dependent dispersal rule, and examine how dispersal decisions based on avoiding fitness loss associated with an Allee effect or competitive effects impact upon population dynamics in spatially structured populations with qualitatively different dynamics. I also investigate the effects of the number of patches in the system and a limit to the patch sampling time available to dispersers. Dispersing to avoid competitive pressures can destabilise otherwise stable population dynamics, and stabilise chaotic dynamics. Dispersing to avoid an Allee effect does not qualitatively change local population dynamics until eventually driving unstable populations to global extinction with a sufficiently high fitness threshold. A time limit for sampling can stabilise dynamics if dispersal is based on escaping the Allee effect, and rescue populations from global extinction. The results are sensitive to the number of patches available in the environment and suggest that dispersal to avoid an Allee effect will only arise under biologically plausible conditions, i.e. where there is a limit to the number of dispersal attempts that can be made between generations.     

The dynamics of two diffusively coupled predator-prey populations

I analyze the dynamics of predator and prey populations living in two patches. Within a patch the prey grow logistically and the predators have a Holling type II functional response. The two patches are coupled through predator migration. The system can be interpreted as a simple predator-prey metapopulation or as a spatially explicit predator-prey system. Asynchronous local dynamics are presumed by metapopulation theory. The main question I address is when synchronous and when asynchronous dynamics arise. Contrary to biological intuition, for very small migration rates the oscillations always synchronize. For intermediate migration rates the synchronous oscillations are unstable and I found periodic, quasi-periodic, and intermittently chaotic attractors with asynchronous dynamics. For large predator migration rates, attractors in the form of equilibria or limit cycles exist in which one of the patches contains no prey. The dynamical behavior of the system is described using bifurcation diagrams. The model shows that spatial predator-prey populations can be regulated through the interplay of local dynamics and migration.     

Antagonistic coevolution between multiple quantitative traits: Matching dynamics can arise from difference interactions

Coevolution is one of the major drivers of complex dynamics in population ecology. Historically, antagonistic coevolution in victim-exploiter systems has been a topic of special interest, and involves traits with various genetic architectures (e.g., the number of genes involved) and effects on interactions. For example, exploiters may need to have traits that “match” those of victims for successful exploitation (i.e., a matching interaction), or traits that exceed those of victims (i.e., a difference interaction). Different models exist which are appropriate for different types of traits, including Mendelian (discrete) and quantitative (continuous) traits. For models with multiple Mendelian traits, recent studies have shown that antagonistic coevolutionary patterns that appear as matching interactions can arise due to multiple difference interactions with costs of having large trait values. Here we generalize their findings to quantitative traits and show, analogously, that the multidimensional difference interactions with costs sometimes behave qualitatively the same as matching interactions. While previous studies in quantitative genetics have used the dichotomy between matching and difference frameworks to explore coevolutionary dynamics, we suggest that exploring multidimensional trait space is important to examine the generality of results obtained from one-dimensional traits.     

Encoding time in neural dynamic regimes with distinct computational tradeoffs

Converging evidence suggests the brain encodes time in dynamic patterns of neural activity, including neural sequences, ramping activity, and complex dynamics. Most temporal tasks, however, require more than just encoding time, and can have distinct computational requirements including the need to exhibit temporal scaling, generalize to novel contexts, or robustness to noise. It is not known how neural circuits can encode time and satisfy distinct computational requirements, nor is it known whether similar patterns of neural activity at the population level can exhibit dramatically different computational or generalization properties. To begin to answer these questions, we trained RNNs on two timing tasks based on behavioral studies. The tasks had different input structures but required producing identically timed output patterns. Using a novel framework we quantified whether RNNs encoded two intervals using either of three different timing strategies: scaling, absolute, or stimulus-specific dynamics. We found that similar neural dynamic patterns at the level of single intervals, could exhibit fundamentally different properties, including, generalization, the connectivity structure of the trained networks, and the contribution of excitatory and inhibitory neurons. Critically, depending on the task structure RNNs were better suited for generalization or robustness to noise. Further analysis revealed different connection patterns underlying the different regimes. Our results predict that apparently similar neural dynamic patterns at the population level (e.g., neural sequences) can exhibit fundamentally different computational properties in regards to their ability to generalize to novel stimuli and their robustness to noise—and that these differences are associated with differences in network connectivity and distinct contributions of excitatory and inhibitory neurons. We also predict that the task structure used in different experimental studies accounts for some of the experimentally observed variability in how networks encode time.     

Multiple Stable Periodic Oscillations in a Mathematical Model of CTL Response to HTLV-I Infection

Stable periodic oscillations have been shown to exist in mathematical models for the CTL response to HTLV-I infection. These periodic oscillations can be the result of mitosis of infected target CD4⁺ cells, of a general form of response function, or of time delays in the CTL response. In this study, we show through a simple mathematical model that time delays in the CTL response process to HTLV-I infection can lead to the coexistence of multiple stable periodic solutions, which differ in amplitude and period, with their own basins of attraction. Our results imply that the dynamic interactions between the CTL immune response and HTLV-I infection are very complex, and that multi-stability in CTL response dynamics can exist in the form of coexisting stable oscillations instead of stable equilibria. Biologically, our findings imply that different routes or initial dosages of the viral infection may lead to quantitatively and qualitatively different outcomes.     

Structure and evolution of a pair-rule interaction element: runt regulatory sequences in D. melanogaster and D. virilis

Pair-rule genes serve two important functions during Drosophila development: they first initiate periodic patterns, and subsequently interact with each other to refine these patterns to the precision required for definition of segmental compartments. Previously, we described a pair-rule input region of the runt gene. Here we further characterize this region through the use of reporter gene constructs and by comparison with corresponding sequences from Drosophila virilis. We find that many but not all regulatory properties of this '7-stripe region' are functionally conserved. Moreover, the similarity between these homologous sequences is surprisingly low. When compared to similar data for gap gene input element, our data suggest that pair-rule target sequences are less constrained during evolution, and that functional elements mediating pair-rule interactions can be dispersed over many kilobases.     

Ion concentration dynamics as a mechanism for neuronal bursting

We describe a simple conductance-based model neuron that includes intra- and extracellular ion concentration dynamics and show that this model exhibits periodic bursting. The bursting arises as the fast-spiking behavior of the neuron is modulated by the slow oscillatory behavior in the ion concentration variables and vice versa. By separating these time scales and studying the bifurcation structure of the neuron, we catalog several qualitatively different bursting profiles that are strikingly similar to those seen in experimental preparations. Our work suggests that ion concentration dynamics may play an important role in modulating neuronal excitability in real biological systems.     

Periodic dynamics in a two-stage Allee effect model are driven by tension between stage equilibria

Single species difference population models can show complex dynamics such as periodicity and chaos under certain circumstances, but usually only when rates of intrinsic population growth or other life history parameter are unrealistically high. Single species models with Allee effects (positive density dependence at low density) have also been shown to exhibit complex dynamics when combined with over-compensatory density dependence or a narrow fertility window. Here we present a simple two-stage model with Allee effects which shows large amplitude periodic fluctuations for some initial conditions, without these requirements. Periodicity arises out of a tension between the critical equilibrium of each stage, i.e. when the initial population vector is such that the adult stage is above the critical value, while the juvenile stage is below the critical value. Within this area of parameter space, the range of initial conditions giving rise to periodic dynamics is driven mainly by adult mortality rates. Periodic dynamics become more important as adult mortality increases up to a certain point, after which periodic dynamics are replaced by extinction. This model has more realistic life history parameter values than most 'chaotic' models. Conditions for periodic dynamics might arise in some marine species which are exploited (high adult mortality) leading to recruitment limitation (low juvenile density) and might be an additional source of extinction risk.     

Biophysical basis for three distinct dynamical mechanisms of action potential initiation

Transduction of graded synaptic input into trains of all-or-none action potentials (spikes) is a crucial step in neural coding. Hodgkin identified three classes of neurons with qualitatively different analog-to-digital transduction properties. Despite widespread use of this classification scheme, a generalizable explanation of its biophysical basis has not been described. We recorded from spinal sensory neurons representing each class and reproduced their transduction properties in a minimal model. With phase plane and bifurcation analysis, each class of excitability was shown to derive from distinct spike initiating dynamics. Excitability could be converted between all three classes by varying single parameters; moreover, several parameters, when varied one at a time, had functionally equivalent effects on excitability. From this, we conclude that the spike-initiating dynamics associated with each of Hodgkin's classes represent different outcomes in a nonlinear competition between oppositely directed, kinetically mismatched currents. Class 1 excitability occurs through a saddle node on invariant circle bifurcation when net current at perithreshold potentials is inward (depolarizing) at steady state. Class 2 excitability occurs through a Hopf bifurcation when, despite net current being outward (hyperpolarizing) at steady state, spike initiation occurs because inward current activates faster than outward current. Class 3 excitability occurs through a quasi-separatrix crossing when fast-activating inward current overpowers slow-activating outward current during a stimulus transient, although slow-activating outward current dominates during constant stimulation. Experiments confirmed that different classes of spinal lamina I neurons express the subthreshold currents predicted by our simulations and, further, that those currents are necessary for the excitability in each cell class. Thus, our results demonstrate that all three classes of excitability arise from a continuum in the direction and magnitude of subthreshold currents. Through detailed analysis of the spike-initiating process, we have explained a fundamental link between biophysical properties and qualitative differences in how neurons encode sensory input.     

实验性神经起步点的不规则节律中的非稳定周期轨道

在大鼠坐骨神经结扎模型中,记录到放电节律以周期加方式相互转化,在确认了周期二与周期三之间的不规则节律具有混性质后,借助峰峰间期序列的回归映象方法,使用了一种测度增强算法,确认了此混沌放电中的非稳定周期轨道结构,提示出非稳定周期轨道在神经不规则放电节律的动力学之中起着重要作用。     

Identifying type I excitability using dynamics of stochastic neural firing patterns

The stochastic firing patterns are simulated near saddle-node bifurcation on an invariant cycle corresponding to type I excitability in stochastic Morris–Lecar model. In absence of external periodic signal, the stochastic firing manifests continuous distribution in ISI histogram (ISIH), whose amplitude at first increases sharply and then decreases exponentially. In presence of the external periodic signal, stochastic firing patterns appear as two cases of integer multiple firing with multiple discrete peaks in ISIH. One manifests perfect exponential decay in all peaks and the other imperfect exponential decay except a lower first peak. These stochastic firing patterns simulated with or without external periodic signal can be demonstrated in the experiments on rat hippocampal CA1 pyramidal neurons. The exponential decay laws in the multiple peaks are also acquired using probability analysis method. The perfect decay law is determined by the independent characteristic within the firing while the imperfect decay law is from the inhibitory effect. In addition, the stochastic firing patterns corresponding to type I excitability are compared to those of type II excitability. The results not only reveal the dynamics of stochastic firing patterns with or without external signal corresponding to type I excitability, but also provide practical indicators to availably identify type I excitability.     

Traveling Wave Solutions of a Nerve Conduction Equation

We consider a pair of differential equations whose solutions exhibit the qualitative properties of nerve conduction, yet which are simple enough to be solved exactly and explicitly. The equations are of the FitzHugh-Nagumo type, with a piecewise linear nonlinearity, and they contain two parameters. All the pulse and periodic solutions, and their propagation speeds, are found for these equations, and the stability of the solutions is analyzed. For certain parameter values, there are two different pulse-shaped waves with different propagation speeds. The slower pulse is shown to be unstable and the faster one to be stable, confirming conjectures which have been made before for other nerve conduction equations. Two periodic waves, representing trains of propagated impulses, are also found for each period greater than some minimum which depends on the parameters. The slower train is unstable and the faster one is usually stable, although in some cases both are unstable.     

Computer simulations of synchrony and oscillations evoked by two coherent inputs

Coherent oscillations have been reported in multiple cortical areas. This study examines the characteristics of output spikes through computer simulations when the neural network model receives periodic/aperiodic spatiotemporal spikes with modulated/constant populational activity from two pathways. Synchronous oscillations which have the same period as the input are observed in response to periodic input patterns regardless of populational activity. The results confirm that the output frequency of synchrony is essentially determined by the period of the repeated input patterns. On the other hand, weak periodic outputs are observed when aperiodic spikes are input with modulated populational activity. In this case, higher firing rates are necessary to input for higher frequency oscillations. The spike-timing-dependent plasticity suppresses the spikes which do not contribute to the synchrony for periodic inputs. This effect corresponds to the experimental reports that learning sharpens the synchrony in the motor cortex. These results suggest that spatiotemporal spike patterns should be entrained on modulated populational activity to transmit oscillatory information effectively in the convergent pathway.