Robustness as an evolutionary principle.

We suggest simulating evolution of complex organisms using a model constrained solely by the requirement of robustness in its expression patterns. This scenario is illustrated by evolving discrete logical networks with epigenetic properties. Evidence for dynamical features in the evolved networks is found that can be related to biological observables.     

Control of firing patterns by two transient potassium currents: leading spike,latency, bistability

Transient potassium currents distinctively affect firing properties, particularly in regulating the latency before repetitive firing. Pyramidal cells of the dorsal cochlear nucleus (DCN) have two transient potassium currents, I _Kif and I _Kis, fast and slowly inactivating, respectively, and they exhibit firing patterns with dramatically variable latencies. They show immediate repetitive firing, or only after a long latency with or without a leading spike, the so-called pauser and buildup patterns. We consider a conductance-based, ten-variable, single-compartment model for the DCN pyramidal cells (Kanold and Manis 2001). We develop and analyze a reduced three-variable integrate-and-fire model (KM-LIF) which captures the qualitative firing features. We apply dynamical systems methods to explain the underlying biophysical and mathematical mechanisms for the firing behaviors, including the characteristic firing patterns, the latency phase, the onset of repetitive firing, and some discontinuities in the timing of latency duration (e.i. first spike latency and first inter spike interval). Moreover, we obtain new insights associated with the leading spike by phase plane analysis. We further demonstrate the effects of possible heterogeneity of I _Kis. The latency before repetitive firing can be controlled to cover a large range by tuning of the relative amounts of I _Kif and I _Kis. Finally, we find for the full system robust bistability when enough I _Kis is present.     

A statistical model of the human core-temperature circadian rhythm

We formulate a statistical model of the human core-temperature circadian rhythm in which the circadian signal is modeled as a van der Pol oscillator, the thermoregulatory response is represented as a first-order autoregressive process, and the evoked effect of activity is modeled with a function specific for each circadian protocol. The new model directly links differential equation-based simulation models and harmonic regression analysis methods and permits statistical analysis of both static and dynamical properties of the circadian pacemaker from experimental data. We estimate the model parameters by using numerically efficient maximum likelihood algorithms and analyze human core-temperature data from forced desynchrony, free-run, and constant-routine protocols. By representing explicitly the dynamical effects of ambient light input to the human circadian pacemaker, the new model can estimate with high precision the correct intrinsic period of this oscillator ( approximately 24 h) from both free-run and forced desynchrony studies. Although the van der Pol model approximates well the dynamical features of the circadian pacemaker, the optimal dynamical model of the human biological clock may have a harmonic structure different from that of the van der Pol oscillator.     

Statistical model building and model criticism for human circadian data

Mathematical models have played an important role in the analysis of circadian systems. The models include simulation of differential equation systems to assess the dynamic properties of a circadian system and the use of statistical models, primarily harmonic regression methods, to assess the static properties of the system. The dynamical behaviors characterized by the simulation studies are the response of the circadian pacemaker to light, its rate of decay to its limit cycle, and its response to the rest-activity cycle. The static properties are phase, amplitude, and period of the intrinsic oscillator. Formal statistical methods are not routinely employed in simulation studies, and therefore the uncertainty in inferences based on the differential equation models and their sensitivity to model specification and parameter estimation error cannot be evaluated. The harmonic regression models allow formal statistical analysis of static but not dynamical features of the circadian pacemaker. The authors present a paradigm for analyzing circadian data based on the Box iterative scheme for statistical model building. The paradigm unifies the differential equation-based simulations (direct problem) and the model fitting approach using harmonic regression techniques (inverse problem) under a single schema. The framework is illustrated with the analysis of a core-temperature data series collected under a forced desynchrony protocol. The Box iterative paradigm provides a framework for systematically constructing and analyzing models of circadian data.     

A model of sequential branching in hierarchical cell fate determination

Multipotent stem or progenitor cells undergo a sequential series of binary fate decisions, which ultimately generate the diversity of differentiated cells. Efforts to understand cell fate control have focused on simple gene regulatory circuits that predict the presence of multiple stable states, bifurcations and switch-like transitions. However, existing gene network models do not explain more complex properties of cell fate dynamics such as the hierarchical branching of developmental paths. Here, we construct a generic minimal model of the genetic regulatory network controlling cell fate determination, which exhibits five elementary characteristics of cell differentiation: stability, directionality, branching, exclusivity, and promiscuous expression. We argue that a modular architecture comprising repeated network elements reproduces these features of differentiation by sequentially repressing selected modules and hence restricting the dynamics to lower dimensional subspaces of the high-dimensional state space. We implement our model both with ordinary differential equations (ODEs), to explore the role of bifurcations in producing the one-way character of differentiation, and with stochastic differential equations (SDEs), to demonstrate the effect of noise on the system. We further argue that binary cell fate decisions are prevalent in cell differentiation due to general features of the underlying dynamical system. This minimal model makes testable predictions about the structural basis for directional, discrete and diversifying cell phenotype development and thus can guide the evaluation of real gene regulatory networks that govern differentiation.     

Nonlinear effects of intrinsic dynamics on temporal encoding in a model of avian auditory cortex

Neurons exhibit diverse intrinsic dynamics, which govern how they integrate synaptic inputs to produce spikes. Intrinsic dynamics are often plastic during development and learning, but the effects of these changes on stimulus encoding properties are not well known. To examine this relationship, we simulated auditory responses to zebra finch song using a linear-dynamical cascade model, which combines a linear spectrotemporal receptive field with a dynamical, conductance-based neuron model, then used generalized linear models to estimate encoding properties from the resulting spike trains. We focused on the effects of a low-threshold potassium current (K_LT) that is present in a subset of cells in the zebra finch caudal mesopallium and is affected by early auditory experience. We found that K_LT affects both spike adaptation and the temporal filtering properties of the receptive field. The direction of the effects depended on the temporal modulation tuning of the linear (input) stage of the cascade model, indicating a strongly nonlinear relationship. These results suggest that small changes in intrinsic dynamics in tandem with differences in synaptic connectivity can have dramatic effects on the tuning of auditory neurons.     

Predictive Coding of Dynamical Variables in Balanced Spiking Networks

Two observations about the cortex have puzzled neuroscientists for a long time. First, neural responses are highly variable. Second, the level of excitation and inhibition received by each neuron is tightly balanced at all times. Here, we demonstrate that both properties are necessary consequences of neural networks that represent information efficiently in their spikes. We illustrate this insight with spiking networks that represent dynamical variables. Our approach is based on two assumptions: We assume that information about dynamical variables can be read out linearly from neural spike trains, and we assume that neurons only fire a spike if that improves the representation of the dynamical variables. Based on these assumptions, we derive a network of leaky integrate-and-fire neurons that is able to implement arbitrary linear dynamical systems. We show that the membrane voltage of the neurons is equivalent to a prediction error about a common population-level signal. Among other things, our approach allows us to construct an integrator network of spiking neurons that is robust against many perturbations. Most importantly, neural variability in our networks cannot be equated to noise. Despite exhibiting the same single unit properties as widely used population code models (e.g. tuning curves, Poisson distributed spike trains), balanced networks are orders of magnitudes more reliable. Our approach suggests that spikes do matter when considering how the brain computes, and that the reliability of cortical representations could have been strongly underestimated.     

Impact of Awareness Programs on Cholera Dynamics: Two Modeling Approaches

We propose two differential equation-based models to investigate the impact of awareness programs on cholera dynamics. The first model represents the disease transmission rates as decreasing functions of the number of awareness programs, whereas the second model divides the susceptible individuals into two distinct classes depending on their awareness/unawareness of the risk of infection. We study the essential dynamical properties of each model, using both analytical and numerical approaches. We find that the two models, though closely related, exhibit significantly different dynamical behaviors. Namely, the first model follows regular threshold dynamics while rich dynamical behaviors such as backward bifurcation may arise from the second one. Our results highlight the importance of validating key modeling assumptions in the development and selection of mathematical models toward practical application.     

Stochastically Gating Ion Channels Enable Patterned Spike Firing through Activity-Dependent Modulation of Spike Probability

The transformation of synaptic input into patterns of spike output is a fundamental operation that is determined by the particular complement of ion channels that a neuron expresses. Although it is well established that individual ion channel proteins make stochastic transitions between conducting and non-conducting states, most models of synaptic integration are deterministic, and relatively little is known about the functional consequences of interactions between stochastically gating ion channels. Here, we show that a model of stellate neurons from layer II of the medial entorhinal cortex implemented with either stochastic or deterministically gating ion channels can reproduce the resting membrane properties of stellate neurons, but only the stochastic version of the model can fully account for perithreshold membrane potential fluctuations and clustered patterns of spike output that are recorded from stellate neurons during depolarized states. We demonstrate that the stochastic model implements an example of a general mechanism for patterning of neuronal output through activity-dependent changes in the probability of spike firing. Unlike deterministic mechanisms that generate spike patterns through slow changes in the state of model parameters, this general stochastic mechanism does not require retention of information beyond the duration of a single spike and its associated afterhyperpolarization. Instead, clustered patterns of spikes emerge in the stochastic model of stellate neurons as a result of a transient increase in firing probability driven by activation of HCN channels during recovery from the spike afterhyperpolarization. Using this model, we infer conditions in which stochastic ion channel gating may influence firing patterns in vivo and predict consequences of modifications of HCN channel function for in vivo firing patterns.     

On the complex dynamics of intracellular ganglion cell light responses in the cat retina

We recorded intracellular responses from cat retinal ganglion cells to sinusoidal flickering lights, and compared the response dynamics with a theoretical model based on coupled nonlinear oscillators. Flicker responses for several different spot sizes were separated in a smooth generator (G) potential and corresponding spike trains. We have previously shown that the G-potential reveals complex, stimulus-dependent, oscillatory behavior in response to sinusoidally flickering lights. Such behavior could be simulated by a modified van der Pol oscillator. In this paper, we extend the model to account for spike generation as well, by including extended Hodgkin-Huxley equations describing local membrane properties. We quantified spike responses by several parameters describing the mean and standard deviation of spike burst duration, timing (phase shift) of bursts, and the number of spikes in a burst. The dependence of these response parameters on stimulus frequency and spot size could be reproduced in great detail by coupling the van der Pol oscillator and Hodgkin-Huxley equations. The model mimics many experimentally observed response patterns, including non-phase-locked irregular oscillations. Our findings suggest that the information in the ganglion cell spike train reflects both intraretinal processing, simulated by the van der Pol oscillator, and local membrane properties described by Hodgkin-Huxley equations. The interplay between these complex processes can be simulated by changing the coupling coefficients between the two oscillators. Our simulations therefore show that irregularities in spike trains, which normally are considered to be noise, may be interpreted as complex oscillations that might carry information.To the memory of Prof. Otto-Joachim Grusser     

Analysis,classification, and coding of multielectrode spike trains with hidden Markov models

It is shown that hidden Markov models (HMMs) are a powerful tool in the analysis of multielectrode data. This is demonstrated for a 30-electrode measurement of neuronal spike activity in the monkey's visual cortex during the application of different visual stimuli. HMMs with optimized parameters code the information contained in the spatiotemporal discharge patterns as a probabilistic function of a Markov process and thus provide abstract dynamical models of the pattern-generating process. We compare HMMs obtained from vector-quantized data with models in which parametrized output processes such as multivariate Poisson or binomial distributions are assumed. In the latter cases the visual stimuli are recognized at rates of more than 90% from the neuronal spike patterns. An analysis of the models obtained reveals important aspects of the coding of information in the brain. For example, we identify relevant time scales and characterize the degree and nature of the spatiotemporal variations on these scales.     

Computational aspects of feedback in neural circuits

It has previously been shown that generic cortical microcircuit models can perform complex real-time computations on continuous input streams, provided that these computations can be carried out with a rapidly fading memory. We investigate the computational capability of such circuits in the more realistic case where not only readout neurons, but in addition a few neurons within the circuit, have been trained for specific tasks. This is essentially equivalent to the case where the output of trained readout neurons is fed back into the circuit. We show that this new model overcomes the limitation of a rapidly fading memory. In fact, we prove that in the idealized case without noise it can carry out any conceivable digital or analog computation on time-varying inputs. But even with noise, the resulting computational model can perform a large class of biologically relevant real-time computations that require a nonfading memory. We demonstrate these computational implications of feedback both theoretically, and through computer simulations of detailed cortical microcircuit models that are subject to noise and have complex inherent dynamics. We show that the application of simple learning procedures (such as linear regression or perceptron learning) to a few neurons enables such circuits to represent time over behaviorally relevant long time spans, to integrate evidence from incoming spike trains over longer periods of time, and to process new information contained in such spike trains in diverse ways according to the current internal state of the circuit. In particular we show that such generic cortical microcircuits with feedback provide a new model for working memory that is consistent with a large set of biological constraints. Although this article examines primarily the computational role of feedback in circuits of neurons, the mathematical principles on which its analysis is based apply to a variety of dynamical systems. Hence they may also throw new light on the computational role of feedback in other complex biological dynamical systems, such as, for example, genetic regulatory networks.     

Unbuffered and buffered supply chains in human metabolism

The investigation of very complex dynamical systems like the human metabolism requires the comprehension of important subsystems. The present paper deals with energy supply chains as subsystems of the metabolism on the molecular, cellular, and individual levels. We form a mathematical model of ordinary differential equations and we show fundamental properties by Fourier techniques. The results are supported by a transition from a system of ordinary differential equations to a partial differential equation, namely, a transport equation. In particular, the behavior of supply chains with dominant pull components is discussed. A special focus lies on the role of buffer compartments.     

Note on the coefficient of variations of neuronal spike trains

It is known that many neurons in the brain show spike trains with a coefficient of variation (CV) of the interspike times of approximately 1, thus resembling the properties of Poisson spike trains. Computational studies have been able to reproduce this phenomenon. However, the underlying models were too complex to be examined analytically. In this paper, we offer a simple model that shows the same effect but is accessible to an analytic treatment. The model is a random walk model with a reflecting barrier; we give explicit formulas for the CV in the regime of excess inhibition. We also analyze the effect of probabilistic synapses in our model and show that it resembles previous findings that were obtained by simulation.     

Stabilizing patterning in the Drosophila segment polarity network by selecting models in silico

The segmentation of Drosophila is a prime model to study spatial patterning during embryogenesis. The spatial expression of segment polarity genes results from a complex network of interacting proteins whose expression products are maintained after successful segmentation. This prompted us to investigate the stability and robustness of this process using a dynamical model for the segmentation network based on Boolean states. The model consists of intra-cellular as well as inter-cellular interactions between adjacent cells in one spatial dimension. We quantify the robustness of the dynamical segmentation process by a systematic analysis of mutations. Our starting point consists in a previous Boolean model for Drosophila segmentation. We define mathematically the notion of dynamical robustness and show that the proposed model exhibits limited robustness in gene expression under perturbations. We applied in silico evolution (mutation and selection) and discover two classes of modified gene networks that have a more robust spatial expression pattern. We verified that the enhanced robustness of the two new models is maintained in differential equations models. By comparing the predicted model with experiments on mutated flies, we then discuss the two types of enhanced models. Drosophila patterning can be explained by modelling the underlying network of interacting genes. Here we demonstrate that simple dynamical considerations and in silico evolution can enhance the model to robustly express the expected pattern, helping to elucidate the role of further interactions.     

A Threshold Equation for Action Potential Initiation

In central neurons, the threshold for spike initiation can depend on the stimulus and varies between cells and between recording sites in a given cell, but it is unclear what mechanisms underlie this variability. Properties of ionic channels are likely to play a role in threshold modulation. We examined in models the influence of Na channel activation, inactivation, slow voltage-gated channels and synaptic conductances on spike threshold. We propose a threshold equation which quantifies the contribution of all these mechanisms. It provides an instantaneous time-varying value of the threshold, which applies to neurons with fluctuating inputs. We deduce a differential equation for the threshold, similar to the equations of gating variables in the Hodgkin-Huxley formalism, which describes how the spike threshold varies with the membrane potential, depending on channel properties. We find that spike threshold depends logarithmically on Na channel density, and that Na channel inactivation and K channels can dynamically modulate it in an adaptive way: the threshold increases with membrane potential and after every action potential. Our equation was validated with simulations of a previously published multicompartemental model of spike initiation. Finally, we observed that threshold variability in models depends crucially on the shape of the Na activation function near spike initiation (about −55 mV), while its parameters are adjusted near half-activation voltage (about −30 mV), which might explain why many models exhibit little threshold variability, contrary to experimental observations. We conclude that ionic channels can account for large variations in spike threshold.     

Maximum likelihood estimation in dynamical models of HIV

The study of dynamical models of HIV infection, based on a system of nonlinear ordinary differential equations (ODE), has considerably improved the knowledge of its pathogenesis. While the first models used simplified ODE systems and analyzed each patient separately, recent works dealt with inference in non-simplified models borrowing strength from the whole sample. The complexity of these models leads to great difficulties for inference and only the Bayesian approach has been attempted by now. We propose a full likelihood inference, adapting a Newton-like algorithm for these particular models. We consider a relatively complex ODE model for HIV infection and a model for the observations including the issue of detection limits. We apply this approach to the analysis of a clinical trial of antiretroviral therapy (ALBI ANRS 070) and we show that the whole algorithm works well in a simulation study.     

Firing-rate models capture essential response dynamics of LGN relay cells

Firing-rate models provide a practical tool for studying signal processing in the early visual system, permitting more thorough mathematical analysis than spike-based models. We show here that essential response properties of relay cells in the lateral geniculate nucleus (LGN) can be captured by surprisingly simple firing-rate models consisting of a low-pass filter and a nonlinear activation function. The starting point for our analysis are two spiking neuron models based on experimental data: a spike-response model fitted to data from macaque (Carandini et al. J. Vis., 20(14), 1–2011, 2007), and a model with conductance-based synapses and afterhyperpolarizing currents fitted to data from cat (Casti et al. J. Comput. Neurosci., 24(2), 235–252, 2008). We obtained the nonlinear activation function by stimulating the model neurons with stationary stochastic spike trains, while we characterized the linear filter by fitting a low-pass filter to responses to sinusoidally modulated stochastic spike trains. To account for the non-Poisson nature of retinal spike trains, we performed all analyses with spike trains with higher-order gamma statistics in addition to Poissonian spike trains. Interestingly, the properties of the low-pass filter depend only on the average input rate, but not on the modulation depth of sinusoidally modulated input. Thus, the response properties of our model are fully specified by just three parameters (low-frequency gain, cutoff frequency, and delay) for a given mean input rate and input regularity. This simple firing-rate model reproduces the response of spiking neurons to a step in input rate very well for Poissonian as well as for non-Poissonian input. We also found that the cutoff frequencies, and thus the filter time constants, of the rate-based model are unrelated to the membrane time constants of the underlying spiking models, in agreement with similar observations for simpler models.