Sensitivity and control analysis of periodically forced reaction networks using the Green's function method

A general sensitivity and control analysis of periodically forced reaction networks with respect to small perturbations in arbitrary network parameters is presented. A well-known property of sensitivity coefficients for periodic processes in dynamical systems is that the coefficients generally become unbounded as time tends to infinity. To circumvent this conceptual obstacle, a relative time or phase variable is introduced so that the periodic sensitivity coefficients can be calculated. By employing the Green's function method, the sensitivity coefficients can be defined using integral control operators that relate small perturbations in the network's parameters and forcing frequency to variations in the metabolite concentrations and reaction fluxes. The properties of such operators do not depend on a particular parameter perturbation and are described by the summation and connectivity relationships within a control-matrix operator equation. The aim of this paper is to derive such a general control-matrix operator equation for periodically forced reaction networks, including metabolic pathways. To illustrate the general method, the two limiting cases of high and low forcing frequency are considered. We also discuss a practically important case where enzyme activities and forcing frequency are modulated simultaneously. We demonstrate the developed framework by calculating the sensitivity and control coefficients for a simple two reaction pathway where enzyme activities enter reaction rates linearly and specifically.     

Cell cycle progression

In this paper we consider cell cycle models for which the transition operator for the evolution of birth mass density is a simple, linear dynamical system with a stochastic perturbation. The convolution model for a birth mass distribution is presented. Density functions of birth mass and tail probabilities in n-th generation are calculated by a saddle-point approximation method. With these probabilities, representing the probability of exceeding an acceptable mass value, we have more control over pathological growth. A computer simulation is presented for cell proliferation in the age-dependent cell cycle model. The simulation takes into account the fact that the age-dependent model with a linear growth is a simple linear dynamical system with an additive stochastic perturbation. The simulated data as well as the experimental data (generation times for mouse L) are fitted by the proposed convolution model.     

Microbial predation in a periodically operated chemostat: a global study of the interaction between natural and externally imposed frequencies.

Predator-prey systems in continuously operated chemostats exhibit sustained oscillations over a wide range of operating conditions. When the chemostat is operated periodically, the interaction of the natural oscillation frequency with the external forcing gives rise to a wealth of dynamic behavior patterns. Using numerical bifurcation techniques, we perform a detailed computational study of these patterns and the transitions (local and especially global) between them as the amplitude and frequency of the forcing vary. The transition from low-forcing-amplitude quasiperiodicity to entrainment of the chemostat behavior by strong forcing (involving the concerted closing of resonance horns) is analyzed. We concentrate on certain strong resonance phenomena between the two frequencies and provide an extensive atlas of computed phase portraits for our model system. Our observations corroborate recent mathematical results and case studies of periodically forced chemical oscillators. In particular, the existence and relative succession of several distinct types of global bifurcations resulting in chaotic transients and multistability are studied in detail. The location in the operating diagram of several key codimension 2 local bifurcations of periodic solutions is computed, and their interaction with an interesting feature we name "real-eigenvalues horns" is examined.     

Phase resetting and coupling of noisy neural oscillators

A number of experimental groups have recently computed Phase Response Curves (PRCs) for neurons. There is a great deal of noise in the data. We apply methods from stochastic nonlinear dynamics to coupled noisy phase-resetting maps and obtain the invariant density of phase distributions. By exploiting the special structure of PRCs, we obtain some approximations for the invariant distributions. Comparisons to Monte-Carlo simulations are made. We show how phase-dependence of the noise can move the peak of the invariant density away from the peak expected from the analysis of the deterministic system and thus lead to noise-induced bifurcations. B. Ermentrout supported in part by NIMH and NSF. Action Editor: Wulfram Gerstner     

Reduction of stochastic conductance-based neuron models with time-scales separation

We introduce a method for systematically reducing the dimension of biophysically realistic neuron models with stochastic ion channels exploiting time-scales separation. Based on a combination of singular perturbation methods for kinetic Markov schemes with some recent mathematical developments of the averaging method, the techniques are general and applicable to a large class of models. As an example, we derive and analyze reductions of different stochastic versions of the Hodgkin Huxley (HH) model, leading to distinct reduced models. The bifurcation analysis of one of the reduced models with the number of channels as a parameter provides new insights into some features of noisy discharge patterns, such as the bimodality of interspike intervals distribution. Our analysis of the stochastic HH model shows that, besides being a method to reduce the number of variables of neuronal models, our reduction scheme is a powerful method for gaining understanding on the impact of fluctuations due to finite size effects on the dynamics of slow fast systems. Our analysis of the reduced model reveals that decreasing the number of sodium channels in the HH model leads to a transition in the dynamics reminiscent of the Hopf bifurcation and that this transition accounts for changes in characteristics of the spike train generated by the model. Finally, we also examine the impact of these results on neuronal coding, notably, reliability of discharge times and spike latency, showing that reducing the number of channels can enhance discharge time reliability in response to weak inputs and that this phenomenon can be accounted for through the analysis of the reduced model.     

On some properties of stochastic information processes in neurons and neuron populations

The information in the nervous spike trains and its processing by neural units are discussed. In these problems, our attention is focused on the stochastic properties of neurons and neuron populations. There are three subjects in this paper, which are the spontaneous type neuron, the forced type neuron and the reciprocal inhibitory pairs.

1. The spontaneous type neuron produces spikes without excitatory inputs. The mathematical model has the following assumptions. The neuron potential (NP) has the fluctuation and obeys the Ornstein-Uhlenbeck process, because the N P is not so perfectly random as that of the Wiener process but has an attraction to the rest value. The threshold varies exponentially and the NP has the constant lower limit. When the NP reaches the threshold, the neuron fires and the NP is reset to a certain position. After a firing, an absolute refractory period exists. In discussing the stochastic properties of neurons, the transition probability density function and the first passage time density function are the important quantities, which are governed by the Kolmogorov's equations. Although they can be set up easily, we can rarely obtain the analytical solutions in time domain. Moreover, they cover only simple properties. Hence the numerical analysis is performed and a good deal of fair results are obtained and discussed.
2. The forced type neuron has input pulse trains which are assumed to be based on the Poisson process. Other assumptions and methods are almost the same as above except the diffusion approximation of the stochastic process. In this case, we encounter the inhomogeneous process due to the pulse-frequency-modulation, whose first passage time density reveals the multimodal distribution. The numerical analysis is also tried, and the output spike interval density is further discussed in the case of the periodic modulation.
3. Two types of reciprocal inhibitory pairs are discussed. The first type has two excitatory driving inputs which are mutually independent. The second type has one common excitatory input but it advances in two ways, one of which has a time lag. The neuron dynamics is the same as that of the forced type neuron and each neuron has an identical structure. The inputs are assumed to be based on the Poisson process and the inhibition occurs when the companion neuron fires. In this case, the equations of the probability density functions are not obtained. Hence the computer simulation is tried and it is observed that the stochastic rhythm emerges in spite of the temporally homogeneous inputs. Furthermore, the case of inhomogeneous inputs is discussed.

     

Lecithin bilayers. Density measurement and molecular interactions.

Density measurement are reported for bilayer dispersions of a series of saturated lecithins. For chain lengths with, respectively, 14, 15, 16, 17, and 18 carbons per chain, the values for the volume changes at the main transition are 0.027, 0.031, 0.037, 0.040 and 0.045 ml/g. The main transition temperature extrapolates with increasing chain length to the melting temperature of polyethylene. Volume changes at the lower transition are an order of magnitude smaller than the main transition. Single phase thermal expansion coefficients are also reported. The combination of X-ray data and density data indicated that the volume changes are predominantly due to the hydrocarbon chains, thus enabling the volume vCH2 of the methylene groups to be computed as a function of temperature. From this and knowledge of intermolecular interactions in hydrocarbon chains, the change in the interchain van der Waals energy, delta UvdW, at the main transition is computed for the lecithins and also for the alkanes and polyethylene at the melting transition. Using the experimental enthalpies of transition and delta UvdW, the energy equation is consistently balanced for all three systems. This yields estimates of the change in the number of gauche rotamers in the lecithins at the main transition. The consistency of these calculations supports the conclusion that the most important molecular energies for the main transition in lecithin bilayers are the hydrocarbon chain interactions and the rotational isomeric energies, and the conclusion that the main phase transition is analogous to the melting transition in the alkanes from the hexagonal phase to the liquid phase, but with some modifications.     

Response of a pacemaker neuron model to stochastic pulse trains

 We investigated the response of a pacemaker neuron model to trains of inhibitory stochastic impulsive perturbations. The model captures the essential aspect of the dynamics of pacemaker neurons. Especially, the model reproduces linearization by stochastic pulse trains, that is, the disappearance of the paradoxical segments in which the output firing rate of pacemaker neurons increases with inhibition rate, as the coefficient of variation of the input pulse train increases. To study the response of the model to stochastic pulse trains, we use a Markov operator governing the phase transition. We show how linearization occurs based on the spectral analysis of the Markov operator. Moreover, using Lyapunov exponents, we show that variable inputs evoke reliable firing, even in situations where periodic stimulation with the same mean rate does not. Received: 30 April 2001 / Accepted in revised form: 19 September 2001     

Statistical properties of ion channel records. Part I: relationship to the macroscopic current

Macroscopic ion channel current can be derived by summation of the stochastic records of individual channel currents. In this paper, we present two probability density functions of single channel records that can uniquely determine the macroscopic current regardless of other statistical properties of records or the stochastic model of channel gating (presented often with stationary Markov models). We show that H(t), probability density function of channel opening events (introduced explicitly in this paper), and D(t), probability density function of the open duration (sometimes has named dwell time distribution as well), determine the normalized macroscopic current, G(t), through G(t) = P(t) - H(t) * Q(t) where P(t) is the cumulative density function of H(t), Q(t) is the cumulative density function of D(t), * is the symbol of convolution integral and G(t) is the macroscopic current divided by the amplitude of single channel current and the number of single channel sweeps. Compared to other equations for the macroscopic current, here the macroscopic current is expressed only in terms of the statistical properties of single channel current and not the stochastic model of ion channel gating or a conditioned form of macroscopic current. Single channel currents of an inactivating BK channel were used to validate this relationship experimentally too. In this paper, we used median filters as they can remove the unwanted noise without smoothing the transitions between open and closed states (compare to low pass filters). This filtering leads to more accurate measurement of transition times and less amount of missed events.     

Stochastic theory of a selection game

The stochastic theory of a nonlinear game is presented which incorporates some of the essential properties of living systems: metabolism, reproduction and mutability. The steady state distribution function as well as the complete time development are given explicitly. The second law of thermodynamics is generalized to a certain class of nonequilibrium systems. An order parameter is introduced as a measure of the system's internal organization. From the point of view of phase transition theory, the model exhibits a transition at the absolute zero of temperature, with critical behaviour showing up in the low temperature region.     

The variance of phase-resetting curves

Phase resetting curves (PRCs) provide a measure of the sensitivity of oscillators to perturbations. In a noisy environment, these curves are themselves very noisy. Using perturbation theory, we compute the mean and the variance for PRCs for arbitrary limit cycle oscillators when the noise is small. Phase resetting curves and phase dependent variance are fit to experimental data and the variance is computed using an ad-hoc method. The theoretical curves of this phase dependent method match both simulations and experimental data significantly better than an ad-hoc method. A dual cell network simulation is compared to predictions using the analytical phase dependent variance estimation presented in this paper. We also discuss how entrainment of a neuron to a periodic pulse depends on the noise amplitude.     

Stochastic models for inferring genetic regulation from microarray gene expression data

Microarray expression profiles are inherently noisy and many different sources of variation exist in microarray experiments. It is still a significant challenge to develop stochastic models to realize noise in microarray expression profiles, which has profound influence on the reverse engineering of genetic regulation. Using the target genes of the tumour suppressor gene p53 as the test problem, we developed stochastic differential equation models and established the relationship between the noise strength of stochastic models and parameters of an error model for describing the distribution of the microarray measurements. Numerical results indicate that the simulated variance from stochastic models with a stochastic degradation process can be represented by a monomial in terms of the hybridization intensity and the order of the monomial depends on the type of stochastic process. The developed stochastic models with multiple stochastic processes generated simulations whose variance is consistent with the prediction of the error model. This work also established a general method to develop stochastic models from experimental information.     

A principle of fractal-stochastic dualism and Gompertzian dynamics of growth and self-organization

The emergence of Gompertzian dynamics at the macroscopic, tissue level during growth and self-organization is determined by the existence of fractal-stochastic dualism at the microscopic level of supramolecular, cellular system. On one hand, Gompertzian dynamics results from the complex coupling of at least two antagonistic, stochastic processes at the molecular cellular level. It is shown that the Gompertz function is a probability function, its derivative is a probability density function, and the Gompertzian distribution of probability is of non-Gaussian type. On the other hand, the Gompertz function is a contraction mapping and defines fractal dynamics in time-space; a prerequisite condition for the coupling of processes. Furthermore, the Gompertz function is a solution of the operator differential equation with the Morse-like anharmonic potential. This relationship indicates that distribution of intrasystemic forces is both non-linear and asymmetric. The anharmonic potential is a measure of the intrasystemic interactions. It attains a point of the minimum (U(0), t(0)) along with a change of both complexity and connectivity during growth and self-organization. It can also be modified by certain factors, such as retinoids.     

On the Origins of Suboptimality in Human Probabilistic Inference

Humans have been shown to combine noisy sensory information with previous experience (priors), in qualitative and sometimes quantitative agreement with the statistically-optimal predictions of Bayesian integration. However, when the prior distribution becomes more complex than a simple Gaussian, such as skewed or bimodal, training takes much longer and performance appears suboptimal. It is unclear whether such suboptimality arises from an imprecise internal representation of the complex prior, or from additional constraints in performing probabilistic computations on complex distributions, even when accurately represented. Here we probe the sources of suboptimality in probabilistic inference using a novel estimation task in which subjects are exposed to an explicitly provided distribution, thereby removing the need to remember the prior. Subjects had to estimate the location of a target given a noisy cue and a visual representation of the prior probability density over locations, which changed on each trial. Different classes of priors were examined (Gaussian, unimodal, bimodal). Subjects'' performance was in qualitative agreement with the predictions of Bayesian Decision Theory although generally suboptimal. The degree of suboptimality was modulated by statistical features of the priors but was largely independent of the class of the prior and level of noise in the cue, suggesting that suboptimality in dealing with complex statistical features, such as bimodality, may be due to a problem of acquiring the priors rather than computing with them. We performed a factorial model comparison across a large set of Bayesian observer models to identify additional sources of noise and suboptimality. Our analysis rejects several models of stochastic behavior, including probability matching and sample-averaging strategies. Instead we show that subjects'' response variability was mainly driven by a combination of a noisy estimation of the parameters of the priors, and by variability in the decision process, which we represent as a noisy or stochastic posterior.     

Stochastic resonance in psychophysics and in animal behavior

 A recent analysis of the energy detector model in sensory psychophysics concluded that stochastic resonance does not occur in a measure of signal detectability (d′), but can occur in a percent-correct measure of performance as an epiphenomenon of nonoptimal criterion placement [Tougaard (2000) Biol Cybern 83: 471–480]. When generalized to signal detection in sensory systems in general, this conclusion is a serious challenge to the idea that stochastic resonance could play a significant role in sensory processing in humans and other animals. It also seems to be inconsistent with recent demonstrations of stochastic resonance in sensory systems of both nonhuman animals and humans using measures of system performance such as signal-to-noise ratio of power spectral densities and percent-correct detections in a two-interval forced-choice paradigm, both closely related to d′. In this paper we address this apparent dilemma by discussing several models of how stochastic resonance can arise in signal detection systems, including especially those that implement a “soft threshold” at the input transform stage. One example involves redefining d′ for energy increments in terms of parameters of the spike-count distribution of FitzHugh–Nagumo neurons. Another involves a Poisson spike generator that receives an exponentially transformed noisy periodic signal. In this case it can be shown that the signal-to-noise ratio of the power spectral density at the signal frequency, which exhibits stochastic resonance, is proportional to d′. Finally, a variant of d′ is shown to exhibit stochastic resonance when calculated directly from the distributions of power spectral densities at the signal frequency resulting from transformation of noise alone and a noisy signal by a sufficiently steep nonlinear response function. All of these examples, and others from the literature, imply that stochastic resonance is more than an epiphenomenon, although significant limitations to the extent to which adding noise can aid detection do exist. Received: 22 January 2001 / Accepted in revised form: 8 March 2002