Optimal Feedback Strength for Noise Suppression in Autoregulatory Gene Networks

Autoregulatory feedback loops, where the protein expressed from a gene inhibits or activates its own expression are common gene network motifs within cells. In these networks, stochastic fluctuations in protein levels are attributed to two factors: intrinsic noise (i.e., the randomness associated with mRNA/protein expression and degradation) and extrinsic noise (i.e., the noise caused by fluctuations in cellular components such as enzyme levels and gene-copy numbers). We present results that predict the level of both intrinsic and extrinsic noise in protein numbers as a function of quantities that can be experimentally determined and/or manipulated, such as the response time of the protein and the level of feedback strength. In particular, we show that for a fixed average number of protein molecules, decreasing response times leads to attenuation of both protein intrinsic and extrinsic noise, with the extrinsic noise being more sensitive to changes in the response time. We further show that for autoregulatory networks with negative feedback, the protein noise levels can be minimal at an optimal level of feedback strength. For such cases, we provide an analytical expression for the highest level of noise suppression and the amount of feedback that achieves this minimal noise. These theoretical results are shown to be consistent and explain recent experimental observations. Finally, we illustrate how measuring changes in the protein noise levels as the feedback strength is manipulated can be used to determine the level of extrinsic noise in these gene networks.     

A Minimal Model of Signaling Network Elucidates Cell-to-Cell Stochastic Variability in Apoptosis

Background

Signaling networks are designed to sense an environmental stimulus and adapt to it. We propose and study a minimal model of signaling network that can sense and respond to external stimuli of varying strength in an adaptive manner. The structure of this minimal network is derived based on some simple assumptions on its differential response to external stimuli.

Methodology

We employ stochastic differential equations and probability distributions obtained from stochastic simulations to characterize differential signaling response in our minimal network model. Gillespie''s stochastic simulation algorithm (SSA) is used in this study.

Conclusions/Significance

We show that the proposed minimal signaling network displays two distinct types of response as the strength of the stimulus is decreased. The signaling network has a deterministic part that undergoes rapid activation by a strong stimulus in which case cell-to-cell fluctuations can be ignored. As the strength of the stimulus decreases, the stochastic part of the network begins dominating the signaling response where slow activation is observed with characteristic large cell-to-cell stochastic variability. Interestingly, this proposed stochastic signaling network can capture some of the essential signaling behaviors of a complex apoptotic cell death signaling network that has been studied through experiments and large-scale computer simulations. Thus we claim that the proposed signaling network is an appropriate minimal model of apoptosis signaling. Elucidating the fundamental design principles of complex cellular signaling pathways such as apoptosis signaling remains a challenging task. We demonstrate how our proposed minimal model can help elucidate the effect of a specific apoptotic inhibitor Bcl-2 on apoptotic signaling in a cell-type independent manner. We also discuss the implications of our study in elucidating the adaptive strategy of cell death signaling pathways.     

Colored extrinsic fluctuations and stochastic gene expression

Stochasticity is both exploited and controlled by cells. Although the intrinsic stochasticity inherent in biochemistry is relatively well understood, cellular variation, or ‘noise’, is predominantly generated by interactions of the system of interest with other stochastic systems in the cell or its environment. Such extrinsic fluctuations are nonspecific, affecting many system components, and have a substantial lifetime, comparable to the cell cycle (they are ‘colored’). Here, we extend the standard stochastic simulation algorithm to include extrinsic fluctuations. We show that these fluctuations affect mean protein numbers and intrinsic noise, can speed up typical network response times, and can explain trends in high‐throughput measurements of variation. If extrinsic fluctuations in two components of the network are correlated, they may combine constructively (amplifying each other) or destructively (attenuating each other). Consequently, we predict that incoherent feedforward loops attenuate stochasticity, while coherent feedforwards amplify it. Our results demonstrate that both the timescales of extrinsic fluctuations and their nonspecificity substantially affect the function and performance of biochemical networks.     

Adjusting phenotypes by noise control

Genetically identical cells can show phenotypic variability. This is often caused by stochastic events that originate from randomness in biochemical processes involving in gene expression and other extrinsic cellular processes. From an engineering perspective, there have been efforts focused on theory and experiments to control noise levels by perturbing and replacing gene network components. However, systematic methods for noise control are lacking mainly due to the intractable mathematical structure of noise propagation through reaction networks. Here, we provide a numerical analysis method by quantifying the parametric sensitivity of noise characteristics at the level of the linear noise approximation. Our analysis is readily applicable to various types of noise control and to different types of system; for example, we can orthogonally control the mean and noise levels and can control system dynamics such as noisy oscillations. As an illustration we applied our method to HIV and yeast gene expression systems and metabolic networks. The oscillatory signal control was applied to p53 oscillations from DNA damage. Furthermore, we showed that the efficiency of orthogonal control can be enhanced by applying extrinsic noise and feedback. Our noise control analysis can be applied to any stochastic model belonging to continuous time Markovian systems such as biological and chemical reaction systems, and even computer and social networks. We anticipate the proposed analysis to be a useful tool for designing and controlling synthetic gene networks.     

Quantifying Stochastic Noise in Cultured Circadian Reporter Cells

Stochastic noise at the cellular level has been shown to play a fundamental role in circadian oscillations, influencing how groups of cells entrain to external cues and likely serving as the mechanism by which cell-autonomous rhythms are generated. Despite this importance, few studies have investigated how clock perturbations affect stochastic noise—even as increasing numbers of high-throughput screens categorize how gene knockdowns or small molecules can change clock period and amplitude. This absence is likely due to the difficulty associated with measuring cell-autonomous stochastic noise directly, which currently requires the careful collection and processing of single-cell data. In this study, we show that the damping rate of population-level bioluminescence recordings can serve as an accurate measure of overall stochastic noise, and one that can be applied to future and existing high-throughput circadian screens. Using cell-autonomous fibroblast data, we first show directly that higher noise at the single-cell results in faster damping at the population level. Next, we show that the damping rate of cultured cells can be changed in a dose-dependent fashion by small molecule modulators, and confirm that such a change can be explained by single-cell noise using a mathematical model. We further demonstrate the insights that can be gained by applying our method to a genome-wide siRNA screen, revealing that stochastic noise is altered independently from period, amplitude, and phase. Finally, we hypothesize that the unperturbed clock is highly optimized for robust rhythms, as very few gene perturbations are capable of simultaneously increasing amplitude and lowering stochastic noise. Ultimately, this study demonstrates the importance of considering the effect of circadian perturbations on stochastic noise, particularly with regard to the development of small-molecule circadian therapeutics.     

Network-based analysis of stochastic SIR epidemic models with random and proportionate mixing

In this paper, we outline the theory of epidemic percolation networks and their use in the analysis of stochastic susceptible-infectious-removed (SIR) epidemic models on undirected contact networks. We then show how the same theory can be used to analyze stochastic SIR models with random and proportionate mixing. The epidemic percolation networks for these models are purely directed because undirected edges disappear in the limit of a large population. In a series of simulations, we show that epidemic percolation networks accurately predict the mean outbreak size and probability and final size of an epidemic for a variety of epidemic models in homogeneous and heterogeneous populations. Finally, we show that epidemic percolation networks can be used to re-derive classical results from several different areas of infectious disease epidemiology. In an Appendix, we show that an epidemic percolation network can be defined for any time-homogeneous stochastic SIR model in a closed population and prove that the distribution of outbreak sizes given the infection of any given node in the SIR model is identical to the distribution of its out-component sizes in the corresponding probability space of epidemic percolation networks. We conclude that the theory of percolation on semi-directed networks provides a very general framework for the analysis of stochastic SIR models in closed populations.     

Ecological consequences of colony structure in dynamic ant nest networks

Access to resources depends on an individual's position within the environment. This is particularly important to animals that invest heavily in nest construction, such as social insects. Many ant species have a polydomous nesting strategy: a single colony inhabits several spatially separated nests, often exchanging resources between the nests. Different nests in a polydomous colony potentially have differential access to resources, but the ecological consequences of this are unclear. In this study, we investigate how nest survival and budding in polydomous wood ant (Formica lugubris) colonies are affected by being part of a multi‐nest system. Using field data and novel analytical approaches combining survival models with dynamic network analysis, we show that the survival and budding of nests within a polydomous colony are affected by their position in the nest network structure. Specifically, we find that the flow of resources through a nest, which is based on its position within the wider nest network, determines a nest's likelihood of surviving and of founding new nests. Our results highlight how apparently disparate entities in a biological system can be integrated into a functional ecological unit. We also demonstrate how position within a dynamic network structure can have important ecological consequences.     

Robustness Analysis of Stochastic Biochemical Systems

We propose a new framework for rigorous robustness analysis of stochastic biochemical systems that is based on probabilistic model checking techniques. We adapt the general definition of robustness introduced by Kitano to the class of stochastic systems modelled as continuous time Markov Chains in order to extensively analyse and compare robustness of biological models with uncertain parameters. The framework utilises novel computational methods that enable to effectively evaluate the robustness of models with respect to quantitative temporal properties and parameters such as reaction rate constants and initial conditions. We have applied the framework to gene regulation as an example of a central biological mechanism where intrinsic and extrinsic stochasticity plays crucial role due to low numbers of DNA and RNA molecules. Using our methods we have obtained a comprehensive and precise analysis of stochastic dynamics under parameter uncertainty. Furthermore, we apply our framework to compare several variants of two-component signalling networks from the perspective of robustness with respect to intrinsic noise caused by low populations of signalling components. We have successfully extended previous studies performed on deterministic models (ODE) and showed that stochasticity may significantly affect obtained predictions. Our case studies demonstrate that the framework can provide deeper insight into the role of key parameters in maintaining the system functionality and thus it significantly contributes to formal methods in computational systems biology.     

Comparison of Deterministic and Stochastic Models of the lac Operon Genetic Network

The lac operon has been a paradigm for genetic regulation with positive feedback, and several modeling studies have described its dynamics at various levels of detail. However, it has not yet been analyzed how stochasticity can enrich the system's behavior, creating effects that are not observed in the deterministic case. To address this problem we use a comparative approach. We develop a reaction network for the dynamics of the lac operon genetic switch and derive corresponding deterministic and stochastic models that incorporate biological details. We then analyze the effects of key biomolecular mechanisms, such as promoter strength and binding affinities, on the behavior of the models. No assumptions or approximations are made when building the models other than those utilized in the reaction network. Thus, we are able to carry out a meaningful comparison between the predictions of the two models to demonstrate genuine effects of stochasticity. Such a comparison reveals that in the presence of stochasticity, certain biomolecular mechanisms can profoundly influence the region where the system exhibits bistability, a key characteristic of the lac operon dynamics. For these cases, the temporal asymptotic behavior of the deterministic model remains unchanged, indicating a role of stochasticity in modulating the behavior of the system.     

A Deterministic Model Predicts the Properties of Stochastic Calcium Oscillations in Airway Smooth Muscle Cells

The inositol trisphosphate receptor () is one of the most important cellular components responsible for oscillations in the cytoplasmic calcium concentration. Over the past decade, two major questions about the have arisen. Firstly, how best should the be modeled? In other words, what fundamental properties of the allow it to perform its function, and what are their quantitative properties? Secondly, although calcium oscillations are caused by the stochastic opening and closing of small numbers of , is it possible for a deterministic model to be a reliable predictor of calcium behavior? Here, we answer these two questions, using airway smooth muscle cells (ASMC) as a specific example. Firstly, we show that periodic calcium waves in ASMC, as well as the statistics of calcium puffs in other cell types, can be quantitatively reproduced by a two-state model of the , and thus the behavior of the is essentially determined by its modal structure. The structure within each mode is irrelevant for function. Secondly, we show that, although calcium waves in ASMC are generated by a stochastic mechanism, stochasticity is not essential for a qualitative prediction of how oscillation frequency depends on model parameters, and thus deterministic models demonstrate the same level of predictive capability as do stochastic models. We conclude that, firstly, calcium dynamics can be accurately modeled using simplified models, and, secondly, to obtain qualitative predictions of how oscillation frequency depends on parameters it is sufficient to use a deterministic model.     

Modeling and stochastic simulation of the Ras/cAMP/PKA pathway in the yeast Saccharomyces cerevisiae evidences a key regulatory function for intracellular guanine nucleotides pools

In the yeast Saccharomyces cerevisiae, the Ras/cAMP/PKA pathway is involved in the regulation of metabolism and cell cycle progression. The pathway is tightly regulated by several control mechanisms, as the feedback cycle ruled by the activity of phosphodiesterase. Here, we present a discrete mathematical model for the Ras/cAMP/PKA pathway that considers its principal cytoplasmic components and their mutual interactions. The tau-leaping algorithm is then used to perform stochastic simulations of the model. We investigate this system under various conditions, and we test how different values of several stochastic reaction constants affect the pathway behaviour. Finally, we show that the level of guanine nucleotides, GTP and GDP, could be relevant metabolic signals for the regulation of the whole pathway.     

The Interplay of Intrinsic and Extrinsic Bounded Noises in Biomolecular Networks

After being considered as a nuisance to be filtered out, it became recently clear that biochemical noise plays a complex role, often fully functional, for a biomolecular network. The influence of intrinsic and extrinsic noises on biomolecular networks has intensively been investigated in last ten years, though contributions on the co-presence of both are sparse. Extrinsic noise is usually modeled as an unbounded white or colored gaussian stochastic process, even though realistic stochastic perturbations are clearly bounded. In this paper we consider Gillespie-like stochastic models of nonlinear networks, i.e. the intrinsic noise, where the model jump rates are affected by colored bounded extrinsic noises synthesized by a suitable biochemical state-dependent Langevin system. These systems are described by a master equation, and a simulation algorithm to analyze them is derived. This new modeling paradigm should enlarge the class of systems amenable at modeling. We investigated the influence of both amplitude and autocorrelation time of a extrinsic Sine-Wiener noise on: the Michaelis-Menten approximation of noisy enzymatic reactions, which we show to be applicable also in co-presence of both intrinsic and extrinsic noise, a model of enzymatic futile cycle and a genetic toggle switch. In and we show that the presence of a bounded extrinsic noise induces qualitative modifications in the probability densities of the involved chemicals, where new modes emerge, thus suggesting the possible functional role of bounded noises.     

Semiclassical approximations of stochastic epidemiological processes towards parameter estimation using as prime example the SIS system with import

In this paper we investigate several schemes to approximate the stationary distribution of the stochastic SIS system with import. We begin by presenting the model and analytically computing its stationary distribution. We then approximate this distribution using Kramers–Moyal approximation, van Kampen's system size expansion, and a semiclassical scheme, also called WKB or eikonal approximation depending on its different applications in physics. For the semiclassical scheme, done in the context of the Hamilton–Jacobi formalism, two approaches are taken. In the first approach we assume a semiclassical ansatz for the generating function, while in the second the solution of the master equation is approximated directly. The different schemes are compared and the semiclassical approximation, which performs better, is then used to analyse the time dependent solution of stochastic systems for which no analytical expression is known. Stochastic epidemiological models are studied in order to investigate how far such semiclassical approximations can be used for parameter estimation.     

Matching–centrality decomposition and the forecasting of new links in networks

Networks play a prominent role in the study of complex systems of interacting entities in biology, sociology, and economics. Despite this diversity, we demonstrate here that a statistical model decomposing networks into matching and centrality components provides a comprehensive and unifying quantification of their architecture. The matching term quantifies the assortative structure in which node makes links with which other node, whereas the centrality term quantifies the number of links that nodes make. We show, for a diverse set of networks, that this decomposition can provide a tight fit to observed networks. Then we provide three applications. First, we show that the model allows very accurate prediction of missing links in partially known networks. Second, when node characteristics are known, we show how the matching–centrality decomposition can be related to this external information. Consequently, it offers us a simple and versatile tool to explore how node characteristics explain network architecture. Finally, we demonstrate the efficiency and flexibility of the model to forecast the links that a novel node would create if it were to join an existing network.     

Population rate coding in recurrent neuronal networks with unreliable synapses

Neuron transmits spikes to postsynaptic neurons through synapses. Experimental observations indicated that the communication between neurons is unreliable. However most modelling and computational studies considered deterministic synaptic interaction model. In this paper, we investigate the population rate coding in an all-to-all coupled recurrent neuronal network consisting of both excitatory and inhibitory neurons connected with unreliable synapses. We use a stochastic on-off process to model the unreliable synaptic transmission. We find that synapses with suitable successful transmission probability can enhance the encoding performance in the case of weak noise; while in the case of strong noise, the synaptic interactions reduce the encoding performance. We also show that several important synaptic parameters, such as the excitatory synaptic strength, the relative strength of inhibitory and excitatory synapses, as well as the synaptic time constant, have significant effects on the performance of the population rate coding. Further simulations indicate that the encoding dynamics of our considered network cannot be simply determined by the average amount of received neurotransmitter for each neuron in a time instant. Moreover, we compare our results with those obtained in the corresponding random neuronal networks. Our numerical results demonstrate that the network randomness has the similar qualitative effect as the synaptic unreliability but not completely equivalent in quantity.     

Stochastic Heterogeneous Interaction Promotes Cooperation in Spatial Prisoner's Dilemma Game

Previous studies mostly investigate player''s cooperative behavior as affected by game time-scale or individual diversity. In this paper, by involving both time-scale and diversity simultaneously, we explore the effect of stochastic heterogeneous interaction. In our model, the occurrence of game interaction between each pair of linked player obeys a random probability, which is further described by certain distributions. Simulations on a 4-neighbor square lattice show that the cooperation level is remarkably promoted when stochastic heterogeneous interaction is considered. The results are then explained by investigating the mean payoffs, the mean boundary payoffs and the transition probabilities between cooperators and defectors. We also show some typical snapshots and evolution time series of the system. Finally, the 8-neighbor square lattice and BA scale-free network results indicate that the stochastic heterogeneous interaction can be robust against different network topologies. Our work may sharpen the understanding of the joint effect of game time-scale and individual diversity on spatial games.     

Joint modelling of repeated transitions in follow-up data--a case study on breast cancer data

In longitudinal studies where time to a final event is the ultimate outcome often information is available about intermediate events the individuals may experience during the observation period. Even though many extensions of the Cox proportional hazards model have been proposed to model such multivariate time-to-event data these approaches are still very rarely applied to real datasets. The aim of this paper is to illustrate the application of extended Cox models for multiple time-to-event data and to show their implementation in popular statistical software packages. We demonstrate a systematic way of jointly modelling similar or repeated transitions in follow-up data by analysing an event-history dataset consisting of 270 breast cancer patients, that were followed-up for different clinical events during treatment in metastatic disease. First, we show how this methodology can also be applied to non Markovian stochastic processes by representing these processes as "conditional" Markov processes. Secondly, we compare the application of different Cox-related approaches to the breast cancer data by varying their key model components (i.e. analysis time scale, risk set and baseline hazard function). Our study showed that extended Cox models are a powerful tool for analysing complex event history datasets since the approach can address many dynamic data features such as multiple time scales, dynamic risk sets, time-varying covariates, transition by covariate interactions, autoregressive dependence or intra-subject correlation.