Modeling stochastic noise in gene regulatory systems

The Master equation is considered the gold standard for modeling the stochastic mechanisms of gene regulation in molecular detail, but it is too complex to solve exactly in most cases, so approximation and simulation methods are essential. However, there is still a lack of consensus about the best way to carry these out. To help clarify the situation, we review Master equation models of gene regulation, theoretical approximations based on an expansion method due to N.G. van Kampen and R. Kubo, and simulation algorithms due to D.T. Gillespie and P. Langevin. Expansion of the Master equation shows that for systems with a single stable steady-state, the stochastic model reduces to a deterministic model in a first-order approximation. Additional theory, also due to van Kampen, describes the asymptotic behavior of multistable systems. To support and illustrate the theory and provide further insight into the complex behavior of multistable systems, we perform a detailed simulation study comparing the various approximation and simulation methods applied to synthetic gene regulatory systems with various qualitative characteristics. The simulation studies show that for large stochastic systems with a single steady-state, deterministic models are quite accurate, since the probability distribution of the solution has a single peak tracking the deterministic trajectory whose variance is inversely proportional to the system size. In multistable stochastic systems, large fluctuations can cause individual trajectories to escape from the domain of attraction of one steady-state and be attracted to another, so the system eventually reaches a multimodal probability distribution in which all stable steady-states are represented proportional to their relative stability. However, since the escape time scales exponentially with system size, this process can take a very long time in large systems.     

Parameter inference for discretely observed stochastic kinetic models using stochastic gradient descent

Background  

Stochastic effects can be important for the behavior of processes involving small population numbers, so the study of stochastic models has become an important topic in the burgeoning field of computational systems biology. However analysis techniques for stochastic models have tended to lag behind their deterministic cousins due to the heavier computational demands of the statistical approaches for fitting the models to experimental data. There is a continuing need for more effective and efficient algorithms. In this article we focus on the parameter inference problem for stochastic kinetic models of biochemical reactions given discrete time-course observations of either some or all of the molecular species.     

NERDSS: A Nonequilibrium Simulator for Multibody Self-Assembly at the Cellular Scale

Currently, a significant barrier to building predictive models of cellular self-assembly processes is that molecular models cannot capture minutes-long dynamics that couple distinct components with active processes, whereas reaction-diffusion models cannot capture structures of molecular assembly. Here, we introduce the nonequilibrium reaction-diffusion self-assembly simulator (NERDSS), which addresses this spatiotemporal resolution gap. NERDSS integrates efficient reaction-diffusion algorithms into generalized software that operates on user-defined molecules through diffusion, binding and orientation, unbinding, chemical transformations, and spatial localization. By connecting the fast processes of binding with the slow timescales of large-scale assembly, NERDSS integrates molecular resolution with reversible formation of ordered, multisubunit complexes. NERDSS encodes models using rule-based formatting languages to facilitate model portability, usability, and reproducibility. Applying NERDSS to steps in clathrin-mediated endocytosis, we design multicomponent systems that can form lattices in solution or on the membrane, and we predict how stochastic but localized dephosphorylation of membrane lipids can drive lattice disassembly. The NERDSS simulations reveal the spatial constraints on lattice growth and the role of membrane localization and cooperativity in nucleating assembly. By modeling viral lattice assembly and recapitulating oscillations in protein expression levels for a circadian clock model, we illustrate the adaptability of NERDSS. NERDSS simulates user-defined assembly models that were previously inaccessible to existing software tools, with broad applications to predicting self-assembly in vivo and designing high-yield assemblies in vitro.     

Space as the final frontier in stochastic simulations of biological systems

Recent technological and theoretical advances are only now allowing the simulation of detailed kinetic models of biological systems that reflect the stochastic movement and reactivity of individual molecules within cellular compartments. The behavior of many systems could not be properly understood without this level of resolution, opening up new perspectives of using computer simulations to accelerate biological research. We review the modeling methodology applied to stochastic spatial models, also to the attention of non-expert potential users. Modeling choices, current limitations and perspectives of improvement of current general-purpose modeling/simulation platforms for biological systems are discussed.     

Accelerating the Gillespie Exact Stochastic Simulation Algorithm Using Hybrid Parallel Execution on Graphics Processing Units

The Gillespie Stochastic Simulation Algorithm (GSSA) and its variants are cornerstone techniques to simulate reaction kinetics in situations where the concentration of the reactant is too low to allow deterministic techniques such as differential equations. The inherent limitations of the GSSA include the time required for executing a single run and the need for multiple runs for parameter sweep exercises due to the stochastic nature of the simulation. Even very efficient variants of GSSA are prohibitively expensive to compute and perform parameter sweeps. Here we present a novel variant of the exact GSSA that is amenable to acceleration by using graphics processing units (GPUs). We parallelize the execution of a single realization across threads in a warp (fine-grained parallelism). A warp is a collection of threads that are executed synchronously on a single multi-processor. Warps executing in parallel on different multi-processors (coarse-grained parallelism) simultaneously generate multiple trajectories. Novel data-structures and algorithms reduce memory traffic, which is the bottleneck in computing the GSSA. Our benchmarks show an 8×−120× performance gain over various state-of-the-art serial algorithms when simulating different types of models.     

Multi-dimensional, mesoscopic Monte Carlo simulations of inhomogeneous reaction-drift-diffusion systems on graphics-processing units

For many biological applications, a macroscopic (deterministic) treatment of reaction-drift-diffusion systems is insufficient. Instead, one has to properly handle the stochastic nature of the problem and generate true sample paths of the underlying probability distribution. Unfortunately, stochastic algorithms are computationally expensive and, in most cases, the large number of participating particles renders the relevant parameter regimes inaccessible. In an attempt to address this problem we present a genuine stochastic, multi-dimensional algorithm that solves the inhomogeneous, non-linear, drift-diffusion problem on a mesoscopic level. Our method improves on existing implementations in being multi-dimensional and handling inhomogeneous drift and diffusion. The algorithm is well suited for an implementation on data-parallel hardware architectures such as general-purpose graphics processing units (GPUs). We integrate the method into an operator-splitting approach that decouples chemical reactions from the spatial evolution. We demonstrate the validity and applicability of our algorithm with a comprehensive suite of standard test problems that also serve to quantify the numerical accuracy of the method. We provide a freely available, fully functional GPU implementation. Integration into Inchman, a user-friendly web service, that allows researchers to perform parallel simulations of reaction-drift-diffusion systems on GPU clusters is underway.     

All systems go: launching cell simulation fueled by integrated experimental biology data

Biological simulation serves to unify the basic elements of systems biology, namely, model selection, experimentation and model refinement. To select biochemical models for simulation, metabolome analysis can be performed using capillary electrophoresis or liquid chromatography coupled with mass spectrometry. In this manner, selected models can be elaborated with temporal/spatial gene and protein expression data obtained from model organisms such as Escherichia coli. The E. coli single gene deletion mutant library (KO collection) and His-tag/GFP-fusion single open reading frame clone expression library (ASKA) are powerful resources for this task. The integration of parallel experimental datasets into dynamic simulation tools forms the remaining challenge for the systematic analysis and elucidation of biological networks and holds promise for biotechnological applications.     

Advances in TERS (tip-enhanced Raman scattering) for biochemical applications

TERS (tip-enhanced Raman scattering) provides exceptional spatial resolution without any need for labelling and has become a versatile tool for biochemical analysis. Two examples will be highlighted here. On the one hand, TERS measurements on a single mitochondrion are discussed, monitoring the oxidation state of the central iron ion of cytochrome c, leading towards a single protein characterization scheme in a natural environment. On the other hand, a novel approach of single molecule analysis is discussed, again based on TERS experiments on DNA and RNA, further highlighting the resolution capabilities of this method.     

Spatial stochastic modelling of the phosphoenolpyruvate-dependent phosphotransferase (PTS) pathway in Escherichia coli

MOTIVATION: Many biochemical networks involve reactions localized on the cell membrane. This can give rise to spatial gradients of the concentration of cytosolic species. Moreover, the number of membrane molecules can be small and stochastic effects can become relevant. Pathways usually consist of a complex interaction network and are characterized by a large set of parameters. The inclusion of spatial and stochastic effects is a major challenge in developing quantitative and dynamic models of pathways. RESULTS: We have developed a particle-based spatial stochastic method (GMP) to simulate biochemical networks in space, including fluctuations from the diffusion of particles and reactions. Gradients emerging from membrane reactions can be resolved. As case studies for the GMP method we used a simple gene expression system and the phosphoenolpyruvate:glucose phosphotransferase system pathway. AVAILABILITY: The source code for the GMP method is available at http://www.science.uva.nl/research/scs/CellMath/GMP.     

Accelerated maximum likelihood parameter estimation for stochastic biochemical systems

ABSTRACT: BACKGROUND: A prerequisite for the mechanistic simulation of a biochemical system is detailed knowledge of its kinetic parameters. Despite recent experimental advances, the estimation of unknown parameter values from observed data is still a bottleneck for obtaining accurate simulation results. Many methods exist for parameter estimation in deterministic biochemical systems; methods for discrete stochastic systems are less well developed. Given the probabilistic nature of stochastic biochemical models, a natural approach is to choose parameter values that maximize the probability of the observed data with respect to the unknown parameters, a.k.a. the maximum likelihood parameter estimates (MLEs). MLE computation for all but the simplest models requires the simulation of many system trajectories that are consistent with experimental data. For models with unknown parameters, this presents a computational challenge, as the generation of consistent trajectories can be an extremely rare occurrence. RESULTS: We have developed Monte Carlo Expectation-Maximization with Modified Cross-Entropy Method (MCEM2): an accelerated method for calculating MLEs that combines advances in rare event simulation with a computationally efficient version of the Monte Carlo expectation-maximization (MCEM) algorithm. Our method requires no prior knowledge regarding parameter values, and it automatically provides a multivariate parameter uncertainty estimate. We applied the method to five stochastic systems of increasing complexity, progressing from an analytically tractable pure-birth model to a computationally demanding model of yeast-polarization. Our results demonstrate that MCEM2 substantially accelerates MLE computation on all tested models when compared to a stand-alone version of MCEM. Additionally, we show how our method identifies parameter values for certain classes of models more accurately than two recently proposed computationally efficient methods. CONCLUSIONS: This work provides a novel, accelerated version of a likelihood-based parameter estimation method that can be readily applied to stochastic biochemical systems. In addition, our results suggest opportunities for added efficiency improvements that will further enhance our ability to mechanistically simulate biological processes.     

COPASI--a COmplex PAthway SImulator

MOTIVATION: Simulation and modeling is becoming a standard approach to understand complex biochemical processes. Therefore, there is a big need for software tools that allow access to diverse simulation and modeling methods as well as support for the usage of these methods. RESULTS: Here, we present COPASI, a platform-independent and user-friendly biochemical simulator that offers several unique features. We discuss numerical issues with these features; in particular, the criteria to switch between stochastic and deterministic simulation methods, hybrid deterministic-stochastic methods, and the importance of random number generator numerical resolution in stochastic simulation. AVAILABILITY: The complete software is available in binary (executable) for MS Windows, OS X, Linux (Intel) and Sun Solaris (SPARC), as well as the full source code under an open source license from http://www.copasi.org.     

Stochastic effects in intercellular calcium spiking in hepatocytes

We carry out a Monte Carlo simulation of stochastic effects for two models of intercellular calcium wave propagation in rat hepatocytes. Both models involve gap junction diffusion by a second messenger. We find that, in general, the stochastic effects improve agreement with experiment, for a reasonable choice of model parameters. Both stochastic models exhibit baseline fluctuations and variations in the peak heights of Ca(2+). In addition, we find for one model that there is a distribution of latency times, rather than a single latency time, with a distribution width which is comparable to the experimental observation of spike widths. We also find for the other model with low gap junction diffusion that it is possible for cell multiplets to oscillate independently initially, but to subsequently become synchronized.     

光学显微镜技术在活细胞单分子检测中的应用

单分子检测是一门以高度的时间以及空间分辨率研究生物单分子的技术。近来,科学技术的探索发展使我们可以观察、检测甚至操纵单个分子并且研究它们的构象变化和动力学行为。这一发展使得以前被传统系综研究体系平均化所隐藏的新信息被揭示出来。单分子检测技术的发展已经揭开了生命科学研究的新篇章。在本文中,我们将介绍有关活细胞中单分子检测技术的发展以及活细胞内单分子检测的现状。     

Multiplicative moments and measures of persistence in ecology

Ecologists and epidemiologists have begun focusing on demographic stochasticity and spatial heterogeneity as important biological factors. With high-powered computers simulation of such systems is a common modelling technique; however we lack a detailed understanding of the processes involved. Moment closure approximations provide a simple method which can be used to capture the main features of a wide variety of stochastic models and to gain a more intuitive understanding. In this paper we give an alternative variation based on multiplicative moments which is equivalent to taking a novel third-order cumulant approximation. The differential equations for these multiplicative moments are far more robust than their additive counterparts. We use this technique to consider the behaviour and persistence of finite metapopulations for two common ecological systems.