Constructing stochastic models from deterministic process equations by propensity adjustment

Background

Models of biochemical systems are typically complex, which may complicate the discovery of cardinal biochemical principles. It is therefore important to single out the parts of a model that are essential for the function of the system, so that the remaining non-essential parts can be eliminated. However, each component of a mechanistic model has a clear biochemical interpretation, and it is desirable to conserve as much of this interpretability as possible in the reduction process. Furthermore, it is of great advantage if we can translate predictions from the reduced model to the original model.

Results

In this paper we present a novel method for model reduction that generates reduced models with a clear biochemical interpretation. Unlike conventional methods for model reduction our method enables the mapping of predictions by the reduced model to the corresponding detailed predictions by the original model. The method is based on proper lumping of state variables interacting on short time scales and on the computation of fraction parameters, which serve as the link between the reduced model and the original model. We illustrate the advantages of the proposed method by applying it to two biochemical models. The first model is of modest size and is commonly occurring as a part of larger models. The second model describes glucose transport across the cell membrane in baker's yeast. Both models can be significantly reduced with the proposed method, at the same time as the interpretability is conserved.

Conclusions

We introduce a novel method for reduction of biochemical models that is compatible with the concept of zooming. Zooming allows the modeler to work on different levels of model granularity, and enables a direct interpretation of how modifications to the model on one level affect the model on other levels in the hierarchy. The method extends the applicability of the method that was previously developed for zooming of linear biochemical models to nonlinear models.     

Methods of Model Reduction for Large-Scale Biological Systems: A Survey of Current Methods and Trends

Complex models of biochemical reaction systems have become increasingly common in the systems biology literature. The complexity of such models can present a number of obstacles for their practical use, often making problems difficult to intuit or computationally intractable. Methods of model reduction can be employed to alleviate the issue of complexity by seeking to eliminate those portions of a reaction network that have little or no effect upon the outcomes of interest, hence yielding simplified systems that retain an accurate predictive capacity. This review paper seeks to provide a brief overview of a range of such methods and their application in the context of biochemical reaction network models. To achieve this, we provide a brief mathematical account of the main methods including timescale exploitation approaches, reduction via sensitivity analysis, optimisation methods, lumping, and singular value decomposition-based approaches. Methods are reviewed in the context of large-scale systems biology type models, and future areas of research are briefly discussed.     

Lumping analysis of biochemical reaction systems with time scale separation

Due to the complexity of the systems, successful modelling of intracellular reaction networks must rely on lumping techniques which systematically reduce the number of variables and parameters. Fortunately, the time scale separation characteristics of biochemical systems provide opportunities for eliminating unnecessary details. Through the proper interpretation of eigenvalues and eigenvectors, this article presents a theoretical basis for systematic model reduction. Results are generalized as a semiheuristic basis for lumping systems without complete kinetic information. It is also illustrated that the simplified system can yield new insight which is otherwise unavailable.     

Development of models of active ion transport for whole-cell modelling: cardiac sodium-potassium pump as a case study

This study presents a method for the reduction of biophysically-based kinetic models for the active transport of ions. A lumping scheme is presented which exploits the differences in timescales associated with fast and slow transitions between model states, while maintaining the thermodynamic properties of the model. The goal of this approach is to contribute to modelling of the effects of disturbances to metabolism, associated with ischaemic heart disease, on cardiac cell function.

The approach is illustrated for the sodium-potassium pump in the myocyte. The lumping scheme is applied to produce a 4-state representation from the detailed 15-state model of Läuger and Apell, Eur. Biophys. J. 13 (1986) 309, for which the principles of free energy transduction are used to link the free energy released from ATP hydrolysis (ΔG_ATP) to the transition rates between states of the model. An iterative minimisation algorithm is implemented to determine the transition rate parameters based on the model fit to experimental data. Finally, the relationship between ΔG_ATP and pump cycling direction is investigated and compared with recent experimental findings.     

Linear systems approach to analysis of complex dynamic behaviours in biochemical networks

Central functions in the cell are often linked to complex dynamic behaviours, such as sustained oscillations and multistability, in a biochemical reaction network. Determination of the specific mechanisms underlying such behaviours is important, e.g. to determine sensitivity, robustness, and modelling requirements of given cell functions. In this work we adopt a systems approach to the analysis of complex behaviours in intracellular reaction networks, described by ordinary differential equations with known kinetic parameters. We propose to decompose the overall system into a number of low complexity subsystems, and consider the importance of interactions between these in generating specific behaviours. Rather than analysing the network in a state corresponding to the complex non-linear behaviour, we move the system to the underlying unstable steady state, and focus on the mechanisms causing destabilisation of this steady state. This is motivated by the fact that all complex behaviours in unforced systems can be traced to destabilisation (bifurcation) of some steady state, and hence enables us to use tools from linear system theory to qualitatively analyse the sources of given network behaviours. One important objective of the present study is to see how far one can come with a relatively simple approach to the analysis of highly complex biochemical networks. The proposed method is demonstrated by application to a model of mitotic control in Xenopus frog eggs, and to a model of circadian oscillations in Drosophila. In both examples we are able to identify the subsystems, and the related interactions, which are instrumental in generating the observed complex non-linear behaviours.     

Nonlinear PI controllers for continuous bioreactors using population balance models

Continuous bioreactors are critical unit operations in many biological systems, but the unique modeling is very complicated due to the underlying biochemical reactions and the distributed properties of cell population. The scope of this paper considers a popular modeling method for microbial cell cultures by population balance equation models, and the control objective aims to attenuate undesired oscillations appeared in the nonlinear distributed parameter system. In view of pursuing the popular/practical control configuration and the lack of on-line sensors, an approximate technique by exploiting the “pseudo-steady-state” approach constructs a simple nonlinear control model. Through an off-line estimation mechanism for the system having self-oscillating behavior, two kinds of nonlinear PI configurations are developed. Closed-loop simulation results have confirmed that the regulatory and tracking performances of the control system proposed are good.     

From intracellular signaling to population oscillations: bridging size- and time-scales in collective behavior

Collective behavior in cellular populations is coordinated by biochemical signaling networks within individual cells. Connecting the dynamics of these intracellular networks to the population phenomena they control poses a considerable challenge because of network complexity and our limited knowledge of kinetic parameters. However, from physical systems, we know that behavioral changes in the individual constituents of a collectively behaving system occur in a limited number of well-defined classes, and these can be described using simple models. Here, we apply such an approach to the emergence of collective oscillations in cellular populations of the social amoeba Dictyostelium discoideum. Through direct tests of our model with quantitative in vivo measurements of single-cell and population signaling dynamics, we show how a simple model can effectively describe a complex molecular signaling network at multiple size and temporal scales. The model predicts novel noise-driven single-cell and population-level signaling phenomena that we then experimentally observe. Our results suggest that like physical systems, collective behavior in biology may be universal and described using simple mathematical models.     

Systematic Computation of Nonlinear Cellular and Molecular Dynamics with Low-Power CytoMimetic Circuits: A Simulation Study

This paper presents a novel method for the systematic implementation of low-power microelectronic circuits aimed at computing nonlinear cellular and molecular dynamics. The method proposed is based on the Nonlinear Bernoulli Cell Formalism (NBCF), an advanced mathematical framework stemming from the Bernoulli Cell Formalism (BCF) originally exploited for the modular synthesis and analysis of linear, time-invariant, high dynamic range, logarithmic filters. Our approach identifies and exploits the striking similarities existing between the NBCF and coupled nonlinear ordinary differential equations (ODEs) typically appearing in models of naturally encountered biochemical systems. The resulting continuous-time, continuous-value, low-power CytoMimetic electronic circuits succeed in simulating fast and with good accuracy cellular and molecular dynamics. The application of the method is illustrated by synthesising for the first time microelectronic CytoMimetic topologies which simulate successfully: 1) a nonlinear intracellular calcium oscillations model for several Hill coefficient values and 2) a gene-protein regulatory system model. The dynamic behaviours generated by the proposed CytoMimetic circuits are compared and found to be in very good agreement with their biological counterparts. The circuits exploit the exponential law codifying the low-power subthreshold operation regime and have been simulated with realistic parameters from a commercially available CMOS process. They occupy an area of a fraction of a square-millimetre, while consuming between 1 and 12 microwatts of power. Simulations of fabrication-related variability results are also presented.     

Metabolic control analysis for large changes: extension to variable elasticity coefficients

Modular approaches are powerful systems biology strategies to deal with complexity. They consist in lumping conceptually all that is irrelevant to the problem under study, leaving explicit the portions of interest. Modular (or top-down) metabolic control analysis is a theoretical and experimental approach to study the sensitivity properties of complex metabolic systems. Initially, it was conceived for infinitesimal changes but, recently, it started to be developed for large metabolic changes. A central result of this approach is that the systemic properties, represented by control coefficients, can be expressed as a function of the properties of isolated modules, the elasticity coefficients. Here we extend the theory for large changes to the case that the elasticity coefficients depend on the extent of the change. The novel theory is used to analyse experimental data related to the control of glycolytic flux in Escherichia coli. Our analysis shows that the pattern of control for large changes is quantitatively and qualitatively different from the one obtained applying the infinitesimal treatment.     

Evaluating model reduction under parameter uncertainty

Background

The dynamics of biochemical networks can be modelled by systems of ordinary differential equations. However, these networks are typically large and contain many parameters. Therefore model reduction procedures, such as lumping, sensitivity analysis and time-scale separation, are used to simplify models. Although there are many different model reduction procedures, the evaluation of reduced models is difficult and depends on the parameter values of the full model. There is a lack of a criteria for evaluating reduced models when the model parameters are uncertain.

Results

We developed a method to compare reduced models and select the model that results in similar dynamics and uncertainty as the original model. We simulated different parameter sets from the assumed parameter distributions. Then, we compared all reduced models for all parameter sets using cluster analysis. The clusters revealed which of the reduced models that were similar to the original model in dynamics and variability. This allowed us to select the smallest reduced model that best approximated the full model. Through examples we showed that when parameter uncertainty was large, the model should be reduced further and when parameter uncertainty was small, models should not be reduced much.

Conclusions

A method to compare different models under parameter uncertainty is developed. It can be applied to any model reduction method. We also showed that the amount of parameter uncertainty influences the choice of reduced models.

     

Exact epidemic models on graphs using graph-automorphism driven lumping

The dynamics of disease transmission strongly depends on the properties of the population contact network. Pair-approximation models and individual-based network simulation have been used extensively to model contact networks with non-trivial properties. In this paper, using a continuous time Markov chain, we start from the exact formulation of a simple epidemic model on an arbitrary contact network and rigorously derive and prove some known results that were previously mainly justified based on some biological hypotheses. The main result of the paper is the illustration of the link between graph automorphisms and the process of lumping whereby the number of equations in a system of linear differential equations can be significantly reduced. The main advantage of lumping is that the simplified lumped system is not an approximation of the original system but rather an exact version of this. For a special class of graphs, we show how the lumped system can be obtained by using graph automorphisms. Finally, we discuss the advantages and possible applications of exact epidemic models and lumping.     

Control Analysis for Autonomously Oscillating Biochemical Networks

It has hitherto not been possible to analyze the control of oscillatory dynamic cellular processes in other than qualitative ways. The control coefficients, used in metabolic control analyses of steady states, cannot be applied directly to dynamic systems. We here illustrate a way out of this limitation that uses Fourier transforms to convert the time domain into the stationary frequency domain, and then analyses the control of limit cycle oscillations. In addition to the already known summation theorems for frequency and amplitude, we reveal summation theorems that apply to the control of average value, waveform, and phase differences of the oscillations. The approach is made fully operational in an analysis of yeast glycolytic oscillations. It follows an experimental approach, sampling from the model output and using discrete Fourier transforms of this data set. It quantifies the control of various aspects of the oscillations by the external glucose concentration and by various internal molecular processes. We show that the control of various oscillatory properties is distributed over the system enzymes in ways that differ among those properties. The models that are described in this paper can be accessed on http://jjj.biochem.sun.ac.za.     

A multiscale model for red blood cell mechanics

The objective of this article is the derivation of a continuum model for mechanics of red blood cells via multiscale analysis. On the microscopic level, we consider realistic discrete models in terms of energy functionals defined on networks/lattices. Using concepts of Γ-convergence, convergence results as well as explicit homogenisation formulae are derived. Based on a characterisation via energy functionals, appropriate macroscopic stress–strain relationships (constitutive equations) can be determined. Further, mechanical moduli of the derived macroscopic continuum model are directly related to microscopic moduli. As a test case we consider optical tweezers experiments, one of the most common experiments to study mechanical properties of cells. Our simulations of the derived continuum model are based on finite element methods and account explicitly for membrane mechanics and its coupling with bulk mechanics. Since the discretisation of the continuum model can be chosen freely, rather than it is given by the topology of the microscopic cytoskeletal network, the approach allows a significant reduction of computational efforts. Our approach is highly flexible and can be generalised to many other cell models, also including biochemical control.     

Virtual NEURON: a strategy for merged biochemical and electrophysiological modeling

Because of its highly branched dendrite, the Purkinje neuron requires significant computational resources if coupled electrical and biochemical activity are to be simulated. To address this challenge, we developed a scheme for reducing the geometric complexity; while preserving the essential features of activity in both the soma and a remote dendritic spine. We merged our previously published biochemical model of calcium dynamics and lipid signaling in the Purkinje neuron, developed in the Virtual Cell modeling and simulation environment, with an electrophysiological model based on a Purkinje neuron model available in NEURON. A novel reduction method was applied to the Purkinje neuron geometry to obtain a model with fewer compartments that is tractable in Virtual Cell. Most of the dendritic tree was subject to reduction, but we retained the neuron’s explicit electrical and geometric features along a specified path from spine to soma. Further, unlike previous simplification methods, the dendrites that branch off along the preserved explicit path are retained as reduced branches. We conserved axial resistivity and adjusted passive properties and active channel conductances for the reduction in surface area, and cytosolic calcium for the reduction in volume. Rallpacks are used to validate the reduction algorithm and show that it can be generalized to other complex neuronal geometries. For the Purkinje cell, we found that current injections at the soma were able to produce similar trains of action potentials and membrane potential propagation in the full and reduced models in NEURON; the reduced model produces identical spiking patterns in NEURON and Virtual Cell. Importantly, our reduced model can simulate communication between the soma and a distal spine; an alpha function applied at the spine to represent synaptic stimulation gave similar results in the full and reduced models for potential changes associated with both the spine and the soma. Finally, we combined phosphoinositol signaling and electrophysiology in the reduced model in Virtual Cell. Thus, a strategy has been developed to combine electrophysiology and biochemistry as a step toward merging neuronal and systems biology modeling.     

Dominant ionic mechanisms explored in spiking and bursting using local low-dimensional reductions of a biophysically realistic model neuron

The large number of variables involved in many biophysical models can conceal potentially simple dynamical mechanisms governing the properties of its solutions and the transitions between them as parameters are varied. To address this issue, we extend a novel model reduction method, based on “scales of dominance,” to multi-compartment models. We use this method to systematically reduce the dimension of a two-compartment conductance-based model of a crustacean pyloric dilator (PD) neuron that exhibits distinct modes of oscillation—tonic spiking, intermediate bursting and strong bursting. We divide trajectories into intervals dominated by a smaller number of variables, resulting in a locally reduced hybrid model whose dimension varies between two and six in different temporal regimes. The reduced model exhibits the same modes of oscillation as the 16 dimensional model over a comparable parameter range, and requires fewer ad hoc simplifications than a more traditional reduction to a single, globally valid model. The hybrid model highlights low-dimensional organizing structure in the dynamics of the PD neuron, and the dependence of its oscillations on parameters such as the maximal conductances of calcium currents. Our technique could be used to build hybrid low-dimensional models from any large multi-compartment conductance-based model in order to analyze the interactions between different modes of activity.