Evaluation of Multitype Mathematical Models for CFSE-Labeling Experiment Data

Carboxy-fluorescein diacetate succinimidyl ester (CFSE) labeling is an important experimental tool for measuring cell responses to extracellular signals in biomedical research. However, changes of the cell cycle (e.g., time to division) corresponding to different stimulations cannot be directly characterized from data collected in CFSE-labeling experiments. A number of independent studies have developed mathematical models as well as parameter estimation methods to better understand cell cycle kinetics based on CFSE data. However, when applying different models to the same data set, notable discrepancies in parameter estimates based on different models has become an issue of great concern. It is therefore important to compare existing models and make recommendations for practical use. For this purpose, we derived the analytic form of an age-dependent multitype branching process model. We then compared the performance of different models, namely branching process, cyton, Smith–Martin, and a linear birth–death ordinary differential equation (ODE) model via simulation studies. For fairness of model comparison, simulated data sets were generated using an agent-based simulation tool which is independent of the four models that are compared. The simulation study results suggest that the branching process model significantly outperforms the other three models over a wide range of parameter values. This model was then employed to understand the proliferation pattern of CD4+ and CD8+ T cells under polyclonal stimulation.     

When the optimal is not the best: parameter estimation in complex biological models

Background

The vast computational resources that became available during the past decade enabled the development and simulation of increasingly complex mathematical models of cancer growth. These models typically involve many free parameters whose determination is a substantial obstacle to model development. Direct measurement of biochemical parameters in vivo is often difficult and sometimes impracticable, while fitting them under data-poor conditions may result in biologically implausible values.

Results

We discuss different methodological approaches to estimate parameters in complex biological models. We make use of the high computational power of the Blue Gene technology to perform an extensive study of the parameter space in a model of avascular tumor growth. We explicitly show that the landscape of the cost function used to optimize the model to the data has a very rugged surface in parameter space. This cost function has many local minima with unrealistic solutions, including the global minimum corresponding to the best fit.

Conclusions

The case studied in this paper shows one example in which model parameters that optimally fit the data are not necessarily the best ones from a biological point of view. To avoid force-fitting a model to a dataset, we propose that the best model parameters should be found by choosing, among suboptimal parameters, those that match criteria other than the ones used to fit the model. We also conclude that the model, data and optimization approach form a new complex system and point to the need of a theory that addresses this problem more generally.     

Modeling Imatinib-Treated Chronic Myelogenous Leukemia: Reducing the Complexity of Agent-Based Models

We develop a model for describing the dynamics of imatinib-treated chronic myelogenous leukemia. Our model is based on replacing the recent agent-based model of Roeder et al. (Nat. Med. 12(10):1181–1184, 2006) by a system of deterministic difference equations. These difference equations describe the time-evolution of clusters of individual agents that are grouped by discretizing the state space. Hence, unlike standard agent-base models, the complexity of our model is independent of the number of agents, which allows to conduct simulation studies with a realistic number of cells. This approach also allows to directly evaluate the expected steady states of the system. The results of our numerical simulations show that our model replicates the averaged behavior of the original Roeder model with a significantly reduced computational cost. Our general approach can be used to simplify other similar agent-based models. In particular, due to the reduced computational complexity of our technique, one can use it to conduct sensitivity studies of the parameters in large agent-based systems.     

Reproducibility and usability of chronic virus infection model using agent-based simulation; comparing with a mathematical model

We created agent-based models that visually simulate conditions of chronic viral infections using two software. The results from two models were consistent, when they have same parameters during the actual simulation. The simulation results comprise a transient phase and an equilibrium phase, and unlike the mathematical model, virus count transit smoothly to the equilibrium phase without overshooting which correlates with actual biology in vivo of certain viruses. We investigated the effects caused by varying all the parameters included in concept; increasing virus lifespan, uninfected cell lifespan, uninfected cell regeneration rate, virus production count from infected cells, and infection rate had positive effects to the virus count during the equilibrium period, whereas increasing the latent period, the lifespan-shortening ratio for infected cells, and the cell cycle speed had negative effects. Virus count at the start did not influence the equilibrium conditions, but it influenced the infection development rate. The space size had no intrinsic effect on the equilibrium period, but virus count maximized when the virus moving speed was twice the space size. These agent-based simulation models reproducibly provide a visual representation of the disease, and enable a simulation that encompasses parameters those are difficult to account for in a mathematical model.     

Exploring the gap between dynamic and constraint-based models of metabolism

Systems biology provides new approaches for metabolic engineering through the development of models and methods for simulation and optimization of microbial metabolism. Here we explore the relationship between two modeling frameworks in common use namely, dynamic models with kinetic rate laws and constraint-based flux models. We compare and analyze dynamic and constraint-based formulations of the same model of the central carbon metabolism of Escherichia coli. Our results show that, if unconstrained, the space of steady states described by both formulations is the same. However, the imposition of parameter-range constraints can be mapped into kinetically feasible regions of the solution space for the dynamic formulation that is not readily transferable to the constraint-based formulation. Therefore, with partial kinetic parameter knowledge, dynamic models can be used to generate constraints that reduce the solution space below that identified by constraint-based models, eliminating infeasible solutions and increasing the accuracy of simulation and optimization methods.     

森林-农业景观格局变化的社会-生态系统模拟模型方法进展

社会-生态系统（SES）模拟模型是景观格局分析和决策的有效工具,能表征景观格局变化的社会-生态效应及景观决策的复杂反馈机制。文献综述了森林-农业景观格局的SES模型方法进展发现：（1）多数模型对景观过程与社会经济决策的反馈关系分析不足;（2）应集成多种情景模拟和景观效应分析方法,完善现有SES模型的理论方法基础;（3）通过集成格局优化模型和自主体模型会有效改进SES模型功能,具体途径包括：集成情景-生态效应的景观格局模拟方法、完善景观决策的理论基础、加强集成模型的不确定性分析、降低模型复杂性和综合定性-定量数据等。研究结果有助于理解多尺度森林-农业景观格局在社会-生态系统中的重要作用,能更好地支持跨学科集成模型开发与应用。     

From steady-state to synchronized yeast glycolytic oscillations I: model construction

An existing detailed kinetic model for the steady-state behavior of yeast glycolysis was tested for its ability to simulate dynamic behavior. Using a small subset of experimental data, the original model was adapted by adjusting its parameter values in three optimization steps. Only small adaptations to the original model were required for realistic simulation of experimental data for limit-cycle oscillations. The greatest changes were required for parameter values for the phosphofructokinase reaction. The importance of ATP for the oscillatory mechanism and NAD(H) for inter-and intra-cellular communications and synchronization was evident in the optimization steps and simulation experiments. In an accompanying paper [du Preez F et al. (2012) FEBS J279, 2823-2836], we validate the model for a wide variety of experiments on oscillatory yeast cells. The results are important for re-use of detailed kinetic models in modular modeling approaches and for approaches such as that used in the Silicon Cell initiative. DATABASE: The mathematical models described here have been submitted to the JWS Online Cellular Systems Modelling Database and can be accessed at http://jjj.biochem.sun.ac.za/database/dupreez/index.html.     

Instability of the steady state solution in cell cycle population structure models with feedback

We show that when cell–cell feedback is added to a model of the cell cycle for a large population of cells, then instability of the steady state solution occurs in many cases. We show this in the context of a generic agent-based ODE model. If the feedback is positive, then instability of the steady state solution is proved for all parameter values except for a small set on the boundary of parameter space. For negative feedback we prove instability for half the parameter space. We also show by example that instability in the other half may be proved on a case by case basis.

     

Mathematical and kinetic modeling of biofilm reactor based on ant colony optimization

Inverse estimation of model parameters via mathematical modeling route, known as inverse modeling (IM), is an attractive alternative approach to the experimental methods. This approach makes use of efficient optimization techniques in the course of solution of an inverse problem with the aid of measured data. In this study, a novel optimization method based on ant colony optimization (ACO), denoted by ACO-IM, is presented for inverse estimation of kinetic and film thickness parameters of biofilm models that describe an experimental fixed bed anaerobic reactor. The proposed optimization method for parameter estimation emulates the fact that ants are capable of finding the shortest path from a food source to their nest by depositing a trial of pheromone during their walk. The efficacy of the ACO-IM for numerical estimation of bio-kinetic parameters is demonstrated through its application for the anaerobic treatment of industry wastewater in a fixed bed biofilm process. The results explain the rigorousness of mathematical models, the form of kinetic and film thickness models and the type of packing to be used with the biofilm process for accurate determination of kinetic and film thickness parameters so as to ensure reliable predictive performance of the biofilm reactor models.     

Efficient parameter estimation for spatio-temporal models of pattern formation: case study of Drosophila melanogaster

MOTIVATION: Diffusable and non-diffusable gene products play a major role in body plan formation. A quantitative understanding of the spatio-temporal patterns formed in body plan formation, by using simulation models is an important addition to experimental observation. The inverse modelling approach consists of describing the body plan formation by a rule-based model, and fitting the model parameters to real observed data. In body plan formation, the data are usually obtained from fluorescent immunohistochemistry or in situ hybridizations. Inferring model parameters by comparing such data to those from simulation is a major computational bottleneck. An important aspect in this process is the choice of method used for parameter estimation. When no information on parameters is available, parameter estimation is mostly done by means of heuristic algorithms. RESULTS: We show that parameter estimation for pattern formation models can be efficiently performed using an evolution strategy (ES). As a case study we use a quantitative spatio-temporal model of the regulatory network for early development in Drosophila melanogaster. In order to estimate the parameters, the simulated results are compared to a time series of gene products involved in the network obtained with immunohistochemistry. We demonstrate that a (mu,lambda)-ES can be used to find good quality solutions in the parameter estimation. We also show that an ES with multiple populations is 5-140 times as fast as parallel simulated annealing for this case study, and that combining ES with a local search results in an efficient parameter estimation method.     

A neuromusculoskeletal tracking method for estimating individual muscle forces in human movement

A neuromusculoskeletal tracking (NMT) method was developed to estimate muscle forces from observed motion data. The NMT method combines skeletal motion tracking and optimal neuromuscular tracking to produce forward simulations of human movement quickly and accurately. The skeletal motion tracker calculates the joint torques needed to actuate a skeletal model and track observed segment angles and ground forces in a forward simulation of the motor task. The optimal neuromuscular tracker resolves the muscle redundancy problem dynamically and finds the muscle excitations (and muscle forces) needed to produce the joint torques calculated by the skeletal motion tracker. To evaluate the accuracy of the NMT method, kinematics and ground forces obtained from an optimal control (parameter optimization) solution for maximum-height jumping were contaminated with both random and systematic noise. These data served as input observations to the NMT method as well as an inverse dynamics analysis. The NMT solution was compared to the input observations, the original optimal solution, and a simulation driven by the inverse dynamics torques. The results show that, in contrast to inverse dynamics, the NMT method is able to produce an accurate forward simulation consistent with the optimal control solution. The NMT method also requires 3 orders-of-magnitude less CPU time than parameter optimization. The speed and accuracy of the NMT method make it a promising new tool for estimating muscle forces using experimentally obtained kinematics and ground force data.     

Comparing Stochastic Differential Equations and Agent-Based Modelling and Simulation for Early-Stage Cancer

There is great potential to be explored regarding the use of agent-based modelling and simulation as an alternative paradigm to investigate early-stage cancer interactions with the immune system. It does not suffer from some limitations of ordinary differential equation models, such as the lack of stochasticity, representation of individual behaviours rather than aggregates and individual memory. In this paper we investigate the potential contribution of agent-based modelling and simulation when contrasted with stochastic versions of ODE models using early-stage cancer examples. We seek answers to the following questions: (1) Does this new stochastic formulation produce similar results to the agent-based version? (2) Can these methods be used interchangeably? (3) Do agent-based models outcomes reveal any benefit when compared to the Gillespie results? To answer these research questions we investigate three well-established mathematical models describing interactions between tumour cells and immune elements. These case studies were re-conceptualised under an agent-based perspective and also converted to the Gillespie algorithm formulation. Our interest in this work, therefore, is to establish a methodological discussion regarding the usability of different simulation approaches, rather than provide further biological insights into the investigated case studies. Our results show that it is possible to obtain equivalent models that implement the same mechanisms; however, the incapacity of the Gillespie algorithm to retain individual memory of past events affects the similarity of some results. Furthermore, the emergent behaviour of ABMS produces extra patters of behaviour in the system, which was not obtained by the Gillespie algorithm.     

Parameter optimization by using differential elimination: a general approach for introducing constraints into objective functions

Background

The investigation of network dynamics is a major issue in systems and synthetic biology. One of the essential steps in a dynamics investigation is the parameter estimation in the model that expresses biological phenomena. Indeed, various techniques for parameter optimization have been devised and implemented in both free and commercial software. While the computational time for parameter estimation has been greatly reduced, due to improvements in calculation algorithms and the advent of high performance computers, the accuracy of parameter estimation has not been addressed.

Results

We propose a new approach for parameter optimization by using differential elimination, to estimate kinetic parameter values with a high degree of accuracy. First, we utilize differential elimination, which is an algebraic approach for rewriting a system of differential equations into another equivalent system, to derive the constraints between kinetic parameters from differential equations. Second, we estimate the kinetic parameters introducing these constraints into an objective function, in addition to the error function of the square difference between the measured and estimated data, in the standard parameter optimization method. To evaluate the ability of our method, we performed a simulation study by using the objective function with and without the newly developed constraints: the parameters in two models of linear and non-linear equations, under the assumption that only one molecule in each model can be measured, were estimated by using a genetic algorithm (GA) and particle swarm optimization (PSO). As a result, the introduction of new constraints was dramatically effective: the GA and PSO with new constraints could successfully estimate the kinetic parameters in the simulated models, with a high degree of accuracy, while the conventional GA and PSO methods without them frequently failed.

Conclusions

The introduction of new constraints in an objective function by using differential elimination resulted in the drastic improvement of the estimation accuracy in parameter optimization methods. The performance of our approach was illustrated by simulations of the parameter optimization for two models of linear and non-linear equations, which included unmeasured molecules, by two types of optimization techniques. As a result, our method is a promising development in parameter optimization.

     

A virtual look at Epstein-Barr virus infection: biological interpretations

The possibility of using computer simulation and mathematical modeling to gain insight into biological and other complex systems is receiving increased attention. However, it is as yet unclear to what extent these techniques will provide useful biological insights or even what the best approach is. Epstein-Barr virus (EBV) provides a good candidate to address these issues. It persistently infects most humans and is associated with several important diseases. In addition, a detailed biological model has been developed that provides an intricate understanding of EBV infection in the naturally infected human host and accounts for most of the virus' diverse and peculiar properties. We have developed an agent-based computer model/simulation (PathSim, Pathogen Simulation) of this biological model. The simulation is performed on a virtual grid that represents the anatomy of the tonsils of the nasopharyngeal cavity (Waldeyer ring) and the peripheral circulation--the sites of EBV infection and persistence. The simulation is presented via a user friendly visual interface and reproduces quantitative and qualitative aspects of acute and persistent EBV infection. The simulation also had predictive power in validation experiments involving certain aspects of viral infection dynamics. Moreover, it allows us to identify switch points in the infection process that direct the disease course towards the end points of persistence, clearance, or death. Lastly, we were able to identify parameter sets that reproduced aspects of EBV-associated diseases. These investigations indicate that such simulations, combined with laboratory and clinical studies and animal models, will provide a powerful approach to investigating and controlling EBV infection, including the design of targeted anti-viral therapies.     

Fat-Tailed Fluctuations in the Size of Organizations: The Role of Social Influence

Organizational growth processes have consistently been shown to exhibit a fatter-than-Gaussian growth-rate distribution in a variety of settings. Long periods of relatively small changes are interrupted by sudden changes in all size scales. This kind of extreme events can have important consequences for the development of biological and socio-economic systems. Existing models do not derive this aggregated pattern from agent actions at the micro level. We develop an agent-based simulation model on a social network. We take our departure in a model by a Schwarzkopf et al. on a scale-free network. We reproduce the fat-tailed pattern out of internal dynamics alone, and also find that it is robust with respect to network topology. Thus, the social network and the local interactions are a prerequisite for generating the pattern, but not the network topology itself. We further extend the model with a parameter that weights the relative fraction of an individual''s neighbours belonging to a given organization, representing a contextual aspect of social influence. In the lower limit of this parameter, the fraction is irrelevant and choice of organization is random. In the upper limit of the parameter, the largest fraction quickly dominates, leading to a winner-takes-all situation. We recover the real pattern as an intermediate case between these two extremes.     

Online model checking approach based parameter estimation to a neuronal fate decision simulation model in Caenorhabditis elegans with hybrid functional Petri net with extension

Mathematical modeling and simulation studies are playing an increasingly important role in helping researchers elucidate how living organisms function in cells. In systems biology, researchers typically tune many parameters manually to achieve simulation results that are consistent with biological knowledge. This severely limits the size and complexity of simulation models built. In order to break this limitation, we propose a computational framework to automatically estimate kinetic parameters for a given network structure. We utilized an online (on-the-fly) model checking technique (which saves resources compared to the offline approach), with a quantitative modeling and simulation architecture named hybrid functional Petri net with extension (HFPNe). We demonstrate the applicability of this framework by the analysis of the underlying model for the neuronal cell fate decision model (ASE fate model) in Caenorhabditis elegans. First, we built a quantitative ASE fate model containing 3327 components emulating nine genetic conditions. Then, using our developed efficient online model checker, MIRACH 1.0, together with parameter estimation, we ran 20-million simulation runs, and were able to locate 57 parameter sets for 23 parameters in the model that are consistent with 45 biological rules extracted from published biological articles without much manual intervention. To evaluate the robustness of these 57 parameter sets, we run another 20 million simulation runs using different magnitudes of noise. Our simulation results concluded that among these models, one model is the most reasonable and robust simulation model owing to the high stability against these stochastic noises. Our simulation results provide interesting biological findings which could be used for future wet-lab experiments.     

An ant-based coordination mechanism for resource-constrained project scheduling with multiple agents and cash flow objectives

We consider a multi-agent extension of the non-preemptive single-mode resource-constrained project scheduling problem with discounted cash flow objectives. Such a problem setting is related to project scheduling problems which involve different autonomous firms where project activities are uniquely assigned to the project parties (agents). Taking into account opportunistic agents and the resulting information asymmetry we propose a general decentralized negotiation approach which uses ideas from ant colony optimization. In the course of the negotiation the agents iteratively vote on proposed project schedules without disclosing preference information regarding cash flow values. Computational experiments serve to analyze the agent-based coordination mechanism in comparison to other approaches from the literature. The proposed mechanism turns out as an effective method for coordinating self-interested agents with conflicting goals which collaborate in resource-constrained projects.     

Bayesian model selection for spatial capture–recapture models

A vast amount of ecological knowledge generated over the past two decades has hinged upon the ability of model selection methods to discriminate among various ecological hypotheses. The last decade has seen the rise of Bayesian hierarchical models in ecology. Consequently, commonly used tools, such as the AIC, become largely inapplicable and there appears to be no consensus about a particular model selection tool that can be universally applied. We focus on a specific class of competing Bayesian spatial capture–recapture (SCR) models and apply and evaluate some of the recommended Bayesian model selection tools: (1) Bayes Factor—using (a) Gelfand‐Dey and (b) harmonic mean methods, (2) Deviance Information Criterion (DIC), (3) Watanabe‐Akaike's Information Criterion (WAIC) and (4) posterior predictive loss criterion. In all, we evaluate 25 variants of model selection tools in our study. We evaluate these model selection tools from the standpoint of selecting the “true” model and parameter estimation. In all, we generate 120 simulated data sets using the true model and assess the frequency with which the true model is selected and how well the tool estimates N (population size), a parameter of much importance to ecologists. We find that when information content is low in the data, no particular model selection tool can be recommended to help realize, simultaneously, both the goals of model selection and parameter estimation. But, in general (when we consider both the objectives together), we recommend the use of our application of the Bayes Factor (Gelfand‐Dey with MAP approximation) for Bayesian SCR models. Our study highlights the point that although new model selection tools are emerging (e.g., WAIC) in the applied statistics literature, those tools based on sound theory even under approximation may still perform much better.     

Modeling spatiotemporal dynamics of vole populations in Europe and America

The mathematical models proposed and studied in the present paper provide a unified framework to understand complex dynamical patterns in vole populations in Europe and North America. We have extended the well-known model provided by Hanski and Turchin by incorporating the diffusion term and spatial heterogeneity and performed several mathematical and numerical analyses to explore the dynamics in space and time of the model. These models successfully predicted the observed rodent dynamics in these regions. An attempt has been made to bridge the gap between the field and theoretical studies carried out by Turchin and Hanski (1997) [23] and Turchin and Ellner (2000) [24]. Simulation experiments, mainly two-dimensional parameter scans, show the importance of spatial heterogeneity in order to understand the poorly understood fluctuations in population densities of voles in Fennoscandia and Northern America. This study shed new light upon the dynamics of voles in these regions. The nonlinear analysis of vole data suggests that the dynamical shift is from stability to chaos. Diffusion driven model systems predict a new type of dynamics not yet observed in the field studies of vole populations carried out so far. This has been termed as chaotic in time and regular in space (CTRS). We observed CTRS dynamics in several simulation experiments. This directs us to expect that dynamics of this animal would be de-correlated in time and simultaneously mass extinctions might be possible at many spatial locations.     

RankAggreg, an R package for weighted rank aggregation

Background

Determining the parameters of a mathematical model from quantitative measurements is the main bottleneck of modelling biological systems. Parameter values can be estimated from steady-state data or from dynamic data. The nature of suitable data for these two types of estimation is rather different. For instance, estimations of parameter values in pathway models, such as kinetic orders, rate constants, flux control coefficients or elasticities, from steady-state data are generally based on experiments that measure how a biochemical system responds to small perturbations around the steady state. In contrast, parameter estimation from dynamic data requires time series measurements for all dependent variables. Almost no literature has so far discussed the combined use of both steady-state and transient data for estimating parameter values of biochemical systems.

Results

In this study we introduce a constrained optimization method for estimating parameter values of biochemical pathway models using steady-state information and transient measurements. The constraints are derived from the flux connectivity relationships of the system at the steady state. Two case studies demonstrate the estimation results with and without flux connectivity constraints. The unconstrained optimal estimates from dynamic data may fit the experiments well, but they do not necessarily maintain the connectivity relationships. As a consequence, individual fluxes may be misrepresented, which may cause problems in later extrapolations. By contrast, the constrained estimation accounting for flux connectivity information reduces this misrepresentation and thereby yields improved model parameters.

Conclusion

The method combines transient metabolic profiles and steady-state information and leads to the formulation of an inverse parameter estimation task as a constrained optimization problem. Parameter estimation and model selection are simultaneously carried out on the constrained optimization problem and yield realistic model parameters that are more likely to hold up in extrapolations with the model.