Bayesian inference for dynamic transcriptional regulation; the Hes1 system as a case study

MOTIVATION: In this study, we address the problem of estimating the parameters of regulatory networks and provide the first application of Markov chain Monte Carlo (MCMC) methods to experimental data. As a case study, we consider a stochastic model of the Hes1 system expressed in terms of stochastic differential equations (SDEs) to which rigorous likelihood methods of inference can be applied. When fitting continuous-time stochastic models to discretely observed time series the lengths of the sampling intervals are important, and much of our study addresses the problem when the data are sparse. RESULTS: We estimate the parameters of an autoregulatory network providing results both for simulated and real experimental data from the Hes1 system. We develop an estimation algorithm using MCMC techniques which are flexible enough to allow for the imputation of latent data on a finer time scale and the presence of prior information about parameters which may be informed from other experiments as well as additional measurement error.     

Bayesian sequential inference for stochastic kinetic biochemical network models.

As postgenomic biology becomes more predictive, the ability to infer rate parameters of genetic and biochemical networks will become increasingly important. In this paper, we explore the Bayesian estimation of stochastic kinetic rate constants governing dynamic models of intracellular processes. The underlying model is replaced by a diffusion approximation where a noise term represents intrinsic stochastic behavior and the model is identified using discrete-time (and often incomplete) data that is subject to measurement error. Sequential MCMC methods are then used to sample the model parameters on-line in several data-poor contexts. The methodology is illustrated by applying it to the estimation of parameters in a simple prokaryotic auto-regulatory gene network.     

Estimating equations for a latent transition model with multiple discrete indicators

This paper proposes a two-part model for studying transitions between health states over time when multiple, discrete health indicators are available. The includes a measurement model positing underlying latent health states and a transition model between latent health states over time. Full maximum likelihood estimation procedures are computationally complex in this latent variable framework, making only a limited class of models feasible and estimation of standard errors problematic. For this reason, an estimating equations analogue of the pseudo-likelihood method for the parameters of interest, namely the transition model parameters, is considered. The finite sample properties of the proposed procedure are investigated through a simulation study and the importance of choosing strong indicators of the latent variable is demonstrated. The applicability of the methodology is illustrated with health survey data measuring disability in the elderly from the Longitudinal Study of Aging.     

Joint modelling of longitudinal measurements and event time data

This paper formulates a class of models for the joint behaviour of a sequence of longitudinal measurements and an associated sequence of event times, including single-event survival data. This class includes and extends a number of specific models which have been proposed recently, and, in the absence of association, reduces to separate models for the measurements and events based, respectively, on a normal linear model with correlated errors and a semi-parametric proportional hazards or intensity model with frailty. Special cases of the model class are discussed in detail and an estimation procedure which allows the two components to be linked through a latent stochastic process is described. Methods are illustrated using results from a clinical trial into the treatment of schizophrenia.     

Estimating linear causality in the presence of latent variables

Learning causality from data is known as the causal discovery problem, and it is an important and relatively new field. In many applications, there often exist latent variables, if such latent variables are completely ignored, which can lead to the estimation results seriously biased. In this paper, a method of combining exploratory factor analysis and path analysis (EFA-PA) is proposed to infer the causality in the presence of latent variables. Our method expands latent variables as well as their linear causal relationships with observed variables, which enhances the accuracy of causal models. Such model can be thought of as the simplest possible causal models for continuous data. The EFA-PA is very similar to that of structural equation model, but the theoretical model established by the structural equation model needs to be modified in the process of data fitting until the ideal model is established.The model gained by EFA-PA not only avoids subjectivity but also reduces estimation complexity. It is found that the EFA-PA estimation model is superior to the other models. EFA-PA can provides a basis for the correct estimation of the causal relationship between the observed variables in the presence of latent variables. The experiment shows that EFA-PA is better than the structural equation model.     

Hyperparameter estimation using stochastic approximation with application to population pharmacokinetics

A stochastic approximation algorithm is proposed for recursive estimation of the hyperparameters characterizing, in a population, the probability density function of the parameters of a statistical model. For a given population model defined by a parametric model of a biological process, an error model, and a class of densities on the set of the individual parameters, this algorithm provides a sequence of estimates from a sequence of individuals' observation vectors. Convergence conditions are verified for a class of population models including usual pharmacokinetic applications. This method is implemented for estimation of pharmacokinetic population parameters from drug multiple-dosing data. Its estimation capabilities are evaluated and compared to a classical method in population pharmacokinetics, the first-order method (NONMEM), on simulated data.     

Structural time series models with feedback mechanisms

Structural time series models have applications in many different fields such as biology, economics, and meteorology. A structural times series model can be represented as a state-space model where the states of the system represent the unobserved components and the structural parameters have clear interpretations. This paper introduces a class of structural time series models that incorporate feedback from the latent components of the history. An iterative procedure is proposed for estimation. These models allow flexible and robust feedback mechanisms, have clear interpretations, and have a computationally efficient estimation procedure. They are applied to hormone data to characterize hormone secretion and to explore a potential feedback mechanism.     

Bayesian lasso for semiparametric structural equation models

There has been great interest in developing nonlinear structural equation models and associated statistical inference procedures, including estimation and model selection methods. In this paper a general semiparametric structural equation model (SSEM) is developed in which the structural equation is composed of nonparametric functions of exogenous latent variables and fixed covariates on a set of latent endogenous variables. A basis representation is used to approximate these nonparametric functions in the structural equation and the Bayesian Lasso method coupled with a Markov Chain Monte Carlo (MCMC) algorithm is used for simultaneous estimation and model selection. The proposed method is illustrated using a simulation study and data from the Affective Dynamics and Individual Differences (ADID) study. Results demonstrate that our method can accurately estimate the unknown parameters and correctly identify the true underlying model.     

Maximum Likelihood Estimation of Long‐Term HIV Dynamic Models and Antiviral Response

Summary HIV dynamics studies, based on differential equations, have significantly improved the knowledge on HIV infection. While first studies used simplified short‐term dynamic models, recent works considered more complex long‐term models combined with a global analysis of whole patient data based on nonlinear mixed models, increasing the accuracy of the HIV dynamic analysis. However statistical issues remain, given the complexity of the problem. We proposed to use the SAEM (stochastic approximation expectation‐maximization) algorithm, a powerful maximum likelihood estimation algorithm, to analyze simultaneously the HIV viral load decrease and the CD4 increase in patients using a long‐term HIV dynamic system. We applied the proposed methodology to the prospective COPHAR2–ANRS 111 trial. Very satisfactory results were obtained with a model with latent CD4 cells defined with five differential equations. One parameter was fixed, the 10 remaining parameters (eight with between‐patient variability) of this model were well estimated. We showed that the efficacy of nelfinavir was reduced compared to indinavir and lopinavir.     

Accelerated maximum likelihood parameter estimation for stochastic biochemical systems

ABSTRACT: BACKGROUND: A prerequisite for the mechanistic simulation of a biochemical system is detailed knowledge of its kinetic parameters. Despite recent experimental advances, the estimation of unknown parameter values from observed data is still a bottleneck for obtaining accurate simulation results. Many methods exist for parameter estimation in deterministic biochemical systems; methods for discrete stochastic systems are less well developed. Given the probabilistic nature of stochastic biochemical models, a natural approach is to choose parameter values that maximize the probability of the observed data with respect to the unknown parameters, a.k.a. the maximum likelihood parameter estimates (MLEs). MLE computation for all but the simplest models requires the simulation of many system trajectories that are consistent with experimental data. For models with unknown parameters, this presents a computational challenge, as the generation of consistent trajectories can be an extremely rare occurrence. RESULTS: We have developed Monte Carlo Expectation-Maximization with Modified Cross-Entropy Method (MCEM2): an accelerated method for calculating MLEs that combines advances in rare event simulation with a computationally efficient version of the Monte Carlo expectation-maximization (MCEM) algorithm. Our method requires no prior knowledge regarding parameter values, and it automatically provides a multivariate parameter uncertainty estimate. We applied the method to five stochastic systems of increasing complexity, progressing from an analytically tractable pure-birth model to a computationally demanding model of yeast-polarization. Our results demonstrate that MCEM2 substantially accelerates MLE computation on all tested models when compared to a stand-alone version of MCEM. Additionally, we show how our method identifies parameter values for certain classes of models more accurately than two recently proposed computationally efficient methods. CONCLUSIONS: This work provides a novel, accelerated version of a likelihood-based parameter estimation method that can be readily applied to stochastic biochemical systems. In addition, our results suggest opportunities for added efficiency improvements that will further enhance our ability to mechanistically simulate biological processes.     

Global parameter estimation methods for stochastic biochemical systems

Background  

The importance of stochasticity in cellular processes having low number of molecules has resulted in the development of stochastic models such as chemical master equation. As in other modelling frameworks, the accompanying rate constants are important for the end-applications like analyzing system properties (e.g. robustness) or predicting the effects of genetic perturbations. Prior knowledge of kinetic constants is usually limited and the model identification routine typically includes parameter estimation from experimental data. Although the subject of parameter estimation is well-established for deterministic models, it is not yet routine for the chemical master equation. In addition, recent advances in measurement technology have made the quantification of genetic substrates possible to single molecular levels. Thus, the purpose of this work is to develop practical and effective methods for estimating kinetic model parameters in the chemical master equation and other stochastic models from single cell and cell population experimental data.     

A stochastic model for extinction and recurrence of epidemics: estimation and inference for measles outbreaks

Epidemic dynamics pose a great challenge to stochastic modelling because chance events are major determinants of the size and the timing of the outbreak. Reintroduction of the disease through contact with infected individuals from other areas is an important latent stochastic variable. In this study we model these stochastic processes to explain extinction and recurrence of epidemics observed in measles. We develop estimating functions for such a model and apply the methodology to temporal case counts of measles in 60 cities in England and Wales. In order to estimate the unobserved spatial contact process we suggest a method based on stochastic simulation and marginal densities. The estimation results show that it is possible to consider a unified model for the UK cities where the parameters depend on the city size. Stochastic realizations from the dynamic model realistically capture the transitions from an endemic cyclic pattern in large populations to irregular epidemic outbreaks in small human host populations.     

A class of latent Markov models for capture-recapture data allowing for time, heterogeneity, and behavior effects

We propose an extension of the latent class model for the analysis of capture-recapture data which allows us to take into account the effect of a capture on the behavior of a subject with respect to future captures. The approach is based on the assumption that the variable indexing the latent class of a subject follows a Markov chain with transition probabilities depending on the previous capture history. Several constraints are allowed on these transition probabilities and on the parameters of the conditional distribution of the capture configuration given the latent process. We also allow for the presence of discrete explanatory variables, which may affect the parameters of the latent process. To estimate the resulting models, we rely on the conditional maximum likelihood approach and for this aim we outline an EM algorithm. We also give some simple rules for point and interval estimation of the population size. The approach is illustrated by applying it to two data sets concerning small mammal populations.     

Latent multinomial models for extended batch-mark data

Batch marking is common and useful for many capture–recapture studies where individual marks cannot be applied due to various constraints such as timing, cost, or marking difficulty. When batch marks are used, observed data are not individual capture histories but a set of counts including the numbers of individuals first marked, marked individuals that are recaptured, and individuals captured but released without being marked (applicable to some studies) on each capture occasion. Fitting traditional capture–recapture models to such data requires one to identify all possible sets of capture–recapture histories that may lead to the observed data, which is computationally infeasible even for a small number of capture occasions. In this paper, we propose a latent multinomial model to deal with such data, where the observed vector of counts is a non-invertible linear transformation of a latent vector that follows a multinomial distribution depending on model parameters. The latent multinomial model can be fitted efficiently through a saddlepoint approximation based maximum likelihood approach. The model framework is very flexible and can be applied to data collected with different study designs. Simulation studies indicate that reliable estimation results are obtained for all parameters of the proposed model. We apply the model to analysis of golden mantella data collected using batch marks in Central Madagascar.     

A Probit Latent Class Model with General Correlation Structures for Evaluating Accuracy of Diagnostic Tests

Summary Traditional latent class modeling has been widely applied to assess the accuracy of dichotomous diagnostic tests. These models, however, assume that the tests are independent conditional on the true disease status, which is rarely valid in practice. Alternative models using probit analysis have been proposed to incorporate dependence among tests, but these models consider restricted correlation structures. In this article, we propose a probit latent class model that allows a general correlation structure. When combined with some helpful diagnostics, this model provides a more flexible framework from which to evaluate the correlation structure and model fit. Our model encompasses several other PLC models but uses a parameter‐expanded Monte Carlo EM algorithm to obtain the maximum‐likelihood estimates. The parameter‐expanded EM algorithm was designed to accelerate the convergence rate of the EM algorithm by expanding the complete‐data model to include a larger set of parameters and it ensures a simple solution in fitting the PLC model. We demonstrate our estimation and model selection methods using a simulation study and two published medical studies.     

Composite Hazard Functions Reflecting Competing Latent Processes

A method for fitting parametric models to apparently complex hazard rates in survival data is suggested. Hazard complexity may indicate competing causes of failure. A competing risks model is constructed on the assumption that a failure time can be considered as the first passage time of possibly several latent, stochastic processes competing in reaching a barrier. An additional assumption of independence between the hidden processes leads directly to a composite hazard function as the sum of the cause specific hazards. We show how this composite hazard model based on Wiener processes can serve as a flexible tool for modelling complex hazards by varying the number of processes and their starting conditions. An example with real data is presented. Parameter estimation and model assessment are based on Markov Chain Monte Carlo methods. (© 2004 WILEY‐VCH Verlag GmbH & Co. KGaA, Weinheim)     

Bayesian variable selection for latent class models

In this article, we develop a latent class model with class probabilities that depend on subject-specific covariates. One of our major goals is to identify important predictors of latent classes. We consider methodology that allows estimation of latent classes while allowing for variable selection uncertainty. We propose a Bayesian variable selection approach and implement a stochastic search Gibbs sampler for posterior computation to obtain model-averaged estimates of quantities of interest such as marginal inclusion probabilities of predictors. Our methods are illustrated through simulation studies and application to data on weight gain during pregnancy, where it is of interest to identify important predictors of latent weight gain classes.     

Stochastic analogues of deterministic single-species population models

Although single-species deterministic difference equations have long been used in modeling the dynamics of animal populations, little attention has been paid to how stochasticity should be incorporated into these models. By deriving stochastic analogues to difference equations from first principles, we show that the form of these models depends on whether noise in the population process is demographic or environmental. When noise is demographic, we argue that variance around the expectation is proportional to the expectation. When noise is environmental the variance depends in a non-trivial way on how variation enters into model parameters, but we argue that if the environment affects the population multiplicatively then variance is proportional to the square of the expectation. We compare various stochastic analogues of the Ricker map model by fitting them, using maximum likelihood estimation, to data generated from an individual-based model and the weevil data of Utida. Our demographic models are significantly better than our environmental models at fitting noise generated by population processes where noise is mainly demographic. However, the traditionally chosen stochastic analogues to deterministic models--additive normally distributed noise and multiplicative lognormally distributed noise--generally fit all data sets well. Thus, the form of the variance does play a role in the fitting of models to ecological time series, but may not be important in practice as first supposed.     

Test of mathematical assumptions behind the 'incidence function' estimation process of metapopulations' dynamic parameters.

I question Hanski's [I. Hanski, A practical model of metapopulation dynamics, J. Animal Ecol. 63 (1994) 151] assumption that incidence functions are relevant approximations of the equilibrium dynamics of stochastic metapopulation models to estimate models' parameters based on snapshot data. Based on ten different metapopulation models, this assumption is found to be at least partly unjustified when referring to the asymptotic behaviour of the models. This leads me to recommend the use of explicit extinction-colonisation transition probabilities and process data (rather than snapshot data) in the estimation process of metapopulation models.     

An approximate multitrait model for genetic evaluation in dairy cattle with a robust estimation of genetic trends (Open Access publication)

In a stochastic simulation study of a dairy cattle population three multitrait models for estimation of genetic parameters and prediction of breeding values were compared. The first model was an approximate multitrait model using a two-step procedure. The first step was a single trait model for all traits. The solutions for fixed effects from these analyses were subtracted from the phenotypes. A multitrait model only containing an overall mean, an additive genetic and a residual term was applied on these preadjusted data. The second model was similar to the first model, but the multitrait model also contained a year effect. The third model was a full multitrait model. Genetic trends for total merit and for the individual traits in the breeding goal were compared for the three scenarios to rank the models. The full multitrait model gave the highest genetic response, but was not significantly better than the approximate multitrait model including a year effect. The inclusion of a year effect into the second step of the approximate multitrait model significantly improved the genetic trend for total merit. In this study, estimation of genetic parameters for breeding value estimation using models corresponding to the ones used for prediction of breeding values increased the accuracy on the breeding values and thereby the genetic progress.