Maximum Likelihood Estimation of Long‐Term HIV Dynamic Models and Antiviral Response

Summary HIV dynamics studies, based on differential equations, have significantly improved the knowledge on HIV infection. While first studies used simplified short‐term dynamic models, recent works considered more complex long‐term models combined with a global analysis of whole patient data based on nonlinear mixed models, increasing the accuracy of the HIV dynamic analysis. However statistical issues remain, given the complexity of the problem. We proposed to use the SAEM (stochastic approximation expectation‐maximization) algorithm, a powerful maximum likelihood estimation algorithm, to analyze simultaneously the HIV viral load decrease and the CD4 increase in patients using a long‐term HIV dynamic system. We applied the proposed methodology to the prospective COPHAR2–ANRS 111 trial. Very satisfactory results were obtained with a model with latent CD4 cells defined with five differential equations. One parameter was fixed, the 10 remaining parameters (eight with between‐patient variability) of this model were well estimated. We showed that the efficacy of nelfinavir was reduced compared to indinavir and lopinavir.     

Integrating genealogical and dynamical modelling to infer escape and reversion rates in HIV epitopes

The rates of escape and reversion in response to selection pressure arising from the host immune system, notably the cytotoxic T-lymphocyte (CTL) response, are key factors determining the evolution of HIV. Existing methods for estimating these parameters from cross-sectional population data using ordinary differential equations (ODEs) ignore information about the genealogy of sampled HIV sequences, which has the potential to cause systematic bias and overestimate certainty. Here, we describe an integrated approach, validated through extensive simulations, which combines genealogical inference and epidemiological modelling, to estimate rates of CTL escape and reversion in HIV epitopes. We show that there is substantial uncertainty about rates of viral escape and reversion from cross-sectional data, which arises from the inherent stochasticity in the evolutionary process. By application to empirical data, we find that point estimates of rates from a previously published ODE model and the integrated approach presented here are often similar, but can also differ several-fold depending on the structure of the genealogy. The model-based approach we apply provides a framework for the statistical analysis and hypothesis testing of escape and reversion in population data and highlights the need for longitudinal and denser cross-sectional sampling to enable accurate estimate of these key parameters.     

Population HIV-1 dynamics in vivo: applicable models and inferential tools for virological data from AIDS clinical trials

In this paper, we introduce a novel application of hierarchical nonlinear mixed-effect models to HIV dynamics. We show that a simple model with a sum of exponentials can give a good fit to the observed clinical data of HIV-1 dynamics (HIV-1 RNA copies) after initiation of potent antiviral treatments and can also be justified by a biological compartment model for the interaction between HIV and its host cells. This kind of model enjoys both biological interpretability and mathematical simplicity after reparameterization and simplification. A model simplification procedure is proposed and illustrated through examples. We interpret and justify various simplified models based on clinical data taken during different phases of viral dynamics during antiviral treatments. We suggest the hierarchical nonlinear mixed-effect model approach for parameter estimation and other statistical inferences. In the context of an AIDS clinical trial involving patients treated with a combination of potent antiviral agents, we show how the models may be used to draw biologically relevant interpretations from repeated HIV-1 RNA measurements and demonstrate the potential use of the models in clinical decision-making.     

Modeling the short-, middle- and long-term viral load responses for comparing estimated dynamic parameters

A virologic marker, the number of HIV RNA copies or viral load, is currently used to evaluate antiviral therapies in AIDS clinical trials. This marker can be used to assess the antiviral potency of therapies, but is easily affected by drug exposures, drug resistance and other factors during the long-term treatment evaluation process. The study of HIV dynamics is one of the most important development in recent AIDS research for understanding the pathogenesis of HIV-1 infection and antiviral treatment strategies. Although many HIV dynamic models have been proposed by AIDS researchers in the last decade, they have only been used to quantify short-term viral dynamics and do not correctly describe long-term virologic responses to antiretroviral treatment. In other words, these simple viral dynamic models can only be used to fit short-term viral load data for estimating dynamic parameters. In this paper, a mechanism-based differential equation models is introduced for characterizing the long-term viral dynamics with antiretroviral therapy. We applied this model to fit different segments of the viral load trajectory data from a simulation experiment and an AIDS clinical trial study, and found that the estimates of dynamic parameters from our modeling approach are very consistent. We may conclude that our model can not only characterize long-term viral dynamics, but can also quantify short- and middle-term viral dynamics. It suggests that if there are enough data in the early stage of the treatment, the results from our modeling based on short-term information can be used to capture the performance of long-term care with HIV-1 infected patients.     

Modeling the Genetic Control of HIV-1 Dynamics After Highly Active Antiretroviral Therapy

The progression of HIV disease has been markedly slowed by the use of highly active antiretroviral therapy (HAART). However, substantial genetic variation was observed to occur among different people in the decay rate of viral loads caused by HAART. The characterization of specific genes involved in HIV dynamics is central to design personalized drugs for the prevention of this disease, but usually cannot be addressed by experimental methods alone rather than require the help of mathematical and statistical methods. A novel statistical model has been recently developed to detect genetic variants that are responsible for the shape of HAART-induced viral decay curves. This model was employed to an HIV/AIDS trial, which led to the identification of a major genetic determinant that triggers an effect on HIV dynamics. This detected major genetic determinant also affects several clinically important parameters, such as half-lives of infected cells and HIV eradication times.Key Words: Hardy-weinberg equilibrium, bi-exponential function, quantitative trait loci, HIV dynamics, functional mapping.     

An accurate two-phase approximate solution to an acute viral infection model

During an acute viral infection, virus levels rise, reach a peak and then decline. Data and numerical solutions suggest the growth and decay phases are linear on a log scale. While viral dynamic models are typically nonlinear with analytical solutions difficult to obtain, the exponential nature of the solutions suggests approximations can be found. We derive a two-phase approximate solution to the target cell limited influenza model and illustrate its accuracy using data and previously established parameter values of six patients infected with influenza A. For one patient, the fall in virus concentration from its peak was not consistent with our predictions during the decay phase and an alternate approximation is derived. We find expressions for the rate and length of initial viral growth in terms of model parameters, the extent each parameter is involved in viral peaks, and the single parameter responsible for virus decay. We discuss applications of this analysis in antiviral treatments and in investigating host and virus heterogeneities.     

Joint Inference on HIV Viral Dynamics and Immune Suppression in Presence of Measurement Errors

Summary : In an attempt to provide a tool to assess antiretroviral therapy and to monitor disease progression, this article studies association of human immunodeficiency virus (HIV) viral suppression and immune restoration. The data from a recent acquired immune deficiency syndrome (AIDS) study are used for illustration. We jointly model HIV viral dynamics and time to decrease in CD4/CD8 ratio in the presence of CD4 process with measurement errors, and estimate the model parameters simultaneously via a method based on a Laplace approximation and the commonly used Monte Carlo EM algorithm. The approaches and many of the points presented apply generally.     

Comparison of Linear,Nonlinear and Semiparametric Mixed‐effects Models for Estimating HIV Dynamic Parameters

The potency of antiretroviral agents in AIDS clinical trials can be assessed on the basis of an early viral response such as viral decay rate or change in viral load (number of copies of HIV RNA) of the plasma. Linear, parametric nonlinear, and semiparametric nonlinear mixed‐effects models have been proposed to estimate viral decay rates in viral dynamic models. However, before applying these models to clinical data, a critical question that remains to be addressed is whether these models produce coherent estimates of viral decay rates, and if not, which model is appropriate and should be used in practice. In this paper, we applied these models to data from an AIDS clinical trial of potent antiviral treatments and found significant incongruity in the estimated rates of reduction in viral load. Simulation studies indicated that reliable estimates of viral decay rate were obtained by using the parametric and semiparametric nonlinear mixed‐effects models. Our analysis also indicated that the decay rates estimated by using linear mixed‐effects models should be interpreted differently from those estimated by using nonlinear mixed‐effects models. The semiparametric nonlinear mixed‐effects model is preferred to other models because arbitrary data truncation is not needed. Based on real data analysis and simulation studies, we provide guidelines for estimating viral decay rates from clinical data. (© 2004 WILEY‐VCH Verlag GmbH & Co. KGaA, Weinheim)     

Complex patterns of viral load decay under antiretroviral therapy: influence of pharmacokinetics and intracellular delay

We present a model of HIV dynamics under antiretroviral therapy that combines drug pharmacokinetics and intracellular delay. A two compartment pharmacokinetic model is employed to determine the time evolution of the intracellular concentrations of the active forms of drugs, and thereby drug efficacy. The viral replication period is divided into pre- and post-drug action parts, allowing for the introduction of an intracellular delay in drug action. The standard model of viral dynamics is modified to account for the drug dependence of intracellular delay and continuously varying drug efficacy. Model calculations reveal that viral load decay in HIV infected patients under monotherapy can exhibit remarkably complex patterns depending on the relative magnitudes of the pharmacokinetic, intracellular, and intrinsic viral dynamic time-scales. The commonly assumed exponential decay is only a special case. However, uncertainties in measurement and the low sampling frequencies employed in present clinical studies preclude the identification of these patterns from existing clinical viral load data.     

Evaluation of HIV-1 kinetic models using quantitative discrimination analysis

MOTIVATION: Since the identification of human immunodeficiency virus (HIV) over twenty years ago, many mathematical models of HIV dynamics have been proposed. The purpose of this study was to evaluate intracellular and intercellular scale HIV models that best described the dynamics of viral and cell titers of a person, where parameters were determined using typically available patient data. In this case, 'best' was defined as the model most capable of describing experimental patient data and was determined by Bayesian-based model discrimination analysis and the ability to provide realistic results. RESULTS: Twenty models of HIV-1 viral dynamics were initially evaluated to determine whether parameters could be obtained from readily available clinical data from established HIV-1 patients with stable disease. Based on this analysis, three models were chosen for further examination and comparison. Parameters were estimated using experimental data from a cohort of 338 people monitored for up to 2484 days. The models were evaluated using a Bayesian technique to determine which model was most probable. The model ultimately selected as most probable was overwhelmingly favored relative to the remaining two models, and it accounted for uninfected cells, infected cells and cytotoxic T lymphocyte dynamics. The authors developed a fourth model for comparison purposes by combining the features of the original three models. Parameters were estimated for the new model and the statistical analysis was repeated for all four models. The model that was initially favored was selected again upon model discrimination analysis. CONTACT: srivasta@engr.uconn.edu.     

Hierarchical Bayesian methods for estimation of parameters in a longitudinal HIV dynamic system

HIV dynamics studies have significantly contributed to the understanding of HIV infection and antiviral treatment strategies. But most studies are limited to short-term viral dynamics due to the difficulty of establishing a relationship of antiviral response with multiple treatment factors such as drug exposure and drug susceptibility during long-term treatment. In this article, a mechanism-based dynamic model is proposed for characterizing long-term viral dynamics with antiretroviral therapy, described by a set of nonlinear differential equations without closed-form solutions. In this model we directly incorporate drug concentration, adherence, and drug susceptibility into a function of treatment efficacy, defined as an inhibition rate of virus replication. We investigate a Bayesian approach under the framework of hierarchical Bayesian (mixed-effects) models for estimating unknown dynamic parameters. In particular, interest focuses on estimating individual dynamic parameters. The proposed methods not only help to alleviate the difficulty in parameter identifiability, but also flexibly deal with sparse and unbalanced longitudinal data from individual subjects. For illustration purposes, we present one simulation example to implement the proposed approach and apply the methodology to a data set from an AIDS clinical trial. The basic concept of the longitudinal HIV dynamic systems and the proposed methodologies are generally applicable to any other biomedical dynamic systems.     

Dynamics of latent HIV under clonal expansion

The HIV latent reservoir exhibits slow decay on antiretroviral therapy (ART), impacted by homeostatic proliferation and activation. How these processes contribute to the total dynamic while also producing the observed profile of sampled latent clone sizes is unclear. An agent-based model was developed that tracks individual latent clones, incorporating homeostatic proliferation of cells and activation of clones. The model was calibrated to produce observed latent reservoir dynamics as well as observed clonal size profiles. Simulations were compared to previously published latent HIV integration data from 5 adults and 3 children. The model simulations reproduced reservoir dynamics as well as generating residual plasma viremia levels (pVL) consistent with observations on ART. Over 382 Latin Hypercube Sample simulations, the median latent reservoir grew by only 0.3 log₁₀ over the 10 years prior to ART initiation, after which time it decreased with a half-life of 15 years, despite number of clones decreasing at a faster rate. Activation produced a maximum size of genetically intact clones of around one million cells. The individual simulation that best reproduced the sampled clone profile, produced a reservoir that decayed with a 13.9 year half-life and where pVL, produced mainly from proliferation, decayed with a half-life of 10.8 years. These slow decay rates were achieved with mean cell life-spans of only 14.2 months, due to expansion of the reservoir through proliferation and activation. Although the reservoir decayed on ART, a number of clones increased in size more than 4,000-fold. While small sampled clones may have expanded through proliferation, the large sizes exclusively arose from activation. Simulations where homeostatic proliferation contributed more to pVL than activation, produced pVL that was less variable over time and exhibited fewer viral blips. While homeostatic proliferation adds to the latent reservoir, activation can both add and remove latent cells. Latent activation can produce large clones, where these may have been seeded much earlier than when first sampled. Elimination of the reservoir is complicated by expanding clones whose dynamic differ considerably to that of the entire reservoir.     

Assessing antiviral potency of anti-HIV therapies in vivo by comparing viral decay rates in viral dynamic models

A virologic marker, the number of HIV RNA copies or viral load, is currently used to evaluate anti-HIV therapies in AIDS clinical trials. This marker can be used to assess the antiviral potency of therapies, but is easily affected by noncompliance, drug resistance, toxicities, and other factors during the long-term treatment evaluation process. Recently it has been suggested to use viral dynamics to assess the potency of antiviral drugs and therapies, since viral decay rates in viral dynamic models have been shown to be related to the antiviral drug potency directly, and they need a shorter evaluation time. In this paper we first review the two statistical approaches for characterizing HIV dynamics and estimating viral decay rates: the individual nonlinear least squares regression (INLS) method and the population nonlinear mixed-effect model (PMEM) approach. To compare the viral decay rates between two treatment arms, parametric and nonparametric tests, based on the estimates of viral decay rates (the derived variables) from both the INLS and PMEM methods, are proposed and studied. We show, using the concept of exchangeability, that the test based on the empirical Bayes' estimates from the PMEM is valid, powerful and robust. This proposed method is very useful in most practical cases where the INLS-based tests and the general likelihood ratio test may not apply. We validate and compare various tests for finite samples using Monte Carlo simulations. Finally, we apply the proposed tests to an AIDS clinical trial to compare the antiviral potency between a 3-drug combination regimen and a 4-drug combination regimen. The proposed tests provide some significant evidence that the 4-drug regimen is more potent than the 3-drug regimen, while the naive methods fail to give a significant result.*To whom correspondence should be addressed.     

Development,Calibration and Performance of an HIV Transmission Model Incorporating Natural History and Behavioral Patterns: Application in South Africa

Understanding HIV transmission dynamics is critical to estimating the potential population-wide impact of HIV prevention and treatment interventions. We developed an individual-based simulation model of the heterosexual HIV epidemic in South Africa and linked it to the previously published Cost-Effectiveness of Preventing AIDS Complications (CEPAC) International Model, which simulates the natural history and treatment of HIV. In this new model, the CEPAC Dynamic Model (CDM), the probability of HIV transmission per sexual encounter between short-term, long-term and commercial sex worker partners depends upon the HIV RNA and disease stage of the infected partner, condom use, and the circumcision status of the uninfected male partner. We included behavioral, demographic and biological values in the CDM and calibrated to HIV prevalence in South Africa pre-antiretroviral therapy. Using a multi-step fitting procedure based on Bayesian melding methodology, we performed 264,225 simulations of the HIV epidemic in South Africa and identified 3,750 parameter sets that created an epidemic and had behavioral characteristics representative of a South African population pre-ART. Of these parameter sets, 564 contributed 90% of the likelihood weight to the fit, and closely reproduced the UNAIDS HIV prevalence curve in South Africa from 1990–2002. The calibration was sensitive to changes in the rate of formation of short-duration partnerships and to the partnership acquisition rate among high-risk individuals, both of which impacted concurrency. Runs that closely fit to historical HIV prevalence reflect diverse ranges for individual parameter values and predict a wide range of possible steady-state prevalence in the absence of interventions, illustrating the value of the calibration procedure and utility of the model for evaluating interventions. This model, which includes detailed behavioral patterns and HIV natural history, closely fits HIV prevalence estimates.     

Assessing predicted HIV-1 replicative capacity in a clinical setting

HIV-1 replicative capacity (RC) provides a measure of within-host fitness and is determined in the context of phenotypic drug resistance testing. However it is unclear how these in-vitro measurements relate to in-vivo processes. Here we assess RCs in a clinical setting by combining a previously published machine-learning tool, which predicts RC values from partial pol sequences with genotypic and clinical data from the Swiss HIV Cohort Study. The machine-learning tool is based on a training set consisting of 65000 RC measurements paired with their corresponding partial pol sequences. We find that predicted RC values (pRCs) correlate significantly with the virus load measured in 2073 infected but drug na?ve individuals. Furthermore, we find that, for 53 pairs of sequences, each pair sampled in the same infected individual, the pRC was significantly higher for the sequence sampled later in the infection and that the increase in pRC was also significantly correlated with the increase in plasma viral load and with the length of the time-interval between the sampling points. These findings indicate that selection within a patient favors the evolution of higher replicative capacities and that these in-vitro fitness measures are indicative of in-vivo HIV virus load.     

Modelling HIV immune response and validation with clinical data

A system of ordinary differential equations is formulated to describe the pathogenesis of HIV infection, wherein certain features that have been shown to be important by recent experimental research are incorporated in the model. These include the role of CD4+memory cells that serve as a major reservoir of latently infected cells, a critical role for T-helper cells in the generation of CD8 memory cells capable of efficient recall response, and stimulation by antigens other than HIV. A stability analysis illustrates the capability of this model in admitting multiple locally asymptotically stable (locally a.s.) off-treatment equilibria. We show that this more biologically detailed model can exhibit the phenomenon of transient viremia experienced by some patients on therapy with viral load levels suppressed below the detection limit. We also show that the loss of CD4+T-cell help in the generation of CD8+memory cells leads to larger peak values for the viral load during transient viremia. Censored clinical data is used to obtain parameter estimates. We demonstrate that using a reduced set of 16 free parameters, obtained by fixing some parameters at their population averages, the model provides reasonable fits to the patient data and, moreover, that it exhibits good predictive capability. We further show that parameter values obtained for most clinical patients do not admit multiple locally a.s off-treatment equilibria. This suggests that treatment to move from a high viral load equilibrium state to an equilibrium state with a lower (or zero) viral load is not possible for these patients.     

RankAggreg, an R package for weighted rank aggregation

Background

Determining the parameters of a mathematical model from quantitative measurements is the main bottleneck of modelling biological systems. Parameter values can be estimated from steady-state data or from dynamic data. The nature of suitable data for these two types of estimation is rather different. For instance, estimations of parameter values in pathway models, such as kinetic orders, rate constants, flux control coefficients or elasticities, from steady-state data are generally based on experiments that measure how a biochemical system responds to small perturbations around the steady state. In contrast, parameter estimation from dynamic data requires time series measurements for all dependent variables. Almost no literature has so far discussed the combined use of both steady-state and transient data for estimating parameter values of biochemical systems.

Results

In this study we introduce a constrained optimization method for estimating parameter values of biochemical pathway models using steady-state information and transient measurements. The constraints are derived from the flux connectivity relationships of the system at the steady state. Two case studies demonstrate the estimation results with and without flux connectivity constraints. The unconstrained optimal estimates from dynamic data may fit the experiments well, but they do not necessarily maintain the connectivity relationships. As a consequence, individual fluxes may be misrepresented, which may cause problems in later extrapolations. By contrast, the constrained estimation accounting for flux connectivity information reduces this misrepresentation and thereby yields improved model parameters.

Conclusion

The method combines transient metabolic profiles and steady-state information and leads to the formulation of an inverse parameter estimation task as a constrained optimization problem. Parameter estimation and model selection are simultaneously carried out on the constrained optimization problem and yield realistic model parameters that are more likely to hold up in extrapolations with the model.     

Parameter estimation in a crossbridge muscle model

Models of muscle crossbridge dynamics have great potential for understanding muscle contraction and having a wide range of application. However, the estimation of many model parameters, most of which are difficult to measure, limits their applicability. This study developed a method of estimating parameters in the Distribution Moment crossbridge model from measurements of force-length and force-velocity relationships in cat soleus single muscle fibers. Analysis of the parameter estimates showed that the detachment rate parameters had more uncertainty than the attachment rate parameter, which could reflect physiological variations in the contractile protein content and in the response of muscle to lengthenings.     

Hierarchical phylogenetic models for analyzing multipartite sequence data

Debate exists over how to incorporate information from multipartite sequence data in phylogenetic analyses. Strict combined-data approaches argue for concatenation of all partitions and estimation of one evolutionary history, maximizing the explanatory power of the data. Consensus/independence approaches endorse a two-step procedure where partitions are analyzed independently and then a consensus is determined from the multiple results. Mixtures across the model space of a strict combined-data approach and a priori independent parameters are popular methods to integrate these methods. We propose an alternative middle ground by constructing a Bayesian hierarchical phylogenetic model. Our hierarchical framework enables researchers to pool information across data partitions to improve estimate precision in individual partitions while permitting estimation and testing of tendencies in across-partition quantities. Such across-partition quantities include the distribution from which individual topologies relating the sequences within a partition are drawn. We propose standard hierarchical priors on continuous evolutionary parameters across partitions, while the structure on topologies varies depending on the research problem. We illustrate our model with three examples. We first explore the evolutionary history of the guinea pig (Cavia porcellus) using alignments of 13 mitochondrial genes. The hierarchical model returns substantially more precise continuous parameter estimates than an independent parameter approach without losing the salient features of the data. Second, we analyze the frequency of horizontal gene transfer using 50 prokaryotic genes. We assume an unknown species-level topology and allow individual gene topologies to differ from this with a small estimable probability. Simultaneously inferring the species and individual gene topologies returns a transfer frequency of 17%. We also examine HIV sequences longitudinally sampled from HIV+ patients. We ask whether posttreatment development of CCR5 coreceptor virus represents concerted evolution from middisease CXCR4 virus or reemergence of initial infecting CCR5 virus. The hierarchical model pools partitions from multiple unrelated patients by assuming that the topology for each patient is drawn from a multinomial distribution with unknown probabilities. Preliminary results suggest evolution and not reemergence.