Targeted maximum likelihood estimation of the parameter of a marginal structural model

Targeted maximum likelihood estimation is a versatile tool for estimating parameters in semiparametric and nonparametric models. We work through an example applying targeted maximum likelihood methodology to estimate the parameter of a marginal structural model. In the case we consider, we show how this can be easily done by clever use of standard statistical software. We point out differences between targeted maximum likelihood estimation and other approaches (including estimating function based methods). The application we consider is to estimate the effect of adherence to antiretroviral medications on virologic failure in HIV positive individuals.     

Estimation and comparison of changes in the presence of informative right censoring: conditional linear model

A general linear regression model for the usual least squares estimated rate of change (slope) on censoring time is described as an approximation to account for informative right censoring in estimating and comparing changes of a continuous variable in two groups. Two noniterative estimators for the group slope means, the linear minimum variance unbiased (LMVUB) estimator and the linear minimum mean squared error (LMMSE) estimator, are proposed under this conditional model. In realistic situations, we illustrate that the LMVUB and LMMSE estimators, derived under a simple linear regression model, are quite competitive compared to the pseudo maximum likelihood estimator (PMLE) derived by modeling the censoring probabilities. Generalizations to polynomial response curves and general linear models are also described.     

Maximum likelihood estimation of the frequency of null alleles at microsatellite loci

We review three methods for estimating the frequency of null alleles at codominant loci (such as microsatellite loci) and present a new maximum likelihood approach. Computer simulations show that the maximum likelihood estimator has a smaller root mean squared error than previous estimators.     

Survival estimation using splines

A nonparametric maximum likelihood procedure is given for estimating the survivor function from right-censored data. It approximates the hazard rate by a simple function such as a spline, with different approximations yielding different estimators. A special case is that proposed by Nelson (1969, Journal of Quality Technology 1, 27-52) and Altshuler (1970, Mathematical Biosciences 6, 1-11). The estimators are uniformly consistent and have the same asymptotic weak convergence properties as the Kaplan-Meier (1958, Journal of the American Statistical Association 53, 457-481) estimator. However, in small and in heavily censored samples, the simplest spline estimators have uniformly smaller mean squared error than do the Kaplan-Meier and Nelson-Altshuler estimators. The procedure is extended to estimate the baseline hazard rate and regression coefficients in the Cox (1972, Journal of the Royal Statistical Society, Series B 34, 187-220) proportional hazards model and is illustrated using experimental carcinogenesis data.     

On the use of concordant pairs in matched case-control studies

A new estimator of the common odds ratio in one-to-one matched case-control studies is proposed. The connection between this estimator and the James-Stein estimating procedure is highlighted through the argument of estimating functions. Comparisons are made between this estimator, the conditional maximum likelihood estimator, and the estimator ignoring the matching in terms of finite sample bias, mean squared error, coverage probability, and length of confidence interval. In many situations, the new estimator is found to be more efficient than the conditional maximum likelihood estimator without being as biased as the estimator that ignores matching. The extension to multiple risk factors is also outlined.     

A Method for Estimating Penetrance of Pathogenic Mutations in a Mitochondrial Genome

Variation in the age of onset is typical of many mitochondrial diseases. The estimation of penetrance of deleterious mtDNA mutations causing such diseases is usually conducted on samples of individuals whose age exceeds the maximum age of the disease manifestation. In the case of rare diseases, samples of sufficient size sometimes cannot be formed. In this study, we propose a method for estimating penetrance involving individuals of any age. The efficiency of the method is demonstrated using Leber hereditary optic neuropathy as an example. It is shown that the method provides an unbiased estimate of penetrance and considerably reduces the error of this estimate in comparison with a sample including individuals whose age exceeds the maximum age of disease manifestation.     

An improved method for estimating inbreeding depression in pedigrees

Fitness is expected to decrease with inbreeding in proportion to the amount of deleterious genetic variation present in a population. The effect of inbreeding on survivorship is usually modeled as a negative exponential relationship, and this model has been widely used to estimate the amount of deleterious genetic variation in populations. Linear regression has traditionally been used to estimate the parameters of the model, including the number of lethal equivalents. This article describes an alternative method for estimating parameters and their confidence limits: the maximum likelihood approach. The accuracy of regression and maximum likelihood estimates of the number of lethal equivalents is compared through simulation. The maximum likelihood approach is found to be both median unbiased and capable of estimating confidence limits with nearly the stated degree of accuracy, while the linear regression approach is found to be median biased. The significance of this on previous estimates of inbreeding depression is discussed. Zoo Biol 17:481–497, 1998. © 1998 Wiley-Liss, Inc.     

Smooth quantile ratio estimation with regression: estimating medical expenditures for smoking-attributable diseases

The methodological development of this paper is motivated by a common problem in econometrics where we are interested in estimating the difference in the average expenditures between two populations, say with and without a disease, as a function of the covariates. For example, let Y(1) and Y(2) be two non-negative random variables denoting the health expenditures for cases and controls. Smooth Quantile Ratio Estimation (SQUARE) is a novel approach for estimating Delta=E[Y(1)] - E[Y(2)] by smoothing across percentiles the log-transformed ratio of the two quantile functions. Dominici et al. (2005) have shown that SQUARE defines a large class of estimators of Delta, is more efficient than common parametric and nonparametric estimators of Delta, and is consistent and asymptotically normal. However, in applications it is often desirable to estimate Delta(x)=E[Y(1)|x]--E[Y(2)|x], that is, the difference in means as a function of x. In this paper we extend SQUARE to a regression model and we introduce a two-part regression SQUARE for estimating Delta(x) as a function of x. We use the first part of the model to estimate the probability of incurring any costs and the second part of the model to estimate the mean difference in health expenditures, given that a nonzero cost is observed. In the second part of the model, we apply the basic definition of SQUARE for positive costs to compare expenditures for the cases and controls having 'similar' covariate profiles. We determine strata of cases and control with 'similar' covariate profiles by the use of propensity score matching. We then apply two-part regression SQUARE to the 1987 National Medicare Expenditure Survey to estimate the difference Delta(x) between persons suffering from smoking-attributable diseases and persons without these diseases as a function of the propensity of getting the disease. Using a simulation study, we compare frequentist properties of two-part regression SQUARE with maximum likelihood estimators for the log-transformed expenditures.     

Semi-parametric estimation of the binormal ROC curve for a continuous diagnostic test

Not until recently has much attention been given to deriving maximum likelihood methods for estimating the intercept and slope parameters from a binormal ROC curve that assesses the accuracy of a continuous diagnostic test. We propose two new methods for estimating these parameters. The first method uses the profile likelihood and a simple algorithm to produce fully efficient estimates. The second method is based on a pseudo-maximum likelihood that can easily accommodate adjusting for covariates that could affect the accuracy of the continuous test.     

An improved method for estimating sequence divergence of DNA using restriction endonuclease mappings

Summary The method proposed by Kaplan and Langley for estimating the extent of sequence divergence between related DNA's using restriction endonuclease maps is modified so that the estimates are easier to compute. In the two-species case, these modifications lead via a maximum likelihood approach to an estimate which is closely related to one recently suggested by Nei and Li (1979) and Gotoh et al. (1979). Simulation studies show that the modified estimates are comparable to those of Kaplan and Langley, providing that there is sufficient homology in the DNA segments of the related species. The M-species case, M 3, is also discussed.     

Common Slope Tests for Bivariate Errors‐in‐Variables Models

Likelihood ratio tests are derived for bivariate normal structural relationships in the presence of group structure. These tests may also be applied to less restrictive models where only errors are assumed to be normally distributed. Tests for a common slope amongst those from several datasets are derived for three different cases – when the assumed ratio of error variances is the same across datasets and either known or unknown, and when the standardised major axis model is used. Estimation of the slope in the case where the ratio of error variances is unknown could be considered as a maximum likelihood grouping method. The derivations are accompanied by some small sample simulations, and the tests are applied to data arising from work on seed allometry.     

Evaluating the mean frequency of responding cells in limiting dilution assays

Summary The validity of limiting dilution assays can be compromised or negated by the use of statistical methodology which does not consider all issues surrounding the biological process. This study critically evaluates statistical methods for estimating the mean frequency of responding cells in multiple sample limiting dilution assays. We show that methods that pool limiting dilution assay data, or samples, are unable to estimate the variance appropriately. In addition, we use Monte Carlo simulations to evaluate an unweighted mean of the maximum likelihood estimator, an unweighted mean based on the jackknife estimator, and a log transform of the maximum likelihood estimator. For small culture replicate size, the log transform outperforms both unweighted mean procedures. For moderate culture replicate size, the unweighted mean based on the jackknife produces the most acceptable results. This study also addresses the important issue of experimental design in multiple sample limiting dilution assays. In particular, we demonstrate that optimization of multiple sample limiting dilution assays is achieved by increasing the number of biological samples at the expense of repeat cultures.     

Shrinkage Pre-Test Estimator of the Intercept Parameter for a Regression Model with Multivariate Student-t Errors

In the presence of an uncertain prior information about the value of the slope parameter, the estimation of the intercept parameter of a simple regression model with a multivariate Student-t error distribution is investigated. The unrestricted, restricted and shrinkage preliminary test maximum likelihood estimators are defined. The expressions for the bias and the mean square error of the three estimators are provided and the relative efficiences are analyzed. A maximin criterion is established, and graphs are constructed for an arbitrary number of degrees of freedom (D.F.) as well as sample sizes. A criterion to select optimal significance level is also discussed.     

Estimation of Microorganism Counts in Agglutination and Enzyme Linked Immuno‐Sorbent Assays: Consequences of Ignoring Censored Data

The consequences of ignoring censored data on the estimation of mean microorganism counts using agglutination assays or certain classes of enzyme linked immuno‐sorbent assays are examined. It is shown that both overestimation and underestimation of the maximum likelihood estimate of the mean number of microorganisms per unit volume may occur if censored data are ignored. It is also shown that the asymptotic variance of the maximum likelihood estimate may either be increased or decreased if censored data are ignored. Data from a trial of vaccines against pig pneumonia and data from an equine health certification process are used as illustrations.     

A maximum pseudo-likelihood approach for estimating species trees under the coalescent model

Background  

Several phylogenetic approaches have been developed to estimate species trees from collections of gene trees. However, maximum likelihood approaches for estimating species trees under the coalescent model are limited. Although the likelihood of a species tree under the multispecies coalescent model has already been derived by Rannala and Yang, it can be shown that the maximum likelihood estimate (MLE) of the species tree (topology, branch lengths, and population sizes) from gene trees under this formula does not exist. In this paper, we develop a pseudo-likelihood function of the species tree to obtain maximum pseudo-likelihood estimates (MPE) of species trees, with branch lengths of the species tree in coalescent units.     

A Stochastic Regression Model for General Trend Analysis of Longitudinal Continuous Data

A predictive continuous time model is developed for continuous panel data to assess the effect of time‐varying covariates on the general direction of the movement of a continuous response that fluctuates over time. This is accomplished by reparameterizing the infinitesimal mean of an Ornstein–Uhlenbeck processes in terms of its equilibrium mean and a drift parameter, which assesses the rate that the process reverts to its equilibrium mean. The equilibrium mean is modeled as a linear predictor of covariates. This model can be viewed as a continuous time first‐order autoregressive regression model with time‐varying lag effects of covariates and the response, which is more appropriate for unequally spaced panel data than its discrete time analog. Both maximum likelihood and quasi‐likelihood approaches are considered for estimating the model parameters and their performances are compared through simulation studies. The simpler quasi‐likelihood approach is suggested because it yields an estimator that is of high efficiency relative to the maximum likelihood estimator and it yields a variance estimator that is robust to the diffusion assumption of the model. To illustrate the proposed model, an application to diastolic blood pressure data from a follow‐up study on cardiovascular diseases is presented. Missing observations are handled naturally with this model.     

Evaluation of several methods for estimating phylogenetic trees when substitution rates differ over nucleotide sites

Several maximum likelihood and distance matrix methods for estimating phylogenetic trees from homologous DNA sequences were compared when substitution rates at sites were assumed to follow a gamma distribution. Computer simulations were performed to estimate the probabilities that various tree estimation methods recover the true tree topology. The case of four species was considered, and a few combinations of parameters were examined. Attention was applied to discriminating among different sources of error in tree reconstruction, i.e., the inconsistency of the tree estimation method, the sampling error in the estimated tree due to limited sequence length, and the sampling error in the estimated probability due to the number of simulations being limited. Compared to the least squares method based on pairwise distance estimates, the joint likelihood analysis is found to be more robust when rate variation over sites is present but ignored and an assumption is thus violated. With limited data, the likelihood method has a much higher probability of recovering the true tree and is therefore more efficient than the least squares method. The concept of statistical consistency of a tree estimation method and its implications were explored, and it is suggested that, while the efficiency (or sampling error) of a tree estimation method is a very important property, statistical consistency of the method over a wide range of, if not all, parameter values is prerequisite.     

Estimating environmental effects on population dynamics: consequences of observation error

Within the paradigm of population dynamics a central task is to identify environmental factors affecting population change and to estimate the strength of these effects. We here investigate the impact of observation errors in measurements of population densities on estimates of environmental effects. Adding observation errors may change the autocorrelation of a population time series with potential consequences for estimates of effects of autocorrelated environmental covariates. Using Monte Carlo simulations, we compare the performance of maximum likelihood estimates from three stochastic versions of the Gompertz model (log–linear first order autoregressive model), assuming 1) process error only, 2) observation error only, and 3) both process and observation error (the linear state–space model on log‐scale). We also simulated population dynamics using the Ricker model, and evaluated the corresponding maximum likelihood estimates for process error models. When there is observation error in the data and the considered environmental variable is strongly autocorrelated, its estimated effect is likely to be biased when using process error models. The environmental effect is overestimated when the sign of the autocorrelations of the intrinsic dynamics and the environment are the same and underestimated when the signs differ. With non‐autocorrelated environmental covariates, process error models produce fairly exact point estimates as well as reliable confidence intervals for environmental effects. In all scenarios, observation error models produce unbiased estimates with reasonable precision, but confidence intervals derived from the likelihood profiles are far too optimistic if there is process error present. The safest approach is to use state–space models in presence of observation error. These are factors worthwhile to consider when interpreting earlier empirical results on population time series, and in future studies, we recommend choosing carefully the modelling approach with respect to intrinsic population dynamics and covariate autocorrelation.     

Testing for group effect in a 2 x k heteroscedastic ANOVA model

It is natural to want to relax the assumption of homoscedasticity and Gaussian error in ANOVA models. For a two-way ANOVA model with 2 x k cells, one can derive tests of main effect for the factor with two levels (referred to as group) without assuming homoscedasticity or Gaussian error. Empirical likelihood can be used to derive testing procedures. An approximate empirical likelihood ratio test (AELRT) is derived for the test of group main effect. To approximate the distributions of the test statistics under the null hypothesis, simulation from the approximate empirical maximum likelihood estimate (AEMLE) restricted by the null hypothesis is used. The homoscedastic ANOVA F -test and a Box-type approximation to the distribution of the heteroscedastic ANOVA F -test are compared to the AELRT in level and power. The AELRT procedure is shown by simulation to have appropriate type I error control (although possibly conservative) when the distribution of the test statistics are approximated by simulation from the constrained AEMLE. The methodology is motivated and illustrated by an analysis of folate levels in the blood among two alcohol intake groups while accounting for gender.