A Procedure for the Common Estimation of Parameters Corresponding to Several Treatment Groups

In this article we give a procedure for the common estimation of parameters corresponding to several treatment groups. Thereby we assume that the distribution functions of the groups belong to the same family and differ only in the parameter values. The procedure allows the common estimation of some of these parameters. The parameters themselves will be estimated by the maximum likelihood method; the estimators will be calculated iteratively by the Newton-Raphson method. To prove if the common estimation is possible, we propose as a suitable test the maximum likelihood ratio test. Finally we show the application of our procedure in the case of the probit analysis.     

A solution to the problem of monotone likelihood in Cox regression

The phenomenon of monotone likelihood is observed in the fitting process of a Cox model if the likelihood converges to a finite value while at least one parameter estimate diverges to +/- infinity. Monotone likelihood primarily occurs in small samples with substantial censoring of survival times and several highly predictive covariates. Previous options to deal with monotone likelihood have been unsatisfactory. The solution we suggest is an adaptation of a procedure by Firth (1993, Biometrika 80, 27-38) originally developed to reduce the bias of maximum likelihood estimates. This procedure produces finite parameter estimates by means of penalized maximum likelihood estimation. Corresponding Wald-type tests and confidence intervals are available, but it is shown that penalized likelihood ratio tests and profile penalized likelihood confidence intervals are often preferable. An empirical study of the suggested procedures confirms satisfactory performance of both estimation and inference. The advantage of the procedure over previous options of analysis is finally exemplified in the analysis of a breast cancer study.     

Mixed-model analysis of a censored normal distribution with reference to animal breeding

A mixed-model procedure for analysis of censored data assuming a multivariate normal distribution is described. A Bayesian framework is adopted which allows for estimation of fixed effects and variance components and prediction of random effects when records are left-censored. The procedure can be extended to right- and two-tailed censoring. The model employed is a generalized linear model, and the estimation equations resemble those arising in analysis of multivariate normal or categorical data with threshold models. Estimates of variance components are obtained using expressions similar to those employed in the EM algorithm for restricted maximum likelihood (REML) estimation under normality.     

A New Method for Estimation of Resource Selection Probability Function

ABSTRACT Weighted distributions can be used to fit various forms of resource selection probability functions (RSPF) under the use-versus-available study design (Lele and Keim 2006). Although valid, the numerical maximization procedure used by Lele and Keim (2006) is unstable because of the inherent roughness of the Monte Carlo likelihood function. We used a combination of the methods of partial likelihood and data cloning to obtain maximum likelihood estimators of the RSPF in a numerically stable fashion. We demonstrated the methodology using simulated data sets generated under the log—log RSPF model and a reanalysis of telemetry data presented in Lele and Keim (2006) using the logistic RSPF model. The new method for estimation of RSPF can be used to understand differential selection of resources by animals, an essential component of studies in conservation biology, wildlife management, and applied ecology.     

Estimation of heritability using variety trials data from incomplete blocks

An assessment of the heritability of a trait is useful in formulating a breeding strategy for crop improvement. We have considered the estimation of broad-sense heritability from a single-location trial and from multi-locational trials conducted in incomplete blocks. Using residual maximum likelihood estimates of variance components, we estimated the heritability and obtained expressions for the estimate of its bias and its standard error. The estimation procedure is illustrated for 25 barley genotypes evaluated at four locations in West Asia and North Africa during 1992.     

Improved estimation of the proportion of triploids in populations with diploid and triploid individuals

We consider the estimation of the proportion of triploids in populations of plants or animals in which diploid and triploid individuals coexist, using data from electrophoretic analysis of isozyme or microsatellite markers. Individuals that have three distinct alleles at a locus are unambiguously triploid. However, other individuals cannot be classified with certainty as diploid or triploid, unless allelic dosage can be determined reliably. This is impossible for microsatellite markers, and for many isozyme markers. We therefore present a maximum likelihood method of estimating the proportion of triploids based only on the presence or absence of different alleles.     

Mixture model for inferring susceptibility to mastitis in dairy cattle: a procedure for likelihood-based inference

A Gaussian mixture model with a finite number of components and correlated random effects is described. The ultimate objective is to model somatic cell count information in dairy cattle and to develop criteria for genetic selection against mastitis, an important udder disease. Parameter estimation is by maximum likelihood or by an extension of restricted maximum likelihood. A Monte Carlo expectation-maximization algorithm is used for this purpose. The expectation step is carried out using Gibbs sampling, whereas the maximization step is deterministic. Ranking rules based on the conditional probability of membership in a putative group of uninfected animals, given the somatic cell information, are discussed. Several extensions of the model are suggested.     

A structural EM algorithm for phylogenetic inference.

A central task in the study of molecular evolution is the reconstruction of a phylogenetic tree from sequences of current-day taxa. The most established approach to tree reconstruction is maximum likelihood (ML) analysis. Unfortunately, searching for the maximum likelihood phylogenetic tree is computationally prohibitive for large data sets. In this paper, we describe a new algorithm that uses Structural Expectation Maximization (EM) for learning maximum likelihood phylogenetic trees. This algorithm is similar to the standard EM method for edge-length estimation, except that during iterations of the Structural EM algorithm the topology is improved as well as the edge length. Our algorithm performs iterations of two steps. In the E-step, we use the current tree topology and edge lengths to compute expected sufficient statistics, which summarize the data. In the M-Step, we search for a topology that maximizes the likelihood with respect to these expected sufficient statistics. We show that searching for better topologies inside the M-step can be done efficiently, as opposed to standard methods for topology search. We prove that each iteration of this procedure increases the likelihood of the topology, and thus the procedure must converge. This convergence point, however, can be a suboptimal one. To escape from such "local optima," we further enhance our basic EM procedure by incorporating moves in the flavor of simulated annealing. We evaluate these new algorithms on both synthetic and real sequence data and show that for protein sequences even our basic algorithm finds more plausible trees than existing methods for searching maximum likelihood phylogenies. Furthermore, our algorithms are dramatically faster than such methods, enabling, for the first time, phylogenetic analysis of large protein data sets in the maximum likelihood framework.     

Estimation and Testing of Tumor Incidence Rates in Experiments Lacking Cause-of-Death Data

Approximate nonparametric maximum likelihood estimation of the tumor incidence rate and comparison of tumor incidence rates between treatment groups are examined in the context of animal carcinogenicity experiments that have interval sacrifice data but lack cause-of-death information. The estimation procedure introduced by MALANI and VAN RYZIN (1988), which can result in a negative estimate of the tumor incidence rate, is modified by employing a numerical method to maximize the likelihood function iteratively, under the constraint that the tumor incidence rate is nonnegative. With the new procedure, estimates can be obtained even if sacrifices occur anywhere within an interval. The resulting estimates have reduced standard error and give more power to the test of two heterogeneous groups. Furthermore, a linear contrast of more than two groups can be tested using our procedure. The proposed estimation and testing methods are illustrated with an experimental data set.     

Restricted BLUP for Mixed Linear Models

A new estimation procedure for mixed regression models is introduced. It is a development of Henderson's best linear unbiased prediction procedure which uses the joint distribution of the observed dependent random variables and the unknown realisations of the random components of the model. It is proposed to replace the likelihood of the observations given the random components by the asymptotic likelihood of the maximum likelihood estimators and the prior distribution of the random components by a restricted prior distribution which is consistent with the usual restrictions placed on the random components when they are considered conditionally fixed.     

Multilevel models for survival analysis with random effects

A method for modeling survival data with multilevel clustering is described. The Cox partial likelihood is incorporated into the generalized linear mixed model (GLMM) methodology. Parameter estimation is achieved by maximizing a log likelihood analogous to the likelihood associated with the best linear unbiased prediction (BLUP) at the initial step of estimation and is extended to obtain residual maximum likelihood (REML) estimators of the variance component. Estimating equations for a three-level hierarchical survival model are developed in detail, and such a model is applied to analyze a set of chronic granulomatous disease (CGD) data on recurrent infections as an illustration with both hospital and patient effects being considered as random. Only the latter gives a significant contribution. A simulation study is carried out to evaluate the performance of the REML estimators. Further extension of the estimation procedure to models with an arbitrary number of levels is also discussed.     

Maximum likelihood with multiparameter models of substitution

Maximum-likelihood approaches to phylogenetic estimation have the potential of great flexibility, even though current implementations are highly constrained. One such constraint has been the limitation to one-parameter models of substitution. A general implementation of Newton's maximization procedure was developed that allows the maximum likelihood method to be used with multiparameter models. The Estimate and Maximize (EM) algorithm was also used to obtain a good approximation to the maximum likelihood for a certain class of multiparameter models. The condition for which a multiparameter model will only have a single maximum on the likelihood surface was identified. Two-and three-parameter models of substitution in base-paired regions of RNA sequences were used as examples for computer simulations to show that these implementations of the maximum likelihood method are not substantially slower than one-parameter models. Newton's method is much faster than the EM method but may be subject to divergence in some circumstances. In these cases the EM method can be used to restore convergence.     

A latent trait finite mixture model for the analysis of rating agreement

This article presents a latent distribution model for the analysis of agreement on dichotomous or ordered category ratings. The model includes parameters that characterize bias, category definitions, and measurement error for each rater or test. Parameter estimates can be used to evaluate rater performance and to improve classification or measurement with use of multiple ratings. A simple maximum likelihood estimation procedure is described. Two examples illustrate the approach. Although considered in the context of analyzing rater agreement, the model provides a general approach for mixture analysis using two or more ordered-caregory measures.     

Estimation of Interplant Dependence in a Linear Planting Scheme

A maximum likelihood procedure is developed to estimate the dependence relations between plants at equal distances along a row, by fitting simultaneous bilateral models to the observations. Where there is more than one characteristic measured on each plant, a simultaneous bilateral vector model can be fitted by maximum likelihood procedures. The latter model also applies when one characteristic is measured on each plant in a two-dimensional planting array where interplant distances within each row are equal but interrow spacing varies. The estimation is particularly suited to the small sample situation.     

Bayesian Reliability Estimation of a Two-parameter Cauchy Distribution

This paper gives an approximate Bayes procedure for the estimation of the reliability function of a two-parameter Cauchy distribution using Jeffreys' non-informative prior with a squared-error loss function, and with a log-odds ratio squared-error loss function. Based on a Monte Carlo simulation study, two such Bayes estimators of the reliability are compared with the maximum likelihood estimator.     

A Simple Illustration of the Failure of PQL,IRREML and APHL as Approximate ML Methods for Mixed Models for Binary Data

Evaluation of the likelihood in mixed models for non-normal data, e.g. dependent binary data, involves high dimensional integration, which offers severe numerical problems. Penalized quasi-likelihood, iterative re-weighted restricted maximum likelihood and adjusted profile h-likelihood estimation are methods which avoid numerical integration. They will be derived by approximation of the maximum likelihood equations. For binary data, these estimation procedures may yield seriously biased estimates for components of variance, intra-class correlation or heritability. An analytical evaluation of a simple example illustrates how very critical the approximations can be for the performance of the variance component estimators.     

Maximum Likelihood Estimation of the Number of Nucleotide Substitutions from Restriction Sites Data

A simple method of the maximum likelihood estimation of the number of nucleotide substitutions is presented for the case where restriction sites data from many different restriction enzymes are available. An iteration method, based on nucleotide counting, is also developed. This method is simpler than the maximum likelihood method but gives the same estimate. A formula for computing the variance of a maximum likelihood estimate is also presented.     

Estimation of parameters of allometric equations.

Accurate parameter estimation of allometric equations is a question of considerable interest. Various techniques that address this problem exist. In this paper it is assumed that the measured values are normally distributed and a maximum likelihood estimation approach is used. The computations involved in this procedure are reducible to relatively simple forms, and an efficient numerical algorithm is used. A listing of the computer program is included as an appendix.     

二个区域的封闭种群的标记重捕模型

通过引入区域的初始比例因子,考虑了二个区域A与B的封闭种群标记重捕模型,再利用完整的极大似然函数和多项分布函数的性质,给出了当个体在不同区域的个体捕捉率相等时的二个区域之间的转移概率与各区域的初始比例的求法,推导出在不同区域的个体捕捉率不相等但个体低转移率条件下二个区域的封闭种群的标记重捕模型的参数表达式,并用实例说明。     

Targeted maximum likelihood estimation for dynamic treatment regimes in sequentially randomized controlled trials

Sequential Randomized Controlled Trials (SRCTs) are rapidly becoming essential tools in the search for optimized treatment regimes in ongoing treatment settings. Analyzing data for multiple time-point treatments with a view toward optimal treatment regimes is of interest in many types of afflictions: HIV infection, Attention Deficit Hyperactivity Disorder in children, leukemia, prostate cancer, renal failure, and many others. Methods for analyzing data from SRCTs exist but they are either inefficient or suffer from the drawbacks of estimating equation methodology. We describe an estimation procedure, targeted maximum likelihood estimation (TMLE), which has been fully developed and implemented in point treatment settings, including time to event outcomes, binary outcomes and continuous outcomes. Here we develop and implement TMLE in the SRCT setting. As in the former settings, the TMLE procedure is targeted toward a pre-specified parameter of the distribution of the observed data, and thereby achieves important bias reduction in estimation of that parameter. As with the so-called Augmented Inverse Probability of Censoring Weight (A-IPCW) estimator, TMLE is double-robust and locally efficient. We report simulation results corresponding to two data-generating distributions from a longitudinal data structure.