Testing hypotheses in case-control studies--equivalence of Mantel-Haenszel statistics and logit score tests.

The two approaches in common use for the analysis of case-control studies are cross-classification by confounding variables, and modeling the logarithm of the odds ratio as a function of exposure and confounding variables. We show here that score statistics derived from the likelihood function in the latter approach are identical to the Mantel-Haenszel test statistics appropriate for the former approach. This identity holds in the most general situation considered, testing for marginal homogeneity in mK tables. This equivalence is demonstrated by a permutational argument which leads to a general likelihood expression in which the exposure variable may be a vector of discrete and/or continuous variables and in which more than two comparison groups may be considered. This likelihood can be used in analyzing studies in which there are multiple controls for each case or in which several disease categories are being compared. The possibility of including continuous variables makes this likelihood useful in situations that cannot be treated using the Mantel-Haenszel cross-classification approach.     

A step-up procedure for selecting variables associated with survival.

Multivariate concomitant information on a subject's condition usually accompanies survival time data. Using a model in which each subject's lifetime is exponentially distributed, this paper suggests a method which utilizes a step-up procedure for choosing the most important variables associated with survival. Maximum likelihood (ML) estimates are utilized, and the likelihood ratio is employed as the criterion for adding significant concomitant variables. An example using multiple myeloma survival data and sixteen concomitant variables is discussed in which three variables are chosen to predict survival.     

Using biological assemblage composition to infer the values of covarying environmental factors

1. Observations of different organisms can often be used to infer environmental conditions at a site. These inferences may be useful for diagnosing the causes of degradation in streams and rivers. 2. When used for diagnosis, biological inferences must not only provide accurate, unbiased predictions of environmental conditions, but also pairs of inferred environmental variables must covary no more strongly than actual measurements of those same environmental variables. 3. Mathematical analysis of the relationship between the measured and inferred values of different environmental variables provides an approach for comparing the covariance between measurements with the covariance between inferences. Then, simulated and field‐collected data are used to assess the performance of weighted average and maximum likelihood inference methods. 4. Weighted average inferences became less accurate as covariance in the calibration data increased, whereas maximum likelihood inferences were unaffected by covariance in the calibration data. In contrast, the accuracy of weighted average inferences was unaffected by changes in measurement error, whilst the accuracy of maximum likelihood inferences decreased as measurement error increased. Weighted average inferences artificially increased the covariance of environmental variables beyond what was expected from measurements, whereas maximum likelihood inference methods more accurately reproduced the expected covariances. 5. Multivariate maximum likelihood inference methods can potentially provide more useful diagnostic information than single variable inference models.     

A Bayesian Decision Procedure for Selecting Prognostic Variables Associated with Survival for Data in which Censoring is Prevalent

A Bayesian procedure is developed for the selection of concomitant variables in survival models. The variables are selected in a step-up procedure according to the criterion of maximum expected likelihood, where the expectation is over the prior parameter space. Prior knowledge of the influence of these covariates on patient prognosis is incorporated into the analysis. The step-up procedure is stopped when the Bayes factor in favor of omitting the variable selected in a particular step exceeds a specified value. The resulting model with the selected variables is fitted using Bayes estimates of the coefficients. This technique is applied to Hodgkin's disease data from a large Cooperative Clinical Trial Group and the results are compared to the results from the classical likelihood selection procedure.     

A computer program for stepwise logistic regression using maximum likelihood estimation

A computer program has been written which performs a stepwise selection of variables for logistic regression using maximum likelihood estimation. The selection procedure is based on likelihood ratio tests for the coefficients. These tests are used in a forward selection and a backward elimination at each step. The use of the program is illustrated by several examples.     

Penalized partial likelihood regression for right-censored data with bootstrap selection of the penalty parameter

The Cox proportional hazards model is often used for estimating the association between covariates and a potentially censored failure time, and the corresponding partial likelihood estimators are used for the estimation and prediction of relative risk of failure. However, partial likelihood estimators are unstable and have large variance when collinearity exists among the explanatory variables or when the number of failures is not much greater than the number of covariates of interest. A penalized (log) partial likelihood is proposed to give more accurate relative risk estimators. We show that asymptotically there always exists a penalty parameter for the penalized partial likelihood that reduces mean squared estimation error for log relative risk, and we propose a resampling method to choose the penalty parameter. Simulations and an example show that the bootstrap-selected penalized partial likelihood estimators can, in some instances, have smaller bias than the partial likelihood estimators and have smaller mean squared estimation and prediction errors of log relative risk. These methods are illustrated with a data set in multiple myeloma from the Eastern Cooperative Oncology Group.     

Computation of the Full Likelihood Function for Estimating Variance at a Quantitative Trait Locus

The proportion of alleles identical by descent (IBD) determines the genetic covariance between relatives, and thus is crucial in estimating genetic variances of quantitative trait loci (QTL). However, IBD proportions at QTL are unobservable and must be inferred from marker information. The conventional method of QTL variance analysis maximizes the likelihood function by replacing the missing IBDs by their conditional expectations (the expectation method), while in fact the full likelihood function should take into account the conditional distribution of IBDs (the distribution method). The distribution method for families of more than two sibs has not been obvious because there are n(n - 1)/2 IBD variables in a family of size n, forming an n X n symmetrical matrix. In this paper, I use four binary variables, where each indicates the event that an allele from one of the four grandparents has passed to the individual. The IBD proportion between any two sibs is then expressed as a function of the indicators. Subsequently, the joint distribution of the IBD matrix is derived from the distribution of the indicator variables. Given the joint distribution of the unknown IBDs, a method to compute the full likelihood function is developed for families of arbitrary sizes.     

Semiparametric maximum likelihood for measurement error model regression

This paper presents an EM algorithm for semiparametric likelihood analysis of linear, generalized linear, and nonlinear regression models with measurement errors in explanatory variables. A structural model is used in which probability distributions are specified for (a) the response and (b) the measurement error. A distribution is also assumed for the true explanatory variable but is left unspecified and is estimated by nonparametric maximum likelihood. For various types of extra information about the measurement error distribution, the proposed algorithm makes use of available routines that would be appropriate for likelihood analysis of (a) and (b) if the true x were available. Simulations suggest that the semiparametric maximum likelihood estimator retains a high degree of efficiency relative to the structural maximum likelihood estimator based on correct distributional assumptions and can outperform maximum likelihood based on an incorrect distributional assumption. The approach is illustrated on three examples with a variety of structures and types of extra information about the measurement error distribution.     

Linear parameter haplotype models with stratification

OBJECTIVES: The question of interest is estimating the relationship between haplotypes and an outcome measure, based upon unphased genotypes. The outcome of interest might be predicting the presence of disease in a logistic model, predicting a numeric drug response in a linear model, or predicting survival time in a parametric survival model with censoring. Explanatory variables may include phased haplotype design variables, environmental variables, or interactions between them. METHODS: We extend existing generalized linear haplotype models to parametric survival outcomes. To improve the stability of model variance estimates, a profile likelihood solution is proposed. An adjustment for population stratification is also considered. Here we investigate data sampled from known 'strata' (e.g., gender or ethnicity) that influence haplotype prior probabilities and thus the regression model weights. Differing linear model variance estimates, and the effect of stratification and departures from Hardy-Weinberg Equilibrium (HWE) on parameter estimates, are compared and contrasted via simulation. RESULTS: From simulations, we observed an improvement in statistical power when using a solution to profile likelihood equations. We also saw that stratification had little impact on estimates. Haplotypes that are not in HWE had a negative impact on power to test hypotheses. Finally, profile likelihood solutions for haplotypes deviating from HWE had improved power and confidence interval coverage of regression model coefficients.     

Mixture Markov regression model with application to mosquito surveillance data analysis

A mixture Markov regression model is proposed to analyze heterogeneous time series data. Mixture quasi‐likelihood is formulated to model time series with mixture components and exogenous variables. The parameters are estimated by quasi‐likelihood estimating equations. A modified EM algorithm is developed for the mixture time series model. The model and proposed algorithm are tested on simulated data and applied to mosquito surveillance data in Peel Region, Canada.     

Restricted BLUP for Mixed Linear Models

A new estimation procedure for mixed regression models is introduced. It is a development of Henderson's best linear unbiased prediction procedure which uses the joint distribution of the observed dependent random variables and the unknown realisations of the random components of the model. It is proposed to replace the likelihood of the observations given the random components by the asymptotic likelihood of the maximum likelihood estimators and the prior distribution of the random components by a restricted prior distribution which is consistent with the usual restrictions placed on the random components when they are considered conditionally fixed.     

Tests for an Epidemic Change in a Sequence of Exponentially Distributed Random Variables

Consider a sequence of independent exponential random variables that is susceptible to a change in the means. We would like to test whether the means have been subjected to an epidemic change after an unknown point, for an unknown duration in the sequence. The likelihood ratio statistic and a likelihood ratio type statistic are derived. The distribution theories and related properties of the test statistics are discussed. Percentage points and powers of the tests are tabulated for selected values of the parameters. The powers of these two tests are then compared to the two statistics proposed by Aly and Bouzar. The tests are applied to find epidemic changes in the set of Stanford heart transplant data and air traffic arrival data.     

The maximum likelihood identification method applied to insect morphometric data

To distinguish species or populations using morphometric data is generally processed through multivariate analyses,in particular the discriminant analysis.We explored another approach based on the maximum likelihood method.Simple statistics based on the assumption of normal distribution at a single variable allows to compute the chance of observing a particular data (or sample) in a given reference group.When data are described by more than one variable,the maximum likelihood (MLi) approach allows to combine these chances to fmd the best fit for the data.Such approach assumes independence between variables.The assumptions of normal distribution of variables and independence between them are frequently not met in morphometrics,but improvements may be obtained after some mathematical transformations.Provided there is strict anatomical correspondence of variables between unknown and reference data,the MLi classification produces consistent classification.We explored this approach using various input data,and compared validated classification scores with the ones obtained after the Mahalanobis distance-based classification.The simplicity of the method,its fast computation,performance and versatility,make it an interesting complement to other classification techniques.     

Joint analysis of time-to-event and multiple binary indicators of latent classes

Multiple categorical variables are commonly used in medical and epidemiological research to measure specific aspects of human health and functioning. To analyze such data, models have been developed considering these categorical variables as imperfect indicators of an individual's "true" status of health or functioning. In this article, the latent class regression model is used to model the relationship between covariates, a latent class variable (the unobserved status of health or functioning), and the observed indicators (e.g., variables from a questionnaire). The Cox model is extended to encompass a latent class variable as predictor of time-to-event, while using information about latent class membership available from multiple categorical indicators. The expectation-maximization (EM) algorithm is employed to obtain maximum likelihood estimates, and standard errors are calculated based on the profile likelihood, treating the nonparametric baseline hazard as a nuisance parameter. A sampling-based method for model checking is proposed. It allows for graphical investigation of the assumption of proportional hazards across latent classes. It may also be used for checking other model assumptions, such as no additional effect of the observed indicators given latent class. The usefulness of the model framework and the proposed techniques are illustrated in an analysis of data from the Women's Health and Aging Study concerning the effect of severe mobility disability on time-to-death for elderly women.     

On the maximum likelihood estimation of respiratory response slopes

Several approaches have been suggested for estimating a respiratory response slope when both x and y variables are observed with error. Recently, a maximum likelihood estimate under the assumption of a bivariate normal distribution has been proposed. A method of moments solution yields a slope estimate of y/x as long as the underlying process mean is nonzero. This paper extends the maximum likelihood approach to the case where the process mean is zero. In this case, certain additional error assumptions must be made to yield a unique estimate. These concepts are applied to the problem of estimating an effective lung volume for steady-state breath-to-breath gas exchange data during exercise.     

A Penalized Likelihood Approach for Bivariate Conditional Normal Models for Dynamic Co‐expression Analysis

Summary Gene co‐expressions have been widely used in the analysis of microarray gene expression data. However, the co‐expression patterns between two genes can be mediated by cellular states, as reflected by expression of other genes, single nucleotide polymorphisms, and activity of protein kinases. In this article, we introduce a bivariate conditional normal model for identifying the variables that can mediate the co‐expression patterns between two genes. Based on this model, we introduce a likelihood ratio (LR) test and a penalized likelihood procedure for identifying the mediators that affect gene co‐expression patterns. We propose an efficient computational algorithm based on iterative reweighted least squares and cyclic coordinate descent and have shown that when the tuning parameter in the penalized likelihood is appropriately selected, such a procedure has the oracle property in selecting the variables. We present simulation results to compare with existing methods and show that the LR‐based approach can perform similarly or better than the existing method of liquid association and the penalized likelihood procedure can be quite effective in selecting the mediators. We apply the proposed method to yeast gene expression data in order to identify the kinases or single nucleotide polymorphisms that mediate the co‐expression patterns between genes.     

A simulation study of measurement error correction methods in logistic regression

Measurement error models in logistic regression have received considerable theoretical interest over the past 10-15 years. In this paper, we present the results of a simulation study that compares four estimation methods: the so-called regression calibration method, probit maximum likelihood as an approximation to the logistic maximum likelihood, the exact maximum likelihood method based on a logistic model, and the naive estimator, which is the result of simply ignoring the fact that some of the explanatory variables are measured with error. We have compared the behavior of these methods in a simple, additive measurement error model. We show that, in this situation, the regression calibration method is a very good alternative to more mathematically sophisticated methods.     

Testing the Equality of Dependent Variances

The likelihood ratio test for testing equality of vgE;2 correlated variables is developed. In general, evaluation of the test statistic involves the iterative optimization of a likelihood function with 1 + v(v – 1)/2 parameters. The explicit form of the test statistic is derived in the bivariate case, and an iterative algorithm for determining the maximum likelihood estimates is suggested. A limited Monte Carlo study determines the behavior of the proposed procedure under the null hypothesis and variety of parameter values.     

A Likelihood Ratio Test of the Equality of Paired Survival Data with Censoring

A test is developed to determine whether the mean survival times are equal when dealing with paired survival data. We assume the data follow a bivariate exponential distribution for which the variables are conditionally independent. The unconditional distribution is derived in which the distribution of the nuissance variable is general. A method based on the likelihood ratio is derived to obtain the test. The data are allowed to have both left and right censoring.     

Maximum likelihood analysis of a general latent variable model with hierarchically mixed data

A general two-level latent variable model is developed to provide a comprehensive framework for model comparison of various submodels. Nonlinear relationships among the latent variables in the structural equations at both levels, as well as the effects of fixed covariates in the measurement and structural equations at both levels, can be analyzed within the framework. Moreover, the methodology can be applied to hierarchically mixed continuous, dichotomous, and polytomous data. A Monte Carlo EM algorithm is implemented to produce the maximum likelihood estimate. The E-step is completed by approximating the conditional expectations through observations that are simulated by Markov chain Monte Carlo methods, while the M-step is completed by conditional maximization. A procedure is proposed for computing the complicated observed-data log likelihood and the BIC for model comparison. The methods are illustrated by using a real data set.