A note on permutation tests for variance components in multilevel generalized linear mixed models

In many applications of generalized linear mixed models to multilevel data, it is of interest to test whether a random effects variance component is zero. It is well known that the usual asymptotic chi-square distribution of the likelihood ratio and score statistics under the null does not necessarily hold. In this note we propose a permutation test, based on randomly permuting the indices associated with a given level of the model, that has the correct Type I error rate under the null. Results from a simulation study suggest that it is more powerful than tests based on mixtures of chi-square distributions. The proposed test is illustrated using data on the familial aggregation of sleep disturbance.     

Testing the non-unity of rate ratio under inverse sampling

Inverse sampling is considered to be a more appropriate sampling scheme than the usual binomial sampling scheme when subjects arrive sequentially, when the underlying response of interest is acute, and when maximum likelihood estimators of some epidemiologic indices are undefined. In this article, we study various statistics for testing non-unity rate ratios in case-control studies under inverse sampling. These include the Wald, unconditional score, likelihood ratio and conditional score statistics. Three methods (the asymptotic, conditional exact, and Mid-P methods) are adopted for P-value calculation. We evaluate the performance of different combinations of test statistics and P-value calculation methods in terms of their empirical sizes and powers via Monte Carlo simulation. In general, asymptotic score and conditional score tests are preferable for their actual type I error rates are well controlled around the pre-chosen nominal level, and their powers are comparatively the largest. The exact version of Wald test is recommended if one wants to control the actual type I error rate at or below the pre-chosen nominal level. If larger power is expected and fluctuation of sizes around the pre-chosen nominal level are allowed, then the Mid-P version of Wald test is a desirable alternative. We illustrate the methodologies with a real example from a heart disease study.     

On power and sample size calculations for likelihood ratio tests in generalized linear models

A direct extension of the approach described in Self, Mauritsen, and Ohara (1992, Biometrics 48, 31-39) for power and sample size calculations in generalized linear models is presented. The major feature of the proposed approach is that the modification accommodates both a finite and an infinite number of covariate configurations. Furthermore, for the approximation of the noncentrality of the noncentral chi-square distribution for the likelihood ratio statistic, a simplification is provided that not only reduces substantial computation but also maintains the accuracy. Simulation studies are conducted to assess the accuracy for various model configurations and covariate distributions.     

Comparing the likelihood ratios of two binary diagnostic tests in the presence of partial verification

The comparison of the efficiency of two binary diagnostic tests requires one to know the disease status for all patients in the sample, by applying a gold standard. In two-phase studies the gold standard is not applied to all patients in a sample, and the problem of partial verification of the disease arises. At present, one of the approaches most used for comparing two binary diagnostic tests are the likelihood ratios. In this study, the maximum likelihood estimators of likelihood ratios are obtained. The tests of hypothesis to compare the likelihood ratios of two binary diagnostic tests when both are applied to the same random sample in the presence of verification bias are deduced, and simulation experiments are performed in order to investigate the asymptotic behaviour of the tests of hypothesis. The results obtained have been applied to the study of Alzheimer's disease.     

Testing for Poisson Zero Inflation in Disease Mapping

When analyzing mortality data due to rare diseases in small areas, it is common to find several health zones with no mortality cases. In these circumstances, the classical homogeneous model based on the Poisson distribution used to estimate the relative risks within each area may encounter lack of fit due to a disproportionately large frequency of zeros. To cope with these zeros, the zero inflated Poisson model can be used. In this paper, we propose a test for detecting zero inflation in the context of disease mapping which is based on bootstrap techniques. The test is illustrated using male mortality data due to brain cancer in Navarra, Spain. In addition, comparisons with other tests for Poisson zero inflation such as the score test and the likelihood ratio test are carried out in terms of empirical power and size using the brain cancer scenario. The proposed bootstrap test has good power and size and works well when detecting the excess of zeros in small area data sets. (© 2004 WILEY‐VCH Verlag GmbH & Co. KGaA, Weinheim)     

Robust alternatives to the F-Test in mixed linear models based on MM-estimates

Mixed linear models are commonly used to analyze data in many settings. These models are generally fitted by means of (restricted) maximum likelihood techniques relying heavily on normality. The sensitivity of the resulting estimators and related tests to this underlying assumption has been identified as a weakness that can even lead to wrong interpretations. Very recently a highly robust estimator based on a scale estimate, that is, an S-estimator, has been proposed for general mixed linear models. It has the advantage of being easy to compute and allows the computation of a robust score test. However, this proposal cannot be used to define a likelihood ratio type test that is certainly the most direct route to robustify an F-test. As the latter is usually a key tool of hypothesis testing in mixed linear models, we propose two new robust estimators that allow the desired extension. They also lead to resistant Wald-type tests useful for testing contrasts and covariate effects. We study their properties theoretically and by means of simulations. The analysis of a real data set illustrates the advantage of the new approach in the presence of outlying observations.     

The use of score tests for inference on variance components

Whenever inference for variance components is required, the choice between one-sided and two-sided tests is crucial. This choice is usually driven by whether or not negative variance components are permitted. For two-sided tests, classical inferential procedures can be followed, based on likelihood ratios, score statistics, or Wald statistics. For one-sided tests, however, one-sided test statistics need to be developed, and their null distribution derived. While this has received considerable attention in the context of the likelihood ratio test, there appears to be much confusion about the related problem for the score test. The aim of this paper is to illustrate that classical (two-sided) score test statistics, frequently advocated in practice, cannot be used in this context, but that well-chosen one-sided counterparts could be used instead. The relation with likelihood ratio tests will be established, and all results are illustrated in an analysis of continuous longitudinal data using linear mixed models.     

Fast Bayesian inference in large Gaussian graphical models

Despite major methodological developments, Bayesian inference in Gaussian graphical models remains challenging in high dimension due to the tremendous size of the model space. This article proposes a method to infer the marginal and conditional independence structures between variables by multiple testing, which bypasses the exploration of the model space. Specifically, we introduce closed‐form Bayes factors under the Gaussian conjugate model to evaluate the null hypotheses of marginal and conditional independence between variables. Their computation for all pairs of variables is shown to be extremely efficient, thereby allowing us to address large problems with thousands of nodes as required by modern applications. Moreover, we derive exact tail probabilities from the null distributions of the Bayes factors. These allow the use of any multiplicity correction procedure to control error rates for incorrect edge inclusion. We demonstrate the proposed approach on various simulated examples as well as on a large gene expression data set from The Cancer Genome Atlas.     

Non-inferiority testing with a variable margin

There has been growing interest, when comparing an experimental treatment with an active control with respect to a binary outcome, in allowing the non-inferiority margin to depend on the unknown success rate in the control group. It does not seem universally recognized, however, that the statistical test should appropriately adjust for the uncertainty surrounding the non-inferiority margin. In this paper, we inspect a naive procedure that treats an "observed margin" as if it were fixed a priori, and explain why it might not be valid. We then derive a class of tests based on the delta method, including the Wald test and the score test, for a smooth margin. An alternative derivation is given for the asymptotic distribution of the likelihood ratio statistic, again for a smooth margin. We discuss the asymptotic behavior of these tests when applied to a piecewise smooth margin. A simple condition on the margin function is given which allows the likelihood ratio test to carry over to a piecewise smooth margin using the same critical value as for a smooth margin. Simulation experiments are conducted, under a smooth margin and a piecewise linear margin, to evaluate the finite-sample performance of the asymptotic tests studied.     

Comparison of properties of tests for assessing tumor clonality

SUMMARY: In a recent article Begg et al. (2007, Biometrics 63, 522-530) proposed a statistical test to determine whether or not a diagnosed second primary tumor is biologically independent of the original primary tumor, by comparing patterns of allelic losses at candidate genetic loci. The proposed concordant mutations test is a conditional test, an adaptation of Fisher's exact test, that requires no knowledge of the marginal mutation probabilities. The test was shown to have generally good properties, but is susceptible to anticonservative bias if there is wide variation in mutation probabilities between loci, or if the individual mutation probabilities of the parental alleles for individual patients differ substantially from each other. In this article, a likelihood ratio test is derived in an effort to address these validity issues. This test requires prespecification of the marginal mutation probabilities at each locus, parameters for which some information will typically be available in the literature. In simulations this test is shown to be valid, but to be considerably less efficient than the concordant mutations test for sample sizes (numbers of informative loci) typical of this problem. Much of the efficiency deficit can be recovered, however, by restricting the allelic imbalance parameter estimate to a prespecified range, assuming that this parameter is in the prespecified range.     

Statistical Inference For Risk Difference in an Incomplete Correlated 2 × 2 Table

In some infectious disease studies and 2‐step treatment studies, 2 × 2 table with structural zero could arise in situations where it is theoretically impossible for a particular cell to contain observations or structural void is introduced by design. In this article, we propose a score test of hypotheses pertaining to the marginal and conditional probabilities in a 2 × 2 table with structural zero via the risk/rate difference measure. Score test‐based confidence interval will also be outlined. We evaluate the performance of the score test and the existing likelihood ratio test. Our empirical results evince the similar and satisfactory performance of the two tests (with appropriate adjustments) in terms of coverage probability and expected interval width. Both tests consistently perform well from small‐ to moderate‐sample designs. The score test however has the advantage that it is only undefined in one scenario while the likelihood ratio test can be undefined in many scenarios. We illustrate our method by a real example from a two‐step tuberculosis skin test study.     

The Residual Likelihood Ratio Test for the Variance Ratio in a Linear Model with Two Variance Components

Residual maximum likelihood has proved to be a successful approach to the estimation of variance components. In this paper, its counterpart in testing, the residual likelihood ratio test, is applied to testing the ratio of two variance components. The test is compared with the Wald test and the locally most powerful invariant test.