Tests of Occupancy Rates for Clustered Populations: Case Where the Cluster Sizes are Known

A modified chi-squared statistic Z is proposed for testing hypotheses about category occupancy rates for individuals distributed by clusters, when the cluster sizes are observed. This statistic is the Pearson chi-square statistic based on the individuals' counts divided by 1 + M* where M* is the mean number of other individuals per cluster per individual. The kind of alternative hypothesis for which the Z-based test compares favourably in power with the Pearson chi-square test based on the cluster frequencies is given. However, we prove that this latter test is more powerful than the former one as long as the equidistribution of the random choice vectors is assumed.     

On the Measure of Agreement Between Two Raters

The degree of agreement between two raters is re-examined. An alternative statistic which uses the chi-square distribution is proposed. We conclude that this statistic is better than the usual k-statistic when the classification variable is at least ordinal.     

Comparing Power Behaviours for Some Goodness-of-Fit Test Statistics in Sparse Multinomials

This paper is concerned with the power behaviour of four goodness-of-fit test statistics in sparse multinomials with k cells. Most previous work has been concerned only with both Pearson's X² and the likelihood ratio test statistics. We consider in this study, two additional test statistics, namely, the Cressie-Read test statistic – I(2/3) and the modified Freeman-Tukey test (FT) statistic. Because k ≥ 10 in this study, a Monte Carlo procedure based on 1000 simulated samples is used to estimate the powers for the four test statistics. Alternatives on various line segments are employed. Results suggest that none of the test statistics completely dominate the other and that the choice of which test to use depends on the nature of the alternative hypothesis. These results are consistent with those obtained by West and Kempthorne (1972), although, the Pearson's χ² test statistic may be preferred because of its closer approximation to the χ² distribution in terms of the attained α levels.     

TEMPORAL VARIATION IN ALLELE FREQUENCIES: TESTING THE RIGHT HYPOTHESIS

Although standard statistical tests (such as contingency chi-square or G tests) are not well suited to the analysis of temporal changes in allele frequencies, they continue to be used routinely in this context. Because the null hypothesis stipulated by the test is violated if samples are temporally spaced, the true probability of a significant test statistic will not equal the nominal α level, and conclusions drawn on the basis of such tests can be misleading. A generalized method, applicable to a wide variety of organisms and sampling schemes, is developed here to estimate the probability of a significant test statistic if the only forces acting on allele frequencies are stochastic ones (i.e., sampling error and genetic drift). Results from analyses and simulations indicate that the rate at which this probability increases with time is determined primarily by the ratio of sample size to effective population size. Because this ratio differs considerably among species, the seriousness of the error in using the standard test will also differ. Bias is particularly strong in cases in which a high percentage of the total population can be sampled (for example, endangered species). The model used here is also applicable to the analysis of parent-offspring data and to comparisons of replicate samples from the same generation. A generalized test of the hypothesis that observed changes in allele frequency can be satisfactorily explained by drift follows directly from the model, and simulation results indicate that the true α level of this adjusted test is close to the nominal one under most conditions.     

A Report on a Monte Carlo Simulation of the Sampling Distribution of the Incidence Test and its Two Related Tests

A large-scale (5000 throws) Monte Carlo simulation experiment was carried out to study the nature of the sampling distributions of the incidence test and its two related tests, the FRIEDMAN test and the dual test, and to evaluate the goodness of the proposed gamma approximation relative to the conventional chi-square approximation. For all three tests, on the basis of the experimental results obtained for k = 3, 4, 5, and N = k(1) (120/k), the gamma approximation should be preferred over the chi-square. Exact companion tabulations show that use of the chi-square approximation entails an appreciable conservative bias. Extensive listings are provided of the moments of the experimental distributions of the three test statistics, and of the observed distributions of the corresponding gamma probabilities. The simulation experiment was run on a UNIVAC 1108 large-scale computer system.     

Testing for Treatment Effects on Subsets of Endpoints

Multiple endpoints are tested to assess an overall treatment effect and also to identify which endpoints or subsets of endpoints contributed to treatment differences. The conventional p‐value adjustment methods, such as single‐step, step‐up, or step‐down procedures, sequentially identify each significant individual endpoint. Closed test procedures can also detect individual endpoints that have effects via a step‐by‐step closed strategy. This paper proposes a global‐based statistic for testing an a priori number, say, r of the k endpoints, as opposed to the conventional approach of testing one (r = 1) endpoint. The proposed test statistic is an extension of the single‐step p‐value‐based statistic based on the distribution of the smallest p‐value. The test maintains strong control of the FamilyWise Error (FWE) rate under the null hypothesis of no difference in any (sub)set of r endpoints among all possible combinations of the k endpoints. After rejecting the null hypothesis, the individual endpoints in the sets that are rejected can be tested further, using a univariate test statistic in a second step, if desired. However, the second step test only weakly controls the FWE. The proposed method is illustrated by application to a psychosis data set.     

Properties and Application of the Location-Test V (n,k)

The present paper is concerned with the properties of a test statistic V(n, k) to test location differences in the one-sample case with known hypothetical distribution G(x). The test is similar to the WILCOXON two-sample statistic after replacement of the second sample by quantiles of the hypothetical distribution. A comparison with the exact distribution of V(n, k) shows that an approximation by means of the normal distribution provides good results even for small sample sizes. The V-test is unbiased against one-tailed alternatives and it is consistent with a restriction which is hardly relevant in practical applications. With regard to the application we are interested especially in the power and robustness against extreme observations for small sample size n. It is shown that in a normal distribution with known standard deviation V(n, k) is more powerful than STUDENT's t for small n and more robust in the sense considered here. The test statistic is based on grouping of the observations into classes of equal expected frequency. A generalization to arbitrary classes provides an essential extension of applicability such as to discrete distributions and to situations where only relative frequencies of G(x) in fixed classes are known.     

Rank Analysis of Block Designs Having Different Cell Frequencies

A distribution–free test is considered for testing the treatment effects in block designs with different cell frequencies. A test statistic which is a function of treatment ranks has been proposed which is distributed as chi-square for large samples. The null distribution of the test statistic has been obtained. The entire procedure has been explained by a numerical example.     

A family-based likelihood ratio test for general pedigree structures that allows for genotyping error and missing data

The purpose of this work is the development of a family-based association test that allows for random genotyping errors and missing data and makes use of information on affected and unaffected pedigree members. We derive the conditional likelihood functions of the general nuclear family for the following scenarios: complete parental genotype data and no genotyping errors; only one genotyped parent and no genotyping errors; no parental genotype data and no genotyping errors; and no parental genotype data with genotyping errors. We find maximum likelihood estimates of the marker locus parameters, including the penetrances and population genotype frequencies under the null hypothesis that all penetrance values are equal and under the alternative hypothesis. We then compute the likelihood ratio test. We perform simulations to assess the adequacy of the central chi-square distribution approximation when the null hypothesis is true. We also perform simulations to compare the power of the TDT and this likelihood-based method. Finally, we apply our method to 23 SNPs genotyped in nuclear families from a recently published study of idiopathic scoliosis (IS). Our simulations suggest that this likelihood ratio test statistic follows a central chi-square distribution with 1 degree of freedom under the null hypothesis, even in the presence of missing data and genotyping errors. The power comparison shows that this likelihood ratio test is more powerful than the original TDT for the simulations considered. For the IS data, the marker rs7843033 shows the most significant evidence for our method (p = 0.0003), which is consistent with a previous report, which found rs7843033 to be the 2nd most significant TDTae p value among a set of 23 SNPs.     

Asymptotic Efficiency of the Chi-Square Test for Heterogeneity of Proportions in Some Sparse-Data Cases

We consider the problem of testing for heterogeneity of K proportions when K is not small and the binomial sample sizes may not be large. We assume that the binomial proportions are normally distributed with variance σ². The asymptotic relative efficiency (ARE) of the usual chi-square test is found relative to the likelihood-based tests for σ²=0. The chi-square test is found to have ARE = 1 when the binomial sample sizes are all equal and high relative efficiency for other cases. The efficiency is low only in cases where there is insufficient data to use the chi-square test.     

The Reliability of Tests of Hypotheses when Overdispersed Logistic-Linear Models are Fitted by Maximum Quasi-Likelihood

When overdispersed logistic-linear models are fitted by maximum quasi-likelihood hypotheses can be tested by comparing either the Wald statistic, or the quasi-likelihood score statistic, or the quasi likelihood-ratio statistic, with the approximating null X² distribution. This paper reports a simulation study of the reliability of these tests. Some factors affecting their relative reliabilities are identified. An extended quasi-likelihood ratio test is also considered.     

Detecting disease gene in DNA haplotype sequences by nonparametric dissimilarity test

Association studies for complex diseases based on haplotype data have received increasing attention in the last few years. A commonly used nonparametric method, which takes haplotype structure into consideration, is to use the U-statistic to compare the similarities between genetic compositions in the case and control populations. Although the method and its variants are convenient to use in practice, there are some areas where the tests cannot detect even large differences between cases and controls. To overcome this problem and enhance the power, we propose a new form of the weighted U-statistic, which directly compares the dissimilarity between the haplotype structures in the case and control populations. We show that this test statistic is asymptotically a linear combination of the absolute values of normal random variables under the null hypothesis, and shifts strictly toward the right under the alternative, and therefore has no blind areas of detection. Simulation studies indicate that our test statistic overcomes the weakness of the existing ones and is robust and powerful as well.     

Simultaneous Non‐inferiority Test of Sensitivity and Specificity for Two Diagnostic Procedures in the Presence of a Gold Standard

Sensitivity and specificity have traditionally been used to assess the performance of a diagnostic procedure. Diagnostic procedures with both high sensitivity and high specificity are desirable, but these procedures are frequently too expensive, hazardous, and/or difficult to operate. A less sophisticated procedure may be preferred, if the loss of the sensitivity or specificity is determined to be clinically acceptable. This paper addresses the problem of simultaneous testing of sensitivity and specificity for an alternative test procedure with a reference test procedure when a gold standard is present. The hypothesis is formulated as a compound hypothesis of two non‐inferiority (one‐sided equivalence) tests. We present an asymptotic test statistic based on the restricted maximum likelihood estimate in the framework of comparing two correlated proportions under the prospective and retrospective sampling designs. The sample size and power of an asymptotic test statistic are derived. The actual type I error and power are calculated by enumerating the exact probabilities in the rejection region. For applications that require high sensitivity as well as high specificity, a large number of positive subjects and a large number of negative subjects are needed. We also propose a weighted sum statistic as an alternative test by comparing a combined measure of sensitivity and specificity of the two procedures. The sample size determination is independent of the sampling plan for the two tests.     

Testing for marginal independence between two categorical variables with multiple responses

Questions that ask respondents to "choose all that apply" from a set of items occur frequently in surveys. Categorical variables that summarize this type of survey data are called both pick any/c variables and multiple-response categorical variables. It is often of interest to test for independence between two categorical variables. When both categorical variables can have multiple responses, traditional Pearson chi-square tests for independence should not be used because of the within-subject dependence among responses. An intuitively constructed version of the Pearson statistic is proposed to perform the test using bootstrap procedures to approximate its sampling distribution. First- and second-order adjustments to the proposed statistic are given in order to use a chi-square distribution approximation. A Bonferroni adjustment is proposed to perform the test when the joint set of responses for individual subjects is unavailable. Simulations show that the bootstrap procedures hold the correct size more consistently than the other procedures.     

A Modified Chi-Square Test for Testing Equality of Two Multinomial Populations Against an Ordering Restricted Alternative

A modified chi-square test for testing the equality of two multinomial populations against an ordering restricted alternative in one sample and two sample cases is constructed. The relation between a concept of dependence called dependence by chi-square and stochastic ordering is established. A tabulation of the asymptotic distribution of the test statistic under the null hypothesis is given. Simulations are used to compare the power of this test with the power of the likelihood ratio test of stochastic ordering of the two multinomial populations.     

Confidence Interval for Rate Ratio in a 2 × 2 Table with Structural Zero: An Application in Assessing False-Negative Rate Ratio When Combining Two Diagnostic Tests

Summary . In this article, we consider problems with correlated data that can be summarized in a 2 × 2 table with structural zero in one of the off‐diagonal cells. Data of this kind sometimes appear in infectious disease studies and two‐step procedure studies. Lui (1998, Biometrics 54, 706–711) considered confidence interval estimation of rate ratio based on Fieller‐type, Wald‐type, and logarithmic transformation statistics. We reexamine the same problem under the context of confidence interval construction on false‐negative rate ratio in diagnostic performance when combining two diagnostic tests. We propose a score statistic for testing the null hypothesis of nonunity false‐negative rate ratio. Score test–based confidence interval construction for false‐negative rate ratio will also be discussed. Simulation studies are conducted to compare the performance of the new derived score test statistic and existing statistics for small to moderate sample sizes. In terms of confidence interval construction, our asymptotic score test–based confidence interval estimator possesses significantly shorter expected width with coverage probability being close to the anticipated confidence level. In terms of hypothesis testing, our asymptotic score test procedure has actual type I error rate close to the pre‐assigned nominal level. We illustrate our methodologies with real examples from a clinical laboratory study and a cancer study.     

Enhanced Regulatory Sequence Prediction Using Gapped k-mer Features

Oligomers of length k, or k-mers, are convenient and widely used features for modeling the properties and functions of DNA and protein sequences. However, k-mers suffer from the inherent limitation that if the parameter k is increased to resolve longer features, the probability of observing any specific k-mer becomes very small, and k-mer counts approach a binary variable, with most k-mers absent and a few present once. Thus, any statistical learning approach using k-mers as features becomes susceptible to noisy training set k-mer frequencies once k becomes large. To address this problem, we introduce alternative feature sets using gapped k-mers, a new classifier, gkm-SVM, and a general method for robust estimation of k-mer frequencies. To make the method applicable to large-scale genome wide applications, we develop an efficient tree data structure for computing the kernel matrix. We show that compared to our original kmer-SVM and alternative approaches, our gkm-SVM predicts functional genomic regulatory elements and tissue specific enhancers with significantly improved accuracy, increasing the precision by up to a factor of two. We then show that gkm-SVM consistently outperforms kmer-SVM on human ENCODE ChIP-seq datasets, and further demonstrate the general utility of our method using a Naïve-Bayes classifier. Although developed for regulatory sequence analysis, these methods can be applied to any sequence classification problem.     

Linear Rank Tests Derived from a Superpopulation Model

A superpopulation model generates the probabilities of a Bernouilli random variable. The ranks of the involved variables are considered as survey weights. The distribution f each linear rank statistic is derived under the null hypothesis for the two sample problem and for the case k2 when a simple random sampling or stratified sampling is used. The growth of a population of insects and the behavior of patients with imsomnia are studied using these procedures.     

A multiple testing procedure for clinical trials.

A multiple testing procedure is proposed for comparing two treatments when response to treatment is both dichotomous (i.e., success or failure) and immediate. The proposed test statistic for each test is the usual (Pearson) chi-square statistic based on all data collected to that point. The maximum number (N) of tests and the number (m1 + m2) of observations collected between successive tests is fixed in advance. The overall size of the procedure is shown to be controlled with virtually the same accuracy as the single sample chi-square test based on N(m1 + m2) observations. The power is also found to be virtually the same. However, by affording the opportunity to terminate early when one treatment performs markedly better than the other, the multiple testing procedure may eliminate the ethical dilemmas that often accompany clinical trials.     

Comparing Species Assemblages Via Species Accumulation Curves

Summary Comparing species assemblages given incidence‐based data is of importance in ecological studies, often done by a visual inspection of estimated species accumulation curves or by an ad hoc use of 95% pointwise confidence bands of these curves. It is shown that comparing species assemblages is a challenging problem. A χ² test is proposed. An adjustment using an eigenvalue decomposition is proposed to overcome computational difficulties. The bootstrap method is also suggested to approximate the distribution of the proposed test statistic. The eigenvalue adjusted (Eva) χ² test and the Eva‐bootstrap test are assessed by a simulation study. Both the Eva‐χ² and the Eva‐bootstrap tests are applied to a study that involves two woody seedling species assemblages.