Maximum likelihood estimation of the parameters of the prior distributions of three variables that strongly influence reproductive performance in cows

Ovulation detection rate, pregnancy rate, and embryo loss rate greatly affect the reproductive performance of cows. A previous model described the separate effects of these variables on the resulting calving patterns and assumed that the variables have the same value for all cows belonging to the same herd. This is not a realistic biological assumption, so the beta distribution is used to introduce "between-cow" variation in the three variables. Two approaches are used to find maximum likelihood estimates of the parameters of these prior beta distributions. The first considers sequences of ovulations, artificial inseminations, and pregnancies, separately. For both ovulation detection rate and pregnancy rate this approach considers the number of "successes" of each event for a particular cow (e.g., in the case of an ovulation, a success is a detection), and conditions on the total number of occurrences of that event in the cow, so that beta-binomial distributions are considered. However, for embryo loss rate the number of pregnancies required until a particular cow calves is considered, so that a beta-geometric distribution results. If the cow is removed before she calves, a censored sequence will result. The second approach considers the sequences of ovulations, artificial inseminations, pregnancies, and embryo losses, together, which will stop only when the cow calves. Otherwise, if she is removed before that time, a censored sequence will result. In this case, a joint distribution, with three independent prior beta distributions, is considered. The results of the analysis of data from 22 herds are discussed.     

Novel bivariate moment-closure approximations

Nonlinear stochastic models are typically intractable to analytic solutions and hence, moment-closure schemes are used to provide approximations to these models. Existing closure approximations are often unable to describe transient aspects caused by extinction behaviour in a stochastic process. Recent work has tackled this problem in the univariate case. In this study, we address this problem by introducing novel bivariate moment-closure methods based on mixture distributions. Novel closure approximations are developed, based on the beta-binomial, zero-modified distributions and the log-Normal, designed to capture the behaviour of the stochastic SIS model with varying population size, around the threshold between persistence and extinction of disease. The idea of conditional dependence between variables of interest underlies these mixture approximations. In the first approximation, we assume that the distribution of infectives (I) conditional on population size (N) is governed by the beta-binomial and for the second form, we assume that I is governed by zero-modified beta-binomial distribution where in either case N follows a log-Normal distribution. We analyse the impact of coupling and inter-dependency between population variables on the behaviour of the approximations developed. Thus, the approximations are applied in two situations in the case of the SIS model where: (1) the death rate is independent of disease status; and (2) the death rate is disease-dependent. Comparison with simulation shows that these mixture approximations are able to predict disease extinction behaviour and describe transient aspects of the process.     

An Evaluation of Beta-Binomial and Dirichlet-Trinomial Models for the Analysis of Reproductive and Developmental Effects

The common endpoints for the evaluation of reproductive and developmental toxic effects are the number of dead/resorbed fetuses, the number of malformed fetuses, and the number of normal fetuses for each litter. The joint distribution of the three endpoints could be modelled by a Dirichlettrinomial distribution or by a product of two-beta-binomial distributions. A simulation experiment is used to investigate the biases of the maximum likelihood estimate (MLE) for the probability of adverse effects under the Dirichlet-trinomial model and the beta-binomial model. Also, the type I errors and powers of the likelihood ratio test for comparing the difference between treatment and control are evaluated for the two underlying models. In estimation, the two MLE's are comparable, the bias estimates are small. In testing, the likelihood ratio test is generally more powerful under the Dirichlet-trinomial model than the beta-binomial model. The type I error rate is greater than the nominal level using the Dirichlet-trinomial model in some cases, when the data are generated from the two-beta-binomial model, and it is less than the nominal level using the beta-binomial model in other cases, when the data are generated from the Dirichlet-trinomial model.     

Analyzing Short-Term Noise Dependencies of Spike-Counts in Macaque Prefrontal Cortex Using Copulas and the Flashlight Transformation

Simultaneous spike-counts of neural populations are typically modeled by a Gaussian distribution. On short time scales, however, this distribution is too restrictive to describe and analyze multivariate distributions of discrete spike-counts. We present an alternative that is based on copulas and can account for arbitrary marginal distributions, including Poisson and negative binomial distributions as well as second and higher-order interactions. We describe maximum likelihood-based procedures for fitting copula-based models to spike-count data, and we derive a so-called flashlight transformation which makes it possible to move the tail dependence of an arbitrary copula into an arbitrary orthant of the multivariate probability distribution. Mixtures of copulas that combine different dependence structures and thereby model different driving processes simultaneously are also introduced. First, we apply copula-based models to populations of integrate-and-fire neurons receiving partially correlated input and show that the best fitting copulas provide information about the functional connectivity of coupled neurons which can be extracted using the flashlight transformation. We then apply the new method to data which were recorded from macaque prefrontal cortex using a multi-tetrode array. We find that copula-based distributions with negative binomial marginals provide an appropriate stochastic model for the multivariate spike-count distributions rather than the multivariate Poisson latent variables distribution and the often used multivariate normal distribution. The dependence structure of these distributions provides evidence for common inhibitory input to all recorded stimulus encoding neurons. Finally, we show that copula-based models can be successfully used to evaluate neural codes, e.g., to characterize stimulus-dependent spike-count distributions with information measures. This demonstrates that copula-based models are not only a versatile class of models for multivariate distributions of spike-counts, but that those models can be exploited to understand functional dependencies.     

Segregation ratios within Segregation Distorter lines of Drosophila melanogaster conform to a beta-binomial distribution

Segregation Distorter (SD) chromosomes are preferentially recovered from SD/SD+ males due to the dysfunction of sperm bearing the SD+ chromosome. The proportion of offspring bearing the SD chromosome is given the symbol k. The nature of the frequency distribution of k was examined by comparing observed k distributions produced by six different SD chromosomes, each with a different mean, with k distributions predicted by two different statistical models. The first model was one where the k of all males with a given SD chromosome were considered to be equal prior to the determination of those gametes which produce viable zygotes. In this model the only source of variation of k would be binomial sampling. The results rigorously demonstrated for the first time that the observed k distributions did not fit the prediction that the only source of variation was binomial sampling. The next model tested was that the prior distribution of segregation ratios conformed to a beta distribution, such that the distribution of k would be a beta-binomial distribution. The predicted distributions of this model did not differ significantly from the observed distributions of k in five of the six cases examined. The sixth case probably failed to fit a beta-binomial distribution due to a major segregating modifier. The demonstration that the prior distribution of segregation ratios of SD lines can generally be approximated with a beta distribution is crucial for the biometrical analysis of segregation distortion.     

Quantitative genetic models for describing simultaneous and recursive relationships between phenotypes

Multivariate models are of great importance in theoretical and applied quantitative genetics. We extend quantitative genetic theory to accommodate situations in which there is linear feedback or recursiveness between the phenotypes involved in a multivariate system, assuming an infinitesimal, additive, model of inheritance. It is shown that structural parameters defining a simultaneous or recursive system have a bearing on the interpretation of quantitative genetic parameter estimates (e.g., heritability, offspring-parent regression, genetic correlation) when such features are ignored. Matrix representations are given for treating a plethora of feedback-recursive situations. The likelihood function is derived, assuming multivariate normality, and results from econometric theory for parameter identification are adapted to a quantitative genetic setting. A Bayesian treatment with a Markov chain Monte Carlo implementation is suggested for inference and developed. When the system is fully recursive, all conditional posterior distributions are in closed form, so Gibbs sampling is straightforward. If there is feedback, a Metropolis step may be embedded for sampling the structural parameters, since their conditional distributions are unknown. Extensions of the model to discrete random variables and to nonlinear relationships between phenotypes are discussed.     

On the asymptotic behaviour of the pseudolikelihood ratio test statistic with boundary problems

This paper considers the asymptotic distribution of the likelihood ratio statistic T for testing a subset of parameter of interest θ, θ = (γ, η), H(0) : γ = γ(0), based on the pseudolikelihood L(θ, ??), where ?? is a consistent estimator of ?, the nuisance parameter. We show that the asymptotic distribution of T under H(0) is a weighted sum of independent chi-squared variables. Some sufficient conditions are provided for the limiting distribution to be a chi-squared variable. When the true value of the parameter of interest, θ(0), or the true value of the nuisance parameter, ?(0), lies on the boundary of parameter space, the problem is shown to be asymptotically equivalent to the problem of testing the restricted mean of a multivariate normal distribution based on one observation from a multivariate normal distribution with misspecified covariance matrix, or from a mixture of multivariate normal distributions. A variety of examples are provided for which the limiting distributions of T may be mixtures of chi-squared variables. We conducted simulation studies to examine the performance of the likelihood ratio test statistics in variance component models and teratological experiments.     

Factor analysis models for structuring covariance matrices of additive genetic effects: a Bayesian implementation

Multivariate linear models are increasingly important in quantitative genetics. In high dimensional specifications, factor analysis (FA) may provide an avenue for structuring (co)variance matrices, thus reducing the number of parameters needed for describing (co)dispersion. We describe how FA can be used to model genetic effects in the context of a multivariate linear mixed model. An orthogonal common factor structure is used to model genetic effects under Gaussian assumption, so that the marginal likelihood is multivariate normal with a structured genetic (co)variance matrix. Under standard prior assumptions, all fully conditional distributions have closed form, and samples from the joint posterior distribution can be obtained via Gibbs sampling. The model and the algorithm developed for its Bayesian implementation were used to describe five repeated records of milk yield in dairy cattle, and a one common FA model was compared with a standard multiple trait model. The Bayesian Information Criterion favored the FA model.     

The Analysis of Association Between Traits When Differences Between Trait States Matter

Because of their elementary significance in almost all fields of science, measures of association between two variables or traits are abundant and multiform. One aspect of association that is of considerable interest, especially in population genetics and ecology, seems to be widely ignored. This aspect concerns association between complex traits that show variable and arbitrarily defined state differences. Among such traits are genetic characters controlled by many and potentially polyploid loci, species characteristics, and environmental variables, all of which may be mutually and asymmetrically associated. A concept of directed association of one trait with another is developed here that relies solely on difference measures between the states of a trait. Associations are considered at three levels: between individual states of two variables, between an individual state of one variable and the totality of the other variable, and between two variables. Relations to known concepts of association are identified. In particular, measures at the latter two levels turn out to be interpretable as measures of differentiation. Examples are given for areas of application (search for functional relationships, distribution of variation over populations, genomic associations, spatiogenetic structure).     

Feature Selection for Gene Expression Using Model-Based Entropy

Gene expression data usually contain a large number of genes but a small number of samples. Feature selection for gene expression data aims at finding a set of genes that best discriminate biological samples of different types. Using machine learning techniques, traditional gene selection based on empirical mutual information suffers the data sparseness issue due to the small number of samples. To overcome the sparseness issue, we propose a model-based approach to estimate the entropy of class variables on the model, instead of on the data themselves. Here, we use multivariate normal distributions to fit the data, because multivariate normal distributions have maximum entropy among all real-valued distributions with a specified mean and standard deviation and are widely used to approximate various distributions. Given that the data follow a multivariate normal distribution, since the conditional distribution of class variables given the selected features is a normal distribution, its entropy can be computed with the log-determinant of its covariance matrix. Because of the large number of genes, the computation of all possible log-determinants is not efficient. We propose several algorithms to largely reduce the computational cost. The experiments on seven gene data sets and the comparison with other five approaches show the accuracy of the multivariate Gaussian generative model for feature selection, and the efficiency of our algorithms.     

Multivariate extensions of McNemar's test

This article considers global tests of differences between paired vectors of binomial probabilities, based on data from two dependent multivariate binary samples. Difference is defined as either an inhomogeneity in the marginal distributions or asymmetry in the joint distribution. For detecting the first type of difference, we propose a multivariate extension of McNemar's test and show that it is a generalized score test under a generalized estimating equations (GEE) approach. Univariate features such as the relationship between the Wald and score tests and the dropout of pairs with the same response carry over to the multivariate case and the test does not depend on the working correlation assumption among the components of the multivariate response. For sparse or imbalanced data, such as occurs when the number of variables is large or the proportions are close to zero, the test is best implemented using a bootstrap, and if this is computationally too complex, a permutation distribution. We apply the test to safety data for a drug, in which two doses are evaluated by comparing multiple responses by the same subjects to each one of them.     

A robust multiple-locus method for quantitative trait locus analysis of non-normally distributed multiple traits

Linear regression-based quantitative trait loci/association mapping methods such as least squares commonly assume normality of residuals. In genetics studies of plants or animals, some quantitative traits may not follow normal distribution because the data include outlying observations or data that are collected from multiple sources, and in such cases the normal regression methods may lose some statistical power to detect quantitative trait loci. In this work, we propose a robust multiple-locus regression approach for analyzing multiple quantitative traits without normality assumption. In our method, the objective function is least absolute deviation (LAD), which corresponds to the assumption of multivariate Laplace distributed residual errors. This distribution has heavier tails than the normal distribution. In addition, we adopt a group LASSO penalty to produce shrinkage estimation of the marker effects and to describe the genetic correlation among phenotypes. Our LAD-LASSO approach is less sensitive to the outliers and is more appropriate for the analysis of data with skewedly distributed phenotypes. Another application of our robust approach is on missing phenotype problem in multiple-trait analysis, where the missing phenotype items can simply be filled with some extreme values, and be treated as outliers. The efficiency of the LAD-LASSO approach is illustrated on both simulated and real data sets.     

Bayesian nonparametric meta-analysis using Polya tree mixture models

Summary .   A common goal in meta-analysis is estimation of a single effect measure using data from several studies that are each designed to address the same scientific inquiry. Because studies are typically conducted in geographically disperse locations, recent developments in the statistical analysis of meta-analytic data involve the use of random effects models that account for study-to-study variability attributable to differences in environments, demographics, genetics, and other sources that lead to heterogeneity in populations. Stemming from asymptotic theory, study-specific summary statistics are modeled according to normal distributions with means representing latent true effect measures. A parametric approach subsequently models these latent measures using a normal distribution, which is strictly a convenient modeling assumption absent of theoretical justification. To eliminate the influence of overly restrictive parametric models on inferences, we consider a broader class of random effects distributions. We develop a novel hierarchical Bayesian nonparametric Polya tree mixture (PTM) model. We present methodology for testing the PTM versus a normal random effects model. These methods provide researchers a straightforward approach for conducting a sensitivity analysis of the normality assumption for random effects. An application involving meta-analysis of epidemiologic studies designed to characterize the association between alcohol consumption and breast cancer is presented, which together with results from simulated data highlight the performance of PTMs in the presence of nonnormality of effect measures in the source population.     

On the use of historical control data to estimate dose response trends in quantal bioassay.

New tests for trend in proportions, in the presence of historical control data, are proposed. One such test is a simple score statistic based on a binomial likelihood for the "current" study and beta-binomial likelihoods for each historical control series. A closely related trend statistic based on estimating equations is also proposed. Trend statistics that allow overdispersed proportions in the current study are also developed, including a version of Tarone's (1982, Biometrics 38, 215-220) test that acknowledges sampling variation in the beta distribution parameters, and a trend statistic based on estimating equations. Each such trend test is evaluated with respect to size and power under both binomial and beta-binomial sampling conditions for the current study, and illustrations are provided.     

Multivariate measures of similarity and niche overlap

Niche overlap measures are used to assess the similarity in resource use by two species. Recently researchers have used niche overlap measures as summary measures and for making inferences, typically about competition for resources. The problem of estimating niche overlap when the niches are multivariate normal distributions with equal covariance matrices has previously been studied. In this work, the assumption of equal covariance matrices is relaxed. Two general measures of similarity are evaluated assuming general multivariate normal distributions. Commonly used measures of overlap are given as special cases of these two general measures. The question of bias in estimating these measures is discussed and shown to be a potential problem, especially when there are many redundant variables or if sample sizes are small.     

An evolutionary quantitative genetics model for phenotypic (co)variances under limited dispersal,with an application to socially synergistic traits

Darwinian evolution consists of the gradual transformation of heritable traits due to natural selection and the input of random variation by mutation. Here, we use a quantitative genetics approach to investigate the coevolution of multiple quantitative traits under selection, mutation, and limited dispersal. We track the dynamics of trait means and of variance–covariances between traits that experience frequency‐dependent selection. Assuming a multivariate‐normal trait distribution, we recover classical dynamics of quantitative genetics, as well as stability and evolutionary branching conditions of invasion analyses, except that due to limited dispersal, selection depends on indirect fitness effects and relatedness. In particular, correlational selection that associates different traits within‐individuals depends on the fitness effects of such associations between‐individuals. We find that these kin selection effects can be as relevant as pleiotropy for the evolution of correlation between traits. We illustrate this with an example of the coevolution of two social traits whose association within‐individuals is costly but synergistically beneficial between‐individuals. As dispersal becomes limited and relatedness increases, associations between‐traits between‐individuals become increasingly targeted by correlational selection. Consequently, the trait distribution goes from being bimodal with a negative correlation under panmixia to unimodal with a positive correlation under limited dispersal.     

Association models for a multivariate binary response

Models for a multivariate binary response are parameterized by univariate marginal probabilities and dependence ratios of all orders. The w-order dependence ratio is the joint success probability of w binary responses divided by the joint success probability assuming independence. This parameterization supports likelihood-based inference for both regression parameters, relating marginal probabilities to explanatory variables, and association model parameters, relating dependence ratios to simple and meaningful mechanisms. Five types of association models are proposed, where responses are (1) independent given a necessary factor for the possibility of a success, (2) independent given a latent binary factor, (3) independent given a latent beta distributed variable, (4) follow a Markov chain, and (5) follow one of two first-order Markov chains depending on the realization of a binary latent factor. These models are illustrated by reanalyzing three data sets, foremost a set of binary time series on auranofin therapy against arthritis. Likelihood-based approaches are contrasted with approaches based on generalized estimating equations. Association models specified by dependence ratios are contrasted with other models for a multivariate binary response that are specified by odds ratios or correlation coefficients.     

The performance of mixture models in heterogeneous closed population capture-recapture.

Dorazio and Royle (2003, Biometrics 59, 351-364) investigated the behavior of three mixture models for closed population capture-recapture analysis in the presence of individual heterogeneity of capture probability. Their simulations were from the beta-binomial distribution, with analyses from the beta-binomial, the logit-normal, and the finite mixture (latent class) models. In this response, simulations from many different distributions give a broader picture of the relative value of the beta-binomial and the finite mixture models, and provide some preliminary insights into the situations in which these models are useful.     

A pathway for multivariate analysis of ecological communities using copulas

We describe a new pathway for multivariate analysis of data consisting of counts of species abundances that includes two key components: copulas, to provide a flexible joint model of individual species, and dissimilarity‐based methods, to integrate information across species and provide a holistic view of the community. Individual species are characterized using suitable (marginal) statistical distributions, with the mean, the degree of over‐dispersion, and/or zero‐inflation being allowed to vary among a priori groups of sampling units. Associations among species are then modeled using copulas, which allow any pair of disparate types of variables to be coupled through their cumulative distribution function, while maintaining entirely the separate individual marginal distributions appropriate for each species. A Gaussian copula smoothly captures changes in an index of association that excludes joint absences in the space of the original species variables. A permutation‐based filter with exact family‐wise error can optionally be used a priori to reduce the dimensionality of the copula estimation problem. We describe in detail a Monte Carlo expectation maximization algorithm for efficient estimation of the copula correlation matrix with discrete marginal distributions (counts). The resulting fully parameterized copula models can be used to simulate realistic ecological community data under fully specified null or alternative hypotheses. Distributions of community centroids derived from simulated data can then be visualized in ordinations of ecologically meaningful dissimilarity spaces. Multinomial mixtures of data drawn from copula models also yield smooth power curves in dissimilarity‐based settings. Our proposed analysis pathway provides new opportunities to combine model‐based approaches with dissimilarity‐based methods to enhance understanding of ecological systems. We demonstrate implementation of the pathway through an ecological example, where associations among fish species were found to increase after the establishment of a marine reserve.     

Joint tests of linkage and association for quantitative traits

In this paper we describe various study designs and analytic techniques for testing the joint hypothesis that a genetic marker is both linked to and associated with a quantitative phenotype. Issues of power and sampling are addressed. The distinction between methods that explicitly examine association and those that infer association by examining the distribution of allelic transmissions from a heterozygous parent is examined. Extensions to multivariate, multiallelic, and multilocus situations are addressed. Recent approaches that combine variance-components-based linkage analyses with joint tests of linkage in the presence of association for disentanglement of the linkage and association and the application of such methods to fine mapping are discussed. Finally, new classes of joint tests of linkage and association that do not require samples of related individuals are described.