Shrinkage and Pretest Nonparametric Estimation of Regression Parameters from Censored Data with Multiple Observations at Each Level of Covariate

A simple linear regression model is considered where the independent variable assumes only a finite number of values and the response variable is randomly right censored. However, the censoring distribution may depend on the covariate values. A class of noniterative estimators for the slope parameter, namely, the noniterative unrestricted estimator, noniterative restricted estimator and noniterative improved pretest estimator are proposed. The asymptotic bias and mean squared errors of the proposed estimators are derived and compared. The relative dominance picture of the estimators is investigated. A simulation study is also performed to asses the properties of the various estimators for small samples.     

Stein‐Rule Estimation in Mixed Regression Models

This paper considers a Stein‐rule mixed regression estimator for estimating a normal linear regression model in the presence of stochastic linear constraints. We derive the small disturbance asymptotic bias and risk of the proposed estimator, and analytically compare its risk with other related estimators. A Monte‐Carlo experiment investigates the empirical risk performance of the proposed estimator.     

Closed-Form Approximations to the REML Estimator of a Variance Ratio (or Heritability) in a Mixed Linear Model

In this article, we estimate heritability or intraclass correlation in a mixed linear model having two sources of variation. In most applications, the commonly used restricted maximum likelihood (REML) estimator can only be obtained via an iterative approach. In some cases, the algorithm used to compute REML estimates may be slow or may even fail to converge. We develop a set of closed-form approximations to the REML estimator, and the performance of these estimators is compared with that of the REML estimator. We provide guidelines regarding how to choose the estimator that best approximates the REML estimator. Examples presented in the article suggest that the closed-form estimators compete with and, in some cases, outperform the REML estimator.     

Modification of the Minimum Logit Chi-Squared Estimator in Simple Linear Logistic Regression

A new modification of Berkson's minimum logit chi-squared estimator in simple linear logistic regression is suggested in order to achieve reduction of first order bias of the estimator as well as in the model. Furthermore, unlike estimators currently available, our procedure is quite simple to apply in practice and is valid even in the presence of zero frequencies in the table.     

Additive partial linear models with measurement errors

We consider statistical inference for additive partial linearmodels when the linear covariate is measured with error. Wepropose attenuation-to-correction and simulation-extrapolation,simex, estimators of the parameter of interest. It is shownthat the first resulting estimator is asymptotically normaland requires no undersmoothing. This is an advantage of ourestimator over existing backfitting-based estimators for semiparametricadditive models which require undersmoothing of the nonparametriccomponent in order for the estimator of the parametric componentto be root-n consistent. This feature stems from a decreaseof the bias of the resulting estimator, which is appropriatelyderived using a profile procedure. A similar characteristicin semiparametric partially linear models was obtained by Wanget al. (2005). We also discuss the asymptotics of the proposedsimex approach. Finite-sample performance of the proposed estimatorsis assessed by simulation experiments. The proposed methodsare applied to a dataset from a semen study.     

Regression analysis when covariates are regression parameters of a random effects model for observed longitudinal measurements

We consider regression analysis when covariate variables are the underlying regression coefficients of another linear mixed model. A naive approach is to use each subject's repeated measurements, which are assumed to follow a linear mixed model, and obtain subject-specific estimated coefficients to replace the covariate variables. However, directly replacing the unobserved covariates in the primary regression by these estimated coefficients may result in a significantly biased estimator. The aforementioned problem can be evaluated as a generalization of the classical additive error model where repeated measures are considered as replicates. To correct for these biases, we investigate a pseudo-expected estimating equation (EEE) estimator, a regression calibration (RC) estimator, and a refined version of the RC estimator. For linear regression, the first two estimators are identical under certain conditions. However, when the primary regression model is a nonlinear model, the RC estimator is usually biased. We thus consider a refined regression calibration estimator whose performance is close to that of the pseudo-EEE estimator but does not require numerical integration. The RC estimator is also extended to the proportional hazards regression model. In addition to the distribution theory, we evaluate the methods through simulation studies. The methods are applied to analyze a real dataset from a child growth study.     

A Class of Ratio-Cum-Product-Type Estimator

The problem of estimating the population mean using an auxiliary information has been dealt with in literature quite extensively. Ratio, product, linear regression and ratio-type estimators are well known. A class of ratio-cum-product-type estimator is proposed in this paper. Its bias and variance to the first order of approximation are obtained. For an appropriate weight ‘a’ and good range of α-values, it is found that the proposed estimator is superior than a set of estimators (i.e., sample mean, usual ratio and product estimators, SRIVASTAVA's (1967) estimator, CHAKRABARTY's (1979) estimator and a product-type estimator) which are, in fact, the particular cases of it. At optimum value of α, the proposed estimator is as efficient as linear regression estimator.     

A Monte Carlo Study of Robustness of Pretest and Shrinkage Estimators in Pooling Coefficients of Variation

Pooling data, when justified, is advantageous for estimating the true parameter. In this paper the problem of estimating the coefficient of variation is considered when it is a priori suspected that two coefficients of variation are the same. Various estimators based on pretest and shrinkage rules are considered. A comparison through the Simulated Mean Squared Error (SMSE) criterion is carried out among various proposed estimators of the target coefficient of variation. The relative simulated efficiencies of the restricted, shrinkage restricted and shrinkage pretest estimators are studied. It is found that the proposed estimators are quite robust when the sample sizes are not too large. The result of Monte Carlo study indicates that the proposed shrinkage pretest estimator is efficient than the usual estimator in a wider range.     

A Note on an Optimality Property of the Regression Estimator

This note points out the derivation of regression estimator through an optimality consideration over a class of estimators generating Generalised Product and dual to ratio estimators.     

An Improved Estimator of the Variance of the Regression Estimator

In this paper, the problem of estimation of variance of the general linear regression estimator has been considered. It has been shown that the first order calibration approach is a special case of the class of estimators proposed by Deng and Wu (1987). A second order calibration approach is suggested. Some new estimators are shown to be the special case of the proposed calibration approach. The efficiency of the proposed strategy is shown to improve on the original strategy. An idea to find a non-negative estimate of variance has been suggested.     

Estimation and comparison of changes in the presence of informative right censoring: conditional linear model

A general linear regression model for the usual least squares estimated rate of change (slope) on censoring time is described as an approximation to account for informative right censoring in estimating and comparing changes of a continuous variable in two groups. Two noniterative estimators for the group slope means, the linear minimum variance unbiased (LMVUB) estimator and the linear minimum mean squared error (LMMSE) estimator, are proposed under this conditional model. In realistic situations, we illustrate that the LMVUB and LMMSE estimators, derived under a simple linear regression model, are quite competitive compared to the pseudo maximum likelihood estimator (PMLE) derived by modeling the censoring probabilities. Generalizations to polynomial response curves and general linear models are also described.     

Sampling distributions, biases, variances, and confidence intervals for genetic correlations

Genetic correlations are frequently estimated from natural and experimental populations, yet many of the statistical properties of estimators of are not known, and accurate methods have not been described for estimating the precision of estimates of Our objective was to assess the statistical properties of multivariate analysis of variance (MANOVA), restricted maximum likelihood (REML), and maximum likelihood (ML) estimators of by simulating bivariate normal samples for the one-way balanced linear model. We estimated probabilities of non-positive definite MANOVA estimates of genetic variance-covariance matrices and biases and variances of MANOVA, REML, and ML estimators of and assessed the accuracy of parametric, jackknife, and bootstrap variance and confidence interval estimators for MANOVA estimates of were normally distributed. REML and ML estimates were normally distributed for but skewed for and 0.9. All of the estimators were biased. The MANOVA estimator was less biased than REML and ML estimators when heritability (H), the number of genotypes (n), and the number of replications (r) were low. The biases were otherwise nearly equal for different estimators and could not be reduced by jackknifing or bootstrapping. The variance of the MANOVA estimator was greater than the variance of the REML or ML estimator for most H, n, and r. Bootstrapping produced estimates of the variance of close to the known variance, especially for REML and ML. The observed coverages of the REML and ML bootstrap interval estimators were consistently close to stated coverages, whereas the observed coverage of the MANOVA bootstrap interval estimator was unsatisfactory for some H, n, and r. The other interval estimators produced unsatisfactory coverages. REML and ML bootstrap interval estimates were narrower than MANOVA bootstrap interval estimates for most H, and r. Received: 6 July 1995 / Accepted: 8 March 1996     

The Chain Ratio Estimator and Regression Estimator with Linear Combination of Two Auxiliary Variables

In sample surveys, it is usual to make use of auxiliary information to increase the precision of the estimators. We propose a new chain ratio estimator and regression estimator of a finite population mean using linear combination of two auxiliary variables and obtain the mean squared error (MSE) equations for the proposed estimators. We find theoretical conditions that make proposed estimators more efficient than the traditional multivariate ratio estimator and the regression estimator using information of two auxiliary variables.     

Closed Form Estimators of Latent Cell Frequencies

One-stage and two-stage closed form estimators of latent cell frequencies in multidimensional contingency tables are derived from the weighted least squares criterion. The first stage estimator is asymptotically equivalent to the conditional maximum likelihood estimator and does not necessarily have minimum asymptotic variance. The second stage estimator does have minimum asymptotic variance relative to any other existing estimator. The closed form estimators are defined for any number of latent cells in contingency tables of any order under exact general linear constraints on the logarithms of the nonlatent and latent cell frequencies.     

A Note on the Theil-Sen Regression Estimator When the Regressor Is Random and the Error Term Is Heteroscedastic

In simple regression, two serious problems with the ordinary least squares (OLS) estimator are that its efficiency can be relatively poor when the error term is normal but heteroscedastic, and the usual confidence interval for the slope can have highly unsatisfactory probability coverage. When the error term is nonnormal, these problems become exacerbated. Two other concerns are that the OLS estimator has an unbounded influence function and a breakdown point of zero. Wilcox (1996) compared several estimators when there is heteroscedasticity and found two that have relatively good efficiency and simultaneously provide protection against outliers: an M-estimator with Schweppe weights and an estimator proposed by Cohen, Dalal and Tukey (1993). However, the M-estimator can handle only one outlier in the X-domain or among the Y values, and among the methods considered by Wilcox for computing confidence intervals for the slope, none performed well when working with the Cohen-Dalal-Tukey estimator. This note points out that the small-sample efficiency of theTheil-Sen estimator competes well with the estimators considered by Wilcox, and a method for computing a confidence interval was found that performs well in simulations. The Theil-Sen estimator has a reasonably high breakdown point, a bounded influence function, and in some cases its small-sample efficiency offers a substantial advantage over all of the estimators compared in Wilcox (1996).     

Estimation of regression parameters and the hazard function in transformed linear survival models

An estimator of the regression parameters in a semiparametric transformed linear survival model is examined. This estimator consists of a single Newton-like update of the solution to a rank-based estimating equation from an initial consistent estimator. An automated penalized likelihood algorithm is proposed for estimating the optimal weight function for the estimating equations and the error hazard function that is needed in the variance estimator. In simulations, the estimated optimal weights are found to give reasonably efficient estimators of the regression parameters, and the variance estimators are found to perform well. The methodology is applied to an analysis of prognostic factors in non-Hodgkin's lymphoma.     

Estimation of regression models under linear restrictions

The variance-covariance matrices of restricted regression and mixed regression estimators are compared and the consequences of introducing variability in the restrictions are examined.     

Improved Shrinkage Estimation of Relative Potency

This article considers the asymptotic estimation theory for the log relative potency in a symmetric parallel bioassay when uncertain prior information about the true log relative potency is assumed to be a known quantity. Three classes of point estimation, namely, the unrestricted estimator, the shrinkage restricted estimator and shrinkage preliminary test estimator are proposed. Their asymptotic mean squared errors are derived and compared. The relative dominance picture of the estimators is presented. Interestingly, proposed shrinkage preliminary test estimator dominates the unrestricted estimator in a range that is wider than that of the usual preliminary test estimator. Most importantly, the size of the preliminary test is much appropriate than the usual preliminary test estimator.     

Shrinkage Estimators for Covariance Matrices

Estimation of covariance matrices in small samples has been studied by many authors. Standard estimators, like the unstructured maximum likelihood estimator (ML) or restricted maximum likelihood (REML) estimator, can be very unstable with the smallest estimated eigenvalues being too small and the largest too big. A standard approach to more stably estimating the matrix in small samples is to compute the ML or REML estimator under some simple structure that involves estimation of fewer parameters, such as compound symmetry or independence. However, these estimators will not be consistent unless the hypothesized structure is correct. If interest focuses on estimation of regression coefficients with correlated (or longitudinal) data, a sandwich estimator of the covariance matrix may be used to provide standard errors for the estimated coefficients that are robust in the sense that they remain consistent under misspecification of the covariance structure. With large matrices, however, the inefficiency of the sandwich estimator becomes worrisome. We consider here two general shrinkage approaches to estimating the covariance matrix and regression coefficients. The first involves shrinking the eigenvalues of the unstructured ML or REML estimator. The second involves shrinking an unstructured estimator toward a structured estimator. For both cases, the data determine the amount of shrinkage. These estimators are consistent and give consistent and asymptotically efficient estimates for regression coefficients. Simulations show the improved operating characteristics of the shrinkage estimators of the covariance matrix and the regression coefficients in finite samples. The final estimator chosen includes a combination of both shrinkage approaches, i.e., shrinking the eigenvalues and then shrinking toward structure. We illustrate our approach on a sleep EEG study that requires estimation of a 24 x 24 covariance matrix and for which inferences on mean parameters critically depend on the covariance estimator chosen. We recommend making inference using a particular shrinkage estimator that provides a reasonable compromise between structured and unstructured estimators.     

Heteroscedastic Nonlinear Regression Models with Random Effects and Their Application to Enzyme Kinetic Data

We present a new modification of nonlinear regression models for repeated measures data with heteroscedastic error structures by combining the transform-both-sides and weighting model from Caroll and Ruppert (1988) with the nonlinear random effects model from Lindstrom and Bates (1990). The proposed parameter estimators are a combination of pseudo maximum likelihood estimators for the transform-both-sides and weighting model and maximum likelihood (ML) or restricted maximum likelihood (REML) estimators for linear mixed effects models. The new method is investigated by analyzing simulated enzyme kinetic data published by Jones (1993).