Bias Reduction and a Solution for Separation of Logistic Regression with Missing Covariates |
| |
Authors: | Tapabrata Maiti Vivek Pradhan |
| |
Institution: | 1. Department of Statistics and Probability, Michigan State University, East Lansing, Michigan 48824, U.S.A.;2. Boston Scientific, 100 Boston Scientific Way, Marlborough, Massachusetts 01752, U.S.A. |
| |
Abstract: | Summary Logistic regression is an important statistical procedure used in many disciplines. The standard software packages for data analysis are generally equipped with this procedure where the maximum likelihood estimates of the regression coefficients are obtained iteratively. It is well known that the estimates from the analyses of small‐ or medium‐sized samples are biased. Also, in finding such estimates, often a separation is encountered in which the likelihood converges but at least one of the parameter estimates diverges to infinity. Standard approaches of finding such estimates do not take care of these problems. Moreover, the missingness in the covariates adds an extra layer of complexity to the whole process. In this article, we address these three practical issues—bias, separation, and missing covariates by means of simple adjustments. We have applied the proposed technique using real and simulated data. The proposed method always finds a solution and the estimates are less biased. A SAS macro that implements the proposed method can be obtained from the authors. |
| |
Keywords: | Bias EM algorithm Maximum likelihood estimate Small sample |
|
|