A sequential test for assessing observed agreement between raters

Assessing the agreement between two or more raters is an important topic in medical practice. Existing techniques, which deal with categorical data, are based on contingency tables. This is often an obstacle in practice as we have to wait for a long time to collect the appropriate sample size of subjects to construct the contingency table. In this paper, we introduce a nonparametric sequential test for assessing agreement, which can be applied as data accrues, does not require a contingency table, facilitating a rapid assessment of the agreement. The proposed test is based on the cumulative sum of the number of disagreements between the two raters and a suitable statistic representing the waiting time until the cumulative sum exceeds a predefined threshold. We treat the cases of testing two raters' agreement with respect to one or more characteristics and using two or more classification categories, the case where the two raters extremely disagree, and finally the case of testing more than two raters' agreement. The numerical investigation shows that the proposed test has excellent performance. Compared to the existing methods, the proposed method appears to require significantly smaller sample size with equivalent power. Moreover, the proposed method is easily generalizable and brings the problem of assessing the agreement between two or more raters and one or more characteristics under a unified framework, thus providing an easy to use tool to medical practitioners.     

Risk-Adjusted Control Charts: Theory,Methods, and Applications in Health

Control charts, the most popular tool of statistical process control, appeared in the literature to ensure that an industrial process is operating only with natural variability, i.e., under statistical control. In the last decades, control charts have been also widely used to assess the quality of non-industrial processes, such as medicine and public health. Mainly in the last two decades, a modification of standard and advanced control charts appeared in the bibliography to improve the monitoring mainly of medical processes. This is the risk-adjusted control charts which take into consideration the varying health conditions of the patients. These charts are used to monitor certain medical processes such as surgeries, mortality, and doctors’ experience. In this paper, we have tried to present all the risk-adjusted control charts presented in the literature appropriately categorized. The risk-adjusted charts have been grouped into three categories: control charts for continuous variables, control charts for attributes (non-continuous variables), time-weighted control charts. The application of risk-adjusted control charts in practical medical processes is also discussed. This review paper highlights the value of the risk-adjusted control charts.