A STATISTICAL ANALYSIS OF DIFFERENCE TESTS WITH REPLICATIONS

This paper proposes a statistical method for difference tests with repetitions. Classical methods for difference tests are based upon the binomial distribution, and are not concerned with the number of repetitions per judge. But when more than one replication of a difference test is required, judgements from different judges are more independent than replicates from the same judge; these two cannot be combined in the classical methods. In this paper, we propose another approach that takes into account two points: the number of repetitions per judge, and the differences within subjects. Two examples are presented to illustrate this approach.