Abstract: The grades of a Spanish university access exam involving 10 graders are analyzed. The interest focuses on finding the greatest group of graders showing similar grading patterns or, equivalently, on detecting if there are graders whose grades exhibit significant deviations from the pattern determined by the remaining graders. Due to differences in background of the involved students and graders, homogeneity is too strong to be considered as a realistic null model. Instead, the weaker similarity model, which seems to be more appropriate in this setting, is considered. To handle this problem, a statistical procedure designed to search for a hidden main pattern is developed. The procedure is based on the detection and deletion of the graders that are significantly non-similar to (the pooled mixture of) the others. This is performed through the use of a probability metric, a bootstrap approach and a stepwise search algorithm. Moreover, the procedure also allows one to identify which part of the grades of each grader makes her/him different from the others.

Authorship

Download reference