The use of online rater self-training is growing in popularity and has obvious practical benefits, facilitating access to training materials and rating samples and allowing raters to reorient themselves to the rating scale and self monitor their behaviour at their own convenience. However there has thus far been little research into rater…

Across the field of educational assessment the case has been made for alternatives to the multiple-choice item type. Most of the alternative types of items require a subjective evaluation by a rater. The reliability of this subjective rating is a key component of these types of alternative items. In this paper, measures of reliability are…

As part of a project on assessing deep understanding of subject matter, a study was conducted to assess students' knowledge of history by focusing on essay writing. Reading a provided text was incorporated into the assessment procedure. Ratings from five high school history teachers were compared with those of four English teachers for 85 essays…