This article reflects on the values and practices of a revolutionary A level (senior secondary) course that achieved a high degree of validity and reliability in assessing the study of English literature. John Hodgson and Bill Greenwell were involved in its teaching and assessment from an early stage, and Greenwell's comments on an early draft of…

Alternative approaches are discussed for use of e-rater[R] to score the TOEFL iBT[R] Writing test. These approaches involve alternate criteria. In the 1st approach, the predicted variable is the expected rater score of the examinee's 2 essays. In the 2nd approach, the predicted variable is the expected rater score of 2 essay responses by the…

After passage of the Every Student Succeeds Act (ESSA) in 2015, states assumed greater responsibility for designing their own accountability and assessment systems. ESSA requires states to measure "higher order thinking skills and understanding" and encourages the use of open-ended performance assessments, which are essential for…

The Every Student Succeeds Act (ESSA) opened up new possibilities for how student and school success are defined and supported in American public education. States have greater responsibility for designing and building their assessment and accountability systems. These new opportunities to develop performance assessments are critically important…

As students increasingly rely on digital media to locate information, composition instructors must incorporate into writing instruction critical evaluation of and reflection on students' use of Web content. A growing problem in the composition class is underdeveloped critical digital literacy skills. To become fully literate, students need more…

From the early 1900s to the present, there have always been inconsistencies in how teachers evaluate the writing quality of their students' essays. Their critiques vary as much as their personalities. To establish common standards in writing for all courses in which essays are assigned and, at the same time, not infringe on the integrity of…

Describes a classroom activity, listing step-by-step directions, that demonstrates the unreliability of essay scoring. Explains that after the exercise the class discussion should address the problematic factors in scoring essays. Lists recommendations for improving reliability and validity of essay scoring. (CMK)

Discusses the basic concepts of testing and item development and the application of alternative assessments to information literacy content for library instruction. Topics include reliability; validity; statistical analysis; selected response, including checklists, rank order, or simple match; constructed response; essays; and complex assessments.…

This paper introduces the Website Acceptability Tiered Checklist (WATCH), a preliminary version of a multi-trait scale that could be used by instructors and students to assess the quality of websites chosen as source materials in students' research papers in a Humanities program. The scale includes bands for assessing: (i) the authority and…

Automated Essay Scoring (AES) is defined as the computer technology that evaluates and scores the written prose (Shermis & Barrera, 2002; Shermis & Burstein, 2003; Shermis, Raymat, & Barrera, 2003). AES systems are mainly used to overcome time, cost, reliability, and generalizability issues in writing assessment (Bereiter, 2003; Burstein,…

E-rater[R] has been used by the Educational Testing Service for automated essay scoring since 1999. This paper describes a new version of e-rater (V.2) that is different from other automated essay scoring systems in several important respects. The main innovations of e-rater V.2 are a small, intuitive, and meaningful set of features used for…