Specialists in the field of large-scale, high-stakes writing assessment have, over the last forty years alternately discussed the issue of maximizing either reliability or validity in test design. Factors complicating the debate--such as Messick's (1989) expanded definition of validity, and the ethical implications of testing--are explored. An…

This paper reports on a test that is being used to fulfill a university writing examination requirement for non-native speakers of English. The test, which requires students to read two passages, write short-answer comprehension and synthesis questions, and write an argument essay on a topic related to the passages, replaces a test that was based…

The authors report on an exploratory study that investigated Grade 10 students' responses to a large-scale, high-stakes literacy test, the results of which determine high school graduation in Ontario, Canada. Through focus-group and individual interviews, the authors found that students perceived the test as evaluating their English skills rather…

Classroom assessment of writing is considered from an anthropological perspective as practitioners' tool use. Pan Canadian data from a 2002 English teacher questionnaire (N = 4070) about self-reported assessment practices were analyzed in terms of tool choice and use by secondary teachers of different experience and qualification levels. Four…

Washington State University (WSU), has developed two large-scale assessment programs to evaluate student learning outcomes. The largest, the Writing Assessment Program, diagnoses student writing abilities at entry and mid-career to determine the type of support needed to navigate the expectations of our writing-rich curriculum. The second, the…

This study aimed to comprehensively investigate the impact of a word-processor on an ESL writing assessment, covering comparison of inter-rater reliability, the quality of written products, the writing process across different testing occasions using different writing media, and students' perception of a computer-delivered test. Writing samples of…

Accuracy in the scoring of writing is critical if standardized tasks are to be used in a national assessment scheme. Three approaches to establishing accuracy (i.e., consensus, consistency, and measurement) exist and commonly large-scale assessment programs of primary school writing demonstrate adjacent agreement consensus rates of between 80% and…

The IELTS test is widely accepted by university admissions offices as evidence of English language ability. The test is also used to guide decisions about the amount of language study required for students to satisfy admissions requirements. Guidelines currently published by the British Association of Lecturers in English for Academic Purposes…