This paper investigates what matters to medical domain experts when setting standards on a language for specific purposes (LSP) English proficiency test: the Occupational English Test's (OET) writing sub-test. The study explores what standard-setting participants value when making performance judgements about test candidates' writing responses,…

Purpose: This paper aims to explore the impact of differences in educational traditions on conventions of teaching and learning, and on the measurement of learning outcomes. These are critical issues within the context of business schools that are steeped in one dominant tradition but have a large population of international students previously…

This article examines the publicly available English Examination Notes from the New South Wales Higher School Certificate (HSC) Marking Centre, alongside past research on writing development, to understand the summative assessment of writing and the qualities of writing that examiners identified as discriminating between samples of different…

Corpus-based approaches to language and literacy education, commonly known as data-driven learning (DDL), are increasing in prominence. However, the vast majority of DDL interventions involve adult tertiary level learners, leaving a dire need for comprehensive DDL studies for secondary education. The present study reports on a half-year DDL…

The rapid decline in Australian students' performance on the "National Assessment Program--Literacy and Numeracy" (NAPLAN) writing test is an issue of national concern. This paper presents the first investigation into patterns of achievement and progress on the NAPLAN writing test across the tested year levels (3, 5, 7 and 9) between…

This article is an extract from a longer research article originally published in the journal "English in Education." It describes a parallel situation in Australia where high-stakes assessment led to stereotyped writing, endless test practice and widespread student disengagement.

While there have been various investigations into the impact of standardised testing in Australian schools over the decade since the introduction of NAPLAN testing, few of these have focused on the extended writing component in particular or on the experiences of secondary English teachers. These teachers are of interest because, despite…

Despite an intense focus on improving Australian students' writing performance in recent years, and comprehensive instructional advice to English teachers, researchers have noted a lack of gains in standardised writing tests and negative effects on student engagement and learning. In this paper we claim that these outcomes are partly attributable…

Research into the teaching and assessment of student writing shows that many students find academic writing a challenge to learn, with legal writing no exception. Improving the availability and quality of timely formative feedback is an important aim. However, the time-consuming nature of assessing writing makes it impractical for instructors to…

National standardized assessment programs have increasingly included extended written performances, amplifying the need for reliable, valid, and efficient methods of assessment. This article examines a two-stage method using comparative judgments and calibrated exemplars as a complement and alternative to existing methods of assessing writing.…

This paper presents a method for equating writing assessments using pairwise comparisons which does not depend upon conventional common-person or common-item equating designs. Pairwise comparisons have been successfully applied in the assessment of open-ended tasks in English and other areas such as visual art and philosophy. In this paper,…

Determining the writing skill level of students commencing tertiary education is a key element in predicting their likely study success and in providing appropriate writing development opportunities. Writing tests constructed around written instructions often assume high levels of reading and comprehension skills, which in some instances impose…

Rubrics for assessing student performance are often seen as providing rich information about complex skills. Despite their widespread usage, however, little empirical research has focused on whether it is possible for rubrics to validly meet their intended purposes. The authors examine a rubric used to assess students' writing in a large-scale…

The Post-Entry Language Assessment (PELA) was introduced by the James Cook University Graduate Research School in February 2013 as a pilot programme to test a new mechanism for initiating post-enrolment support for research degree candidates who have English as an additional language. Language ability does not necessarily, on its own, predict…

Purpose: This paper argues that in a well-organised school with strong leadership and vision coupled with a concerted effort to improve the teaching performance of each teacher, student achievement can be enhanced. The purpose of this paper is to demonstrate that while macro-effect sizes such as "whole of school" metrics are useful for…