Both school and district administrators use the results of standardized, large-scale tests to inform decisions about the need for, or success of, educational programs and interventions. However, test results at the school level are subject to random fluctuations due to changes in cohort, test items, and other factors outside of the school's…

This study examined the writing score and writing feature changes of 562 repeat test takers who took the Canadian English Language Proficiency Index Program--General (CELPIP--General) test at least three times, with a short (30-40 day) interval between the first and second attempts and a longer (90-180 day) interval between the first and third…

Canadian post-secondary classrooms are linguistically diverse. This diversity comes from immigration, more access to higher education for marginalized and minority groups, and international student recruitment. An institute's language prerequisites serve as tools to help admissions decide who is linguistically prepared for study in English.…

To investigate whether the type of keyboard used in exams introduces any construct-irrelevant variance to the TOEFL iBT Writing scores, we surveyed 17,040 TOEFL iBT examinees from 24 countries on their keyboard-related perceptions and preferences and analyzed the survey responses together with their test scores. Results suggest that controlling…

The effect of using a computer or paper and pencil on student writing scores on a provincial standardized writing assessment was studied. A sample of 302 francophone students wrote a short essay using a computer equipped with Microsoft Word with all of its correction functions enabled. One week later, the same students wrote a second short essay…

This study examined the relationship between ninth-grade students' use of connectives (temporal, causal, adversative, and additive) in functional writing and performance on standards-based/criterion-referenced measures of reading and writing. Specifically, structural equation modeling (SEM) techniques were used to examine the relationship between…

A major concern with computer-based (CB) tests of second-language (L2) writing is that performance on such tests may be influenced by test-taker keyboarding skills. Poor keyboarding skills may force test-takers to focus their attention and cognitive resources on motor activities (i.e., keyboarding) and, consequently, other processes and aspects of…

Researchers of high-stakes, subjectively scored writing assessments have done much work to better understand the process that raters go through in applying a rating scale to a language performance to arrive at a score. However, there is still unexplained, systematic variability in rater scoring that resists rater training (see Hoyt & Kerns,…

This study investigates the effects of topical knowledge on ESL (English as a Second Language) writing performance in the English Language Proficiency Index (LPI), a standardized English proficiency test used by many post-secondary institutions in western Canada. The participants were 50 students with different levels of English proficiency…

Using generalizability (G-) theory, this study examined the accuracy and validity of the writing scores assigned to secondary school ESL students in the provincial English examinations in Canada. The major research question that guided this study was: Are there any differences between the accuracy and construct validity of the analytic scores…

In Quebec the high-stakes Secondary Five ESL exit writing exam developed by the Education Ministry (MELS) is administered and corrected by classroom teachers. In this distinctive situation, the MELS works toward aligning classroom-based assessment (CBA) and the writing exam by making ongoing teacher involvement part of its development and…

This article presents a review of the "Test of Written Language-Fourth Edition" (TOWL-4), a newly updated individual or group-based measure of written language for students aged 9 years, 0 months through 17 years, 11 months. The stated purposes of the measure are to identify students in need of support or intervention in the area of…

In high-stakes writing assessments, rater training in the use of a rating scale does not eliminate variability in grade attribution. This realisation has been accompanied by research that explores possible sources of rater variability, such as rater background or rating scale type. However, there has been little consideration thus far of…

This manual was written to provide technical information regarding the 2002 Series GED (General Educational Development) Tests. Throughout this manual, documentation is provided regarding the development of the GED Tests, data collection activities, as well as reliability and validity evidence. The purpose of this manual is to provide evidence…

This study examined relationships between the after-school literacy activities and test performance of students who passed and students who failed the 2003 administration of the Ontario Secondary School Literacy Test. It included both students who have been in the Canadian school system for most of their school lives and mostly use English as a…