Our nation's bleak economic situation has forced state governments to cut educational funding. While funds are decreasing, accountability for student achievement remains high. The No Child Left Behind Act (NCLB) forces each state to create and implement an accountability system of rewards and sanctions based on standardized test scores. In…

This study investigated whether dedicated test preparation classes gave learners an advantage in improving their writing test scores. Score gains following instruction on a measure of academic writing skills--the International English Language Testing System (IELTS) academic writing test--were compared across language courses of three types; all…

Educators often have to choose among different types of rating scales to assess second-language (L2) writing performance. There is little research, however, on how different rating scales affect rater performance. This study employed a mixed-method approach to investigate the effects of two different rating scales on EFL essay scores, rating…

The objective of the present investigation was to examine the comparability of writing prompts for different gender groups in the context of the computer-based Test of English as a Foreign Language[TM] (TOEFL[R]-CBT). A total of 87 prompts administered from July 1998 through March 2000 were analyzed. An extended version of logistic regression for…

Using generalizability theory, this study examined both the rating variability and reliability of ESL students' writing in the provincial English examinations in Canada. Three years' data were used in order to complete the analyses and examine the stability of the results. The major research question that guided this study was: Are there any…

Possible integrated and independent tasks were pilot tested for the writing section of a new generation of the TOEFL[R] (Test of English as a Foreign Language[TM]). This study examines the impact of various rating designs and of the number of tasks and raters on the reliability of writing scores based on integrated and independent tasks from the…

Adult English as a second language (ESL) students learning English outside of traditional academic settings are an understudied population of second language learners. The purpose of the research reported here is to contribute to meeting the instructional needs of these students more effectively by investigating the relationships between their…

Providing information to test takers and test score users about the abilities of test takers at different score levels has been a persistent problem in educational and psychological measurement (Carroll, 1993). Since the 1990s Educational Testing Service has been investigating solutions to this problem through the development of proficiency…

This study explored the extent to which the reading-to-write construct is the sum of one's reading and writing abilities or an independent construct. The investigation included an analysis of (a) test tasks, (b) the relationship of test task scores and scores on reading and writing measures, and (c) the effects of proficiency level and educational…

In this work, prominent authorities review the latest research on all aspects of ELL instruction (K-12) and identify what works for today's students and schools. Provided are best-practice guidelines for targeting reading, writing, oral language, vocabulary, content-domain literacies, and other core skill areas; assessing culturally and…

A long-time detractor of immersion education has been the concern that a substantial proportion of teaching in and about a language other than English might potentially lead to irreparable damage to immersion students' development in English and, hence, their ability to function in an English-dominant society. The assessment in this article,…

This research aimed to investigate the effect of computers on the test and inter-rater reliability of writing test scores of ESL learners. Writing samples of 20 pen-paper and 20 computer group students were scored in analytic scoring method by two scorers, and then the scores were analyzed in Alpha (Cronbach) model. The results showed that the…

The use of online rater self-training is growing in popularity and has obvious practical benefits, facilitating access to training materials and rating samples and allowing raters to reorient themselves to the rating scale and self monitor their behaviour at their own convenience. However there has thus far been little research into rater…

This research aimed to investigate the effect of computers on the test and inter-rater reliability of writing test scores of ESL learners. Writing samples of 20 pen-paper and 20 computer group students were scored in analytic scoring method by two scorers, and then the scores were analyzed in Alpha (Cronbach) model. The results showed that the…

This is a research brief of a longer report, also published as "Bilingual Education and English as a Second Language Summary Report, 2009-2010". Twenty-nine percent of students enrolled in Austin Independent School District were English language learners in 2009-2010. The majority of them (62%) continued to make progress in English…