This paper presents an empirical study investigating the relationship between vocabulary size and the skills of listening, reading and writing in English as a foreign language (EFL). The participants were 88 EFL learners from lower secondary education whose language skills were assessed as part of the national school leaving examination in…

The main purpose of the study was to investigate the distinctness and reliability of analytic (or multitrait) rating dimensions and their relationships to holistic scores and "e-rater"® essay feature variables in the context of the TOEFL® computer-based test (CBT) writing assessment. Data analyzed in the study were analytic and holistic…

The use of computer programs that can be used to correct and assess students' written work in the EFL classroom has become more commonplace within the last decade. This paper discusses the role of CALL in the process of data collection, standardisation of assessment criteria and compilation of the number of errors in the areas of grammar learning…

Performance assessments have become the norm for evaluating language learners' writing abilities in international examinations of English proficiency. Two aspects of these assessments are usually systematically varied: test takers respond to different prompts, and their responses are read by different raters. This raises the possibility of undue…

For many purposes, it is useful to collect a corpus of texts all produced to the same stimulus, whether to measure performance (as on a test) or to test hypotheses about population differences. This paper examines several methods for measuring similarities in phrasing and content and demonstrates that these methods can be used to identify…

The present study investigated the effectiveness of integrating RCampus in EFL freshman classrooms on EFL students' reading and writing skills development. Forty-three freshman students majoring in translation participated in the study. Before instruction, the students were pretested. Then they received traditional in-class instruction that…

The goal of the current study was to examine the validity and topic generality of a writing performance test designed to place international students into appropriate ESL courses at a large mid-western university. Because for each test administration the test randomly rotates three academic topics integrated with listening and reading sources, it…

This action research study evaluates a classroom approach incorporating a reflective, metacognitive component within a second language process-oriented writing environment. Inspired by the literature and developed by the first author, this approach seeks to provide English language learners (ELLs) with a command of metalinguistic principles…

The present study investigates the use of English lexical collocations and their relation to the online writing of Taiwanese college English majors and non-English majors. Data for the study were collected from 41 English majors and 21 non-English majors at a national university of science and technology in southern Taiwan. Each student was asked…

This study investigated whether dedicated test preparation classes gave learners an advantage in improving their writing test scores. Score gains following instruction on a measure of academic writing skills--the International English Language Testing System (IELTS) academic writing test--were compared across language courses of three types; all…

Educators often have to choose among different types of rating scales to assess second-language (L2) writing performance. There is little research, however, on how different rating scales affect rater performance. This study employed a mixed-method approach to investigate the effects of two different rating scales on EFL essay scores, rating…

Using generalizability theory, this study examined both the rating variability and reliability of ESL students' writing in the provincial English examinations in Canada. Three years' data were used in order to complete the analyses and examine the stability of the results. The major research question that guided this study was: Are there any…

Possible integrated and independent tasks were pilot tested for the writing section of a new generation of the TOEFL[R] (Test of English as a Foreign Language[TM]). This study examines the impact of various rating designs and of the number of tasks and raters on the reliability of writing scores based on integrated and independent tasks from the…

Adult English as a second language (ESL) students learning English outside of traditional academic settings are an understudied population of second language learners. The purpose of the research reported here is to contribute to meeting the instructional needs of these students more effectively by investigating the relationships between their…

Providing information to test takers and test score users about the abilities of test takers at different score levels has been a persistent problem in educational and psychological measurement (Carroll, 1993). Since the 1990s Educational Testing Service has been investigating solutions to this problem through the development of proficiency…