Presented at the Annual National Council on Measurement in Education (NCME) in New York in March 2008. This presentation explores how different item weighting can affect the effective weights, validity coefficents and test reliability of composite scores among test takers.

This study investigated differences in vocabulary knowledge as a potential explanation for perceived differences between placed and promoted students in a university EAP reading course. Students in an advanced reading course (N=59) were tested on their vocabulary knowledge using the Vocabulary Levels Test Form B [Nation, I. S. P. (2001). "Learning…

Previous research on differences in the reliability, validity, and difficulty of essay tests given under different timing conditions has indicated that giving examinees more time to complete an essay may raise their scores to a certain extent, but does not change the meaning of those scores, or the rank ordering of students. There is no evidence…

This article is drawn from a large-scale ongoing study on linguistic progress in advanced French as a second language (FL2). The performance of 48 English-speaking students who spent their third year of university in France the "experimental" group) has been compared to that of 39 classmates who chose to stay and study at home in…

This paper examines the nature of confidence in relation to cognitive abilities, personality traits, and metacognition. Confidence was measured as it was expressed in answers to each test item during the administration of reading and listening sections of the TOEFL® iBT. The confidence scores were correlated with the accuracy scores from the TOEFL…

Statistical and measurement properties are examined for features used in essay assessment to determine the generalizability of the features across populations, prompts, and individuals. Data are employed from TOEFL® and GMAT® examinations and from writing for Criterion?.

This paper consists of four sections, each dealing with the assessment of a single language skill: Writing, Speaking, Reading and Listening. While culture includes those "everyday aspects of life within a society" which are present but not necessarily overtly expressed, Culture embraces "those aspects and artifacts of society that represent what…

This study investigated the relationship between language learning strategy (LLS) preferences and English proficiency among Chinese university students. Oxford's (1990), Strategy Inventory for Language Learning (SILL) and an institutional version (ITP) of the Test of English as a Foreign Language (TOEFL) were administered to 168 third-year English…

Nearly all Western loanwords in Japanese are first introduced to the public by a small number of individuals with most Japanese people having never heard or read the word before, and having no role to play in their borrowing. Because of this presumptuous use of foreign words by, for example, academics, government bodies, and the media, the…

Non native speakers of English wishing to study at tertiary level in English speaking countries are increasingly required to prove their English language competence by taking an internationally recognised test such as the Test of English as a Foreign Language (TOEFL) and the International English Language Testing Systems (IELTS). This article…

A challenge for many EAP teachers working on pre-sessional programs is to find ways to reconcile the dual aims of preparing students for university study and for the IELTS test. The study described here seeks to provide some guidance on this issue through an analysis of the type of writing required in the two domains. We compared the standard…

Much of the research on the effects of tests on foreign and second-language classrooms has examined the impact or washback effect that commercial/institutional language tests, such as the TOEFL, have on teachers' instructional practices (Hughes, 1998; Wall & Alderson, 1993). Using a case study methodology, this study uncovered the ways in…

Background: There is a need to provide students with a repertoire of strategies to enable them to know what to use when and for what learning task. What they need to do is acquisition and use of the most important of skills; learning how to learn skills. Purpose: The present study aimed at investigating the effects of a suggested training program…

The washback effect of tests on teaching has attracted considerable attention over recent years, but the critical question of how this translates into washback on learning remains under-explored. To address this issue, questionnaires relating to academic writing instruction were distributed to 108 learners from mainland China preparing for…

Statistical prediction problems often involve both a direct estimate of a true score and covariates of this true score. Given the criterion of mean squared error, this study determines the best linear predictor of the true score given the direct estimate and the covariates. Results yield an extension of Kelley's formula for estimation of the true…