The implicit sociocultural functioning of the "content" of high-stakes English language proficiency tests is a rarely-explored concern in language assessment. This study attempts to bring critical views of language testing and critical discourse studies together to examine the content of IELTS preparation materials in search of topics…

The TOEFL iBT test was introduced in 2005 to better reflect the language demands of real-life academic tasks than did previous versions of the test. The task-based design of the test was intended to support the interpretation of its scores as a trustworthy measure of international students' ability to use English in an academic environment. Until…

This paper presents a methodology for directly aligning 'can do' frameworks to each other. The methodology, inspired by the manual for relating examinations to the "Common European Framework of Reference for Languages: Learning, teaching, assessment" (CEFR) (Council of Europe, 2009) and Kane's (2004, 2013) interpretative argument, takes…

One of the greatest assessment challenges is providing fair and valid tests for multilingual pupils. Since language proficiency impacts their results on content tests, accommodations are suggested to help in solving the validity issues. In this mixed methods study on multilingual assessment, pupils were divided according to three testing…

Despite the wide use of language tests as a basis for awarding English language course credits at Japanese universities, little has been published about how universities set policies on awarding credits according to external test scores. To narrow this gap, the characteristics of such policies were investigated in relation to the EIKEN Test in…

The proceedings of the first Language Testing Forum in 1980 were published in "ELT Documents 111: Issues in Language Testing" (Alderson & Hughes, 1981). Discussants at the 1980 Forum raised a number questions on Language for Specific Purposes (LSP) testing relating, notably, to test specificity, test content, the relationship between…

Listening comprehension tests typically include both monologic and dialogic input to measure listening ability. However, research as to which type of input is more challenging for examinees remains limited and has provided inconclusive results (Brindley & Slatyer, 2002; Read, 2002; Shohamy & Inbar, 1991). A better understanding of the…

Although the United States has had a language requirement for citizenship (through the naturalization process) since the first decade of the 20th century, very little research and discussion has taken place in academic circles about this requirement, which has been enforced for the past two decades through a test and testing practice to which…

In cognitive diagnosis a Q-matrix (Tatsuoka, 1983, 1990), which is an incidence matrix that defines the relationships between test items and constructs of interest, has great impact on the nature of performance feedback that can be provided to score users. The purpose of the present study was to identify meaningful skill coding categories that…

This article reviews research on differential item functioning (DIF) in language testing conducted primarily between 1990 and 2005 with an eye toward providing methodological guidelines for developing, conducting, and disseminating research in this area. The article contains a synthesis of 27 studies with respect to five essential sets of…

This article provides practical advice on the development of test and item specifications. Because my experience has been with English as a second or foreign language, most examples are taken from this field, although they can be applied to other language tests. The article first discusses steps in the process of test development, including…

This article follows the development of test items (see "Language Assessment Quarterly", Volume 3 Issue 1, pp. 71-79 for the article "Test and Item Specifications Development"), beginning with a review of test and item specifications, then proceeding to writing and editing of items, pretesting and analysis, and finally selection of an item for a…

The Common European Framework of Reference (CEFR) is intended as a reference document for language education including assessment. This article describes a project that investigated whether the CEFR can help test developers construct reading and listening tests based on CEFR levels. If the CEFR scales together with the detailed description of…

Annually in the People's Republic of China (China) several million secondary school graduates who wish to gain entrance to Chinese universities and colleges take the National Matriculation English Test (NMET)--the university entrance test of English for the entire country. This article first describes the test, and then focuses on examining its…