Justification of testing practice involves moving from one state of knowledge about the test to another. Theories of test validity can (a) focus on the beginning of the process, (b) focus on the end, or (c) encompass the entire process. Analyses of four case studies test and illustrate three claims: (a) restrictions on validity entail a supplement…

Despite the importance of assessment accommodations, little is known about its use in the context of classroom assessments. To provide guidance for teachers on how to best support their emergent bilinguals during classroom assessments, there may be ideas from large-scale assessments that can be used in the classrooms. This article, a targeted…

Focusing on the reflective exchanges of four test writers at an intensive language school within a public university, this study explored the effectiveness of a "lesson study" model on their professional development as test writers. Lesson study is a powerful tool for teachers' professional development and a modified version of it--a…

Educators have many decisions to make and it's important that they have the right data to inform those decisions and access to questionnaires that can gather that data. This guide, developed by REL Central and based on work done through separate projects with the Wyoming Office of Public Instruction and the Nebraska Department of Education,…

This report is an update of the assessment principles and guidelines for English language learners published in 2013 (Thurlow, Liu, Ward, & Christensen). That report, which was developed by the Improving the Validity of Assessment Results for English Language Learners with Disabilities (IVARED) project, presented essential principles of…

This study is a critical analysis of a low-stakes in-house English as a Second Language (ESL) and English literacy test from a local program in a large city in the southwestern United States. From a critical multimodal social semiotic perspective (Kress G. Multimodality: A social semiotic approach to contemporary communication. Routledge, 2010;…

This is a multi-method study to develop and validate an instrument to measure teachers' self-efficacy for teaching students with autism spectrum disorder (ASD) in inclusive early childhood classrooms, "Teacher Self-efficacy for Teaching Students with ASD Inclusive Classrooms Scale": TSE-ASDI. I conducted literature and expert reviews as…

New Meridian Corporation has developed the "Quality Testing Standards and Criteria for Comparability Claims" (QTS) to provide guidance to states that are interested in including New Meridian content and would like to either keep reporting scores on the New Meridian Scale or use the New Meridian performance levels; that is, the state…

Admission in English-medium universities or institutions of higher education depends on the results obtained by candidates in large-scale proficiency tests including Test of English as a Foreign Language (TOEFL) internet-based test (iBT). The structure and administration procedure of the TOEFL iBT speaking test leaves no room for carrying out…

The primary purpose of International Computer and Information Literacy Study (ICILS) 2018 is to assess systematically the capacities of students to use ICT productively for a range of different purposes, in ways that go beyond a basic use of ICT. ICILS 2018 includes authentic computer-based assessments that are administered to students in their…

Contrary to popular belief, modern cognitive assessments--including the new Common Core tests--produce test scores based on sophisticated statistical models rather than the simple percent of items a student answers correctly. While there are good reasons for this, it means that reported test scores depend on many decisions made by test designers,…

Gender differences in reading seem to increase throughout schooling and then decrease or even disappear with age, but the reasons for this are unclear. In this study, we explore whether differences in the way "reading literacy" is operationalised can add to our understanding of varying gender differences in international large-scale…

Writing multiple-choice test items to measure student learning in higher education is a challenge. Based on extensive scholarly research and experience, the author describes various item formats, offers guidelines for creating these items, and provides many examples of both good and bad test items. He also suggests some shortcuts for developing…

The current study reports the results of a project aimed at assessing L2 listening comprehension by drawing on two approaches to dynamic assessment: interventionist and interactionist. The former approach was actualized by providing two graduated hints which were fixed and standardized for all test takers while the latter was actualized by asking…

Testing organization needs large numbers of high-quality items due to the proliferation of alternative test administration methods and modern test designs. But the current demand for items far exceeds the supply. Test items, as they are currently written, evoke a process that is both time-consuming and expensive because each item is written,…