The purpose of this study is to describe a methodology to recover the item model used to generate multiple-choice test items with a novel graph theory approach. Beginning with the generated test items and working backward to recover the original item model provides a model-based method for validating the content used to automatically generate test…

Educators have many decisions to make and it's important that they have the right data to inform those decisions and access to questionnaires that can gather that data. This guide, developed by REL Central and based on work done through separate projects with the Wyoming Office of Public Instruction and the Nebraska Department of Education,…

Integrated speaking tasks requiring test takers to read and/or listen to stimulus texts and to incorporate their content into oral performances are now used in large-scale, high-stakes tests, including the TOEFL iBT. These tasks require test takers to identify, select, and combine relevant source text information to recognize key relationships…

This report is an update of the assessment principles and guidelines for English language learners published in 2013 (Thurlow, Liu, Ward, & Christensen). That report, which was developed by the Improving the Validity of Assessment Results for English Language Learners with Disabilities (IVARED) project, presented essential principles of…

In the fall of 2014, the University at Buffalo created a new universal Student Evaluation of Teaching (SET). The purpose of the present study was to establish the construct validity of SET items. Rasch analyses of data from 7 semesters (N=203,194 students) revealed problems with item fit indices and threshold distances. Changes to items and…

This article discusses the outcomes of research into the media literacy aspects of ENEM ("Exame Nacional do Ensino Médio"), Brazil's unified university entrance exam, which contains a significant number of exam questions based on excerpts from newspaper articles, online news and other media sources. Through content analysis, these…

This study is a critical analysis of a low-stakes in-house English as a Second Language (ESL) and English literacy test from a local program in a large city in the southwestern United States. From a critical multimodal social semiotic perspective (Kress G. Multimodality: A social semiotic approach to contemporary communication. Routledge, 2010;…

The purpose of this study is to examine the appropriateness of using the "TOEFL Primary®" tests to evaluate the language abilities of students learning English as a foreign language (EFL) through an online-delivered curriculum, the VIPKid Major Course (MC). Data include student test scores on the TOEFL Primary Listening and Reading tests…

The purpose of this study was to investigate the impact of a cheating prevention strategy employed for a professional credentialing exam that involved releasing over 7,000 active and retired exam items. This study evaluated: 1) If any significant differences existed between examinee performance on released versus non-released items; 2) If item…

This paper reports on a design-based implementation study of the use of a diagnostic classroom assessment tool framed on learning trajectories (LTs) for middle grades mathematics, where teachers and students are provided immediate data on students' progress along LTs. The study answers the question: "How can one characterize the challenges…

The Angoff standard setting method relies on content experts to review exam items and make judgments about the performance of the minimally proficient examinee. Unfortunately, at times content experts may have gaps in their understanding of specific exam content. These gaps are particularly likely to occur when the content domain is broad and/or…

In this article, the authors present the adaptation and validation processes conducted to render the American "Test of Financial Literacy" (TFL) suitable for use in Germany (TFL-G). First, they outline the translation procedure followed and the various cultural adjustments made in line with international standards. Next, they present…

Increased understanding of the importance of the affective domain in chemistry education research has led to the development and adaptation of instruments to measure chemistry-specific affective traits, including motivation. Many of these instruments are adapted from other fields by using the word "chemistry" in place of other…

This article begins with a theoretical discussion of the characteristics that a task should feature to be regarded as a mathematics problem suitable for pre-primary students. Those considerations are followed by a report of a classroom experience in which three problems involving quotative or partitive division were posed to pre-primary school…

This is a multi-method study to develop and validate an instrument to measure teachers' self-efficacy for teaching students with autism spectrum disorder (ASD) in inclusive early childhood classrooms, "Teacher Self-efficacy for Teaching Students with ASD Inclusive Classrooms Scale": TSE-ASDI. I conducted literature and expert reviews as…