In an effort provide access to devices and prepare students for the future, a small rural high school committed to becoming a high-tech school. However, data collected using the IPI-T process suggested teachers were typically the users of the technology, students were often disengaged, and teachers were asking students to participate in…

Within professional higher education, the construct of assessment validity is used to make assumptions about the extent to which students are able to replicate in professional practice what they have learned during their studies through the provision of authentic simulated opportunities to practice. Drawing on the work of Bruno Latour, this…

For academic success, it is increasingly important that students of all ages can produce and comprehend expository discourse. This article provides guidance to clinicians and educators on using language sample analysis (LSA) to assess the expository language abilities of students across grades. Focusing on microstructural and macrostructural…

Key competences are important for personal development, employment, integration into society and lifelong learning. They are transversal and form the basis for all other competences. Acquiring key competences is possible through various learning pathways, including vocational education and training (VET). However, little is known at the European…

ACT requested assistance from the National Center for the Improvement of Educational Assessment (Center for Assessment) to investigate declines of scores for states administering the ACT to its 11th grade students in 2018. This request emerged from conversations among state leaders, the Center for Assessment, and ACT in trying to understand the…

Frequent language exposure and use are among the most important conditions for successful language learning, whether in classrooms, during study abroad, or in other informal contexts. Research probing exposure and usage often relies on one-off self-report questionnaires in which participants estimate their typical level of language exposure over…

This paper presents a critical analysis, from the point of view of a statistician, of the methodology used by Hattie in "Visible Learning," and explains why it must absolutely be called pseudoscience. We first discuss what appears to be the intentions of Hattie's approach. Then we describe the major mistakes in "Visible…

The measurement error in principal components extracted from a set of fallible measures is discussed and evaluated. It is shown that as long as one or more measures in a given set of observed variables contains error of measurement, so also does any principal component obtained from the set. The error variance in any principal component is shown…

As evaluators, we are often asked to determine whether policies and programs provide value for the resources invested. Addressing that question can be a quandary, and, in some cases, evaluators question whether cost-benefit analysis is fit for this purpose. With increased interest globally in social enterprise, impact investing, and social impact…

Universities are seldom lauded publicly for maintaining good processes and practices; instead, media stories commonly focus on shortcomings. Furthermore, universities, even when doing everything right, sometimes are unfairly targeted for criticism in circumstances in which making a public defence is difficult. A prominent case at the University of…

Education reform legislation has led to an upwelling of mandatory teacher evaluation for all elementary, middle school, and high school educators, including those who teach special education. While this reform effort aimed to improve overall teacher effectiveness and student learning outcomes, the teacher evaluation for special education is a…

The increased use of quantitative education data is often regarded by scholars as evidence of the emergence of 'governing by numbers'. These scholars ascribe major stakeholders such as the OECD and nation states agency as they produce, distribute and consume data, and respond to these with policy and management initiatives. This paper argues that…

How should colleges determine whether students are placed into developmental or college-level courses? Each year, colleges place millions of students into developmental math and English courses upon enrollment. To do so, colleges most often use a high-stakes placement test, which numerous research studies have shown to be highly inaccurate in…

Aguirre-Urreta, Rönkkö, and Marakas' (2016) paper in "Measurement: Interdisciplinary Research and Perspectives" (hereafter referred to as ARM2016) is an important and timely piece of scholarship, in that it provides strong analytic support to the growing theoretical literature that questions the underlying ideas behind causal and…

The purpose of this ITEMS module is to provide an introduction to differential item functioning (DIF) analysis using mixture item response models. The mixture item response models for DIF analysis involve comparing item profiles across latent groups, instead of manifest groups. First, an overview of DIF analysis based on latent groups, called…