In recent years, educators, administrators, policymakers, and measurement experts have called for assessments that support educators in making better instructional decisions. One promising approach to measurement to support instructional decision-making is diagnostic classification models (DCMs). DCMs are flexible psychometric models that…

What if there was a better way to collect and interpret assessment data that could strengthen the link between teaching and learning? "Student Assessment: Better Evidence, Better Decisions, Better Learning" is the innovative guide to show you how it is done and done right. This unique book offers a new assessment model focused on…

In many large-scale testing programs, examinees are frequently categorized into different performance levels. These classifications are then used to make high-stakes decisions about examinees in contexts such as in licensure, certification, and educational assessments. Numerous approaches to estimating the consistency and accuracy of this…

The causal view of categories assumes that categories are represented by features and their causal relations. To study the effect of causal knowledge on categorization, researchers have used Bayesian causal models. Within that framework, categorization may be viewed as dependent on a likelihood computation (i.e., the likelihood of an exemplar with…

Purpose: The aim is to qualitatively explore Civics teachers' assessment decisions regarding content, skills, and methods in Swedish upper secondary schools. Methodology: Thematic analyses of assignments and interviews of thirteen Civics teachers in Swedish upper secondary school. Findings: The open Swedish curriculum and Civics syllabus enables…

Judges, jurors and other triers of fact often rely upon eyewitness evidence in criminal trials, but eyewitness memory is not always accurate and can sometimes be contaminated. The I-I-Eye is an evidence-based teaching aid designed to improve the evaluation of eyewitness evidence in legal settings. We aimed to further test the I-I-Eye and examine…

Increasing concerns about the trustworthiness of research have prompted calls to scrutinise studies' Individual Participant Data (IPD), but guidance on how to do this was lacking. To address this, we developed the IPD Integrity Tool to screen randomised controlled trials (RCTs) for integrity issues. Development of the tool involved a literature…

This paper argues for three aspects of tolerance with respect to QCA research: tolerance with respect to different approaches to QCA; producing QCA research with tolerance (work that is resistant to criticism); and for QCA researchers to be clear about the tolerance of the solutions they present -- especially in terms of calibration and truth…

Data-based decision-making has been a frequently used policy and practice intervention used in schools to help inform the decision-making processes of educational practitioners, with the aim of improving student outcomes. Interim benchmark assessments are designed by commercial test developers to support educators in this framework. In fact, the…

Evaluation competency frameworks across the globe regard evaluation approaches as important to know and use in practice. Prior classifications have been developed to aid in understanding important differences among varying approaches. Nevertheless, there is an opportunity for a new classification of evaluation approaches, in particular one that is…

Nontraditional grading methods have recently become more common, and as with any large pedagogical shift, there are a number of questions to consider when applying a new grading scheme to a course. This article summarizes four types of nontraditional grading and shares experiences from the authors who have applied them to a variety of courses in…

Multiple measures, such as multiple content domains or multiple types of performance, are used in various testing programs to classify examinees for screening or selection. Despite the popular usages of multiple measures, there is little research on classification consistency and accuracy of multiple measures. Accordingly, this study introduces an…

Consistency and coverage are two core parameters of model fit used by configurational comparative methods (CCMs) of causal inference. Among causal models that perform equally well in other respects (e.g., robustness or compliance with background theories), those with higher consistency and coverage are typically considered preferable. Finding the…

Multicriteria decision-making (MCDM) techniques have been widely adopted to evaluate the effectiveness of e-learning. However, the literature review has not kept pace with the rapid accumulation of knowledge in this field. This study systematically reviews the MCDM techniques applied in e-learning issues. In total, we reviewed 77 published studies…

A necessary step in applying bi-factor models is to evaluate the need for domain factors with a general factor in place. The conventional null hypothesis testing (NHT) was commonly used for such a purpose. However, the conventional NHT meets challenges when the domain loadings are weak or the sample size is insufficient. This article proposes…