This paper looks at the tension between the desire to claim predictive ability for Agent-Based Models (ABMs) and its extreme difficulty for social and ecological systems, suggesting that this is the main cause for the continuance of a rhetoric of prediction that is at odds with what is achievable. Following others, it recommends that it is better…

In recent years, educators, administrators, policymakers, and measurement experts have called for assessments that support educators in making better instructional decisions. One promising approach to measurement to support instructional decision-making is diagnostic classification models (DCMs). DCMs are flexible psychometric models that…

A frequent criticism of exploratory factor analysis (EFA) is that it does not allow correlated residuals to be modelled, while they can be routinely specified in the confirmatory (CFA) model. In this article, we propose an EFA approach in which both the common factor solution and the residual matrix are unrestricted (i.e., the correlated residuals…

Evidence-based programs and grassroots programs are often adapted during implementation. Adaptations are often hidden, ignored, or punished. Although some adaptations stem from lack of organizational capacity, evaluators report other adaptations happen in good faith or are efforts to better fit the local context. Program implementers, facilitators…

When reevaluating the educational landscape and aiming to incorporate movement into the day, remember that all exercise is not created equal. We recommend creating a model to evaluate the level of student exercise within an organization. The four-level framework discussed in this column can be used to evaluate exercise and sedentariness within an…

Agent-based models (ABMs) often rely on psychometric constructs such as 'opinions', 'stubbornness', 'happiness', etc. The measurement process for these constructs is quite different from the one used in physics as there is no standardized unit of measurement for opinion or happiness. Consequently, measurements are usually affected by 'psychometric…

CIPP, which stands for Context, Input, Process and Product, an evaluation model, is one of the most widely applied curriculum evaluation models in education. This document-based study sought to determine the historical development of CIPP as a curriculum evaluation model. Here, the reasons why the CIPP evaluation model was conceptualised are…

Evaluations are considered of key importance for a well-functioning democracy. Against this background, it is vital to assess whether and how evaluation models approach the role of citizens. This paper is the first in presenting a review of citizen involvement in the main evaluation models which are commonly distinguished in the field. We present…

Purpose: The purpose of this study is to determine the competency characteristics required for the employment of master's degree students in educational technology. Design/methodology/approach: A combined qualitative and quantitative method was used to consult multiple experts through a modified Delphi method. Competency characteristics were…

A growing number of countries has a strong interest in assessing the quality of their talent-support systems. We propose combining two relevant conceptual frameworks -- hemerotopes and the learning and educational capital approach -- to better achieve this end. Hemerotopes provide qualitative categories for assessing the degree to which countries…

An intraverbal assessment was administered to older adults with aphasia, using a hierarchy of questions that required increasingly complex verbal discriminative stimulus control. Five categories of errors were defined and analyzed for putative stimulus control, with the aim to identify requisite assessment components leading to more efficient and…

In response to the shifting educational landscape and the growing emphasis on responsibility and quality, quality assurance systems in higher education have experienced significant modification throughout time. These systems are essential for assuring the delivery of high-quality educational programmes and preserving the standing and reputation of…

Abstract This study proposes a new Bayesian differential item functioning (DIF) detection method using posterior predictive model checking (PPMC). Item fit measures including infit, outfit, observed score distribution (OSD), and Q1 were considered as discrepancy statistics for the PPMC DIF methods. The performance of the PPMC DIF method was…

The aim of this paper is to present a schema that maps the terrain of intercultural assessment strategies. This schema is based upon Haraway's semiotic square and has two dimensions. The first considers how distant or near the cultural Other is understood to be -- whether they are perceived a "stranger" or a "neighbour." The…

State and federal governments invest millions of dollars in providing accurate and relevant information on expected outcomes to students pursuing higher education, but whether such information targets what students value about college is unclear. We use new survey data to identify the extent to which conventional indicators for college quality and…