Premised on the idea that evaluators should be familiar with a range of approaches to program modifications, I review several existing approaches and then describe another, less well-recognized option. In this newer option, evaluators work with others to identify potentially needed adaptations for select program aspects "in advance." In…

CIPP, which stands for Context, Input, Process and Product, an evaluation model, is one of the most widely applied curriculum evaluation models in education. This document-based study sought to determine the historical development of CIPP as a curriculum evaluation model. Here, the reasons why the CIPP evaluation model was conceptualised are…

Multicriteria decision-making (MCDM) techniques have been widely adopted to evaluate the effectiveness of e-learning. However, the literature review has not kept pace with the rapid accumulation of knowledge in this field. This study systematically reviews the MCDM techniques applied in e-learning issues. In total, we reviewed 77 published studies…

To improve the validity of self-report measures, researchers should control for response style (RS) effects, which can be achieved with IRTree models. A traditional IRTree model considers a response as a combination of distinct decision-making processes, where the substantive trait affects the decision on response direction, while decisions about…

This paper is concerned with the process of selecting between the increasingly popular bi-factor model and the second-order factor model in measurement research. It is indicated that in certain settings widely used in empirical studies, the second-order model is nested in the bi-factor model and obtained from the latter after imposing appropriate…

In recent years, educators, administrators, policymakers, and measurement experts have called for assessments that support educators in making better instructional decisions. One promising approach to measurement to support instructional decision-making is diagnostic classification models (DCMs). DCMs are flexible psychometric models that…

The rationality and the effectiveness of classroom teaching behavior directly influence the quality of classroom instruction. Analyzing teaching behavior intelligently can provide robust data support for teacher development and teaching supervision. By observing verbal and nonverbal behaviors of teachers in the classroom, valuable data on…

Fuzzy sets have experienced multiple expansions since their conception to enhance their capacity to convey complex information. Intuitionistic fuzzy sets, image fuzzy sets, q-rung orthopair fuzzy sets, and neutrosophic sets are a few of these extensions. Researchers and academics have acquired a lot of information about their theories and methods…

Teachers need to judge students accurately to ensure social justice within classrooms. Currently, many reviews have estimated how accurately teachers overall judge students, but only a few provided clues about how teachers' accuracy could be improved. To provide insight regarding the sources of teachers' (in)accuracy, we review and synthesise lens…

Most recent research on teacher evaluation examines evaluation's measurement properties and accountability uses. Less research studies how evaluation data can improve teaching and student learning. In other contexts, researchers have examined how teachers use data to improve their practice. From general research on teachers' data use, we apply the…

When measuring latent constructs, for example, language ability, we use statistical models to specify appropriate relationships between the latent construct and observe responses to test items. These models rely on theoretical assumptions to ensure accurate parameter estimates for valid inferences based on the test results. This dissertation…

Knowledge components (KCs) have many applications. In computing education, knowing the demonstration of specific KCs has been challenging. This paper introduces an entirely data-driven approach for: (1) discovering KCs; and (2) demonstrating KCs, using students' actual code submissions. Our system is based on two expected properties of KCs: (1)…

When producing creative ideas (i.e., ideas that are original and useful) two main processes occur: ideation, where people brainstorm ideas, and evaluation, where they decide if the ideas are creative or not. While much is known about the ideation phase, the cognitive processes involved in creativity evaluation are less clear. In this article, we…

Sociology faculty are accountable to multiple stakeholders to demonstrate that our academic programs are effective and that students are learning. Despite the ubiquity of mandated program review practices, which often include the assessment of student learning, research is lacking on the extent to which these efforts lead to improvements in…

Aim/Purpose: The purpose of this paper is to develop and evaluate a debiasing-based approach to assessing the learning materials in problem-based learning (PBL) environments. Background: Research in cognitive debiasing suggests nine debiasing strategies improve decision-making. Given the large number of decisions made in semester-long,…