In this paper, based on the established Vitae Researcher Development Framework (RDF), we introduce a new framework, tailor-made specifically for Vietnamese educational researchers, namely, Vietnam's Framework for Educational Researchers (VFER). VFER is expected to serve as a tool for Vietnamese educational researchers to self-evaluate their skills…

Most existing solutions to the current replication crisis in science address only the factors stemming from specific poor research practices. We introduce a novel mechanism that leverages the experts' predictive abilities to analyze the root causes of replication failures. It is backed by the principle that the most accurate predictor is the most…

Although scholars have discussed in depth about the evaluation content and the construction of evaluation index system of emergency management and crisis management, a unified and standardized interpretation of system construction concepts and empirical research on the performance evaluation of urban emergency management is still lacking. In view…

When and how to survey potential respondents is often determined by budgetary and external constraints, but choice of survey modality may have enormous implications for data quality. Different survey modalities may be differentially susceptible to measurement error attributable to interviewer assignment, known as interviewer effects. In this…

This analysis employs a Bayesian framework to estimate the impact of a Cognitive-Behavioral Therapy (CBT) intervention on the recidivism of high-risk people under community supervision. The study relies on the reanalysis of experimental datal using a Bayesian logistic regression model. In doing so, new estimates of programmatic impact were…

This paper presents the process of conducting a community-wide needs assessment that initially focused on soliciting information about childcare needs of families with school-aged children. The researchers were interested in understanding whether the method designed to conduct the needs assessment helped to foster collaboration, trust, and…

Unfolding item response theory (IRT) models are important alternatives to dominance IRT models in describing the response processes on self-report tests. Their usage is common in personality measures, since they indicate potential differentiations in test score interpretation. This paper aims to gain a better insight into the structure of trait…

Objective: This article describes the process implemented in order to define and build up a Basic Monitoring and Evaluation System for Spanish Cooperation's Culture and Development Strategy (CD-S). Research Design: Delphi techniques were used to assess a wide catalogue of indicators for each of the strategic areas included in the CD-S. Afterward,…

Research synthesis of evaluation findings is a multistep process. An investigator identifies a research question, acquires the relevant literature, codes findings from that literature, and analyzes the coded data to estimate the average treatment effect and its distribution in a population of interest. The process of estimating the average…

Background: Recent reviews suggest that many plausible programs are found to have at best small impacts not commensurate with their cost, and often have no detectable positive impacts at all. Even programs with initial rigorous impact evaluation (RIE) that show them to be effective often fail a second test with an expanded population or at…

Background and objectives: The evaluation of public health law requires reliable accounts of underlying statutes and regulations. States often enact public health-related statutes with nonuniform provisions, and variation in the structure of state legal codes can foster inaccuracy in evaluating the impact of specific categories of law. The optimal…

Objective: Public and private stakeholders of substance abuse treatment services require economic cost data to guide program evaluations and funding decisions. Background: Rigorous cost assessments have been conducted for several treatment programs across the United States, but a systematic and comprehensive evaluation of programs in a particular…

Objective: In this article, we estimate the effect of a multidisciplinary collaboration program on the length of sickness absence. The intention with the program was to avoid long-term sickness absence by providing an early and holistic evaluation of the sick-listed individuals' conditions. The target group was individuals who were at risk of…

Background: Many university departments use students' evaluations of teaching (SET) to compare and rank courses. However, absenteeism from class is often nonrandom and, therefore, SET for different courses might not be comparable. Objective: The present study aims to answer two questions. Are SET positively biased due to absenteeism? Do…

Background: Stakeholder participation is an important trend in the field of program evaluation. Although a few measurement instruments have been proposed, they either have not been empirically validated or do not cover the full content of the concept. Objectives: This study consists of a first empirical validation of a measurement instrument that…