The synthetic control method (SCM) is a popular approach for estimating the impact of a treatment on a single unit with panel data. Two challenges arise with higher frequency data (e.g., monthly versus yearly): (1) achieving excellent pre-treatment fit is typically more challenging; and (2) overfitting to noise is more likely. Aggregating data…

Evaluators widely agree that the involvement of key actors is a central aspect of quality practice. However, a scoping review of to what extent and how youth are included has not been explored. This is an important omission because many evaluations are done on programs that directly serve youth. We examined 159 evaluation reports in a publicly…

According to architectural designers, although they are aware of the sound environment when designing spaces, in many cases visual (design) and cost (cost-effectiveness, etc.) were the predominant factors. In many cases, the visual (design) and cost aspects (cost-effectiveness, etc.) were dominant. The tacit rule for evaluating the sound…

This paper reviews 38 studies conducted between 2015 and 2022 on collaborative assessments in open-distance and e-learning (ODeL) contexts, focusing on the benefits, types, challenges, and strategies to improve collaborative assessments. This qualitative review aims to investigate collaborative assessments within the ODeL comprehensively. The…

The purpose of this systematic review was to survey available measures of creativity for pk12 students for assessments characteristics and reporting of psychometric properties. Using the PRISMA framework, we identified 42 unique articles with 48 assessments meeting our inclusion criteria. Then, two coders independently coded all articles using a…

Reweighting a distribution to minimize a distance to a target distribution is a powerful and flexible strategy for estimating a wide range of causal effects, but can be challenging in practice because optimal weights typically depend on knowledge of the underlying data generating process. In this paper, we focus on design-based weights, which do…

To address the computational constraints of parameter estimation in the polytomous Cognitive Diagnosis Model (pCDM) in large-scale high data volume situations, this study proposes two two-stage polytomous attribute estimation methods: P_max and P_linear. The effects of the two-stage methods were studied via a Monte Carlo simulation study, and the…

Since the George Floyd murder in 2020 and Black Lives Matter campaign, there has been increased interest among evaluators and PIs in Diversity, Equity and Inclusion (DEI) in their projects and evaluations. Our previous research showed a lack of clarity in understanding the distinction between the terms in practice and desire to engage with these…

Teachers' technological experiences are constrained by limitations in reflective decision-making and theoretical frameworks. Challenges with the technological pedagogical content knowledge framework (TPACK) are often associated with deficits in self-regulation. To effectively develop TPACK, it is recommended that educators focus on enhancing…