The synthetic control method (SCM) is a popular approach for estimating the impact of a treatment on a single unit with panel data. Two challenges arise with higher frequency data (e.g., monthly versus yearly): (1) achieving excellent pre-treatment fit is typically more challenging; and (2) overfitting to noise is more likely. Aggregating data…

Evaluators widely agree that the involvement of key actors is a central aspect of quality practice. However, a scoping review of to what extent and how youth are included has not been explored. This is an important omission because many evaluations are done on programs that directly serve youth. We examined 159 evaluation reports in a publicly…

The exponential growth of scholarly publications in recent years has presented a daunting challenge for researchers to keep track of relevant articles within their research field. To address this issue, we examined the capabilities of InfraNodus, an AI-Powered text network analysis platform. InfraNodus promises to provide insights into any…

This study aims to examine the studies on curriculum commitment in Turkey. The descriptive content analysis method was used in the research. Google Scholar and YÖK national databases were searched using the keywords "curriculum" and "fidelity." Twenty-four studies using these words in their titles were included in the research.…

Knowledge Tracing (KT) is a task to model students' knowledge based on their coursework interactions within an Intelligent Tutoring System (ITS). Recently, Deep Neural Networks (DNN) showed superb performance over classical methods on multiple dataset benchmarks. While most Deep Learning based Knowledge Tracing (DLKT) models are optimized for…

This paper reviews 38 studies conducted between 2015 and 2022 on collaborative assessments in open-distance and e-learning (ODeL) contexts, focusing on the benefits, types, challenges, and strategies to improve collaborative assessments. This qualitative review aims to investigate collaborative assessments within the ODeL comprehensively. The…

The purpose of this systematic review was to survey available measures of creativity for pk12 students for assessments characteristics and reporting of psychometric properties. Using the PRISMA framework, we identified 42 unique articles with 48 assessments meeting our inclusion criteria. Then, two coders independently coded all articles using a…

Gifted students are future leaders in society. In order to support and encourage them, it's important to have a thorough understanding of the nature of giftedness and the perceptions, and anticipations of gifted students. Therefore, the purpose of this study is to investigate the perceptions and anticipations of 6th-grade gifted students about…

The roles in traditional mentoring dyads are well known across both academic and professional contexts (Dawson, 2014). Despite the universality of these relationships, the way mentorship is evaluated in these relationships is fractured. Evaluation is limited to singular voices, singular points in time and simplified metrics to capture the journey…

Idiomatic expressions (IEs) play an essential role in natural language. In this paper, we study the task of idiomatic sentence paraphrasing (ISP), which aims to paraphrase a sentence with an IE by replacing the IE with its literal paraphrase. The lack of large scale corpora with idiomatic-literal parallel sentences is a primary challenge for this…

Automated essay scoring (AES), where natural language processing is applied to score written text, can underpin educational resources in blended and distance learning. AES performance has typically been reported in terms of correlation coefficients or agreement statistics calculated between a system and an expert human examiner. We describe the…

In this paper we report our development of instruments to measure Big Ideas in school mathematics. In tackling the issue of assessment fatigue among students, we present an aggregated approach to measure students' knowledge of Big Ideas.

Reweighting a distribution to minimize a distance to a target distribution is a powerful and flexible strategy for estimating a wide range of causal effects, but can be challenging in practice because optimal weights typically depend on knowledge of the underlying data generating process. In this paper, we focus on design-based weights, which do…

This article focuses on the results of an investigation about the "traffic light" method in kindergarten, which is used as a self-assessment method, a strategy by which the preschoolers evaluate their own progress in achieving the learning objectives, and the teacher obtains an immediate feedback regarding the level of understanding of…

The validity of the Kappa coefficient of chance-corrected agreement has been questioned when the prevalence of specific rating scale categories is low and agreement between raters is high. The researchers proposed the Lambda Coefficient of Rater-Mediated Agreement as an alternative to Kappa to address these concerns. Lambda corrects for chance…