Purpose: To evaluate pluralistic Extension and Advisory Services (EAS) systems performance and outcomes, and share the experiences made with applying a participatory semi-quantitative approach allowing for cross-country comparability. Design/methodology/approach: The Food and Agriculture Organization of the United Nations (FAO) developed the…

The combination of measuring performance and giving feedback creates tension between formative and summative purposes of progress evaluations and can be challenging for supervisors. There are conflicting perspectives and evidence on the effects supervisor-trainee relationships have on assessing performance. The aim of this study was to learn how…

LXD Research was engaged by 95 Percent Group to conduct a third-party, mixed-methods efficacy study of their 95 Phonics Core Program (95 PCP) to evaluate the impact on fourth and fifth grade literacy outcomes over the school year 2023-2024. LXD analyzed the formative assessment data from i-Ready, focusing on overall scale scores, subdomains, and…

Schools are a critical setting for improving child nutrition and food security and preventing obesity in the United States. The U.S. Department of Agriculture mandates that the Supplemental Nutrition Assistance Program--Education, known as CalFresh Healthy Living (CFHL) in California, implements obesity prevention efforts that utilize…

Propensity score matching and weighting methods are applied to balance covariates and reduce selection bias in the analysis of observational study data, and ultimately estimate a treatment effect. We wish to evaluate the impact of a Supplemental Instruction (SI) program on student success in an Introductory Statistics course. In such student…

Background: There is a lack of critical or empirical work interrogating the nature and purpose of evaluating technology use in education. Objectives: In this study, we examine the values underpinning the evaluation of technology use in education through field specialist perceptions. The study also poses critical reflections about the rigour of…

Due to repeated observations of an outcome behavior in N-of-1 or single-case design (SCD) intervention studies, the occurrence of missing scores is inevitable in such studies. Approximately 21% of SCD articles published in five reputable journals between 2015 and 2019 exhibited evidence of missing scores. Missing rates varied by designs, with the…

This study examines the impact of the College, Career, and Community Writers Program (C3WP) on upper-elementary students' first draft writing quality, addressing the challenges teachers face in providing timely and effective feedback on extensive student writing, particularly in spelling, grammar, mechanics, and cohesion. The hypothesis posits…

The purpose of this research was to employ the Research and Development (R&D) methodology to produce an educational innovation, called "Online Self-Training Program for Empowering Teachers' Learning to Develop Students' Design Thinking Skills", expected to be widely used among the schools that are the target population in…

In the Early Childhood Education and Care (ECEC) sector there is a move to reduce oversight costs by reducing the frequency of quality assessments in providers who score highly consistently across time. However, virtually nothing is known about the stability of ECEC quality assessments over time. Using a validated measure of overall classroom…

The Every Student Succeeds Act (ESSA) offers states increased flexibility in how they identify, rank, label, and support underperforming schools. Initial reviews of state ESSA plans, however, suggest that identification and labeling policies have remained relatively unchanged. In this study, we analyze all state ESSA plans to systematically…

Public schools follow school improvement guidelines to improve outcomes for students. This study utilized a quantitative method with a correlational design to discern any relationship between the NCStar School Improvement Program Indicators and student proficiency scores. The population for the study was 636 public high schools implementing the…

States are responsible for evaluating teacher preparation programs (TPPs) through program reviews. We use data from Massachusetts to describe the first analysis of program review ratings and their relationship to in-service outcomes for TPP graduates. When comparisons are made across all schools and districts in the state, a TPP's review scores…

This quantitative correlational study dives into the heart of understanding the significance of model fidelity for implementing school threat assessment teams. The target population was instructional staff and threat assessment team members from schools in Dutchess, Putnam, and Westchester Counties in New York State that use the Comprehensive…

We revisit the merits of the retrospective pretest-posttest (RPP) design for repeated-measures research. The underutilized RPP method asks respondents to rate survey items twice during the same posttest measurement occasion from two specific frames of reference: "now" and "then." Individuals first report their current attitudes…