We describe a combination of methods for assessing the effectiveness of complex interventions, especially where substantial heterogeneity with regard to the population, intervention, comparison, outcomes, and study design of interest is expected. We applied these methods in a recent systematic review of the effectiveness of reinforced home-based…

Given the widespread use of non-experimental (NE) methods for assessing program impacts, there is a strong need to know whether NE approaches yield causally valid results in field settings. In within-study comparison (WSC) designs, the researcher compares treatment effects from an NE with those obtained from a randomized experiment that shares the…

Drawing on Glenn Fulcher's extensive work in performance-based language assessment of speaking, this paper explores the assessment of L2 speaking ability in local language testing contexts. For that purpose, I review Fulcher's influential work that highlights the relationship between the speaking construct, the task, the performance, and the…

Students with autism may struggle to develop the academic skills necessary for success in school and beyond. Understanding and improving academic skills performance requires appropriate measurement approaches. One such option that has been minimally studied with students with autism is curriculum-based measurement (CBM). Coinciding with the need…

This article reports on the findings of qualitative research which investigated appropriate means for measuring the efficacy of 3 + 1 transfer programs. In a 3 + 1 program, students complete 90 credits at the community college and are awarded a baccalaureate degree after completing their final 30 credits at a four-year college or university.…

Although the high costs of implementing personnel development programs in enterprises and increasingly in universities as well are commonly accepted, the scientifically-grounded evaluation of a program's effectiveness is often neglected. The aim of this paper was to evaluate a personnel development program for academics at a German university…

Purpose: The impact of decentralization on education systems requires the local government to develop local content curriculum to preserve regional characteristics and local uniqueness through education. Practice in the field revealed problems in terms of implementation so that the development of an evaluation model in accordance with the…

This paper reports an innovative, hybrid teaching model for a junior level lab course. This model leverages in-person lab operation by adding a student-led online learning mode. Both course outcomes and student outcomes were evaluated. Student feedback was collected, and its analysis showed both positive and negative impacts in this hybrid model.…

This systematic review synthesizes research on school-based crisis intervention protocols, descriptions, and evaluations. We performed a comprehensive literature search, and 60 studies met the inclusion criteria for this review. We found an overwhelming lack of evaluation studies (n = 3), suggesting that interventions are being administered…

Identification of reinforcers is critical to the effectiveness of behavioral interventions. Stimulus preference assessments (SPA) are a frequently used method to identify putative reinforcers. Given the fluctuating nature of individual preferences, there is need for efficient training of providers that may regularly implement SPAs. The present…

This report presents key findings from the four years of the Quality Support Program (QSP). The QSP is an initiative of, and funded by, the New South Wales (NSW) Department of Education Early Childhood Education Quality Assurance and Regulatory Services Directorate (NSW DoE), involving the delivery by Australian Children's Education and Care…

Participatory monitoring and evaluation (PME) is an approach that higher education institutions should use to ensure achievement of objectives especially quality academic programs, research, consultancies, outreach services and administrative functions. Indeed, over the past 10 years PME has gained increased prominence over more conventional…

The provision of all-female computer science outreach programmes is a common strategy used to foster greater interest in the subject for high school aged girls. Based on key factors that affect girls' interest in computer science (CS), outreach programmes often share much in their approach. Nonetheless, there is criticism from a research…

This issue of "Assessment Update" presents the following articles: (1) Organizing for Learning Improvement: What It Takes (Andrea M. Pope and Keston H. Fulcher); (2) Editor's Notes: The Leadership Imperatives for Assessment Excellence -- Imperative #2, Attracting and Retaining Talent to Support Assessment Excellence (Stephen P. Hundley);…

Although every educational institution has a code of academic honesty, they still encounter incidents of plagiarism. These are difficult and time-consuming to detect and deal with. This paper explores the use of personalized assessments with the goal of reducing incidents of plagiarism, proposing a personalized assessment software framework…