The use of complexity-based evaluation methods remains relatively underexplored in the field of evaluation. While increasingly employed to assess complex interventions, Contribution Analysis (CA) continues to suffer from a lack of operationalization. In this article, we propose enhancing the implementation of CA by leveraging Participatory Systems…

This study aimed to assess the methods and outcomes of The Measurement Tool to Assess systematic Reviews (AMSTAR) 2 appraisals in overviews of reviews (overviews) of interventions in the cardiovascular field and identify factors that are associated with these outcomes. MEDLINE, Scopus, and the Cochrane Database of Systematic Reviews were searched…

This dissertation used synthetic datasets, semi-synthetic datasets, and a real-world dataset from an educational intervention to compare the performance of 15 machine learning and multiple imputation methods to estimate the individual treatment effect (ITE). In addition, it examined the performance of five evaluation metrics that can be used to…

Measures of learning speed (i.e., the amount of learning/cumulative time learner spends engaged in an intervention) are rarely included in research designed to evaluate and compare academic interventions. We build a case that includes analyses of learning speed metrics in academic intervention research can provide more useful information for…

The number of real-world laboratories (RwLs) as research settings to address sustainability problems by using collaborative and experimental approaches has been growing steadily over the past years. RwLs are widely considered promising settings for the production of action-orientated knowledge in order to contribute solving wicked real-world…

When teachers work with students exhibiting academic failure, they may look to factors outside of instruction such as a student's home life or perceived disability as explanations. Placing the locus of control outside of the instructional context becomes a convenient way to escape culpability for unsatisfactory outcomes. A more functional approach…

Computational Thinking (CT) is considered a core 21st century digital skill. The aspect of assessment is crucial and knowing what, who, when, how, and where to assess is important for assessment design. In this study, we conducted an umbrella review to gain insights regarding CT assessment in higher education. In total, we analyzed 11 reviews,…

Background: With the right support, people with learning disabilities can be 'good enough' parents (Coren et al., 2011; Murphy & Feldman, 2002). Parenting programmes exist to support parents and are made accessible for people with learning disabilities who are expecting a baby, but evaluation of the benefit of these interventions is poor due…

The visual analysis of data presented in time-series graphs are common in single-case design (SCD) research and applied practice in school psychology. A growing body of research suggests that visual analysts' ratings are often influenced by construct-irrelevant features including Y-axis truncation and compression of the number of data points per…

This article, located in the discipline of academic literacy studies, draws upon the fields of critical realism, design research, and evaluation studies. It reports on the validation of a flexible evaluation design for assessing the impact of academic literacy interventions. The design was validated in two ways. Firstly, through a process of…

Traditional efforts around improving assessment often center on the teacher as the evaluator of work rather than the students. These assessment efforts typically focus on measuring learning rather than stimulating, promoting, or producing learning in students. This paper summarizes a study of a large sample of undergraduate students (n = 550) in…

Many university students, including first-year business education students (FYBES) in Ghana, struggle to adjust to academic demands and university life, leading to low engagement and satisfaction with academic experiences. Despite efforts to improve student engagement and satisfaction, the extent to which gender influence this relationship remains…

In this scoping review on 34 studies, we examined the use of immersive virtual reality (IVR) in neurodevelopmental disorders (NDD). IVR was mostly used in connection with autism spectrum disorder (ASD) for assessment of and intervention in social skills, and in attention deficit hyperactivity disorder (ADHD) for assessment of executive…

The current research sought to explore the utility of the Assessment for Intervention (AFI) model in bridging the gap between assessment and intervention, through the conceptual lens of Bio-Ecological Systems Theory (BEST) and Social Constructivist Theory (SCT). AFI is a five-stage assessment model that aims to provide useful and evidence-based…

Power analysis based on the analytical t-test is an important aspect of a research study to determine the sample size required to detect the effect for the comparison of two means. The current paper presents a reader-friendly procedure for carrying out the t-test power analysis using the various R add-on packages. While there is a growing of R…