Researchers often make claims regarding the importance of predictor variables in multiple regression analysis by comparing standardized regression coefficients (standardized beta coefficients). This practice has been criticized as a misuse of multiple regression analysis. As a remedy, I highlight the use of dominance analysis and random forests, a…

Purpose: The purpose of this paper is to explore more agile and effective learning processes that help identify potentially high-performing staff during workplace training. Design/methodology/approach: To test the efficacy of the learning-oriented assessment (LOA) process in workplace training, a pharmaceutical sales organization implemented an…

Effect modification (EM) may cause bias in network meta-analysis (NMA). Existing population adjustment NMA methods use individual patient data to adjust for EM but disregard available subgroup information from aggregated data in the evidence network. Additionally, these methods often rely on the shared effect modification (SEM) assumption. In this…

Collaborative testing and its benefits have been reported in diverse disciplines across different types of academic institutions. However, there has been minimal research conducted on collaborative assessments in medical schools, particularly in the gross anatomy laboratory. The objectives of this study were to explore the effect of collaborative…

Background: Draw-A-Scientist Test (DAST) has been one of the most used instruments to study conceptions of scientists and science. It has been especially useful for charting the conceptions of younger children who might lack the skills to express themselves in writing. However, recent studies suggest that instead of children's conceptions of the…

The subjective aspect of standard-setting is often criticized, yet data-driven standard-setting methods are rarely applied. Therefore, we applied a mixture Rasch model approach to setting performance standards across several testing programs of various sizes and compared the results to existing passing standards derived from traditional…

While much research has explored the quality of traditional teacher evaluations, little is known about the quality of ratings in preservice teacher evaluations. This paper presents a case study of Many-facet Rasch measurement (MFR, Linacre, 1989) to explore potential rater effects influencing the quality of supervisor ratings in educator…

Lecturers often claim that time constraints cause tension regarding feedback on students' assessment opportunities. Assessment strategies for effective feedback procedures can lead to early identification of problem areas in student performance. Numerous students at higher education institutions (HEIs) do not complete their qualifications or take…

Principles focused evaluation (PFE) can complement existing formative and outcome evaluation plans by identifying Effectiveness Principles (EPs), an operationalization of values and standards that guide practitioners during program implementation. To date, however, few examples of PFE are available in the literature. This description of the…

Multilingual summative assessments face significant challenges due to tensions that exist between multiple language provision and comparability. Yet, conventional approaches for investigating comparability in multilingual assessments fail to accommodate assessments that comprise extended responses that target complex constructs. This article…

Learning-oriented assessment has been called a practice that can be employed to increase the power of assessment practices in the classroom and one that has been said to promote efficient student learning. However, it is not always easy to employ learning-oriented assessment in English classes, because of a number of constraints. This study aimed…

Engaging students in creating learning resources has demonstrated pedagogical benefits. However, to effectively utilize a repository of student-generated content (SGC), a selection process is needed to separate high- from low-quality resources as some of the resources created by students can be ineffective, inappropriate, or incorrect. A common…

Background: Mainstream economic evaluations methods may not be appropriate to capture the range of effects triggered by interventions for people with intellectual disabilities. In this systematic review, we aimed to identify, assess and synthesise the arguments in the literature on how the effects of interventions for people with intellectual…

This research investigates the linkage between training evaluation, learning design and training transfer. A new training evaluation model, (i.e., learning-transfer evaluation model [LTEM]), was used to examine its ability to provide evaluative evidence through robust assessments in pre-, post- and delayed assessments. The model was used to…

Purpose: This paper illustrates how Guba and Lincoln's parallel criteria for establishing trustworthiness, can be adapted and applied to qualitative research on indigenous social protection systems. It provides insights for social protection researchers, exploring plausible qualitative research rigor evaluation criteria, on plausible alternatives.…