Manipulation checks are an essential component of quality experimental design in motor learning. Guided by the Preferred Reporting Items for Systematic Reviews and Meta-Analyses framework, this methodological systematic review examined the utilization of manipulation checks in focus of attention research. Seventy-eight protocols from four…

Purpose of the Study: Missing data are a common problem encountered while implementing measurement instruments. Yet the extent to which reliability, validity, average discrimination and difficulty of the test results are affected by the missing data has not been studied much. Since it is inevitable that missing data have an impact on the…

This study intends to develop a standardized instrument for measuring classroom teaching and learning in secondary chemistry lessons. Based on previous studies and interviews with expert teachers, the progression of five quality levels was constructed hypothetically to represent the quality of chemistry lessons in Chinese secondary schools. The…

The long-term goal of the State Systemic Improvement Plan (SSIP) and other federal and state early intervention and early childhood education initiatives is improved child and family outcomes. States play a critical role in supporting practitioners in the use of evidence-based practices to improve child and family outcomes. When practitioners…

This work asks one simple question: "how reliable is the method used by the National Centre for Vocational Education Research (NCVER) to estimate projected rates of VET program completion?" In other words, how well do early projections align with actual completion rates some years later? Completion rates are simple to calculate with a…

In an earlier paper, we presented methods for estimating achievement gaps when test scores are coarsened into a small number of ordered categories, preventing fine-grained distinctions between individual scores. We demonstrated that gaps can nonetheless be estimated with minimal bias across a broad range of simulated and real coarsened data…

Ho and Reardon (2012) present methods for estimating achievement gaps when test scores are coarsened into a small number of ordered categories, preventing fine-grained distinctions between individual scores. They demonstrate that gaps can nonetheless be estimated with minimal bias across a broad range of simulated and real coarsened data…

Researchers use many different metrics for evaluation of performance of student models. The aim of this paper is to provide an overview of commonly used metrics, to discuss properties, advantages, and disadvantages of different metrics, to summarize current practice in educational data mining, and to provide guidance for evaluation of student…

In some popular test designs (including computerized adaptive testing and multistage testing), many item pairs are not administered to any test takers, which may result in some complications during dimensionality analyses. In this paper, a modified DETECT index is proposed in order to perform dimensionality analyses for response data from such…

Context: Quality measures focused on outpatient settings are of increasing interest to policy makers, but little research has been conducted on hospital outpatient quality measures, especially in rural settings. Purpose: To evaluate the relevance of Centers for Medicare and Medicaid Services' (CMS) outpatient quality measures for rural hospitals,…

Purpose: Many adults with aphasia demonstrate concomitant deficits in working memory (WM), but such deficits are difficult to quantify because of a lack of validated measures as well as the complex interdependence between language and WM. We examined the feasibility, reliability, and internal consistency of an "n"-back task for…

Quality measurement serves as a foundation for child care Quality Rating and Improvement Systems (QRIS). Understanding the variation that exists in quality measurement, the different contexts in which states make decisions, and the factors that play into their decisions can help administrators identify where their state may fall along the spectrum…

This article describes the development of a ten-item scale to assess biology majors' self-efficacy towards the critical thinking and data analysis skills taught in an upper-division cell biology course. The original seven-item scale was expanded to include three additional items based on the results of item analysis. Evidence of reliability and…

Community engagement professionals and partners serve as, work with, study, and build the capacity of boundary spanners. To augment knowledge about these functions, the Weerts-Sandmann Boundary Spanning Conceptual Framework (2010) has been operationalized through a survey instrument to examine community engagement boundary-spanning behaviors by…

Background: Coaches and physical educators must obtain valid data relating to the contribution of each of their players in order to assess their level of performance in team sport competition. This information must also be collected and used in real game situations to be more valid. Developed initially for a physical education class context, the…