Equating error is usually small relative to the magnitude of measurement error, but it could be one of the major sources of error contributing to mean scores of large groups in educational measurement, such as the year-to-year state mean score fluctuations. Though testing programs may routinely calculate the standard error of equating (SEE), the…

This study examined the effect of sample size ratio and model misfit on the Type I error rates and power of the Difficulty Parameter Differences procedure using Winsteps. A unidimensional 30-item test with responses from 130,000 examinees was simulated and four independent variables were manipulated: sample size ratio (20/100/250/500/1000); model…

The log-odds ratio (ln[OR]) is commonly used to quantify treatments' effects on dichotomous outcomes and then pooled across studies using inverse-variance (1/v) weights. Calculation of the ln[OR]'s variance requires four cell frequencies for two groups crossed with values for dichotomous outcomes. While primary studies report the total sample size…

Effectively teaching scientific reasoning requires an understanding of the challenges students face when learning these skills. We designed an assessment that measures undergraduate student abilities to form hypotheses, design experiments, and interpret data from experiments in cellular and molecular biology. The assessment uses…

Evidence has been provided about the importance of avoiding American Psychological Association (APA) errors in the abstract, body, reference list, and table sections of empirical research articles. Specifically, authors are significantly more likely to have their manuscripts rejected for publication if they fail to avoid APA violations--and, thus,…

We examined the error-related negativity (ERN) as an endophenotype of ASD by comparing the ERN in families of ASD probands to control families. We hypothesized that ASD probands and families would display reduced-amplitude ERN relative to controls. Participants included 148 individuals within 39 families consisting of a mother, father, sibling,…

Purpose: Surveys that include skill measures may suffer from additional sources of error compared to those containing questionnaires alone. Examples are distractions such as noise or interruptions of testing sessions, as well as fatigue or lack of motivation to succeed. This paper aims to provide a review of statistical tools based on latent…

Fisher randomization tests for Neyman's null hypothesis of no average treatment effects are considered in a finite population setting associated with completely randomized experiments with more than two treatments. The consequences of using the F statistic to conduct such a test are examined both theoretically and computationally, and it is argued…

Purpose: Speech-evoked neurophysiological responses are often collected to answer clinically and theoretically driven questions concerning speech and language processing. Here, we highlight the practical application of machine learning (ML)-based approaches to analyzing speech-evoked neurophysiological responses. Method: Two categories of ML-based…

The two-high-threshold (2HT) model of recognition memory assumes that people make memory errors because they fail to retrieve information from memory and make a guess, whereas the continuous unequal-variance (UV) model and the low-threshold (LT) model assume that people make memory errors because they retrieve misleading information from memory.…

Tatsuoka (1984) suggested several extended caution indices and their standardized versions that have been used as person-fit statistics by researchers such as Drasgow, Levine, and McLaughlin (1987), Glas and Meijer (2003), and Molenaar and Hoijtink (1990). However, these indices are only defined for tests with dichotomous items. This paper extends…

In recent years, there has been increasing focus on the issue of multiple hypotheses testing in education evaluation studies. In these studies, researchers are typically interested in testing the effectiveness of an intervention on multiple outcomes, for multiple subgroups, at multiple points in time or across multiple treatment groups. When…

In this study, we analyze the systematic error from false positives of the Force Concept Inventory (FCI). We compare the systematic errors of question 6 (Q.6), Q.7, and Q.16, for which clearly erroneous reasoning has been found, with Q.5, for which clearly erroneous reasoning has not been found. We determine whether or not a correct response to a…

Through the process of "reconsolidation," reminders can temporarily destabilize memories and render them vulnerable to change. Recent rodent research has proposed that prediction error, or the element of surprise, is a key component of this process; yet, this hypothesis has never before been extended to complex episodic memories in…

Error patterns in vocabulary learning data were used as a window into the mechanisms that underlie vocabulary learning performance in bilinguals vs. monolinguals. English--Spanish bilinguals (n = 18) and English-speaking monolinguals (n = 18) were taught novel vocabulary items in association with English translations. At testing, participants…