The internal validity of observational study is often subject to debate. In this study, we define the counterfactuals as the unobserved sample and intend to quantify its relationship with the null hypothesis statistical testing (NHST). We propose the probability of a robust inference for internal validity, that is, the PIV, as a robustness index…

State-wide tests are designed to measure student overall ability on grade-level standards. School leaders want fine-grained information on student performance to inform curriculum and instruction. One currently used target scoring method, which compares student scores to expected values is currently used to give this feedback to schools, but there…

This study aims to analyse the reasoning that children and adults with the same school level use to assess and justify the fairness of games, considering aspects of probability such as randomness, sample space, and comparison of probabilities. Data collection included a Piagetian clinical interview based on games of chance. The results showed that…

This study focuses on pre-service teachers' experimentation with a game-modding process in a constructionist setting whilst they experimented with randomness embedded in wider socio-scientific issues that call for decision making under uncertainty. In this process, participants created 39 different game mods. Our observations of the participants…

The study aims to examine whether differential item function is displayed in three different test forms that have item orders of random and sequential versions (easy-to-hard and hard-to-easy), based on Classical Test Theory (CTT) and Item Response Theory (IRT) methods and bearing item difficulty levels in mind. In the correlational research, the…

In this paper, we derive the result of the classical gambler's ruin problem using elementary linear algebra. Moreover, the pedagogical advantage of the derivation is briefly discussed.

Understanding students' misconceptions and how they change is an essential part of supporting students in their science learning. This paper presents results from distractor-driven multiple-choice assessments that target students' misconceptions about energy. Over 20,000 elementary, middle and high school students from across the U.S. participated…

The objective of this article is to contribute to research on teachers' probabilistic knowledge and reasoning. To meet this objective, prospective mathematics teachers were presented coin flip sequences and were asked to determine and explain which of the sequences was least likely to occur. This research suggests that certain individuals, when…

Can student performance on computer-based tests (CBT) and paper-and-pencil tests (PPT) be considered equivalent measures of student knowledge? States and school districts are grappling with this question, and although studies addressing this question are growing, additional research is needed. We report on the performance of students who took…

One of the best-known methods for setting a benchmark standard on a test is that of Angoff and its modifications. When scored dichotomously, judges estimate the probability that a benchmark student has of answering each item correctly. As in most methods of standard setting, it is assumed implicitly that the unit of the latent scale of the…

This volume, a comprehensive survey and critical analysis of today's issues in mathematics education, distills research to build knowledge and capacity in the field. The compendium is a valuable new resource that provides the most comprehensive evidence about what is known about research in mathematics education. The 38 chapters present five…

In this study, we explored the influence of kindergarten children's perspectives of school on their literacy and self-regulation outcomes. Children's early perspectives were captured in a three-question, finger-puppet interview. Responses to the interview questions were coded thematically as being academic and/or social in nature, and were…

The study compared the aberrance detection powers of the BW person-fit indices with other group-based indices (SCI, MCI, NCI, and Wc&Bs) and item response theory based (IRT-based) indices (OUTFITz, INFITz, ECI2z, ECI4z, and lz). Four kinds of comparative conditions, including content category (CC), types of aberrance (AT), severity of…

Letter-name identification has been widely used as part of early screening to identify children who might be at risk for future word reading difficulty. The goal of the present study was to examine whether a reduced set of letters could have similar diagnostic accuracy rather than a full set (i.e., 26 letters) when used as a screen. First, we…

This dissertation describes a design for training, in accordance with probability judgment heuristics principles, for the Angoff standard setting method. The new training with instruction, practice, and feedback tailored to the probability judgment heuristics principles was called the Heuristic training and the prevailing Angoff method training…