This study aimed to examine authentic models of science assessment in assessing the competence of senior high school students who met the criteria of validity, practicality, and effectiveness. The methodology applied was an evaluation and developmental research. Research was conducted in senior high school in accordance with the needs of the…

The Mantel-Haenszel estimator is one of the most popular techniques for measuring differential item functioning (DIF). A generalization of this estimator is applied to the context of DIF to compare items by taking the covariance of odds ratio estimators between dependent items into account. Unlike the Item Response Theory, the method does not rely…

The growing fiscal cost of K-12 teacher pension plans and pension-induced labor market distortions have led to calls for teacher pension reforms. Dynamic structural econometric models are a useful way to analyze the fiscal and staffing consequences of current and alternative retirement plans. This article lays out the benefits of the structural…

Published research in scientific journals are critical resources for researchers as primary sources about: what is important in the field, the direction the field is headed, how the field relates to other sciences, and as a historical record for each of these. In this exploratory study, we analyzed the articles of five behavior analytic journals…

The goal of this research was to provide a general assessment framework of students' statistical reasoning in medicine, then build three scales to assess students' statistical reasoning ability in solving practical medical problems, including Description, Interpretation and Prediction. On that basis, the study designed a set of tools to assess…

Learning analytics needs to pay more attention to the temporal aspect of learning processes, especially in self-regulated learning (SRL) research. In doing so, learning analytics models should incorporate both the duration and frequency of learning activities, the passage of time, and the temporal order of learning activities. However, where this…

In multisite trials, learning about treatment effect variation across sites is critical for understanding where and for whom a program works. Unadjusted comparisons, however, capture "compositional" differences in the distributions of unit-level features as well as "contextual" differences in site-level features, including…

Introduction: The replication crisis in the behavioral and social sciences spawned a credibility revolution, calling for new open science research practices that ensure greater transparency, including preregistrations, open data and code, and open access. Statement of the Problem: Replications of published research are an important element in this…

There is a need for robust evidence about which educational interventions work in preschool to foster children's cognitive and socio-emotional learning (SEL) outcomes. Lab-based individually randomized experiments can develop and refine such interventions, and field-based randomized experiments (e.g., cluster randomized trials) evaluate their…

This paper aims to unsettle assumptions of generalizability and representativeness in quantitative research using queer framings and positionalities. We argue that generalizability and representativeness are tools of supremacist dominance that reinforce harmful and essentialist categories of identities for the false purpose of statistical…

The European Education Area aims to support Member States' efforts in enhancing the educational attainment of younger generations. In this policy context, there is a need for an objective tool to assess the educational outcomes of EU countries. The present report addresses this need by pursuing two objectives: (1) providing a comprehensive method…

Statistical tests carry with them a number of assumptions that must be checked. Failing to do so and to report the results of such preliminary analyses introduce a potential threat to the internal validity of a study and to our ability as consumers to put faith in study findings. This article systematically examines the reporting of checks on…

Theories of causation in philosophy ask what makes causal claims true and establish the so-called truth conditions allowing one to separate causal from noncausal relationships. We argue that social scientists should be aware of truth conditions of causal claims because they imply which method of causal inference can establish whether a specific…

Population-adjusted indirect comparisons estimate treatment effects when access to individual patient data is limited and there are cross-trial differences in effect modifiers. Popular methods include matching-adjusted indirect comparison (MAIC) and simulated treatment comparison (STC). There is limited formal evaluation of these methods and…

In evaluating the learning achievement of programming-thinking skills, the method of using a rubric that describes evaluation items and evaluation stages is widely employed. However, few studies have evaluated the reliability, validity, and consistency of the rubrics themselves. In this study, we introduced a statistical method for evaluating the…