In this article, Regine Haardörfer outlines five general steps taken by good data analysts and how they need to be theory-driven data-informed. She uses these to discuss some issues and propose approaches to promote better data analysis and reporting. The proposed steps to rigorous data analysis are to: (1) create an a priori data analysis plan;…

The present simulation study indicates that a method where the regression effect of a predictor (X) on an outcome at follow-up (Y1) is calculated while adjusting for the outcome at baseline (Y0) can give spurious findings, especially when there is a strong correlation between X and Y0 and when the test-retest correlation between Y0 and Y1 is…

In basketball, game-related statistics are the most common measure of performance. However, the literature assessing their reliability is scarce. Purpose: Analyze the number of games required to obtain a good relative and absolute reliability of teams' game-related statistics. Method: A total of 884 games from the 2015-2016 to 2017-2018 seasons of…

Chalmers recently published a critique of the use of ordinal a[alpha] proposed in Zumbo et al. as a measure of test reliability in certain research settings. In this response, we take up the task of refuting Chalmers' critique. We identify three broad misconceptions that characterize Chalmers' criticisms: (1) confusing assumptions with…

Moderators are variables that affect the relationship between a predictor and outcome. They help to clarify otherwise ambiguous patterns of results, extend theory, and signal the growth of a field. Given the importance of moderators, the authors offer an overview of methodological and statistical considerations for testing moderation and then…

We derive formulas for the differential item functioning (DIF) measures that two routinely used DIF statistics are designed to estimate. The DIF measures that match on observed scores are compared to DIF measures based on an unobserved ability (theta or true score) for items that are described by either the one-parameter logistic (1PL) or…

Two approaches for the statistical analysis of social network generation are widely used; the tie-oriented exponential random graph model (ERGM) and the stochastic actor-oriented model (SAOM) or Siena model. While the choice for either model by empirical researchers often seems arbitrary, there are important differences between these models that…

The aim of the research was to analyze the goals scored in Russia World Cup 2018. The sample of this research was composed of 64 games played and 169 goals scored in the 2018 Russia World Cup. No goals were scored only in one competition. Because of 12 goals scored were own goals, 157 goals scored were analyzed on eleven different ways. The…

We proposed an extended form of the Govindarajulu and Barnett margin of error (MOE) equation and used it with an analysis of variance experimental design to examine the effects of aggregating student evaluations of teaching (SET) ratings on the MOE statistic. The interpretative validity of SET ratings can be questioned when the number of students…

Current practices for growth mixture modeling emphasize the importance of the proper parameterization and number of classes, but the impact of these decisions on latent class composition and the substantive implications has not been thoroughly addressed. Using measures of behavior from 575 middle school students, we compared the results of several…

This study examined the effect of sample size ratio and model misfit on the Type I error rates and power of the Difficulty Parameter Differences procedure using Winsteps. A unidimensional 30-item test with responses from 130,000 examinees was simulated and four independent variables were manipulated: sample size ratio (20/100/250/500/1000); model…

The log-odds ratio (ln[OR]) is commonly used to quantify treatments' effects on dichotomous outcomes and then pooled across studies using inverse-variance (1/v) weights. Calculation of the ln[OR]'s variance requires four cell frequencies for two groups crossed with values for dichotomous outcomes. While primary studies report the total sample size…

The purpose of this study was to write programs to define sampling sizes and observation units by probability sampling methods and to provide an idea for software developers. The algorithms of the programs were written in Python 3. The programs may be run by double-clicking on the Windows operating system or by the command prompt of the DOS…

Principal stratification is a widely used framework for addressing post-randomization complications. After using principal stratification to define causal effects of interest, researchers are increasingly turning to finite mixture models to estimate these quantities. Unfortunately, standard estimators of mixture parameters, like the MLE, are known…

Despite the broad appeal of missing data handling approaches that assume a missing at random (MAR) mechanism (e.g., multiple imputation and maximum likelihood estimation), some very common analysis models in the behavioral science literature are known to cause bias-inducing problems for these approaches. Regression models with incomplete…