Corrections are a frequently used and effective tool for countering misinformation. However, concerns have been raised that corrections may introduce false claims to new audiences when the misinformation is novel. This is because boosting the familiarity of a claim can increase belief in that claim, and thus exposing new audiences to novel…

The purpose of the present experiments was to systematically replicate Step it UP! Game interventions with adults with disabilities. Participants were divided into two competing teams, and the team with the highest step count participated in a prize drawing. Experiment 1 (N = 9) evaluated the efficacy of an extended version of the Step it UP! Game…

Generated information is better recognized and recalled than information that is read. This generation effect has been replicated several times for different types of material, including texts. Perhaps the most influential demonstration is by McDaniel, Einstein, Dunay, and Cobb ("Journal of Memory and Language," 1986, 25(6), 645-656;…

There has been a great deal of interest in second language vocabulary studies regarding the potential of reading as a source of incidental vocabulary learning. More recently, several studies have also focused on comparing reading with other input modes, such as listening, or reading-while-listening. Among these studies there are two -- Brown et…

We conducted a close replication of the seminal work by Marcus and colleagues from 1999, which showed that after a brief auditory exposure phase, 7-month-old infants were able to learn and generalize a rule to novel syllables not previously present in the exposure phase. This work became the foundation for the theoretical framework by which we…

The number of meta-analyses of aggregate data has dramatically increased due to the facility of obtaining data from publications and the development of free, easy-to-use, and specialised statistical software. Even when meta-analyses include the same studies, their results may vary owing to different methodological choices. Assessment of the…

Across waves of a panel survey, panel members are repeatedly exposed to the same or very similar survey questions, which might lead to learning effects. We used data from 24 waves of online interviews in a probability-based panel survey to investigate the positive and negative effects of becoming more familiar with the survey questions. We found…

Published studies of intervention effects probably report effect sizes that are larger than the true effect size. There are probably many reasons for this, but one can be thought of as a "winner's curse." In this essay, I discuss evidence from two recent studies that highlight how evidence clearinghouses might inadvertently expose…

Replicating research studies is considered one way of establishing validity and confidence of findings in a field of study. In this paper, we introduce a replication framework for classifying studies conducted in the area of educational technology as a possible guide to conducting and reporting replication studies in the field. The paper includes…

Extracting data from studies is the norm in meta-analyses, enabling researchers to generate effect sizes when raw data are otherwise not available. While there has been a general push for increased reproducibility in meta-analysis, the transparency and reproducibility of the data extraction phase is still lagging behind. Unfortunately, there is…

Given recent evidence challenging the replicability of results in the social and behavioral sciences, critical questions have been raised about appropriate measures for determining replication success in comparing effect estimates across studies. At issue is the fact that conclusions about replication success often depend on the measure used for…

Replication provides a confrontation of psychological theory, not only in experimental research, but also in model-based research. Goodness-of-fit (GOF) of the original model to the replication data is routinely provided as meaningful evidence of replication. We demonstrate, however, that GOF obscures important differences between the original and…

Most existing solutions to the current replication crisis in science address only the factors stemming from specific poor research practices. We introduce a novel mechanism that leverages the experts' predictive abilities to analyze the root causes of replication failures. It is backed by the principle that the most accurate predictor is the most…

A decision consistency (DC) index is an estimate of the consistency of a classification decision on an exam. More specifically, DC estimates the percentage of examinees that would have the same classification decision on an exam if they were to retake the same or a parallel form of the exam again without memory of taking the exam the first time.…

Ensuring a credible literature base is essential for all research fields. One element of this relates to the replicability of published work, which is the probability that the results of an original study would replicate in an independent investigation. A critical feature of replicable research is that the sample size of a study is sufficient to…