The randomized control trial (RCT) is the primary experimental design in education research due to its strong internal validity for causal inference. However, in situations where RCTs are not feasible or ethical, quasi-experiments are alternatives to establish causal inference. This paper serves as an introduction to several quasi-experimental…

With the growing complexity of societal and scientific problems, research centers have emerged to facilitate the conduct of research beyond disciplinary and institutional boundaries. While they have become firmly established in the global university landscape, research centers raise some critical questions for research evaluation. Existing…

Propensity and prognostic score methods are two statistical techniques used to correct for the selection bias in nonexperimental studies. Recently, the joint use of propensity and prognostic scores (i.e., two-score methods) has been proposed to improve the performance of adjustments using propensity or prognostic scores alone for bias reduction.…

We present an aggregation scheme that increases power in randomized controlled trials and quasi-experiments when the intervention possesses a robust and well-articulated theory of change. Intervention studies using longitudinal data often include multiple observations on individuals, some of which may be more likely to manifest a treatment effect…

This Monte Carlo simulation study compares methods to estimate the effects of programs with multiple versions when assignment of individuals to program version is not random. These methods use generalized propensity scores, which are predicted probabilities of receiving a particular level of the treatment conditional on covariates, to remove…

African-American boys who receive exclusionary discipline (i.e. in- or out-of-school suspensions) are overrepresented at the elementary (kindergarten through fifth grade) level. Although African-American boys comprised only 15% of the population of this school, they accounted for 70% of the exclusionary discipline incidents. This…

Despite the importance of replication, it remains rare in the interactive learning research community. In this paper, we attempt to replicate recent quasi-experimental results suggesting that the ALEKS intelligent tutoring system is effective at improving student course outcomes in higher education (Mojarad et al., 2018). In this paper, we conduct…

The modality principle states that narration rather than on-screen text supports best learners in their understanding of information. Many of the modality studies involve content that is irrelevant to the participants. A few studies in the engineering domain have shown that development of self-efficacy affects students' belief in their ability to…

Relieving test anxiety actions range from relaxation exercises to prescription medication. Humor can be a simple method of test anxiety relief. The current study was used to determine if humor, in the form of a cartoon, placed on the splash page of an online exam improved the test scores of students who have high test anxiety. In the current…

Purpose: The purposes of this study were to: (a) examine the impact of the Silverman and Solmon article (1998) on how researchers handle the unit of analysis issue in their field-based intervention research in physical education in the United States and summarize statistical approaches that have been used to analyze the data, and (b) provide…

The objective of this study was to examine how individual interest and knowledge acquisition are causally related. Three hypotheses were tested using a cross-lagged panel analysis (N = 186) and two quasi-experimental studies (N = 68 and N = 108) involving students from schools in Singapore. The first hypothesis is the broadly shared standard…

Persuasive arguments have been made for the existence of pedagogical discourses that invoke gender as a factor in the ascription of quality to musical compositions, and previous research has shown that some music teachers ascribe "maleness" to the characteristics that they regard as markers of high quality. Drawing upon Lucy Green's…

Underlying all What Works Clearinghouse (WWC) products are WWC Study Review Guides, which are intended for use by WWC certified reviewers to assess studies against the WWC evidence standards. As part of an ongoing effort to increase transparency, promote collaboration, and encourage widespread use of the WWC standards, the Institute of Education…

The testing effect is the enhanced retention of learned information by individuals who have studied and completed a test over the material relative to individuals who have only studied the material. Although numerous laboratory studies and simulated classroom studies have provided evidence of the testing effect, data from a natural class setting…

The purpose of this paper is to provide guidance in choice of analytic bias reduction methods for educational studies in which the goal is to estimate a treatment effect in the presence of selection bias into treatment. In addition, issues of dimensionality, collinearity, omitted confounders, missing outcomes, and non-independence may be factors…