In this Methods Showcase Article, we outline a workflow for running behavioral experiments online, with a focus on experiments that rely on presentation of complex stimuli and measurement of reaction times, which includes many psycholinguistic experiments. The workflow that we describe here relies on three tools: OpenSesame/OSWeb (open source)…

Experimental studies of educational interventions are rarely based on representative samples of the target population. This simulation study tests two formal sampling strategies for selecting districts and schools from within strata when they may not agree to participate if selected: (1) balanced selection of the most typical district or school…

Background/Context: Methodological background: Meta-analysis typically depends on the assumption that true effects follow the normal distribution. While assuming normality of effect "estimates" is often supported by a central limit theorem, normality for the distribution of interventions' "true" effects is a computational…

The implementation of context-based chemistry programs has been started before 40 years ago since 1980s in an attempt to make the learning of chemistry more meaningful for students. Consequent to its lengthy, there has been a steady increase in the number of interventional context-based (ICB) approach chemistry studies investigating the effect of…

Qualitative researchers often turn to focus groups as an efficient and effective way to gather data in a collective context. A common critique is that they play into power dynamics present at the site, privileging dominant, high status, and more vocal participants. Traditional focus group structures also rely on participants to trust the…

In this paper, we critically examine the way in which scholars have traditionally defined and problematized attrition. Through a series of examples of large-scale intervention impact studies, we share insights about the sources and consequences of attrition that expand our notion of how and why attrition occurs. We also discuss potential steps for…

Yinyang philosophy encompasses an essential understanding of the mechanism and laws of nature, cosmos, and human society in Chinese culture, and reaches to many other parts of Asia and around the world. The purpose of this article is to explore how yinyang philosophy can serve as a philosophical underpinning of mixed methods research (MMR). In…

The purpose of this descriptive study was to investigate course-based undergraduate research experience (CURE) outcomes of community college students by looking at students' sense of project ownership, science self-efficacy, and science identity using an end of course survey. A total of 54 students, 41 females and 13 males, completed the survey.…

In the first edition of this book, Tim Stewart provided an easy-to-follow guide to conducting classroom research, from getting started to publishing your findings. The second edition of "Classroom Research for Language Teachers" further explores different approaches to conducting classroom research in the English language classroom,…

The administration of college financial aid is a key venue through which colleges can affect the likelihood that students will make it to graduation. We investigate the effects of an understudied yet consequential federal student aid policy: Return of Title IV Funds (R2T4). Under R2T4, students "earn" Federal Student Aid over a term or…

Previous research found bias in the estimate of the overall fixed effects and variance components using multilevel meta-analyses of standardized single-case data. Therefore, we evaluate two adjustments in an attempt to reduce the bias and improve the statistical properties of the parameter estimates. The results confirm the existence of bias when…

Mediation has played a critical role in developmental theory and research. Yet, developmentalists rarely discuss the methodological challenges of establishing causality in mediation analysis or potential strategies to improve the identification of causal mediation effects. In this article, we discuss the potential outcomes framework from…

Longitudinal panel studies are widely used in developmental science to address important research questions on human development across the lifespan. These studies, however, are often challenging to implement. They can be costly, time-consuming, and vulnerable to test--retest effects or high attrition over time. Planned missingness designs (PMDs),…

For research evidence to inform decision making, an appraisal needs to be made of whether the claims are justified and whether they are useful to the decisions being made. This chapter provides a high level framework of core issues relevant to appraising the "fitness for purpose" of evidence claims. The framework includes (I) the…

This article presents a thorough review of the literature dedicated to learning more about mixed methods research design. Explanatory sequential mixed methods studies and exploratory sequential mixed methods studies are the two types of mixed methods research design models that this article presents in detail. To contextualize different ideas…