Evidence-based education aims to support policy makers choosing between potential interventions. This rarely involves considering each in isolation; instead, sets of evidence regarding many potential policy interventions are considered. Filtering a set on any quantity measured with error risks the "winner's curse": conditional on…

Composite scores are an exceptionally important psychometric tool for behavioral science research applications. A prototypical example occurs with self-report data, where researchers routinely use questionnaires with multiple items that tap into different features of a target construct. Item-level missing data are endemic to composite score…

Concerns about the conduct of research are pervasive in many fields, including education. In this preregistered study, we replicated and extended previous studies from other fields by asking education researchers about 10 questionable research practices and five open research practices. We asked them to estimate the prevalence of the practices in…

When scientists act unethically, their actions can cause harm to participants, undermine knowledge creation, and discredit the scientific community. Responsible Conduct of Research (RCR) training is one of the main ways institutions try to prevent scientists from acting unethically. However, this only addresses the problem if scientists value the…

Longitudinal panel studies are widely used in developmental science to address important research questions on human development across the lifespan. These studies, however, are often challenging to implement. They can be costly, time-consuming, and vulnerable to test--retest effects or high attrition over time. Planned missingness designs (PMDs),…

Judgments of learning (JOLs) play a fundamental role in helping learners regulate their study strategies but are susceptible to various kinds of illusions and biases. These can potentially impair learning efficiency, and hence understanding the mechanisms underlying the formation of JOLs is important. Many studies have suggested that both…

In this commentary, we argue that literacy research would be more productive if researchers had a clearer, more nuanced understanding of theory. Specifically, we argue that theory in a practice-oriented field is most fundamentally productive when it provides instrumental guidance for literacy beyond academic understanding about literacy. Premises…

Bowers ("Educational Psychology Review," 32, 681-705, 2020) reviewed 12 meta-analytic syntheses addressing the effects of phonics instruction, concluding that the evidence is weak to nonexistent in supporting the superiority of systematic phonics to alternative reading methods. We identify five issues that limit Bowers' conclusions: (1)…

Since the early 2000s, the proliferation of cameras, whether in mobile phones or CCTV, led to a sharp increase in visual recordings of human behavior. This vast pool of data enables new approaches to analyzing situational dynamics. Application is both qualitative and quantitative and ranges widely in fields such as sociology, psychology,…

This article by Dr. Mahmoud M. S. Abdallah provides a comprehensive guide to formulating a research problem in education and language learning, particularly for TESOL/TEFL researchers. It emphasizes the importance of a well-defined research problem as the cornerstone of any research project, guiding the selection of methods, data collection, and…

This paper evaluates the use of Factor Analysis (FA) in English education research in Korea and suggests improvements in methodology. A detailed coding protocol was used to review 179 FA cases from 12 major English education journals (2014-2023). The review identified several key issues, including small sample sizes and lenient criteria for sample…

While research that is embedded in schools is reported widely in education and psychological research literature, studies that focus on how researchers might navigate school-based gatekeepers is minimal. This study addresses this gap. The research presented in this paper reports on the recruitment process that was employed in a study that involved…

The education field, these authors assert, often alternatively ignores, belittles, or "weaponizes" scientific findings and evidence relevant to education. They show examples of how education does a worse job than other fields at either rushing to apply approaches without enough evidence of effectiveness or…

Large-scale analyses are a powerful and increasingly common tool for investigating a range of public health and social concerns (Pienta, O'Rourke, & Franks, 2011). This series will provide a primer on large-scale secondary analysis in school psychology, with this article focusing on considerations for researchers interested in applying and…

Missing data result in less precise and possibly biased effect estimates in single studies. Bias arising from studies with incomplete outcome data is naturally propagated in a meta-analysis. Conventional analysis using only individuals with available data is adequate when the meta-analyst can be confident that the data are missing at random (MAR)…