I propose two practical advances to the argument-based approach to validity: developing a living document and incorporating preregistration. First, I present a potential structure for the living document that includes an up-to-date summary of the validity argument. As the validation process may span across multiple studies, the living document…

The five SEERNet digital learning platforms (DLPs) present unique opportunities for researchers by offering tools, processes, and infrastructure to make research more efficient, scalable, and relevant. However, conducting research within a DLP may require a shift in a researcher's orientation or mindset in how they think about potential research…

This article considers the multiple relations that emerge from and between Facebook commenters, as well as between commenters, researchers, and the research project during recruitment. To do so, we draw on our experiences of recruiting individuals who have concerns about or are opposed to a range of recent social and legal changes in…

Extracting data from studies is the norm in meta-analyses, enabling researchers to generate effect sizes when raw data are otherwise not available. While there has been a general push for increased reproducibility in meta-analysis, the transparency and reproducibility of the data extraction phase is still lagging behind. Unfortunately, there is…

Data is ubiquitous and inseparable from the human experience. It constantly informs and transforms interactions, decisions, and understanding. If the total amount of all the data created daily was printed on paper, it would fill a library the size of 110 Libraries of Congress. As a senior research consultant for an education market research and…

Most existing solutions to the current replication crisis in science address only the factors stemming from specific poor research practices. We introduce a novel mechanism that leverages the experts' predictive abilities to analyze the root causes of replication failures. It is backed by the principle that the most accurate predictor is the most…

This article provides an introduction to randomized response polling, a technique which was designed to allow for questioning on sensitive issues while protecting the respondent's privacy and avoiding social desirability bias. It is described in terms that are suitable for presentation and use in any classroom environment. Instructions for plain…

In response to the evolving needs of knowledge synthesis, this manuscript introduces the concept of narrative reanalysis, a method that refines data from initial reviews, such as systematic and reviews, to focus on specific sub-phenomena. Unlike traditional narrative reviews, which lack the methodological rigor of systematic reviews and are…

Artificial intelligence (AI) and data science (DS) are receiving a lot of attention in various fields. In the educational field, the need for education utilizing AI and DS is also being emerged. In this context, we have created an AI/DS integrating program that generates a compound classification/regression model using characteristics of compounds…

Building a better data culture can be the path to better results and greater equity in schools. But what do we mean by data? Your students are not just statistics. They aren't simply a set of numbers or faceless dots on a proficiency scale. They are vibrant collections of experiences, thoughts, perspectives, emotions, wants, and dreams. And taken…

Across higher education, educational developers and their supporting campus communities are being called upon to scale up evidence-informed practices, to enhance student experiences, and to document the changes. This article builds on the work of scholars who have taken up this evaluative challenge, by examining varied aspects of the evidencing…

We note two possibilities for how our science might capitalize on advances in computing that harness and weave "big data" into the rich tapestry of how human development unfolds. First, we propose that the classic theoretical models that have guided developmental research since the 1970s and the hierarchical analytical models used to…

The use of social media platforms as a means of data collection for researchers is increasing. With the number of active users of Facebook across the globe exceeding two billion, the platform offers a means to reach and hear from diverse populations and gather information-rich data. Despite an increase of researchers utilising Facebook and…

Autism is heterogeneous at many levels, including clinical symptoms and etiology. A key strategy in studying heterogeneous conditions is having large enough sample sizes to stratify into smaller groups that are more homogeneous. SPARK and Simons Searchlight are large and growing research cohorts of individuals with autism in the United States and…

The purpose of this essay is to discuss the impact of the EdD experience on one teacher's understanding of data and research. From a first-person narrative, the author shares how learning to collect and analyze qualitative data has the potential to change the way teachers can engage with "data-driven decision making" in a high school…