There is a growing need to empirically evaluate the quality of online instructional interventions at scale. In response, some online learning platforms have begun to implement rapid A/B testing of instructional interventions. In these scenarios, students participate in series of randomized experiments that evaluate problem-level interventions in…

A critical issue in using fine-grained gameplay data to measure learning processes is the development of indicators and the algorithms used to derive such indicators. Successful development--that is, developing traceable, interpretable, and sensitive-to-learning indicators--requires understanding the underlying theory, how the theory is…

While there are many different types of education data, policymakers and education leaders often place heavy emphasis on data from large-scale quantitative measures, such as annual state assessments. But data from these sources alone do not provide a complete picture of learning and are often not well suited to informing improvements at the local…

Background: The data revolution in education has led to more data collection, more randomized controlled trials (RCTs), and more data collection within RCTs. Often following IES recommendations, researchers studying program effectiveness gather data on how the intervention was implemented. Educational implementation data can be complex, including…

Background: Understanding knowledge utilisation in policymaking is a core task for the social and political sciences. However, limitations and biases abound in commonplace approaches to measuring such use. Consequently, we have little systematic evidence of the extent to which knowledge sources are used in policy decisions. Aims and objectives:…

Language research has come to rely heavily on large-scale, web-based datasets. These datasets can present significant methodological challenges, requiring researchers to make a number of decisions about how they are collected, represented, and analyzed. These decisions often concern long-standing challenges in corpus-based language research,…

Assessment trace data, such as mouse positions and their timing, offer interesting and provocative reflections of individual differences yet are currently underutilized by testing professionals. In this article, we present a 10-step procedure to maximize the probability that a trace data modeling project will be successful: (1) grounding the…

This toolkit is designed to guide educators in developing and improving practical measurement instruments for use in networked improvement communities (NICs) and other education contexts in which principles of continuous improvement are applied. Continuous improvement includes distinct repeating processes: understanding the problem, identifying…

In both general chemistry and analytical chemistry courses, students are introduced to the concept of predominant species in solution when discussing acid/base chemistry. Speciation diagrams are often used to illustrate the concept and predict the relative abundance of species in solution. Herein, we describe a laboratory experiment for an…

SEERNet digital learning platforms (DLPs) are developing new infrastructure to support research in authentic contexts where student learning is happening. In order to contextualize this work within the larger field, we trace historical precedents along four main categories: data repositories, data collection services, research design interfaces,…

As part of a study investigating research productivity of sociology PhD students in Australia, an application to the federal government's Department of Education, Skills and Employment (DESE) aimed to establish a baseline count of completed sociology doctorates by university. It was anticipated that university totals might be different from PhD…

Purpose: Overall quantitative research aims to observe certain fundamental principles of logic and scientific frame of reasoning. There continues to be challenges on how quantitative research is conducted in the field of information systems. Design/methodology/approach: Structured equation modelling (SEM) research identifies concerns about the…

In a 1993 book review, E. Pearlstein asks, "Why don't textbook authors begin their discussion of magnetism by talking about magnets? That's what students have experience with." A similar question can be asked, "Why don't professors have students measure the force between permanent magnets in introductory physics labs?" The…

Systems for learning and producing knowledge, such as career and technical education (CTE), often reproduce inequities unless an equity-focused lens is used when designing, implementing, and evaluating programs. This framework presents guidance for conducting CTE research with an intentional focus on equity. Developed by the CTE Research Network's…

Psycholinguistics is the research of language in the mind: The architecture of storing the different components of language in our memory, and the ways we access that knowledge when processing and producing language. Psycholinguists usually conduct quantitative experimental research in which certain standards of experimental design, data…