With the growing attention on large-scale educational testing and assessment, the ability to process substantial volumes of response data becomes crucial. Current estimation methods within item response theory (IRT), despite their high precision, often pose considerable computational burdens with large-scale data, leading to reduced computational…

Clients display considerable variations in functioning across the contexts that encompass their social environments (e.g., home, school/workplace, peer interactions). No single measurement method can fully capture these variations. Yet, assessors must balance the need to accurately capture clients' clinical presentations, and at the same time…

Accounting for complex interactions between contextual variables and learners' individual differences in aptitudes and background requires building the means to connect and access learner data at large scales, across time, and in multiple contexts. This paper describes the ASU Learning@Scale (L@S) project to develop a digital learning network…

In this article, Rachel Abenavoli, Natalia Rojas, Rebecca Unterman, Elise Cappella, Josh Wallack, and Pamela Morris argue that research-practice partnerships make it possible to rigorously study relevant policy questions in ways that would otherwise be infeasible. Randomized controlled trials of small-scale programs have shown us that early…

More than ever in the past, researchers have access to broad, educationally relevant text data from sources such as literature databases (e.g., ERIC), an open-ended response from online courses/surveys, online discussion forums, digital essays, and social media. These advances in data availability can dramatically increase the possibilities for…

The COVID-19 outbreak emphasizes the need for alternative methods for data gathering and collaboration among researchers in a virtual research environment. One experimental design that is well suited in a social distancing research context is the single-case experimental design (SCD). SCDs can handle disruptions as: (a) they do not require large…

The quantitative assessment of eye tracking data quality is critical for ensuring accuracy and precision of gaze position measurements. However, researchers often report the eye tracker's optimal manufacturer's specifications rather than empirical data about the accuracy and precision of the eye tracking data being presented. Indeed, a recent…

Many national science frameworks (e.g., Next Generation Science Standards) argue that developing mathematical modeling competencies is critical for students' deep understanding of science. However, science teachers may be unprepared to assess these competencies. We are addressing this need by developing virtual lab performance assessments that…

Consistency of learning behaviors is known to play an important role in learners' engagement in a course and impact their learning outcomes. Despite significant advances in the area of learning analytics (LA) in measuring various self-regulated learning behaviors, using LA to measure consistency of online course engagement patterns remains largely…

Modern social intelligence includes the ability to watch videos and answer questions about social and theory-of-mind-related content, e.g., for a scene in "Harry Potter," "Is the father really upset about the boys flying the car?" Social visual question answering (social VQA) is emerging as a valuable methodology for studying…

In this paper, we consider a minimalistic and behavioristic view of AIS to enable a standardizable mapping of both the behavior of the system and of the learner. In this model, the "learners" interact with the learning "resources" in a given learning "environment" following preset steps of learning…

Schools are increasingly turning towards restorative practices as a pathway to building schools with stronger relationships, justice, and equity. While effectiveness studies are increasing, too little attention is focused on evaluating implementation. This resources is for audiences who evaluate implementation of whole school restorative practices…

A survey of all 50 states and District of Columbia was conducted in Fall 2020 to gain background information to inform an Institute of Museum and Library Services (IMLS) grant project called SLIDE: The School Librarian Investigation--Decline or Evolution? As part of the grant, a school library leader, some in a state government/agency position or…

The City University of New York (CUNY) is the largest urban public university system in the United States with approximately 100,000 students enrolled in associate degree programs. Similar to trends nationwide, many associate degree students come to CUNY underprepared for college-level classes and are assigned to take remedial or developmental…

Imagine a large randomized controlled trial study of a mathematics educational intervention planned in two large urban districts. District 1 gets a new administrator and drops out. In the meantime, the state test changed, so one of the planned outcome measures is no longer usable. Teacher dropout is high. And, as the analysis is being completed,…