This paper describes, and lays out an argument for, the use of a procedure to help groups of reviewers to judge the quality of prior research reports. It argues why such a procedure is needed, and how other existing approaches are only relevant to some kinds of research, meaning that a review or synthesis cannot successfully combine quality…

The product Bayes factor (PBF) synthesizes evidence for an informative hypothesis across heterogeneous replication studies. It can be used when fixed- or random effects meta-analysis fall short. For example, when effect sizes are incomparable and cannot be pooled, or when studies diverge significantly in the populations, study designs, and…

This research brief describes recent methodological initiatives with the Public Libraries Survey. It describes how starting with the 2022 data, Institute of Museum and Library Services (IMLS) updated geographic identifiers to better align Census Bureau geography types with the library's legal service area, with the goal of enabling data users to…

Assessment is used to describe the process of gathering information to make judgments about how well someone has performed, how much progress has been made, and how much potential someone has. In other words, gathering information and forming judgments are both indispensable to good teaching. Educational institutions, government agencies, and…

Higher education professionals often are tasked with providing evidence to stakeholders that programs, services, and practices implemented on their campuses contribute to student success. Furthermore, in the absence of a solid base of evidence related to effective practices, higher education researchers and practitioners are left questioning what…

A growing understanding of the importance of children's earliest years has led to an increasing desire to measure early childhood development (ECD) outcomes. There are now nearly 150 tools for measuring ECD outcomes internationally, which can make it challenging to choose an appropriate measurement tool for a given measurement effort. This…

The purpose of this paper was to review best-practice methods of collecting and analyzing speech production data from minimally verbal autistic speakers. Data on speech production data in minimally verbal individuals are valuable for a variety of purposes, including phenotyping, clinical assessment, and treatment monitoring. Both perceptual…

While the field advocates for a diversified and comprehensive professional role (National Association of School Psychologists, 2020), school psychologists have long spent most of their time in assessment-related activities (Farmer et al., 2021), averaging about eight cognitive evaluations monthly (Benson et al., 2020). Assessment practices have…

Education can be transformed if we eradicate our fixation on big data like standardized test scores as the supreme measure of equity and learning. Instead of the focus being on "fixing" and "filling" academic gaps, we must envision and rebuild the system from the "student" up--with classrooms, schools and systems…

Bridge International Academies, the largest network of elementary schools in the developing world operates both low-cost private schools, and public-private partnership schools. More than 800,000 students are enrolled in 2,026 schools in five countries. Bridge tries lots of different ideas and initiatives, many of which are backed up by research…

The U.S. Department of Education has required educational collection and reporting. For postsecondary institutions, this requirement has evolved from the Higher Education General Information Survey (HEGIS), which was used from the 1960s to the 1980s, to the Integrated postsecondary Education Data System (IPEDS) (Aliyeva, Cody, & Low, 2018).…

With the aim to provide teachers with more specific, frequent, and actionable feedback about their teaching, we explore how Large Language Models (LLMs) can be used to estimate "Instructional Support" domain scores of the CLassroom Assessment Scoring System (CLASS), a widely used observation protocol. We design a machine learning…

We describe a computer-assisted program for conducting well-body assessments of children with neurodevelopmental disabilities attending a private special education school. Classroom instructors completed daily assessments to detect the presence of bodily injuries and other skin trauma, determine the need for medical treatment, and monitor healing…

The purpose of this paper is to present an assessment system that enables physical education programs to collect data capable of meeting their assessment. Assessment at the elementary level is a daunting task. Practitioners are charged to teach multiple objectives across all learning domains to hundreds of students in multiple grades in a limited…

Multiple data collection or research methods exist for evaluating library spaces. Faced with numerous choices and limited time for gathering data, it becomes challenging for information professionals to determine the best way to proceed with evaluating their libraries' physical spaces. There is a gap in the literature on best practices for…