We investigate two research questions using a recent statewide transition from paper to computer-based testing: first, the extent to which test mode effects found in prior studies can be eliminated in large-scale administration; and second, the degree to which online and paper assessments offer different information about underlying student…

We investigate two research questions using a recent statewide transition from paper to computer-based testing: first, the extent to which test mode effects found in prior studies can be eliminated; and second, the degree to which online and paper assessments offer different information about underlying student ability. We first find very small…

The charter school movement encompasses many school models. In Massachusetts in the 2010's, the site of our study, urban charter schools primarily used "No Excuses" practices, whereas nonurban charters had greater model variety. Using randomized admissions lotteries, we estimate the impact of charter schools by locality on college…

When the U.S. Department of Education (ED) signaled that the broad waivers for state assessments it had offered in 2019-20 would not be widely offered in 2021, it sought to balance the need for student learning data to inform pandemic recovery with the very real operational challenges states face in administering tests this year. This policy…

We investigate the predictive validity of teacher licensure tests using data from the Massachusetts Tests for Educator Licensure (MTEL). MTEL scores predict teachers' in-service performance ratings and contributions to student test scores (i.e., value added). We then explore whether these relationships vary for teacher candidates of color.…

For the past 20 years Massachusetts has used a high-stakes, test-based accountability system for the state's public schools. The Massachusetts Comprehensive Assessment System (MCAS) are standardized tests administered in Grades 3-10 which account for the majority of district and school accountability measures, and the Grade 10 tests serve as an…

The impact of admissions process design on the racial diversity of schools and colleges has sparked heated debates. We study the pipeline into Boston's three public exam schools to understand racial gaps in enrollment. Admission to these schools has historically been based on a combination of grade point average (GPA) and a score on an optional…

Prior work has documented a substantial penalty associated with taking the Partnership for Assessment of Readiness for College and Careers (PARCC) online relative to on paper (Backes & Cowan, 2019). However, this penalty does not necessarily make online tests less useful. For example, it could be the case that computer literacy skills are…

This article reports on two quantitative studies of English learners' (ELs) interactions with constructed-response items from a Grade 5 state science test. Study 1 investigated the relationships between the constructed-response item-level variables of English Reading Demand, English Writing Demand, and Background Knowledge Demand and the…

Along with a student's academic progress, the Massachusetts Comprehensive Assessment System (MCAS) English Language Arts, MCAS Mathematics, and MCAS Science exams dictate whether a student in the Massachusetts public school system earns a diploma or a certificate of attainment. The difference is that students who do not receive a diploma are not…

Nearly two dozen states now administer online exams to deliver testing to K-12 students. These tests have real consequences: their results feed into accountability systems, which have been used for more than a decade to hold schools and districts accountable for their students' learning. We examine the rollout of computer-based testing in…

Assessment and accountability are hotly debated topics in the field of education. Finding ways to include students with significant cognitive disabilities, a requirement under federal law, remains a challenge. In Massachusetts, students with significant cognitive disabilities participate in the Massachusetts Comprehensive Assessment System's…

Since the 1920, colleges and universities have leveraged standardized testing as a way to determine worthiness of access to higher education. Nearly 100 years since its first appearance, the use of standardized testing has become commonplace despite the growing evidence of the socioeconomic and racial disparities among test takers. While some high…

The Thomas B. Fordham Institute has released a report, "Evaluating the Content and Quality of Next Generation Assessments," ostensibly an evaluative comparison of four testing programs, the Common Core derived SBAC and PARCC, ACT's Aspire, and the Commonwealth of Massachusetts' MCAS. Of course, anyone familiar with Fordham's past work…

There is empirical evidence of substantial heterogeneity in economic mobility across geographic areas and the efficacy of schools has been suggested as an explanatory factor. Using administrative microdata from seven states covering nearly 3 million students, we explore the potential role of schools in promoting economic mobility by estimating…