While Massachusetts has received accolades for its high scores on the National Assessment for Educational Progress (NAEP) and Program for International Student Assessment (PISA) tests, absolute results from standardized tests tend to correlate strongly with family income and parental education. The Massachusetts Consortium for Innovative Education Assessment (MCIEA) was founded in March 2016 by a group of school districts, teacher unions, partner organizations, and a key state senator, with the goal of creating a new multiple-measures accountability system. This system was founded on the belief that there are richer assessment methods than a single standardized test to truly assess student learning and school quality, methods that can provide a deeper, more dynamic understanding of students and schools. The consortium is creating a multiple-measures school quality dashboard in the areas of teachers and the teaching environment, school culture, resources, student learning, and civic engagement and well-being. In this article, Dan French, the executive director of the Center for Collaborative Education (CCE), sat down with Dianne Kelly, superintendent of the Revere Public Schools (a consortium district), and Erik Fearing, Revere Teachers Association president and MCIEA co-chair, to discuss the consortium. These consortium leaders discuss how their model--based on collaboration among districts, teachers unions, and community organizations--aims to change the way school quality is assessed.