State education systems in the U.S. experienced major disruptions due to the COVID-19 pandemic. Results from assessments administered during, and at the conclusion of, the 2020-21 school year indicate substantial 'unfinished learning', with the losses generally greater among disadvantaged and marginalized students. States' assessment systems are strongly tilted toward meeting Federal accountability requirements, especially state-wide comparability of end-of year test results, which severely limits innovation. The two-year pause in accountability due to the pandemic presents an opportunity to radically rethink school accountability, allowing states greater flexibility in developing creative interventions and more balanced assessment systems to better support student learning. A new trade-off between comparability and local flexibility is long overdue, especially given the poor record of the current system in promoting learning and closing achievement gaps. We offer some examples of how the trade-off can be accomplished and the potential benefits that would ensue.