Criticisms about psychometric paradigms currently used in healthcare professions education include claims of reductionism, objectification, and poor compliance with assumptions. Nevertheless, perhaps the most crucial criticism comes from learners' difficulty in interpreting and making meaningful use of summative scores and the potentially…

The introduction of the CEFR was welcomed by researchers and practitioners in language education, given its potential for increasing transparency of test results and the meaningfulness of test scores. In this paper, I reflect on Glenn Fulcher's (2004, 2016) critical take on the use of the CEFR in the context of mapping (linking or aligning) test…

Reliability is a measure of consistency. It is the degree to which student results are the same when they take the same test on different occasions, when different scorers score the same item or task, and when different but equivalent tests are taken at the same time or at different times. Reliability is about making sure that different test forms…

A great deal has been written on the topic of test validity. Guiding our work at ACT are "The Standards for Educational and Psychological Testing" (2014), which outlines best practices in test development and validation. As ACT transitions from an assessment company to a learning, measurement, and navigation organization, a framework for…

Standard setting is the process of identifying the point(s) on a scale that serve to differentiate between individuals of distinct proficiency levels. While standard setting is ultimately a policy decision, most of the process is carried out by subject matter experts who are tasked with reconciling item-level or examinee-level information (e.g.…

This paper was prepared as a response to: (1) A national trend towards lessening the requirements to become a public school superintendent and hiring non-traditional superintendents. State and national approaches to alternative licensure for public school superintendents are reviewed, including the lessening or abolition of standards. This is of…

This article is designed to help teachers interpret reading assessment data from DIBELS beyond individual subtests to better support their students' needs. While it is important to understand the individual subtest measures, it is more vital to understand how each fits into the larger picture of reading development. The underlying construct of…

Almost three-fourths of the American public has lost confidence in the nation's schools, but the recent passage of the Proposition 30 shows that the majority of voters in California hold on to their hope for their schools. School administrators need to build on that vote of confidence, starting at the local level, so they can help the public…

Not long ago, the author had the wonderful opportunity to visit schools in China and speak to Chinese educators. Everywhere she went, teachers and administrators asked her the same question: How can we help our students become more flexible, creative thinkers? She was struck by the contrast between these conversations and the ones she most often…

In this article, Heather C. Hill and Pam Grossman discuss the current focus on using teacher observation instruments as part of new teacher evaluation systems being considered and implemented by states and districts. They argue that if these teacher observation instruments are to achieve the goal of supporting teachers in improving instructional…

Rhode Island's School Accountability system is in a period of transition to the Every Student Succeeds Act (ESSA). The accountability data released October 2017 is based on the 2016-17 administration of the PARCC assessment. Results from the Multi-State Alternate Assessment in ELA/literacy and mathematics are also included. The results of this…

More than 40 states plan to assess student performance with new tests tied to the Common Core State Standards. In summer 2013, results from Common Core-aligned tests in New York showed a steep decline in outcomes. Common Core advocates hailed the scores as an honest accounting of school and student performance, while others worried that they…

This article is a commentary of a paper by Derek C. Briggs and Frederick A. Peck, "Using Learning Progressions to Design Vertical Scales That Support Coherent Inferences about Student Growth," which describes an elegant potential framework for at least beginning to address three priorities in large-scale assessment that have not been…

While many educators expect the Common Core State Standards (CCSS) to be more rigorous than previous state standards, some wonder if the transition to CCSS and to a Common Core aligned MAP test will have an impact on their students' RIT scores or the NWEA norms. MAP assessments use a proprietary scale known as the RIT (Rasch unit) scale to measure…

The need to adequately prepare all students for the next stage in their lives has led a number of states to adopt new educational standards that reflect the expectation that all high school students will be ready for college and career when they graduate. The report "Communicating College and Career Readiness through Proficiency…