A common practice in medical education is to create a prescribed distribution of grades, or ratings, so that only a certain percentage of students receive the highest marks. This approach typically is employed to curb grade inflation and as a means to help faculty distinguish outstanding performers. Despite the well-intentioned reasoning for using…

In music education, current assessment trends emphasize student reflection, tracking progress over time, and formative as well as summative measures. This view of assessment requires instrumental music educators to modernize their approaches without interfering with methods that have proven to be successful. To this end, the Longitudinal Scales…

The purpose of this document is to describe the methods RAND used to analyze achievement for 23 personalized learning (PL) schools for the 2012-13 through 2013-14 academic years. This work was performed at the request of the Bill & Melinda Gates Foundation (BMGF), as part of a multi-year evaluation contract. The 23 schools were selected from a…

Despite the widespread availability of information and communication technologies (ICTs) and some research into specific pedagogical practices using them, there has been little research on the role of these technologies in shaping broader pedagogical approaches in higher education (HE). Increased experimentation in using ICTs raises questions…

This research investigates the reliability and validity of three major publications' rankings of MBA programs. Each set of rankings showed reasonable consistency over time, both at the level of the overall rankings and for most of the facets from which the rankings are derived. Each set of rankings also showed some levels of convergent and…

The Adequate Yearly Progress (AYP) Model has been used to make many high-stakes decisions concerning schools, though it does not provide a complete assessment of student academic achievement and school effectiveness. To provide a clearer perspective, many states have implemented various Growth and Value Added Models, in addition to AYP. The…

Approximately one-third of American freshmen at two-year and four-year colleges require remedial coursework and over 40 percent of employers rate new hires with a high school diploma as "deficient" in their overall preparation for entry-level jobs. Yet, over the past decade, as these students marched through America's public education…

Background/Context: Principles of evidential reasoning have often been discussed in the context of educational and psychological measurement with respect to construct validity and validity arguments. More recently, Mislevy proposed the metaphor of assessment as an evidentiary argument about students' learning and abilities given their…

Three alternative approaches to assessment of exam responses were applied in an undergraduate biochemistry course. First, phenomenography was used to categorize written exam responses into an inclusive hierarchy. Second, responses to the same question were similarly categorized according to the Structure of Observed Learning Outcome (SOLO)…

Simulations are employed widely as teaching tools in political science, yet evidence of their pedagogical effectiveness, in comparison to other methods of instruction, is mixed. The assessment of learning outcomes is often a secondary concern in simulation design, and the qualitative and quantitative methods used to evaluate outcomes are…

U.S. higher education institutions are being called to question their central nature, priorities, and functions, with prominent and unprecedented attention being given to accountability and the measurement of student learning outcomes. As higher education evolves in how it assesses student learning and leisure studies and recreation departments…

State education agencies and school districts are increasingly using measures based on student test-score growth in their systems for evaluating school and teacher performance. In many cases, these systems inform high-stakes decisions such as which schools to close and which teachers to retain. Performance metrics tied directly to student…

Math in Common® (MiC) is a five-year initiative that supports a formal network of 10 California school districts as they implement the Common Core State Standards in mathematics (CCSS-M) across grades K-8. As the MiC initiative moves into its second year, one of the central activities that each of the districts is undergoing to support CCSS…

The first step in the Validity and Reliability Study summarizes the history and purpose of California's quality rating and improvement system (QRIS), reviews findings from other QRIS evaluation studies, and describes the approach to validating the system in California. The majority of this report focuses on providing context for the California…

Between 2009 and 2014, thirty-seven states in the United States have adopted or significantly amended their teacher evaluation laws, mostly shifting toward using measurements of student growth on achievement tests. Yet, the processes to evaluate core subjects have not always transitioned smoothly to nontested or artistic content, causing some…