Writing multiple-choice test items to measure student learning in higher education is a challenge. Based on extensive scholarly research and experience, the author describes various item formats, offers guidelines for creating these items, and provides many examples of both good and bad test items. He also suggests some shortcuts for developing…

The National Assessment of Educational Progress (NAEP) measures student science achievement nationally, state by state, and, most recently, across selected urban school districts. Periodically, the framework underlying the science assessment is revised or updated. This document, "Science Framework for the 2019 National Assessment of…

The Test Of Astronomy STandards (TOAST) is a comprehensive assessment instrument designed to measure students' general astronomy content knowledge. Built upon the research embedded within a generation of astronomy assessments designed to measure single concepts, the TOAST is appropriate to measure across an entire astronomy course. The TOAST's…

This report will determine to what degree the AP Physics 1 and 2 and AP Calculus AB and BC frameworks are aligned with the Trends in International Mathematics and Science Study (TIMSS) Advanced Physics and Mathematics frameworks. This will enable an exploration of any differences in content coverage and levels of complexity, and will set the stage…

Many of the instruments developed for research use by the chemistry education community are relatively new. Because psychometric evidence dictates the validity of interpretations made from test scores, gathering and reporting validity and reliability evidence is of utmost importance. Therefore, the purpose of this study was to investigate what…

We describe an innovative automated test construction algorithm for building aligned achievement tests. By incorporating the algorithm into the test construction process, along with other test construction procedures for building reliable and unbiased assessments, the result is much more valid tests than result from current test construction…

Current science assessments typically present a series of isolated fact-based questions, poorly representing the complexity of how real-world science is constructed. The National Research Council asserts that this needs to change to reflect a more authentic model of science practice. We strongly concur and suggest that good science assessments…

The purpose of this document is to provide background information that will be useful in interpreting the 2007 results from the Trends in International Mathematics and Science Study (TIMSS) by comparing its design, features, framework, and items with those of the U.S. National Assessment of Educational Progress and another international assessment…

Educational tests used for accountability purposes must represent the content domains they purport to measure. When such tests are used to monitor progress over time, the consistency of the test content across years is important for ensuring that observed changes in test scores are due to student achievement rather than to changes in what the test…

Described is how tests that accompany texts can be effective if items selected relate to topics stressed in class. Identified are problems commonly found in these types of tests and directions on how to improve problem questions. (KR)

This study investigated three factors that may contribute to the large variation in student performance across open-ended measures. These factors are content domain, format (whether the task required only pencil and paper or involved a hands-on manipulation of equipment), and level of inquiry (whether the task guided the student toward the…

A set of prototype measures has been developed to measure students' understanding of content areas. Although the starting point has been history, the project has explored the use of a common model for assessment in geography and science as well. These prototypes are intended to provide models for users with assessment requirements who do not have…

Beginning in the 1995-96 school year, the science test will be added to the Ninth-grade Proficiency Tests Program. Any student graduating after September 15, 2000 will be required to pass the Ninth-grade Proficiency Test in Science, as well as the other tests in reading, writing, mathematics, and citizenship. This fact sheet provides information…

Classroom tests developed by seventh- and eighth-grade science teachers (n=23) and mathematics teachers (n=18) were analyzed by panels of content and measurement experts. The 41 participating teachers, each of whom contributed 2 tests, completed a questionnaire, an interview, and 2 measures of competence in testing. Teachers used all major item…

The Massachusetts Educational Assessment Program (MEAP) is designed to improve curriculum and instruction in the public schools. The MEAP tests all students in grades 4, 8, and 12 in major curriculum areas biennially. The test is not designed to yield scores for individual students. This document describes the content of the assessment instruments…