The benefits of practice testing for long-term learning are well established in many contexts. However, little is known about learner characteristics that might moderate its effectiveness. The effects of practice tests might depend on individual prerequisites for learning, especially in real-world educational settings. We explored whether the…

Standard setting is a method used to set cut scores on large-scale assessments. One of the most popular standard setting methods is the Bookmark method. In the Bookmark method, panelists are asked to envision a response probability (RP) criterion and move through a booklet of ordered items based on a RP criterion. This study investigates whether…

Operational testing programs employing item response theory (IRT) applications benefit from of the property of item parameter invariance whereby item parameter estimates obtained from one sample can be applied to other samples (when the underlying assumptions are satisfied). In theory, this feature allows for applications such as computer-adaptive…

This paper provides a history of ETS's role in developing assessment instruments and psychometric procedures for measuring change in large-scale national assessments funded by the Longitudinal Studies branch of the National Center for Education Statistics. It documents the innovations developed during more than 30 years of working with…

Scores are the most visible and widely used products of a testing program. The choice of score scale has implications for test specifications, equating, and test reliability and validity, as well as for test interpretation. At the same time, the score scale should be viewed as infrastructure likely to require repair at some point. In this report…

Rescoring of Center for Occupational and Professional Assessment objective-referenced tests is decided largely by content experts selected by client organizations. A few of the test items, statistically flagged for review, are not rescored. Some of this incongruence could be due to the use of the biserial correlation (r-biserial) as an…

The current status of state testing programs is assessed drawing primarily on information provided by the Educational Testing Service publication, "State Testing Programs, 1973 Revision." Increases in state operated programs are indicated and are probably due to an increase in federal money for testing purposes. Because of possible…

This four-year study investigated factors associated with stage of concern and change in stage of concern of teachers and principals when implementing a benchmark testing program in a large school district. Findings are presented and discussed. (Author/MT)

A criterion-referenced test battery was devised for use with the mathematics program of the Mamaroneck Public Schools (New York) in 1971. After two annual administrations, the tests were revised in four ways. The format was changed, and the number of items dealing with geometry was increased; some items were revised to conform better with the…

Although most states use a single strategy for statewide assessment, one Midwestern state has chosen a model in which local school districts are responsible for developing strategies to measure and report students' progress on state-adopted content strategies. This paper describes the state assessment system and focuses on the perspectives of…

This survey on modifications allowed for students with disabilities by 30 states in statewide criterion-referenced testing programs found no universal agreement about modifications. Accommodations in Test Setting and Test Scheduling were more frequently allowed than revisions in Test Directions or Test Format. Assistance devices and accommodations…

The Michigan accountability system, based on statewide objectives-referenced testing at two grade levels generated considerable controversy, including this response to criticisms of an evaluation of the program by a panel of three persons. The contract under which the evaluation was performed is quoted to show that the authors of the report were…

The pros and cons of using behavioral objectives, the merits of norm-referenced versus objective-referenced tests, and the virtues of sampling versus census testing are familiar topics in evaluation literature. Far less common is practical information on how to implement objective-referenced testing, particularly the large-scale testing required…

This paper represents a summary statement on an investigation into the area of statewide testing of minimum basic skills conducted last year for the New Jersey Task Force on Competency Indicators and Standards. Survey work and the study of source documents led to the following conclusions: (1) there was no obvious and agreed upon set of employment…

This fourth report in the 1973-74 series presents a compilation of the scores of Michigan's fourth and seventh grade students who participated in the educational assessment. Results of the objective-referenced test data reveal that while none of the objectives was attained by all of the students, performance levels were quite high for some of the…