A description of the difficulties encountered in constructing a criterion-referenced test to assess end-of-year skills as part of a program evaluation is presented. The problems encountered in preparing the customized test are described in humorous detail. The first problem involved the listening test obtained from a publisher without…

The purpose of this study was to examine the homogeneity in difficulty of item domains and the effectiveness of Rasch pre-equating procedures for adjusting test scores for differences in the difficulty of tests constructed by sampling from item domains. The data used were taken from a field test and calibration of 810 tenth-grade items in…

This study had three purposes. First, to develop and validate a criterion-referenced test to measure science knowledge of students who finished the second cycle of the Basic General Education (6th grade). Second, to assess the performance of the entire Costa Rican population of sixth graders and, third, to analyze the results according to some…

The development of a test design methodology used to construct a criterion-referenced System Achievement Test (CR-SAT) for selected Naval enlisted classification (NEC) in the Strategic Weapon System (SWS) of the United States Navy is described. Subject matter experts, training data analysts and educational specialists developed a comprehensive…

The causal effects of time spent in learning (TSL) and time needed for learning (TTL) on the reading and spelling achievement of 171 fourth and fifth grade students were investigated. TTL contributed significantly to achievement, and its direct effect was greater than TSL. Results also support a Carroll's learning model. (Author/BS)

In 1984 an evaluation team examined the Maryland Functional Testing Program (MFTP), a statewide competency-based, criterion-referenced testing program that was instituted to limit awarding of high school diplomas to those students who had earned scores above cut scores on a series of achievement tests. This article examines the procedures the…

In 1982-83, Riverside Unified School District (California) selected an achievement test to provide both norm- and criterion-referenced (dual objective) data for its achievement testing program. The test selection process was focused around eight evaluation aspects: prescreening of tests, content matching, instructional evaluation, processing…

Focusing on technical issues, this paper critiques proposed changes in assessment procedures at the further educational level (ages 16 through 18) in England and Wales. Major structural changes are taking place at this educational level, partly because of large scale youth unemployment. The two current examination systems for the final year of…

This paper describes and reports results of a program aimed at improving performance of all students, K-12, through a program of sequenced objectives monitored with criterion-referenced tests. Target curriculum areas were mathematics, reading, and language skills. Nationally normed achievement tests were administered in a base year and each year…

This paper argues that no single measurement strategy serves all purposes and that applying methods and techniques which allow a variety of data elements to be retrieved and juxtaposed may be an investment in the future. Item response theory, Rasch model, and latent trait theory are all approaches to a single conceptual topic. An abbreviated look…

Examines the British government's goal of introducing criterion-referenced, formative student evaluation in primary schools. Reports on a case study in which the reliability of a Standard Assessment Task was examined in three second-grade classrooms. Questions whether or not the decision to drop the task from the test was correct. (CFR)

Many problems are encountered by school districts regardless of size. State and federal involvement in education provides certain financial resources, but also makes demands for accountability. This creates conflicts between local program development and the requirements of state and federal regulations, and particularly complicates the…

The Pre-Professional Skills Tests (PPST), was developed at Educational Testing Service at the request of the National Teachers Examination Policy Council. The battery of three tests is designed to provide objective, standardized measures of basic proficiency in reading, mathematics, and writing. The steps in the test development process of this…

Intended both to evaluate the California testing program's success in assessing student achievement in the basic skills and to suggest possible improvements in the program, this report includes an executive summary evaluating current testing procedures, describing experimental studies on new ways of testing and reporting testing information, and…

The sequential probability ratio test (SPRT), developed by Abraham Wald, is one statistical model available for making mastery decisions during computer-based criterion referenced tests. The predictive validity of the SPRT was empirically investigated with two different and relatively large item pools with heterogeneous item parameters. Graduate…