The gold standard in making causal inference on program effects is a randomized trial. Most randomization designs in education randomize classrooms or schools rather than individual students. Such "clustered randomization" designs have one principal drawback: They tend to have limited statistical power or precision. This study aims to…

A description of the difficulties encountered in constructing a criterion-referenced test to assess end-of-year skills as part of a program evaluation is presented. The problems encountered in preparing the customized test are described in humorous detail. The first problem involved the listening test obtained from a publisher without…

The Chicago Public Schools have been developing and implementing a citywide instructional program of continuous progress/mastery learning in reading. It includes the delineation of a K-8 continuum of instructional objectives; a criterion-referenced testing program which serves as the basis for instruction, promotion, and administrative monitoring;…

This article examines what types of language tests are suitable in evaluating instructional programs in testing for educational accountability. Norm-referenced measurements are found unsuitable for this purpose; new, criterion-referenced tests must be developed. (CHK)

The 1973 statewide (Maryland) educational accountability plan, for which this report was compiled, called for the development and establishment of statewide and local goals in reading, writing, and mathematics; a comprehensive and uniform statewide testing program; procedures for collecting data on student, home, community, and school…

Despite their advantages over other assessment techniques, current achievement and ability tests are not especially efficient sources of information for the range of educational decisions for which they are used and relied upon. Two major types of tests, criterion-referenced and norm-referenced, and two types of use, student evaluation and program…

In 1984 an evaluation team examined the Maryland Functional Testing Program (MFTP), a statewide competency-based, criterion-referenced testing program that was instituted to limit awarding of high school diplomas to those students who had earned scores above cut scores on a series of achievement tests. This article examines the procedures the…

The potential use of criterion referenced tests (CRT) and norm referenced tests (NRT) in the same testing program is discussed. The advantages and disadvantages of each are listed, and the best solution, a merging, is proposed. To merge CRTs and NRTs into an overall testing program, meaningful and useful to all levels, consideration must be given…

This paper delineates several problems which arise when criterion-referenced test results are used to evaluate the effects of a specific educational treatment. Focus is on these topics: (1) the aggregation of individual students' data on objectives, (2) the sensitivity of the instrument to instruction, (3) the interpretation of…

The National Assessment of Educational Progress (NAEP) is a federally funded, nationwide survey of educational achievement in 10 academic fields. The program is examined to determine whether viable alternatives exist to measure educational achievement. The information produced by NAEP concerns the educational achievement of 9-year-olds;…

This is a report on the evaluation of the Reading Strategy Project operated in 46 public and eight non-public schools during the 1974-75 regular school year. This project served 7,698 pupils. The design of the instructional format of the Reading Strategy Project was one which utilized a criterion-referenced diagnostic reading test, locally…

An information feedback system for use in evaluating an educational program is described, and its effectiveness in evaluating the Follow Through program and its use in relation to the Iowa Tests of Basic Skills are discussed. The systems approach to program evaluation consists of objectives clarification, decision making, and program planning. In…

This report discusses the merits of performance contracting in the light of recent performance contract experiment evaluations, and it provides guidelines for administrators who are considering the use of performance contracts. The merits of the OEO experiment and the interpretation of the results by the OEO and the Rand Corporation are discussed.…

Those who are charged with the evaluation of an educational program or school or effects of teaching often must consider how well students do on the variety of standardized tests they take in the course of a school year. This overview describes common types of tests students take in large-scale programs. Criterion-referenced tests are tests that…