This experiment was designed to assess the ability of item writers to construct truly parallel tests based on a "duplicate-construction experiment" in which Cronbach argues that if the universe description and sampling are ideally refined, the two independently constructed tests will be entirely equivalent, and that within the limits of item…

Livingston's work is a careful analysis of what occurs when one pools two populations with different means, but similar variances and reliability coefficients. However, his work fails to advance reliability theory for the special case of criterion-referenced testing. See ED 042 802 for Livingston's paper. (MS)

Three methods for setting performance standards for criterion referenced tests--theories, expert judgments, and practical necessity--are reviewed. The author concludes that the use of performance standards is not a promising vehicle for making societal decisions. (Author/JKS)

This special issue covers recent technical developments in the field of criterion-referenced testing. An introduction, six papers, and two commentaries dealing with test development, test score uses, and evaluation of scores review relevant literature, offer new models and/or results, and suggest directions for additional research. (SLD)

The reliability of criterion-referenced tests (CRTs) used in health program evaluation can be conceptualized in different ways. Formulas are presented for estimating appropriate standard error of measurement (SEM) for CRTs. The SEM can be used in computing confidence intervals for domain score estimates and for a cut-score. (Author/LMO)

Discusses the strengths and weaknesses of Reading Yardsticks, a criterion referenced test. Concludes that there are significant problems associated with its effective use. (FL)

Illustrates ways to link the motivating power and efficiency of the computer to the effectiveness and necessity of traditional teaching practice and criterion referenced testing in order to assess and teach spelling. (FL)

In this paper, an attempt has been made to synthesize some of the current thinking in the area of criterion-referenced testing as well as to provide the beginning of an integration of theory and method for such testing. (Editor)

This article is a reply to a previous paper (see TM 500 488) interpreting Livingston's original article (see TM 500 487). (CK)

This article first describes the growing trend of using criterion referenced tests, and then explores the need for setting standards for these types of tests. (RC)

A study was conducted at Stark Technical College to compare a normative-referenced test for mathematics placement with a criterion-referenced test that had been used by the college. The study sought to compare statistically the scores of 165 students on the Mathematics Inventory Test (MIT--a criterion-referenced test that had been developed…

This booklet is intended to help school personnel, parents, students, and members of the community understand concepts and research relating to achievement testing in public schools. The paper's sections include: (1) test use with direct effects on students (test of certification, selection, and placement); (2) test use with indirect effects on…

Both criterion-referenced testing and behavioral assessment share the basic assumption that test behavior is a sample rather than a sign. In addition, both types of assessment focus on response capabilities and performance in specified content domains. Although content validity has been traditionally recognized as essential to criterion-referenced…

This study examined the effects of certain item selection methods on the classification accuracy and classification consistency of criterion-referenced instruments. Three item response data sets, representing varying situations of instructional effectiveness, were simulated. Five methods of item selection were then applied to each data set for the…

The scoring scheme of the National Assessment of Educational Progress (NAEP) is studied, as well as techniques for estimating its reliability. NAEP data are collected on students of age 13 in the fall, age 9 in the winter, and age 17 in the spring. The scoring task, involving hand scoring of open-ended items, may vary between 25,000 responses to…