A framework for integrating the many conceptions of criterion-referenced testing is provided, which illustrates that there is no single type of test that can be identified as the prototype criterion-referenced test. The use of one kind of criterion-referenced test may not be applicable to another. (Author/RL)

Discusses problems in using traditional measures of reliability for criterion-referenced tests (CRTs) and describes two approaches to reliability for CRTs: estimates sensitive to all measures of error; and estimates of consistency in test outcome. Compares the two approaches and proposes recommendations for interpretation and use. (Author/LRW)

A relatively simple method is developed to obtain confidence intervals for a student's proportion of domain mastery in criterion-referenced or mastery measurement situations. The method uses the binomial distribution as a model for the student's scores under hypothetically repeated assessments, and it makes use of widely available "F"…

Two types of test scores are often used for determining eligibility for early intervention services: standard scores and developmental-age scores. Because they are derived using different methods, these two types of scores do not provide equivalent information. Characteristics of norm-referenced and criterion-referenced tests and the scores…

The current study examined the mathematical achievement of high school students enrolled for 3 years in one of three NSF funded "Standards"-based curricula (IMP, CMIC, MMOW). The focus was on traditional topics in mathematics as measured by subtests of a standardized achievement test and a criterion-referenced test of mathematics…

This study was designed to examine the effects of looping, a practice whereby teachers and students stay together for more than one year, on perceived values and academic achievement in language arts at a Fresno Unified School District elementary school in Fresno, CA. Looping has many perceived advantages, such as the development of long-term…

The European Credit Transfer and Accumulation System (ECTS) has been developed and instituted to facilitate student mobility and academic recognition. This paper presents, discusses, and illustrates the pertinence and the limitation of the current statistical distribution of the ECTS grades, and we propose an alternative way to calculate the ECTS…

The study investigated the feasibility of adapting the coefficient k introduced by Cohen (1960) and elaborated by Swaminathan, Hambleton, and Algina (1974) to an internal consistency estimate for criterion referenced tests in single test administrations. The authors proposed the use of k as an internal consistency estimate by logically dividing…

Single-administration procedures for estimating the coefficient of agreement, a reliability index for criterion referenced tests, were recently developed by Subkoviak. The procedures require a distributional assumption for errors of measurement and an estimate of each examinee's true score. A computer simulation of tests composed of items that…

This study examined the effectiveness of two different domain definition strategies in achieving homogeneity of criterion-referenced test items. The argument was tested regarding the extent to which item writers following the Instructional Objectives Exchange (IOX) domain definition strategy for a cognitive skill generate items that are more…

A framework, or classification scheme, is provided for displaying the spectrum of criterion-referenced tests. This framework illustrates that no single type of test can be identified as the absolute prototype criterion-referenced test. It is shown that over the past 115 years criterion-referenced testing has grown to be a many-faceted concept, its…

Teachers should be evaluated chiefly by the results they produce. Those results will not be properly detected through the use of norm-referenced achievement tests (NRT) due to the following major deficits of NRT: (1) the descriptions of what is measured by NRT are far too loose; (2) evaluative expectations are unclear; (3) the necessity for NRT to…

This annotated bibliography lists currently available criterion-referenced measures. It includes measures appropriate for a wide range of goals and across a variety of subjects. The inclusion of a test in this bibliography should not be construed as a recommendation of that test. (Author/DEP)

Attempts by the Southwest Educational Development Laboratory to arrive at a comprehensive evaluation model are reviewed. Problems that arose from using classical procedures and measures are discussed. The emphasis of the Lab was to develop an evaluation model related to criterion referenced measures that provide decision-making information. (DB)