Argues that there is room for both those tests that focus on stable between-individual gains, and discusses how to evaluate a test along both the psychometric and edumetric dimensions. (Author/JM)

Two approaches to criterion-referenced test construction are compared. Classical test theory is based on the practice of random sampling from a well-defined domain of test items; latent trait theory suggests that the difficulty of the items should be matched to the achievement level of the student. In addition to these two methods of test…

Formulas are presented for decision reliability and for classification validity for mastery/nonmastery decisions based on criterion referenced tests. Two item parameters are used: the probability of a master answering an item correctly, and the probability of a nonmaster answering an item incorrectly. The theory explores the relationships of…

This paper describes the development of a criterion-referenced test. The Prescriptive Mathematics Inventory (PMI) was developed to measure 400 stated behavioral objectives. The test consists of three overlapping levels with the objectives chosen to cover 90 to 95 per cent of the mathematics curriculum nominally taught in grades 4 through 8. Each…

These rating scales are intended for evaluation of student pilot performance. Each student is evaluated individually on the basis of video recordings of the student in flight. Ten point rating lines are used for the ten criterion performance elements of each of three maneuvers, (1) Final Turn to Landing, (2) Lazy Eight, and (3) Vertical S "A".…

Attention has recently been focused on the need to design and validate instructional materials that guarantee competent student performance. In preparing such products, developers have come to rely on competency-based achievement tests. Unfortunately, expertise for constructing reliable and valid competency-based instruments is not currently…

The development and evaluation of prototype hands-on equipment, job sample performance tests for a high skilled technical Military Occupational Specialty (MOS) are described. An electronic maintenance MOS (26C20) was used as the research vehicle. The results led to the conclusion that valid and reliable performance tests could be constructed, but…

The standard growth expectations for various levels and categories of the Quarterly Profile Examination were reported in this study as an approach to assessing edumetric validity. The results demonstrated the usefulness of computing standard growth expectations for tests used in the measurement of within-individual growth. (Author/JKS)

Presents approaches to test development analysis, reliability, and validity based on criterion-referenced measurement principles and compares them with norm-referenced approaches in terms of the types of decisions that result from either approach. This is done by using data from an English-as-a-second-language achievement testing project at the…

Discusses methods of sampling the best information from instruction/training developers/candidates for professional certification and examines the problems of interpreting that information and making classification decisions. Assessment strategies including criterion-referenced, multiple-choice, short answer, and essay questions, and portfolio…

Concludes that the Brigance Screen is a well-organized criterion-referenced test designed to assist in the early identification of individuals who need further testing. (FL)

The reliabilities of two types of measurement plans were compared across six hypothetical distributions of true scores or abilities. The measurement plans were: (1) fixed-length, where the number of trials for all examinees is set in advance; and (2) trials-to-criterion, where examinees must keep trying until they complete a given number of trials…

A reliability coefficient for criterion-referenced tests is developed from the assumptions of classical test theory. The coefficient is based on deviations of scores from the criterion score, rather than from the mean. (Author/CK)

An alternative interpretation of Livingston's reliability coefficient (see TM 500 487) is based on the notion of the relation of the size of the reliability coefficient to the range of talent. (Author/CK)