Coventional true score approaches to criterion-referenced tests are not applicable when tests are used for classification. Criterion-referenced testing is now used frequently for educational decision making. The assumption is made that these instruments are to be considered as tests designed to classify into "mastery" and "non-mastery" groups,…

Argues that there is room for both those tests that focus on stable between-individual gains, and discusses how to evaluate a test along both the psychometric and edumetric dimensions. (Author/JM)

A study was undertaken to determine if a criterion referenced test based on a Piagetian stage model of reading acquisition was related to grade level, to a standardized reading achievement test, and to a test of cognitive developmental level. Sixty first, second, and third grade children were administered a comprehensive test of basic skills. They…

Two approaches to criterion-referenced test construction are compared. Classical test theory is based on the practice of random sampling from a well-defined domain of test items; latent trait theory suggests that the difficulty of the items should be matched to the achievement level of the student. In addition to these two methods of test…

Formulas are presented for decision reliability and for classification validity for mastery/nonmastery decisions based on criterion referenced tests. Two item parameters are used: the probability of a master answering an item correctly, and the probability of a nonmaster answering an item incorrectly. The theory explores the relationships of…

Currently available measures of functional literacy for adults are reviewed and evaluated. This report concentrates on tests that are referenced to literary skills important to an adequately functioning adult, such as life skills, coping skills, etc. Because functional literacy has frequently been defined in terms of a grade level equivalent or…

The problems of standardized tests with regard to Mexican American students, particularly "ethnic validity", are reviewed. Inadequate norm group representation, cultural bias, and language bias are purported by the author to be the most common faults of standardized tests. Suggested is the elimination of standardized testing as a principal means…

This paper describes the development of a criterion-referenced test. The Prescriptive Mathematics Inventory (PMI) was developed to measure 400 stated behavioral objectives. The test consists of three overlapping levels with the objectives chosen to cover 90 to 95 per cent of the mathematics curriculum nominally taught in grades 4 through 8. Each…

These rating scales are intended for evaluation of student pilot performance. Each student is evaluated individually on the basis of video recordings of the student in flight. Ten point rating lines are used for the ten criterion performance elements of each of three maneuvers, (1) Final Turn to Landing, (2) Lazy Eight, and (3) Vertical S "A".…

The desirable characteristics of criterion referenced test items and sets of items are described. A two-stage item tryout and item selection procedure are also described. The paper presents the results of using the procedure as compared with traditional item selection procedures used in selecting items for norm referenced tests. It was found that…

Attention has recently been focused on the need to design and validate instructional materials that guarantee competent student performance. In preparing such products, developers have come to rely on competency-based achievement tests. Unfortunately, expertise for constructing reliable and valid competency-based instruments is not currently…

The development and evaluation of prototype hands-on equipment, job sample performance tests for a high skilled technical Military Occupational Specialty (MOS) are described. An electronic maintenance MOS (26C20) was used as the research vehicle. The results led to the conclusion that valid and reliable performance tests could be constructed, but…

The standard growth expectations for various levels and categories of the Quarterly Profile Examination were reported in this study as an approach to assessing edumetric validity. The results demonstrated the usefulness of computing standard growth expectations for tests used in the measurement of within-individual growth. (Author/JKS)

This article examines what types of language tests are suitable in evaluating instructional programs in testing for educational accountability. Norm-referenced measurements are found unsuitable for this purpose; new, criterion-referenced tests must be developed. (CHK)