Four different procedures were used for estimating the proportion of persons who would be classified consistently as either passing both of two parallel tests or failing both. These four methods were applied at each of four different mastery level scores for each of three different length tests. Data were based on 50 replications of each procedure…

Research partially supported by the UCLA Center for the Study of Evaluation of Instructional Programs.

Three basic areas of definition, measurement, and research, voiced as concerns by members of the National Council of Measurement in Education (NCME) to its Task Force on Measurement Problems in Competency-Based Programs, are used as an organizer for a sponsored symposia and the papers in this monograph. The problem of the definition of competency…

In this paper, several models for the psychometric nature of criterion-referenced tests are presented and results derived with implications for test construction, reliability and validity measures, and educational decision making. Both dichotomous and continuous underlying abilities to perform are considered. Illustrative data fitting both cases…

A brief description of the Ohio Vocational Interest Survey (OVIS) is presented. This instrument was designed to facilitate vocational exploration rather than prediction. In this criterion-referenced instrument, the OVIS items are brief descriptions of activities, designed to represent a certain occupational cluster and/or criterion. A scale score…

Thematic summaries of those papers from the 1971 annual meeting of the AERA dealing specifically with criterion-referenced measurement are presented. An evaluative commentary by the writer is also included. (AG)

A work sample criterion test was developed for General Vehicle Repairman, MOS 63C30 and 63C40. Test items covered three task categories: troubleshooting, corrective action, and preventive maintenance. Thirty-eight organizational mechanics were tested at Fort Knox, Kentucky. Data were also collected on the quality of performance, for example, use…

The development of a series of parallel single-topic tests for testing attainment of 14 objectives concerned with inquiry skill in biology is discussed. The series of eight two-part tests are called "Explorations in Biology" (EIB). (CK)

A summary is provided of the rationale for questioning the applicability of classical reliability measures to criterion referenced tests; an extension of the classical theory of true and error scores to incorporate a theory of dichotomous decisions; a presentation of the mean split-half coefficient of agreement, a single-administration test index…

Presents major stages in design and development of criterion referenced tests (CRT) with emphasis on differences between CRT construction and norm-referenced test construction. Discussion covers test interpretation; test theory; preparation for test construction (hierarchical analysis, item type selection, and choosing number of items); test…

A sample (N=37) of currently published achievement tests was surveyed as to the availability of five types of technical data: (1) item selection techniques; (2) standardization; (3) types of norms; (4) types of validating data; and (5) types of reliability data. Recommendations for publishers and cautions for test users are given. (BS)

The question of how standardized tests can be better developed to improve educational program evaluation is probed in this paper. After the first section's brief introduction, section 2 explores the thesis that tests developed in terms of selection and inference may not serve current social functions of educational testing. To clarify this thesis,…

The problem of determining optimal test lengths with fixed total testing time has proved to be a difficult one for criterion-referenced test developers. An algorithm is needed which can be used by test developers to allocate available testing time to maximize the validity of their total criterion-referenced tests or testing programs. To be…

The reliability of criterion referenced tests, which are often used to evaluate health education programs, may be conceptualized in different ways. Classical conceptualizations of test reliability have limited usefulness when applied to health-related criterion referenced tests. When a cutting score is set, test reliability can be represented as…

An advisory committee representing counselors, curriculum specialists, students, teachers, and community members should participate in selecting standardized tests for school districts. These steps should be followed: (1) identify test purpose in relation to needs and objectives--diagnosis, placement, career guidance, program evaluation; (2)…