Standards for evaluating criterion-referenced tests are presented. Twenty-one standards, grouped in three categories, are discussed. Category one is defined as measurement properties and is comprised of conceptual validity, including description of the domain, test item agreement with objectives, and item representativeness of the objectives; and…

A method for establishing minimal acceptable performance levels for criterion referenced multiple choice examinations is described and two procedures for evaluating its validity are discussed. The method involves assigning a priori item difficulties based on the similarity between the distractor and the correct response. In estimating the validity…

The criterion issues in the area of outcome research in psychotherapy were addressed and reviewed. Through this review of previous outcome research, it was determined that three basic criterion areas related best to traditional outcome variables such as therapist and community informant ratings, length of stay, and rehospitalization. These three…

This project began with the delineation of the roles and functions of respiratory therapy personnel by the American Association for Respiratory Therapy. In Phase II, The Psychological Corporation used this delineation to develop six proficiency examinations, three at each of two levels. One exam at each level was designated for the purpose of the…

This study compared the criterion-related validity of interest inventories measuring basic types of interests. A significant characteristic of reports based on same-sex norms is they suggest similar vocational options to males and females. The other reporting procedures typically suggest options traditional for a person's sex. (Author)

Competency-based vocational education is based on the following three essentials: specifying job-related tasks in advance, providing instruction in the tasks, and measuring and certifying that students can perform the tasks. This article focuses on measuring and certifying student competencies by addressing several related questions. (BM)

The items of the Florida minimal competency test have never been validated as measures of "survival skills," and the pass/fail standards were set mindlessly and capriciously. (Author/IRT)

Discussed in relation to career education for handicapped students are advantages and disadvantages of four types of measurement: applied performance testing, criterion validity studies, product vs. process measurement, and criterion vs. norm-referenced measurement. Available from: Division on Career Development, The Council for Exceptional…

Discusses problems with the ACTFL/ETS Oral Proficiency Guidelines and examines inconsistencies relating to three assumptions of oral proficiency (OPT)--hours of study, accuracy/interest, and errors. Further, it is argued that the main problems with OPT arise from an analytic approach and the native speaker yardstick. (SED)

PLANA is a training program for subject matter analysis and construction of instructional objectives. This investigation tries to find out whether education students in the PLANA program differ from other students on planning instruction processes. (BW)

This paper describes major concepts related to item analysis for criterion-referenced tests including validity, reliability, item difficulty, and item discrimination, particularly in relation to criterion-referenced tests. The paper discussed how these concepts can be used to revise and improve items and listed suggestions regarding general…

Author discusses and defines criterion tests in the context of classroom needs that have created much of the interest in the theory at this time. The primary source of interest is related to the growing implementation of individualized curricula. (Author/CB)

A criterion-referenced test for a beginning archery class was developed and evaluated. Techniques for estimating test validity and reliability were applied to data. A method developed by R. A. Burk (1976) was used to establish a cutoff score that would distinguish between those mastering the class and nonmasters. (Authors/PP)

Seventh-grade science students (n=22) wrote prompted essays, compare-contrast essays, and traditional end-of-chapter criterion-referenced tests. Results indicated that essay tests may be highly sensitive to instructional content and prompt design, and the validity of essays as measures of content learning relates more to goals of instruction than…

Test specifications need to take a middle road so that they are not so general that instructional targeting is impossible and not so specific that only unitary assessment targets are fostered. Using illustrative sample items provides a good means of communicating the items eligible to be tested. (SLD)