This digest introduces ways of responding to the call for criterion-referenced information using Bayes' Theorem, a method that was coupled with criterion-referenced testing in the early 1970s (see R. Hambleton and M. Novick, 1973). To illustrate Bayes' Theorem, an example is given in which the goal is to classify an examinee as being a master or…

A discussion of the need to utilize a training approach based on job performance requirements and criterion tests." (Author/AK)

This study examined the effectiveness of two different domain definition strategies in achieving homogeneity of criterion-referenced test items. The argument was tested regarding the extent to which item writers following the Instructional Objectives Exchange (IOX) domain definition strategy for a cognitive skill generate items that are more…

A framework, or classification scheme, is provided for displaying the spectrum of criterion-referenced tests. This framework illustrates that no single type of test can be identified as the absolute prototype criterion-referenced test. It is shown that over the past 115 years criterion-referenced testing has grown to be a many-faceted concept, its…

Two sets of obstacles are discussed as part of a major weakness in the methodology of a criterion-reference measurement, and it is suggested that no criterion referenced measure should be published without an explicit statement of how its items were derived from objectives, and by what means item-objective congruence was determined. (Author/STS)

Examines four factors involved in the determination of how many test items should be constructed or sampled for a set of objectives: (1) the type of decision to be made with results, (2) importance of objectives, (3) number of objectives, and (4) practical constraints. Specific guidelines that teachers and evaluators can use and an illustrative…

Several innovations in educational testing are discussed as alternatives to standardized tests. (RC)

A measure of potential performance for counselors is needed as an adjunct to the information presently employed in selection decisions. One possible method of developing such a potential performance criterion and the steps taken in attempting to validate it are discussed. (Author)

Classical test theory has been rejected for application to criterion-referenced (CR) tests by most psychometricians due to an expected lack of variance in scores and other difficulties. The present study was conceived to resolve the variance problem and explore the possibility that classical test theory is both appropriate and desirable for some…

The purpose of this article is to demonstrate how instructors can prepare criterion-referenced tests that will meet the student assessment needs of vocational-technical education. (SK)

Easy-Test has been developed to produce computer generated criterion referenced tests on any of 300 subject areas at the secondary level. The tests are drawn from over 14,000 items, can be used for diagnostic purposes, and have been shown to be both valid and reliable. Among limitations of the system are the inclusion of some items not taught in a…

Criterion-referenced performance tests (CRPT) provide a realistic method for objectively measuring task proficiency against predetermined attainment standards. This article explains the procedures of constructing, validating, and scoring CRPTs and includes a checklist for a welding test. (JOW)

Argues for the establishment of a criterion-referenced testing program constructed of test items created by the district's teachers and geared to the district's curriculum objectives. (IRT)

Explains Subkoviak's method for estimating alternate-form reliability from one administration of a criterion-referenced test and describes computer program that handles tests for large number of examinees and allows application of Subkoviak's technique. Concludes that program is superior to other methods since user can directly check…