Since mid-1971 the Instructional Objectives Exchange has been engaged in a major effort to develop and disseminate criterion-referenced tests in the fields of reading, mathematics, language arts, and social studies. This paper isolates the chief technical decision-alternatives faced in this project, such as: (1) the optimal number of tests to…

The author began his education career committed to curriculum, not measurement. After years of using teacher-made and standardized tests as instructional afterthoughts, he recognized the superiority of criterion-referenced testing and the influence of high-stakes testing on instruction. He then became involved with developing such tests on a…

Attention is drawn to the dynamics of criterion-referenced test (CRT) construction in this report. How CRT's are developed at the Instructional Objectives Exchange is described through a series of three steps. The procedures pertain to the construction of "off the shelf" as well as "customized" tests. Step one, isolating the…

Argues that customized criterion-referenced tests produced for use by particular school systems are preferable to "off-the-shelf" criterion-referenced tests or standardized norm-referenced tests, and briefly discusses some of the problems related to developing effective customized criterion-referenced tests. (JG)

The use of the regression equation derived from the Anglo-American sample to predict grades of Mexican-American students resulted in overprediction. An examination of the standardized regression weights revealed a significant difference in the weight given to the Scholastic Aptitude Test Mathematics Score. (Author/BB)

A well-constructed criterion-referenced test has an unambiguous descriptive scheme, an adequate number of items, a sufficiently limited focus, reliability, validity, and comparative data. (Author/MLF)

Test specifications need to take a middle road so that they are not so general that instructional targeting is impossible and not so specific that only unitary assessment targets are fostered. Using illustrative sample items provides a good means of communicating the items eligible to be tested. (SLD)

Research partially supported by the UCLA Center for the Study of Evaluation of Instructional Programs.

Problems in constructing criterion referenced tests related to inadequate technical criteria, and guidelines for their solution are discussed. The need to select a well-defined domain of behaviors is emphasized as the key to test construction and to understanding students' test performance. Considerations must also be given to the most effective…