The literature on criterion referenced testing is full of discussions concerning whether classical measurement techniques are appropriate, whether variance is necessary, whether new indices of reliability are needed, and the like. What appears to be lacking, however, is a clear and simple discussion of why the problems occur. This paper suggests…

In this paper, an attempt has been made to synthesize some of the current thinking in the area of criterion-referenced testing as well as to provide the beginning of an integration of theory and method for such testing. Since criterion-referenced testing is viewed from a decision-theoretic point of view, approaches to reliability and validity…

This article presents views of proponents and opponents to standardized tests, isolates the major weakness of testing--questionable validity--and offers several recommendations for the betterment of test development and use. Some major misuses of tests include the following: (a) tests are at times administered with no clear purpose; (b) test…

The assumptions of the classical test-theory model are used to develop a theory of reliability for criterion-referenced measures which parallels that for norm-referenced measures. It is shown that the Spearman-Brown formula holds for criterion-referenced measures and that the criterion-referenced reliability coefficient can be used to correct…

This study was designed to develop and standardize parallel forms of a criterion-referenced test for measuring the proficiency of undergraduate college students in the application of syllabication skills. Twenty-seven classes in 14 colleges and universities participated in the final standardization of the tests. Analysis of results indicated that…

Using norm-referenced reading achievement tests as both "criterion referenced" (through repeated administration of the same form at successively higher grade levels) and as norm-referenced (in the usual manner) helps to differentiate individual changes in learning how to read as well as individual differences in gaining information from textual…

Since competency-based instruction is based on the testing process, this study suggests that careful attention to the construction of tests can produce a reliable, valid measure. The next steps to be taken include developing larger banks of test items, increasingly accurate tests, and instruction to meet specified objectives of the curriculum.…

Outlines a six-step process which can be used by faculty teams to assess the validity of criterion-referenced tests. Steps include: comparing test items with course objectives, assessing the test in terms of the domains and levels of Bloom's Taxonomy, and examining the appropriateness of various types of test questions. (JP)

A general issue related to language program development involves the empirical rationalization of cut score decisions in criterion-referenced language tests. Cut score dependability focuses on the consistency of the decisions in repeated testing or the assessment of language learner performances. In this case, the issue is to determine the optimal…

The Assessment Resource Center (ARC) at Florida State University provides computer assisted testing (CAT) for approximately 4,000 students each term. Computer capabilities permit a small proctoring staff to administer tests simultaneously to large numbers of students. Programs provide immediate feedback for students and generate a variety of…

The purposes of this study were to examine the reliability and validity of a basal reading series mastery test, and to explore the appropriateness and usefulness of two strategies for investigating the reliability and validity of criterion-referenced tests. Subjects were 47 sixth graders, who were tested on the SRA Reading Achievement Test, the…

The purpose of this study was to examine the reliability and validity of a basal reading series mastery test. Subjects were 47 fifth graders, who were tested on the SRA Reading Achievement Test, the Ginn 720 End-of-level 11 Mastery Test (MT), and the Word Reading Test. A subgroup of 22 children was tested a second time on the MT. Traditional…

The purpose of this study was to examine the reliability and validity of a basal reading series mastery test. Subjects were 25 fourth graders, who were tested once on the SRA Reading Achievement Test, twice on the Scott-Foresman End-of-Book 9 Criterion-referenced Test (CRT), and once on the Word Reading Test. Traditional psychometric correlational…

The purpose of this study was to examine the reliability and validity of a basal reading series mastery test. Subjects were 21 fourth graders, who were tested once on the SRA Reading Achievement Test, twice on the Holt Basic Reading Series Management Program Level 13 Test (MPLT), and once on the Word Reading Test. Traditional psychometric…

This document is a training module designed to familiarize practicing school psychologists and school psychology students with the field of criterion-referenced measurement and recent developments within the field. The introduction gives reasons for the need for criterion-referenced testing as opposed to norm-referenced tests which include legal…