Describes two types of criterion-referenced testing that districts can use to measure achievement outcomes of their instructional programs: a random sampling assessment plan and an item-response theory assessment plan. (Author/JM)

The fundamental Reading Competencies Test assesses proficiency with respect to well-defined functional reading skills of high school students. Validity and reliability data for the test are presented. (Author/JKS)

The article focuses on the controversy over norm-referenced v criterion-referenced measures (CRM) in assessment of learning disorders. The authors contend that while the reliability of CRMs is generally indisputable, the validity of measures designed from local curricula is still dependent on the intuitive judgments of teachers. (Author/SBH)

In September 2005 the National Foundation for Educational Research (NFER) in association with the Department for Education and Skills (DfES), the Sutton Trust and the College Board, began a five-year research study to examine the validity of an aptitude test in higher education admissions. This report describes and explores the relationships…

Data from research studies seem to support the validity of teacher judgments of student achievement; however, there are unresolved issues, including the focus of the judgment, the external validity or credibility of the assessment, and the process of the assessment itself. To achieve maximum benefits from this form of assessment/teaching…

The paper presents 12 steps in developing and validating criterion referenced tests (CRTs). The author emphasizes the need to closely examine the test's stated purpose and trace the test through the 12 steps in order to find CRTs that are useful rather than useless. Examples are given for each step: preparing or selecting objectives; developing…

Three kinds of classificatory decisions that might be made using criterion-referenced tests (CRTs) are described, and methods to appraise the validity of each are subsequently discussed. Decisions that entail predictive, descriptive, and evaluative classifications comprised the three kinds of decisions described. Predictive classifications entail…

Intended to help educators select diagnostic and criterion referenced reading tests for their specific purposes, this book contains reviews of nine individual and three group tests. The reviewed tests were selected for their "importance" from a list of 34 and were reviewed by experts according to their descriptions of content, test development,…

Basic issues in criterion-referenced measurement are addressed. In section II, issues involved in determining what a person does and can do are considered. A preliminary analysis of "can" is given which shows that there are several important senses of "can". In section III, results of an analysis of "ability" are…

The purpose of this study was to validate the Prescriptive Instructional Program for Educational Readiness (PIPER) for utilization as a criterion referenced test (CRT) among learning disabled children. The program consisted of behavioral objectives and diagnostic and/or mastery tasks and activities for each objective in the area of gross motor…

This paper was presented with other papers in a forum dealing with statewide testing programs. The primary purpose of the paper is to address practical considerations and methods of resolution for large districts or states who are planning on conducting large scale testing or assessment programs with criterion or performance referenced measures.…

Essential for an effective criterion-referenced testing program is a set of test items that are "valid" indicators of the objectives they have been designed to measure. Unfortunately, the complex matter of assessing item validity has received only limited attention from educational measurement specialists. One promising approach to the item…

Investigated were the effects of two levels of penalty for incorrect responses on two dependent variables (a measure of risk-taking or confidence, based on nonsense items, and the number of response-attempts to legitimate items) for three treatment groups in a 2x3, multi-response repeated measures, multivariate ANOVA (Analysis of Variance) design.…

New strategies for evaluation criterion referenced measures (CRM) are discussed. These strategies examine the following issues: (1) the use of normed referenced measures (NRM) as CRM and then estimating the reliability and validity of such measures in terms of variance from an arbitrarily specified criterion score, (2) estimation of the…

A well-constructed criterion-referenced test has an unambiguous descriptive scheme, an adequate number of items, a sufficiently limited focus, reliability, validity, and comparative data. (Author/MLF)