A good criterion-referenced test item is defined as the one which allows the individual to answer correctly if he masters the criterion behavior represented by the item and answer incorrectly if he actually does not master it. Therefore, a good discriminating item for criterion-referenced tests is the one which has a larger proportion of correct…

A decision model designed to determine the reliability and validity of criterion referenced measures (CRMs) is presented. General procedures which pertain to the model are discussed as to: Measures of relationship, Reliability, Validity (content, criterion-oriented, and construct validation), and Item Analysis. The decision model is presented in…

Describes a technique for measuring reliability (the consistency of decision making across repeated test administrations) and validity (the accuracy of decision making between administration of a reading test and administration of a criterion measure) and gives an example of its use. (JM)

The characteristics of three threshold loss agreement indices which reflect the agreement or consistency in assignment to mastery-nonmastery status are reviewed. These are proportion of agreement, coefficient kappa, and modified kappa. (Author/MT)

Twenty-two handicapped and 10 nonhandicapped young children were administered the Evaluation and Programing System Level 1 (EPS-1), a measure designed to provide information to develop educational programs and assess program effectiveness. The article notes reliability, validity, and utility data. (Author/CL)

The 10 criticisms of criterion-referenced tests addressed in this paper are: the domains tested; pedagogical influence; difficulty of items; cumbersome reports; reliability; arbitrary criteria; local objectives; labeling; predictive validity; and repeated testing. (SJL)

The fundamental Reading Competencies Test assesses proficiency with respect to well-defined functional reading skills of high school students. Validity and reliability data for the test are presented. (Author/JKS)

A dozen different approaches that yield 13 reliability indices for criterion-referenced tests were identified and grouped into three categories: threshold loss function, squared-error loss function, and domain score estimation. Indices were evaluated within each category. (Author/RL)

The article focuses on the controversy over norm-referenced v criterion-referenced measures (CRM) in assessment of learning disorders. The authors contend that while the reliability of CRMs is generally indisputable, the validity of measures designed from local curricula is still dependent on the intuitive judgments of teachers. (Author/SBH)

A Monte Carlo approach is proposed, using the Statistical Analysis System (SAS) programming language, for estimating reliability coefficients in generalizability theory studies. Test scores are generated by a probabilistic model that considers the probability for a person with a given ability score to answer an item with a given difficulty…

The Mat-Sea-Cal Oral Proficiency Tests are a series of comparable grammatical structure tests. They have been developed in six languages: English, Spanish, Cantonese, Mandarin, Ilokano and Tagalog. Their purpose is to identify linguistic skills and deficiencies of primary school children grades K through 4. This research reported on the…

The paper presents 12 steps in developing and validating criterion referenced tests (CRTs). The author emphasizes the need to closely examine the test's stated purpose and trace the test through the 12 steps in order to find CRTs that are useful rather than useless. Examples are given for each step: preparing or selecting objectives; developing…

Intended to help educators select diagnostic and criterion referenced reading tests for their specific purposes, this book contains reviews of nine individual and three group tests. The reviewed tests were selected for their "importance" from a list of 34 and were reviewed by experts according to their descriptions of content, test development,…

The purpose of this study was to validate the Prescriptive Instructional Program for Educational Readiness (PIPER) for utilization as a criterion referenced test (CRT) among learning disabled children. The program consisted of behavioral objectives and diagnostic and/or mastery tasks and activities for each objective in the area of gross motor…

In determining how reliable is reliable enough and how much error can be tolerated in criterion-referenced testing, the following relationships hold: (1) the more specific an objective is, the fewer the items required to reliably measure it; (2) the more specific the objectives are, the more objectives required to cover a given span of the…