Rajaratnam, Cronbach and Gleser's generalizability formula for stratified-parallel tests and Raju's coefficient beta are generalized to estimate the reliability of a composite of criterion-referenced tests, where the parts have different cutting scores. (Author/GK)

Thirty states which administer criterion-referenced tests to students with visual impairments were surveyed to determine types of accommodations they allowed in their testing programs. The survey addressed aspects of the test setting, test scheduling, test directions, test format, answer mode, and mechanical and nonmechanical aids. (Author/JDD)

Rescoring of Center for Occupational and Professional Assessment objective-referenced tests is decided largely by content experts selected by client organizations. A few of the test items, statistically flagged for review, are not rescored. Some of this incongruence could be due to the use of the biserial correlation (r-biserial) as an…

Examination of the implementation of General National Vocational Qualifications in Britain highlights the limitations of criterion-referenced assessment practices. Analysis leads to the establishment of assessment principles: (1) continuous assessment should allow for learner development; (2) better ways of assessing "soft" skills are…

The educational implications of criterion-referenced tests are demonstrated. It is the hypothesis of the author that criterion-referenced tests have little educational impact unless carefully constructed around rigorous domain specifications. The paper details the process and problems of construction of a series of history tests presently being…

These four characteristics inherent in criterion-referenced tests form the central theme of this paper: (1) The classes of behaviors that define different achievement levels are specified as clearly as possible before the test is constructed; (2) Each behavior class is defined by a set of test situations (that is, test tasks) in which the…

The purpose of this study was to validate the Prescriptive Instructional Program for Educational Readiness (PIPER) for utilization as a criterion referenced test (CRT) among learning disabled children. The program consisted of behavioral objectives and diagnostic and/or mastery tasks and activities for each objective in the area of gross motor…

Cautions that criterion referenced tests are no more effective at diagnosing comprehension subskills than are traditional instruments, and they may lend false credibility to the subskill approach to comprehension. (AEA)

Using criterion-referenced test item data collected in an empirical study, differences in item selection between Cox and Vargas' pretest-posttest validity index and a latent trait approach (evaluation of the item information function for the mastery score) are analyzed. (Author/GK)

A problem of considerable importance in certain educational settings is determining how many items to include on a mastery test. Applying ranking and selection procedures, a solution is given which includes as a special case all existing single-stage, non-Bayesian solutions based on a strong true-score model. (Author/JKS)

Forty-six tests from the Kit of Factor-Referenced Cognitive Tests, published by the Educational Testing Service, were used in an investigation of the factor structure of the Armed Services Vocational Aptitude Battery. The overall kit contains 72 fairly short tests that have been developed to serve as markers for 23 factors that appear in the…

A review of current theory and research related to writing ability leads to the conclusion that there is no existing test, instrument, or set of procedures which will provide valid data regarding the writing abilities of individuals. As an alternative approach, a textual cognition model of written communicative competence is proposed and…

The scoring scheme of the National Assessment of Educational Progress (NAEP) is studied, as well as techniques for estimating its reliability. NAEP data are collected on students of age 13 in the fall, age 9 in the winter, and age 17 in the spring. The scoring task, involving hand scoring of open-ended items, may vary between 25,000 responses to…

Because criterion referenced measurement is a relatively new approach to testing, systematic guidelines for constructing criterion referenced tests (CRTs) have not yet been developed. A number of questions and issues face the test developer who wishes to provide a test that will be helpful in a particular decision-making situation. There are three…

This report represents the results of an investigation of the appropriateness of criterion-referenced tests (CRTS) for large-scale evaluations. First, the development and validation of CRTS, including the formulation and generation of CRT objectives, items, and score-interpretation schemes and dimensions of item and test quality, were examined to…