This instructional training package introduces practitioners to methods for developing, validating, using, and reporting criterion-referenced tests. It provides a comprehensive presentation of criterion-referenced testing technology. The package emphasizes the most recent substantive and technological advances in the field that are both important…

This document contains the following manuscripts: "Effects of Alternate Scoring Options on the Classification of Entering Freshmen Writing Competencies," by Edys Quellmalz and Eva Baker; "Implications of Learning Research for Designing Competency Based Assessment," by Edys Quellmalz; "Effects of Alternative Discourse and…

This article analyzes potential problems in using standardized achievement tests in early childhood education settings. The first problem discussed is whether the outcomes typically measured by standardized achievement tests are the outcomes about which early childhood educators are most concerned. Second, it is argued that a concern for test…

This paper highlights some special characteristics of criterion-referenced tests while comparing them with norm-referenced tests. Psychometric considerations involved in constructing a criterion-referenced test, including item analysis, reliability, and validity, are discussed, along with application of criterion-referenced testing to individual…

The corpus of descriptive terminology associated with achievement testing has expanded considerably in recent years, in large part due to the heightened interest in absolute and/or direct metrics for interpreting test performance plus the development of more rigorous strategies for specifying test content. Widely prevalent disagreement about…

This monograph documents the basis for selection of test items and health-related, criterion-referenced standards associated with the Brockport Physical Fitness Test (BPFT), a criterion-referenced fitness test for children and adolescents with disabilities. The manual is divided into separate chapters for the relevant components or sub-components…

Because of the importance of standardized test scores in current definitions of educational achievement, pressure to raise test scores has affected their accuracy. Examines the causes of two major sources of test score pollution and their impact on education. Discusses the ethical status of documented test-preparation activities. (CJS)

The scaling of a new assessment is a significant undertaking. The scaling of a new assessment designed as a multiple-level, criterion-referenced assessment is even more so. A Guttman approach to scaling was used with the Work Keys selected-response assessments, Reading for Information and Applied Mathematics. Assessments in development in the Work…

This booklet has been written to help persons interested in assessment of education and training programs in general and competency-based vocational education programs in particular. The following topics are covered in the individual sections: the meaning of the term "assessment"; the importance of assessment; curriculum models; percentages and…

Focusing on the use of the Metropolitan Achievement Test (MAT) with Project Follow Through evaluations, this report represents an extended discussion of the appropriateness of standardized tests for evaluation and policy research. First, the development of the MAT and its roots in the Army Alpha intelligence test are described in detail. The next…

The objectives of this booklet are to provide suggestions, procedures, and rules of thumb to aid the evaluator in using achievement tests in program evaluation. It also discusses some of the theories underlying the procedures for developing and selecting achievement tests and interpreting their results. Each of the six chapters offers advice on…

It is asserted in this paper that some standardized tests do not do a good job of what they claim to do, and for some testing purposes nonstandardized tests are more appropriate or efficient. Under present circumstances, group I.Q. tests should be abolished. They provide no useful information that cannot be gained from achievement tests. And what…

A study was conducted to review the concept of validity in the context of vocational education and training (VET) in Australia. The study included a review of literature, case studies, presentation of key findings, and recommendation of a tool to guide assessors. An eight-faceted approach to validity, based on Nitko, was developed, with each…

The concept of performance levels in criterion-referenced assessment is explored by applying the idea to different types of tests commonly used in schools, mastery tests (including diagnostic tests) and achievement tests. In mastery tests, a threshold performance standard must be established for each criterion. Attainment of this threshold…

A project was conducted to develop and validate criterion-referenced test items for the following vocational education programs: child care worker, machine shop, electronics, drafting, and automobile mechanics. For each of the programs, the following activities took place: a project coordinator was assigned, subject-area instructors and a test…