It is argued in this paper that generalizability theory provides a uniquely useful framework for defining and quantifying the dependability of data for decision making. It does so by requiring careful specification of the conditions of measurement and the anticipated sources of variation in the results of the measurement procedure. A distinction…

This manual outlines the rationale for using the Criterion Referenced Test (CRT) approach and suggests specific guidelines for test developers to use in constructing test items. Methods for assessing the adequacy of a CRT are also provided. (Author/RC)

Correlations between the Enrollee Test Battery (ETB) and performance on more conventional tests were examined to determine the ETB validity, in addition to a small-Scale study of predictive validity of both ETB and the conventional tests. Three types of paper and pencil measures were utilized: the ETB, conventional cognitive skills tests, and…

This report of the development and validation of a criterion-referenced examination for physician's assistants contains an overview of phase 1 project activities (1972-74) and more detailed description and data on phase 2 activities (1975-76). The overview describes the rationale for the development of the examination. (It was the first certifying…

This test manual presents information on the Brockport Physical Fitness Test (BPFT), a criterion-referenced fitness test for children and adolescents with disabilities. The first chapter of the test manual includes an introduction and target populations are identified, defined, and classified. The second chapter presents information on the…

Three expert panels reviewed the 1991 Maryland School Performance Assessment Program (MSPAP) reading test. This was the first year of an assessment program designed to measure school progress toward, among other content areas, three reading outcomes: reading for literary experience, reading to become informed, and reading to perform a task. The…

This first test and technical manual explains the development, purpose, use, validity, and reliability of the criterion-referenced final examination for the Chemistry of Hazardous Materials course of the National Fire Academy in Emmitsburg (Maryland). Because of possible diversity in the testing knowledge and background of readers, the manual…

The primary purpose of testing in early childhood is to identify children who may be at risk for learning problems so they may be placed in appropriate educational environments. Testing is popular because educators take at face value the claim by test developers that using standardized test instruments to classify, retain, or promote children is…

This paper examines some impacts of basic skills proficiency testing of teachers in Arizona. A discussion of some legal issues involved in teacher proficiency testing is presented. Specific cases are cited which illustrate the fact that the courts have ruled that testing must show "job-relatedness" and a "rational basis for…

Perspectives on testing and grading are considered; and strategies, reference materials, and sample test items are presented. Attention is directed to specific impacts of testing and grading on students and teachers, purposes of testing and grading, and common complaints of students and teachers. Extra activities proposed for the teacher include…

The materials presented were developed for use in a series of conferences on testing and instruction sponsored by the National Institute of Education, with the United States Office of Education, the UCLA Center for the Study of Evaluation, and a network of research and development agencies. They are intended for use by school practitioners and…

The technology of transforming sentences from prose instruction into test questions was examined by comparing two methods of selecting sentences (keyword vs. rare singleton), two types of question words (nouns vs. adjectives), and two foil construction methods (writer's choice vs. algorithmic). Four item writers created items using each…

The objective of this study was to show that standardized reading scores could be adequately estimated from scores on a criterion-referenced test in reading. This would reduce classroom test time, while, at the same time, provide the kinds of information teachers need to guide instruction, and the kinds of information administrators require for…

The report proposes to complete the validation and refinement of a new domain referenced testing technology designed to assess literal comprehension ability in students in grades 1-12. The domain referenced measures in this technology, along with other more traditional measures of reading comprehension, literal and non-literal, are subsequently…

Between July and November 1993, a cross-section of Australia's school- and workplace-based vocational education and training programs was studied to identify programs using innovative assessment strategies and materials. As innovative strategies/materials were identified, the study methodology was revised and a case study approach was adopted. The…