Value-added models help to evaluate the knowledge that school districts, schools, and teachers add to student learning as students progress through school. In this article, the well-known Education Value-Added Assessment System (EVAAS) is examined. The author presents a practical investigation of the methodological issues associated with the…

The Maryland State Department of Education issued a request for proposals to develop a score reporting system for the Maryland Functional Testing Program. RMC Research Corporation conducted a literature review of extant literature and developed a national survey of non-norm-referenced test score reporting practices. This comprehensive analysis of…

The development of a test design methodology used to construct a criterion-referenced System Achievement Test (CR-SAT) for selected Naval enlisted classification (NEC) in the Strategic Weapon System (SWS) of the United States Navy is described. Subject matter experts, training data analysts and educational specialists developed a comprehensive…

Standards, passing scores, or cut scores have been seen as an element of criterion-referenced tests since their introduction. This paper discusses at least two issues surrounding the establishment of cut scores which appear to need clarification: (1) the theoretical definition of a cut score; and (2) decisions which must be made in selecting a…

This paper presents an introduction to the use of latent trait models for the estimation of domain scores. It was shown that these models provided an advantage over classical test theory and binomial error models in that unbiased estimates of true domain scores could be obtained even when items were not randomly selected from a universe of items.…

Four discrimination indices were compared, using score distributions which were normal, bimodal, and negatively skewed. The score distributions were systematically varied to represent the common circumstances of a military training situation using criterion-referenced mastery tests. Three 20-item tests were administered to 110 simulated subjects.…

This report evaluates an "effective schools" intervention project, the purpose of which was to improve achievement on proficiency tests in selected Knoxville City Schools (KCS). Six target schools, predominantly serving Knoxville's impoverished areas as identified by Chapter I and census data, were selected to work toward improving…

This study explores the use of the modified caution index (MCI) for identifying judges whose patterns of recommendations suggest that their judgments might be based on incomplete information, flawed reasoning, or inattention to their standard-setting tasks. It also examines the effect on test standards and passing rates when the test standards of…

In 1983 the Maryland State Department of Public Education (MSDE) issued a request for proposals for "The Development of the Score Reporting System for the Maryland Functional Testing Program." The MSDE called for a literature review, a national survey, a statewide survey of user needs and capabilities, an assessment of the state's report…

The results of different types of reading achievement measures were compared for 58 low-income urban black third graders. Two formal tests were administered: the norm-referenced California Achievement Tests (CAT), and the criterion-referenced Alabama Basic Competency Test (ABCT). Informal measures included the Houghton-Mifflin Informal Reading…