This paper presents a strategy for measuring cognitive gains in reading during the early school years. It is argued that accurate estimates of gain scores and their appropriate interpretation requires the use of adaptive tests with multiple criterion referenced points that mark learning milestones. It is further argued that two different measures…

Although the primary use of the speaking section of the Test of English as a Foreign Language™ Internet-based test (TOEFL® iBT Speaking test) is to inform admissions decisions at English medium universities, it may also be useful as an initial screening measure for international teaching assistants (ITAs). This study provides criterion-related…

These analyses suggest that if a criterion-referenced test had a reliability (defined in terms of internal consistency) below 0.5, a simple a priori procedure would provide better estimates of students' universe scores than would individual observed scores. (Author/LMO)

Standards-based score reports interpret test performance with reference to cut scores defining categories like "below basic," "proficient," or "master." This article first develops a conceptual framework for validity arguments supporting such interpretations, then presents three applications. Two of these serve to introduce new standard-setting…

Concern about passing those examinees who should pass, and retaining those who need remedial work, is one problem related to criterion-referenced testing. This paper deals with one aspect of that problem. When determining how many items to include on a criterion-referenced test, practitioners must resolve various non-statistical issues before a…

For the last 10 years, the Duval County School System (Jacksonville, Florida) has accumulated extensive student performance data with its district-wide criterion referenced testing program (the Essential Skills Test for K-6 students and the Minimum Level Skills Test for grades 7-12), which tests over 100,000 students yearly. The research project…

The use of the regression equation derived from the Anglo-American sample to predict grades of Mexican-American students resulted in overprediction. An examination of the standardized regression weights revealed a significant difference in the weight given to the Scholastic Aptitude Test Mathematics Score. (Author/BB)

Many problems in the areas of test interpretation and educational assessment are causing difficulties for educators. On one hand the public and legislators are requesting more state testing programs and assessment programs, while on the other, educators realize the problems concerning testing and test interpretation. Difficulties arise when tests…

An attempt toward the development of a criterion-referenced test as a joint project of the Puerto Rican Division of Evaluation and the Mathematics Program in the Department of Education is discussed. The approach used included the following steps: (1) clarification of objectives, (2) development of test items for each objective, (3) development of…

Describes an attempt to construct an ESL dictation test that would: (1) be appropriate for a wide range of ability, (2) be easy and fast to score, (3) consist of set items that would form both a unidimensional and cumulative scale, and (4) yield scores that would be directly interpretable with respect to specified levels of English proficiency.…

This study addressed what standard-setting panelists think about when they make item performance estimates for a barely proficient student. This study extended previous studies by considering the factors that influenced panelists' decisions in an Angoff (1971)-based standard-setting study as a function of their item performance estimates.…

A Monte Carlo approach is proposed, using the Statistical Analysis System (SAS) programming language, for estimating reliability coefficients in generalizability theory studies. Test scores are generated by a probabilistic model that considers the probability for a person with a given ability score to answer an item with a given difficulty…

The Georgia Criterion-referenced Tests are designed to measure a core group of essential basic skills at key points throughout the educational development of students. This monograph reports test results for grades one, four, eight, and ten. Results are presented by graphs and figures, with brief narrative summaries. Information is provided on:…

The Chicago Public Schools have been developing and implementing a citywide instructional program of continuous progress/mastery learning in reading. It includes the delineation of a K-8 continuum of instructional objectives; a criterion-referenced testing program which serves as the basis for instruction, promotion, and administrative monitoring;…

The relationship between classical discrimination indices (CDI) and criterion-referenced discrimination indices (CRDI) and the appropriateness of each for use on criterion-referenced tests are investigated. A CRDI is proposed that attempts to separate those who master material from those who do not master material. A 26 item multiple-choice…