As part of the Content Analysis Project, a panel of six experts in mathematics education examined the congruence between the Maryland grade-8 test and the National Assessment of Educational Progress (NAEP) test. Two panelists were very familiar with the Maryland School Performance Assessment Program (MSPAP), two with the NAEP, and the other two…

Three different applications of the testlet concept are presented, and the psychometric models most suitable for each application are described. Difficulties that testlets can help overcome include (1) context effects; (2) item ordering; and (3) content balancing. Implications for test construction are discussed. (SLD)

This review of the Peabody Individual Achievement Test--Revised (often used with learning-disabled students) notes the addition of a Written Expression subtest, replacement of most items to reflect current curricular content, and use of updated norms. The test also measures: general information, reading recognition, reading comprehension,…

Test specifications need to take a middle road so that they are not so general that instructional targeting is impossible and not so specific that only unitary assessment targets are fostered. Using illustrative sample items provides a good means of communicating the items eligible to be tested. (SLD)

The study described in this paper is part of an effort to improve understanding of the science assessment of the National Assessment of Educational Progress (NAEP). It involved the coding of all the items in the 1996 NAEP science assessments, which included 45 blocks (15 each for grades 4, 8, and 12) and over 500 items. Each of the approximately…

A method is presented for determining the content validity of a series of secondary school mathematics tests. These tests are part of the Mathematics Diagnostic Testing Project (MDTP), a collaborative effort by California university systems to develop placement examinations and a means to document student preparation in mathematics. Content…

CASAS, in cooperation with the CASAS National Consortium Policy Council, conducted a study to provide guidance to program and instructional staff regarding student readiness to take the GED Tests. The study looked at the relationship of CASAS reading and math scores to official 2002 GED test results from five states--California, Hawaii, Iowa,…

Assessing complex teaching performance in the National Board of Professional Teaching Standards (NBPTS) has caused the Educational Testing Service to wrestle with fundamental scoring issues that are both conceptual and technical. This report reviews the challenges encountered, how they are being addressed, and what the NBPTS effort has learned…

An expanded version of the method of content evaluation proposed by S. G. Sireci and K. F. Giesinger (1992) was evaluated with respect to a national licensure examination and a nationally standardized social studies achievement test. Two groups of 15 subject-matter experts rated the similarity and content relevance of the items. (SLD)

Brief, impromptu essays written for the 1990 administration of the College Board's English Composition Test (ECT) were randomly sampled for four groups of examinees. These essays were subjected to further holistic ratings beyond those conducted for the ECT, and analytical ratings were also obtained. The holistic scores were correlated with the…

Data from the College Board Validity Study Service show that the average multiple correlation of the Scholastic Aptitude Test (SAT) with college grades peaked in 1974 and then tended to decline. Data from other sources also estimate a small average decline from 1974 to 1985. This study documented changes in the SAT and related these changes to…

This paper discusses the design and pedagogy underpinning the use of online quiz items in which students are presented with a range of questions designed to enhance understanding of complex linguistic constructions. It explores the design of different types of quiz questions from the perspective of pedagogy and cognitive demand. The particular…

Results are presented from a study of portfolio use for large-scale assessment in the Pittsburgh (Pennsylvania) public schools that are more encouraging for the use of this form of assessment than many other studies have been. Requirements for the psychometric integrity of portfolio assessment are discussed. (SLD)

Examined 6 widely used grade-8 standardized tests for content, required processes, and level to determine their alignment with the 5-8 NCTM "Curriculum and Evaluation Standards." Concluded that these tests inadequately covered the 5-8 standards. A follow-up study examined items from newly developed and foreign tests to demonstrate the…

Preliminary data was gathered to guide subsequent research that will shape training procedures and scoring practice for performance assessment activities that integrate multiple content areas. Content area integration is a key feature of many of the tasks in the Maryland School Performance Assessment Program (MSPAP), a large-scale assessment of…