Causes of local item dependence in a large-scale performance assessment were studied using data from the Maryland School Performance Assessment Program. Contextual characteristics (content and response requirements) were identified to differentiate locally independent and dependent item clusters. Hypothesized explanations are offered for high…

Gender differences on the National Education Longitudinal Study of 1988 science tests were explored through statistical analyses and interviews with 25 high school students. Results show the importance of studying the validity of the outcome measure and suggest that conclusions about group differences and correlates of achievement depend on the…

This study is the National Board of Medical Examiners exploration of content-based techniques (standard-setting techniques in which pass/fail decisions are based upon the performance of examinees in relation to test content). Two content-based techniques (Angoff and Ebel) and three methods of evaluating examinee performance were studied. (MLW)

Studied whether student scores on standardized tests represent reasonable measures of instructional quality using ratings by 10 parents and 11 educators (school principals) of the degree to which test items from a nationally marketed standardized achievement test represent the content actually taught. On average, raters felt that test items…

An expanded version of the method of content evaluation proposed by S. G. Sireci and K. F. Giesinger (1992) was evaluated with respect to a national licensure examination and a nationally standardized social studies achievement test. Two groups of 15 subject-matter experts rated the similarity and content relevance of the items. (SLD)

This study attempted to establish the validity of an essay test of clinical judgment by defining the domain of clinical judgment and operationalizing this definition in a 12-item essay examination administered to 98 residents in internal medicine. The relationship between essay scores and other measures of competence was then examined and the…

A meta-analysis was conducted of 107 classroom and laboratory studies concerning the effects of expecting a recall, recognition, essay, multiple-choice, or true-false test on students' subsequent achievement. Laboratory studies did not generalize well to classrooms. In classroom studies, subjects performed better when they knew which test type to…

Increasing emphasis on assessment and concern about assessment techniques have stirred interest in alternative assessment forms, for which evidence is needed about consequences, transfer of performance on specific assessment tests, and assessment fairness. Criteria concerning consequences, fairness, transfer-generalizability, cognitive complexity,…

Investigates the relationship between Chapter 1 and regular classroom teachers' estimates of test content coverage (opportunity to learn) and mathematics achievement of 89 fourth graders (65% were African American and 35% were white) in Chapter 1 mathematics instruction. Results indicate the importance of measuring students' opportunity to learn…