Scoring procedures for the constructed-response (CR) items in large-scale mixed-format educational assessments often involve checks for rater agreement or rater reliability. Although these analyses are important, researchers have documented rater effects that persist despite rater training and that are not always detected in rater agreement and…

When judging subject-specific aspects of students' texts, teachers should assess various characteristics, e.g., spelling and content, independently of one another since these characteristics are indicators of different skills. Independent judgments enable teachers to adapt their classroom instruction according to students' skills. It is still…

The Assessment Policy Committee of the National Assessment of Educational Progress (NAEP) has directed the NAEP staff to focus the 1985-86 Assessments of Reading, Mathematics, Science, and Computer Competence on the higher-order skills. Each Learning Area Committee worked independently developing three-dimensional models. These defined what could…

Five papers on the assessment of writing ability presented at the Division D meeting are critiqued. It is suggested that it is not possible to conclude--as has Larson in his study of grades 4, 6, and 8--that National Assessment of Educational Progress results do not give evidence of growth in writing ability. Dovell and Buhr, examining approaches…