This study was conducted to determine whether the writing skills, as measured by the University Writing Requirement (UWR), of Kentucky high school graduates who had participated in Kentucky's Commonwealth Accountability Testing System (CATS) writing portfolios had improved in comparison with their peers in the past who had not done the writing…

The purpose of this study was to examine rater, domain, and gender influences on the assessed quality of student writing using weighted and unweighted scores. Twenty rates were randomly selected from a group of 87 operational raters contracted to rate essays as part of the 1993 field test of the Georgia High School Writing Test. All of the raters…

The purpose of this study was to describe the Rasch model for measurement and apply the model to examine the relationship between raters, domains of written compositions, and student writing ability. Twenty raters were randomly selected from a group of 87 operational raters contracted to rate essays as part of the 1993 field test of the Georgia…

Setting performance standards on constructed-response assessments involving polytomously scored exercises presents a challenge for measurement practitioners. Some standard setting methods designed for use with multiple-choice, dichotomously scored assessments entail aggregating item performance estimates across a panel of experts. For these items,…

A study examined the expectations of incoming University of Tennessee at Chattanooga freshmen about an hour-long placement essay. Subjects, 96 randomly chosen students, responded to a series of 5 questions concerning what an essay is, what kinds of writing they had done, how they feel about writing tests, what topics they had written about in…

The Work Keys (trademark) system of the American College Testing program has combined assessments of listening and writing into a single test administration. The Listening and Writing assessment uses independent scorings of the examinee's written responses to audiotaped prompts to assess both listening and writing skills separately. This paper…

The results of a small research project that studied the effect computer administration has on student performance for writing or essay tests are presented. The introduction of computer-administered tests has raised concern about the equivalence of scores generated by computer versus paper-and-pencil test versions. For this study a sample of…

The effects of presenting a choice of writing tasks on the quality of essays produced by eleventh graders were studied with 34,200 students in Georgia. The choice condition had no substantive effect on the quality of essays, but race, gender, and the writing task variable did. (SLD)

This paper presents and evaluates a new procedure to classify examinees into meaningful categories based on their responses to (performance on) items comprising a test instrument. The proposed procedure uses the data analytic technique of cluster analysis to partition the examinee population into homogeneous groupings. This procedure was applied…

A study examined Maryland high school teachers' attitudes toward specific individual characteristics of the Maryland Writing Test as well as their overall attitudes toward the test. Subjects, 538 English/language arts, mathematics, science, and social studies teachers in Maryland's 176 public high schools, responded to a survey designed to elicit…

The writing assessment used in grade 10 of the Cherry Creek, (Colorado) schools is described. Over the past 3 years, the focus of the assessment has changed from an assessment heavily weighted on multiple-choice items, with minimal constructed response tasks, to an assessment based entirely on a written product. Students are provided with multiple…

In the Dutch Educational Assessment Program, the students' language proficiency is measured in grade 9, at age 15. Writing performance is measured through several performance-based writing tasks, rated on numerous aspects such as content, style, organization, punctuation, spelling and grammar. As a consequence, national performance levels are…

The scaling of a new assessment is a significant undertaking. The scaling of a new assessment designed as a multiple-level, criterion-referenced assessment is even more so. A Guttman approach to scaling was used with the Work Keys selected-response assessments, Reading for Information and Applied Mathematics. Assessments in development in the Work…

Changes to the Scholastic Aptitude Test (SAT) that will be introduced in the 1993-94 academic year are reviewed, with attention to edumetric factors such as relationship of curriculum and instructional practice to test design and the impact of the changes. The new SAT will put increased emphasis on critical reading skills to reflect developments…