How do scores from writing samples generated by computerized essay scorers compare to those generated by ''untrained'' human scorers and what combination of scores, if any, is more accurate at placing students in composition courses? This study endeavored to answer this two-part question by evaluating the correspondence between writing sample…

The development and scoring of a recently introduced computer-based writing skills test is described. The test asks the examinee to edit a writing passage presented on a computer screen. Scoring difficulties are addressed through the combined use of option weighting and the sequential probability ratio test. (SLD)

This article focuses on the assessment of writing abilities among master of social work students. The purposes and methods of writing assessment are explored, as well as the evaluation and reporting of results. The article also summarizes results from an assessment project conducted in 2003 of 129 MSW students' writing skill. Among the findings…

Research into the technical adequacy of statewide alternate assessments is limited. In this study, the authors analyzed 2 years of data from one state's alternate assessment in written language in an attempt to validate current test score interpretations. More than 1,000 students were included in each year. Findings support the test's technical…

This report examines the feasibility of scoring essays using computer-based techniques. Essays have been incorporated into many of the standardized testing programs. Issues of validity and reliability must be addressed to deploy automated approaches to scoring fully. Two approaches that have been used to classify documents, surface- and word-based…

This study investigated the practice of weighting a type of test item, such as constructed response, more than other types of items, such as selected response, to compute student scores for a mixed-item type of test. The study used data from statewide writing field tests in grades 3, 5, and 8 and considered two contexts, that in which a single…

Comments on the Analytical Writing Assessment (AWA), a new component of the Graduate Management Admissions Test (GMAT). Examines the AWA's historical significance and addresses questions regarding the relevance of the writing test for management education. Finds that the AWA is of limited value as a writing assessment and will meet only some of…

The Colorado Process Analysis of the Written Language of Hearing-Impaired Children assesses the semantic characteristics of expressive written language narratives prepared by beginning writers. The validity of the instrument was examined with 284 children (ages 7-21), indicating that the model does identify characteristics that are critical to the…

This article describes the development and evaluation of a five-item writing assessment for persons with age-related vision loss. It provides a standard for measuring the baseline ability and the effectiveness of interventions to improve the writing ability of this population.

Unstable, and potentially invalid, variance component estimates may result from using only a limited portion of available data from operational performance assessments. However, missing observations are common in these settings because of the nature of the assessment design. This paper describes a procedure for overcoming the computational and…

Analyzes the Analytical Writing Assessment's (AWA) contribution as a performance assessment. Critiques its potential usefulness as a diagnostic tool for management education. Concludes that the AWA does not meet the expectations of GMAT-user schools who endorsed the test as a diagnostic instrument for identifying student deficiencies. States that…

A study was conducted to investigate the stability of rater severity over an extended rating period. Multifaceted Rasch analysis was applied to ratings of writing performances of 8,285 primary school (elementary) students. Each performance was rated on two performance dimensions by two trained raters over a period of 7 rating days. Performances…

This report compares students' scores on the 2000 Delaware Student Testing Program (DSTP) writing assessment with the writing scores of their counterparts in 1998 and 1999. In addition, the results of a writing study are discussed briefly. Delaware students in grades 3, 5, 8, and 10 took the 2000 DSTP writing assessment, responding to a text-based…

Describes procedures for calculating conditional standard error of measurement (CSEM) and reliability of scale scores and classification of consistency of performance levels. Applied these procedures to data from the American College Testing Program's Work Keys Writing Assessment with sample sizes of 7,097, 1,035, and 1,793. Results show that the…

Children with specific language impairment (SLI) have associated difficulties in reading decoding and reading comprehension. To date, few research studies have examined the children's written language. The aim of the present study was to (a) evaluate the nature and extent of the children's difficulties with writing and (b) investigate the…