This study examined the reliability of scores assigned to the essays written by Kentucky students to meet the University Writing Requirement (UWR) at Eastern Kentucky University. Two sets of essays, 50 each, on the same prompt that had been read and scored in 1989 and 1997 by trained UWR scorers were read by 7 UWR scorers in 2000. A correlation…

Unstable, and potentially invalid, variance component estimates may result from using only a limited portion of available data from operational performance assessments. However, missing observations are common in these settings because of the nature of the assessment design. This paper describes a procedure for overcoming the computational and…

Beginning in 1999, an analytical writing measure was offered as an optional test in the Graduate Record Examinations (GRE) program. This test will be incorporated into the GRE General Test in fall 2002. The essays in this test focus on critical reasoning and analytical writing skills. This study examined the performance of various examinee groups…

A study compared the effects of retesting (with and without the benefit of short term instruction) on the scores of subjects in an upper-division university who had failed a writing test. Subjects who did not receive a passing score in their first attempt at the essay test were given the opportunity of attending a 4-hour workshop designed to…

This study demonstrates the advantages of using a constrained optimization algorithm to explore the optimal number of prompts, modes of discourse, and raters for achieving an acceptable level of reliability during a direct writing assessment. Writing samples elicited from 50 college students were rated by 3 graduate students and the scores…

A study examined the differences in the essay exam scores of college students who did no planning, some planning, or extensive planning before writing answers to questions on essay exams. Subjects, 100 undergraduate education students enrolled in reading methods classes and 37 graduate reading students enrolled in a psychology of reading class,…

A study examined the responses of 10 students taking Miami University's 1990 College Composition Proficiency Exam which asked students to evaluate their own learning experiences with teaching, learning, and knowledge in and out of school. Scores ranged from 2 to 12; all 10 of the examined essays received a score of 11. Five students were male, and…

A substantially revised Medical College Admission Test (MCAT) was introduced in spring 1991. The new examination is designed to assess critical thinking skills, basic concepts and problem solving facility in science, and writing skills. This paper reports preliminary findings on the factor structure of the revised MCAT, which consists of four…