NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ693619
Record Type: Journal
Publication Date: 2005-Jan
Pages: 30
Abstractor: Author
ISBN: N/A
ISSN: ISSN-0265-5322
EISSN: N/A
Generalizability of Writing Scores: An Application of Structural Equation Modeling
Schoonen, Rob
Language Testing, v22 n1 p1-30 Jan 2005
The assessment of writing ability is notoriously difficult. Different facets of the assessment seem to influence its outcome. Besides the writer's writing proficiency, the topic of the assignment, the features or traits scored (e.g., content or language use) and even the way in which these traits are scored (e.g., holistically or analytically) may contribute to the writer's score. In this article, the effect of these facets is estimated in a generalizability study using variance analytic techniques. A structural equation modeling (SEM) approach is used to estimate the variance components in the writing scores. Eighty-nine grade 6 students (aged 11- 12 years) wrote four essays, each of which was scored by five raters using two scoring methods (i.e., holistically and analytically) for two traits (i.e., Content and Organization, and Language Use). Analyses of these ratings showed that the generalizability of writing scores and the effects of raters and topics are very much dependent on the way the essays are scored and the trait that is scored. The overall picture is that writing tasks contribute more to the score variance than raters do.
Hodder Arnold Journals, Turpin-Distribution, Stratton Business Park, Pegasus Drive, Biggleswade, Bedfordshire SG18 8QB UK. Tel: +44 (0)1767 604951; Fax: +44 (0)1767 601640; e-mail: subscriptions@turpin-distribution.com.
Publication Type: Journal Articles; Reports - Evaluative
Education Level: Grade 6
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A