ERIC Number: EJ876566
Record Type: Journal
Publication Date: 2010
Pages: 30
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0741-0883
EISSN: N/A
Linguistic Features of Writing Quality
McNamara, Danielle S.; Crossley, Scott A.; McCarthy, Philip M.
Written Communication, v27 n1 p57-86 2010
In this study, a corpus of expert-graded essays, based on a standardized scoring rubric, is computationally evaluated so as to distinguish the differences between those essays that were rated as high and those rated as low. The automated tool, Coh-Metrix, is used to examine the degree to which high- and low-proficiency essays can be predicted by linguistic indices of "cohesion" (i.e., coreference and connectives), "syntactic complexity" (e.g., number of words before the main verb, sentence structure overlap), the "diversity of words" used by the writer, and "characteristics of words" (e.g., frequency, concreteness, imagability). The three most predictive indices of essay quality in this study were syntactic complexity (as measured by number of words before the main verb), lexical diversity (as measured by the Measure of Textual Lexical Diversity), and word frequency (as measured by Celex, logarithm for all words). Using 26 validated indices of cohesion from Coh-Metrix, none showed differences between high- and low-proficiency essays and no indices of cohesion correlated with essay ratings. These results indicate that the textual features that characterize good student writing are not aligned with those features that facilitate reading comprehension. Rather, essays judged to be of higher quality were more likely to contain linguistic features associated with text difficulty and sophisticated language. (Contains 7 tables, 1 figure, and 4 notes.)
Descriptors: Essays, Undergraduate Students, Educational Quality, Computational Linguistics, Word Frequency, Connected Discourse, Computer Software, Difficulty Level, Sentence Structure, Verbs, Vocabulary, Scoring Rubrics, Reading Comprehension
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://bibliotheek.ehb.be:2814
Publication Type: Journal Articles; Reports - Evaluative
Education Level: Higher Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
IES Funded: Yes
Grant or Contract Numbers: R305A080589