NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
Peer reviewed Peer reviewed
PDF on ERIC Download full text
ERIC Number: EJ1413432
Record Type: Journal
Publication Date: 2023
Pages: 16
Abstractor: As Provided
ISBN: N/A
ISSN: N/A
EISSN: EISSN-1814-0556
Student-Written versus ChatGPT-Generated Discursive Essays: A Comparative Coh-Metrix Analysis of Lexical Diversity, Syntactic Complexity, and Referential Cohesion
Tlatso Nkhobo; Chaka Chaka
International Journal of Education and Development using Information and Communication Technology, v19 n3 p69-84 2023
This article reports on a comparative analysis of two sets of essays, student-discursive essays (SDEs) and ChatGPT-generated discursive essays (ChatGPT-GDEs) on the same essay topic using Coh-Metrix. It focused on three Coh-Metrix indices, lexical density, syntactic complexity, and referential cohesion as the basis for the comparative analysis. The authors also conducted a t test on the Coh-Metrix results, especially the mean scores, in relation to these three linguistic indices. Using convenience sampling, the study selected seven SDEs from the essays that were submitted as part of an assignment for an English Studies module in the second semester of 2020 at the University of South Africa. ChatGPT was prompted with the same essay topic that had been used for the SDEs. Overall, at raw mean score levels, the SDEs outperformed ChatGPT-GDEs in lexical density and referential cohesion, while ChatGPT-GDEs did so in syntactic complexity. Nonetheless, at a t test level, there was no statistically significant difference between the mean scores of the two essay sets in relation to the three Coh-Metrix linguistic indices investigated in this study.
International Journal of Education and Development using Information and Communication Technology. University of the West Indies Open Campus, Cavehill, Bridgetown, Barbados, BB11000, West Indies. e-mail: chiefeditor-ijedict@open.uwi.edu; Web site: http://ijedict.dec.uwi.edu/
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: South Africa
Grant or Contract Numbers: N/A