ERIC Number: EJ1454508
Record Type: Journal
Publication Date: 2024
Pages: 19
Abstractor: As Provided
ISBN: N/A
ISSN: N/A
EISSN: EISSN-2621-6485
OpenAI ChatGPT vs Google Gemini: A Study of AI Chatbots' Writing Quality Evaluation and Plagiarism Checking
English Language Teaching Educational Journal, v7 n2 p90-108 2024
This study explores the writing quality of two AI chatbots, OpenAI ChatGPT and Google Gemini. The research assesses the quality of the generated texts based on five essay models using the T.E.R.A. software, focusing on ease of understanding, readability, and reading levels using the Flesch-Kincaid formula. Thirty essays were generated, 15 from each chatbot, and evaluated for plagiarism using two free detection tools -- SmallSEOTools and Check-Plagiarism -- as well as one paid tool, Turnitin. The findings revealed that both ChatGPT and Gemini performed well in terms of word concreteness but demonstrated weaknesses in narrativity. ChatGPT showed stronger performance in referential and deep cohesion, while Gemini excelled in narrativity, syntactic simplicity and word concreteness. However, a significant concern was the degree of plagiarism detected in texts from both AI tools, with ChatGPT's essays exhibiting a higher likelihood of plagiarism compared to Gemini's. These findings highlight the potential limitations and risks associated with using AI-generated writing.
Descriptors: Plagiarism, Artificial Intelligence, Computer Software, Essays, Writing Evaluation, Risk, Correlation, Comparative Analysis, Readability, Readability Formulas, Identification, Connected Discourse
Universitas Ahmad Dahlan. Kampus 4 UAD, Jl. Ringroad Selatan, Tamanan, Bantul Yogyakarta, 55166 Indonesia. e-mail: eltej@pbi.uad.ac.id; Web site: http://journal2.uad.ac.id/index.php/eltej/index
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Assessments and Surveys: Flesch Kincaid Grade Level Formula
Grant or Contract Numbers: N/A