ERIC Number: EJ1422074
Record Type: Journal
Publication Date: 2024
Pages: 17
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-2643-7996
EISSN: EISSN-2643-8003
ChatGPT Is Powerful, but Does It Have Power Distance? A Study of Culturally Imbued Discourse in AI-Generated Essays
International Journal of Adult Education and Technology, v15 n1 2024
Power distance (PD), a cultural value denoting acceptance of asymmetrical power relationships, influences the force of rhetoric used by a writer to address their reader. However, AI technologies such as ChatGPT lack an explicit awareness of PD, which could affect the quality of AI-generated persuasive texts used for language learning. To investigate this issue, 200 persuasive essays written by ChatGPT were compared to 200 essays written by L1-English university learners. Three elements of formulaic language related to PD were examined: stances, modals, and pronoun deixis. Differences in stances (z = -3.411; p = 0.001) and modals (z = -2.100; p = 0.036) were both significant according to the Wilcoxon signed ranks formula, whereas differences in pronoun deixis were nearly significant (z = -1.917; p = 0.055). Overall, language of ChatGPT appears generic and incomplete, suggesting that consistent and uniform expressions are being borrowed from an LLM training corpus to mimic aspects of PD. Limitations of AI highlight a need for pedagogical emphasis of culturally imbued discourse.
Descriptors: Power Structure, Artificial Intelligence, Computer Software, Persuasive Discourse, Discourse Analysis, Native Language, English, College Students, Language Usage, Phrase Structure, Form Classes (Languages), Verbs, Computational Linguistics, Cultural Awareness, Asians, English (Second Language), Second Language Learning, Contrastive Linguistics, Writing Evaluation, Audience Awareness, Language Variation
IGI Global. 701 East Chocolate Avenue, Hershey, PA 17033. Tel: 866-342-6657; Tel: 717-533-8845; Fax: 717-533-8661; Fax: 717-533-7115; e-mail: journals@igi-global.com; Web site: https://www.igi-global.com/journals/
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A