ERIC Number: EJ1459036
Record Type: Journal
Publication Date: 2025-Feb
Pages: 19
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0266-4909
EISSN: EISSN-1365-2729
Integrating Peer Assessment Cycle into ChatGPT for STEM Education: A Randomised Controlled Trial on Knowledge, Skills, and Attitudes Enhancement
Journal of Computer Assisted Learning, v41 n1 e13085 2025
Background: Science, Technology, Engineering, and Mathematics (STEM) education in Asian universities struggles to integrate Knowledge, Skills, and Attitudes (KSA) due to large classes and student reluctance. While ChatGPT offers solutions, its conventional use may hinder independent critical thinking. Objectives: This study introduces PA-GPT, using ChatGPT as a "virtual peer" in peer assessments to promote active learning and enhance knowledge, higher-order thinking skills (HOTS), and attitudes--the core of KSA in STEM. Methods: A randomised controlled trial involved 61 first-year engineering students (43 males, 18 females) from a university in Southern Taiwan enrolled in "Network Embedded Systems and Applications." Participants, all with prior ChatGPT experience but no programming background, were purposively sampled. They were randomly assigned to the experimental group (n = 31) using PA-GPT or the control group (n = 30) using traditional ChatGPT. Over 8 weeks, data were collected using pre- and post-tests: a knowledge construction test (20 items, [alpha] = 0.85); a HOTS scale ([alpha] = 0.78-0.83) measuring critical thinking, problem-solving, and creativity; and the S-STEM questionnaire ([alpha] >0.80) assessing attitudes towards STEM subjects and 21st-century learning. ANCOVA analysed the data, controlling for pre-test scores, and Levene's test checked homogeneity of variances. Results and Conclusions: ANCOVA results showed that PA-GPT significantly outperformed traditional ChatGPT in enhancing knowledge construction (F = 9.89, p = 0.002), critical thinking (F = 37.00, p < 0.001), problem-solving (F = 9.40, p = 0.003), creativity (F = 7.22, p = 0.009), and attitudes towards mathematics (F = 25.52, p < 0.001), engineering/technology (F = 16.06, p < 0.001), and 21st-century learning (F = 26.38, p < 0.001). These findings demonstrate that PA-GPT effectively addresses challenges in student engagement and HOTS development in STEM education by simulating peer interactions. Peer Assessment with ChatGPT (PA-GPT) promotes active learning and self-reflection, potentially revolutionising AI-assisted education in large class settings. This study provides pioneering evidence for the effectiveness of AI-driven peer assessment in enhancing comprehensive STEM competencies, offering a promising direction for future educational technology integration.
Descriptors: Peer Evaluation, Artificial Intelligence, Natural Language Processing, Technology Uses in Education, STEM Education, Knowledge Level, Student Attitudes, Foreign Countries, Active Learning, Thinking Skills, Skill Development, College Freshmen, Engineering Education, Critical Thinking, Problem Solving, Creativity
Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://bibliotheek.ehb.be:2191/en-us
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Taiwan
Grant or Contract Numbers: N/A