ERIC Number: EJ1424887
Record Type: Journal
Publication Date: 2024-May
Pages: 19
Abstractor: As Provided
ISBN: N/A
ISSN: N/A
EISSN: EISSN-2578-2118
Using ChatGPT with Novice Arduino Programmers: Effects on Performance, Interest, Self-Efficacy, and Programming Ability
Donald M. Johnson; Will Doss; Christopher M. Estepp
Journal of Research in Technical Careers, v8 n1 Article 1 p1-17 2024
A posttest-only control group experimental design compared novice Arduino programmers who developed their own programs (self-programming group, n = 17) with novice Arduino programmers who used ChatGPT 3.5 to write their programs (ChatGPT-programming group, n = 16) on the dependent variables of programming scores, interest in Arduino programming, Arduino programming self-efficacy, Arduino programming posttest scores, and types of programming errors. Students were undergraduates in an introductory agricultural systems technology course in Fall 2023. The results indicated no significant (p < 0.10) differences between groups for programming rubric scores (p = 0.50) or interest in Arduino programming (p = 0.50). There were significant differences for Arduino programming self-efficacy, (p = 0.03, Cohen's d = 0.75) and Arduino posttest scores, (p = 0.03, Cohen's d = 0.76); students in the self-programming group scored significantly higher on both measures. Analysis of students' errors indicated the ChatGPT group made significantly (p < 0.01) more program punctuation errors. These results indicated novice students writing their own programs developed greater Arduino programming self-efficacy and programming ability than novice students using ChatGPT. Nevertheless, ChatGPT may still play an important role in assisting novices to write microcontroller programs.
Descriptors: Artificial Intelligence, Technology Uses in Education, Natural Language Processing, Novices, Programming, Student Interests, Self Efficacy, Skill Development, Undergraduate Students, Agricultural Education, Academic Achievement
UNLV Department of Teaching and Learning. 4505 South Maryland Parkway PO Box 3005, Las Vegas, NV 89154. e-mail: jrtc@unlv.edu; Web site: https://digitalscholarship.unlv.edu/jrtc/
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: National Institute of Food and Agriculture (NIFA) (USDA)
Authoring Institution: N/A
Identifiers - Location: Arkansas
Grant or Contract Numbers: 1024473