Loading [a11y]/accessibility-menu.js
Exploring ChatGPT's Ability to Classify the Structure of Literature Reviews in Engineering Research Articles | IEEE Journals & Magazine | IEEE Xplore

Exploring ChatGPT's Ability to Classify the Structure of Literature Reviews in Engineering Research Articles


Abstract:

ChatGPT is a newly emerging artificial intelligence (AI) tool that can generate and assess written text. In this study, we aim to examine the extent to which it can corre...Show More
Topic: Special issue on ChatGPT and Generative AI

Abstract:

ChatGPT is a newly emerging artificial intelligence (AI) tool that can generate and assess written text. In this study, we aim to examine the extent to which it can correctly identify the structure of literature review sections in engineering research articles. For this purpose, we conducted a manual content analysis by classifying paragraphs of literature review sections into their corresponding categories that are based on Kwan's model, which is a labeling scheme for structuring literature reviews. We then asked ChatGPT to perform the same categorization and compared both outcomes. Numerical results do not imply a satisfactory performance of ChatGPT; therefore, writers cannot fully depend on it to edit their literature reviews. However, the AI chatbot displays an understanding of the given prompt and is able to respond beyond the classification task by giving supportive and useful explanations for the users. Such findings can be especially helpful for beginners who usually struggle to write comprehensive literature review sections since they highlight how users can benefit from this AI chatbot to revise their drafts at the level of content and organization. With further investigations and advancement, AI chatbots can also be used for teaching proper literature review writing and editing.
Topic: Special issue on ChatGPT and Generative AI
Published in: IEEE Transactions on Learning Technologies ( Volume: 17)
Page(s): 1819 - 1828
Date of Publication: 04 June 2024

ISSN Information:

American University of Beirut, Beirut, Lebanon
Santa Clara University, Santa Clara, CA, USA
Maha Issa received the master’s degree in electrical and computer engineering with a focus on artificial intelligence and machine learning, and the master’s degree in biomedical engineering from the American University of Beirut, Beirut, Lebanon, in 2022 and 2023, respectively. She is currently working toward the Ph.D. degree in computer science and engineering with Santa Clara University, Santa Clara, CA, USA.
She was a R...Show More
Maha Issa received the master’s degree in electrical and computer engineering with a focus on artificial intelligence and machine learning, and the master’s degree in biomedical engineering from the American University of Beirut, Beirut, Lebanon, in 2022 and 2023, respectively. She is currently working toward the Ph.D. degree in computer science and engineering with Santa Clara University, Santa Clara, CA, USA.
She was a R...View more
American University of Beirut, Beirut, Lebanon
Marwa Faraj received the bachelor's degree in biology from Lebanese University, Beirut, Lebanon, in 2020, and the master's degree in biomedical engineering from the American University of Beirut, Beirut, in 2023.
She is currently a biomedical engineering graduate and a Research Assistant with the American University of Beirut, Beirut. During her master’s, she studied the role of nanoparticles in facilitating the delivery o...Show More
Marwa Faraj received the bachelor's degree in biology from Lebanese University, Beirut, Lebanon, in 2020, and the master's degree in biomedical engineering from the American University of Beirut, Beirut, in 2023.
She is currently a biomedical engineering graduate and a Research Assistant with the American University of Beirut, Beirut. During her master’s, she studied the role of nanoparticles in facilitating the delivery o...View more
University of Texas at Austin, Austin, TX, USA
Niveen AbiGhannam received the B.S. degree in biology and the M.S. degree in environmental policy from the American University of Beirut, Beirut, Lebanon, in 2007 and 2009, respectively, and the Ph.D. degree in science communication from the University of Texas at Austin, Austin, TX, USA, in 2015.
She is currently an Engineering Communication Researcher and Educator with the University of Texas at Austin. She studies the s...Show More
Niveen AbiGhannam received the B.S. degree in biology and the M.S. degree in environmental policy from the American University of Beirut, Beirut, Lebanon, in 2007 and 2009, respectively, and the Ph.D. degree in science communication from the University of Texas at Austin, Austin, TX, USA, in 2015.
She is currently an Engineering Communication Researcher and Educator with the University of Texas at Austin. She studies the s...View more

American University of Beirut, Beirut, Lebanon
Santa Clara University, Santa Clara, CA, USA
Maha Issa received the master’s degree in electrical and computer engineering with a focus on artificial intelligence and machine learning, and the master’s degree in biomedical engineering from the American University of Beirut, Beirut, Lebanon, in 2022 and 2023, respectively. She is currently working toward the Ph.D. degree in computer science and engineering with Santa Clara University, Santa Clara, CA, USA.
She was a Research Assistant in technical and academic communication at the American University of Beirut.
Maha Issa received the master’s degree in electrical and computer engineering with a focus on artificial intelligence and machine learning, and the master’s degree in biomedical engineering from the American University of Beirut, Beirut, Lebanon, in 2022 and 2023, respectively. She is currently working toward the Ph.D. degree in computer science and engineering with Santa Clara University, Santa Clara, CA, USA.
She was a Research Assistant in technical and academic communication at the American University of Beirut.View more
American University of Beirut, Beirut, Lebanon
Marwa Faraj received the bachelor's degree in biology from Lebanese University, Beirut, Lebanon, in 2020, and the master's degree in biomedical engineering from the American University of Beirut, Beirut, in 2023.
She is currently a biomedical engineering graduate and a Research Assistant with the American University of Beirut, Beirut. During her master’s, she studied the role of nanoparticles in facilitating the delivery of drugs in cardiac hypoxia injury. She has also completed training on academic and technical communication.
Marwa Faraj received the bachelor's degree in biology from Lebanese University, Beirut, Lebanon, in 2020, and the master's degree in biomedical engineering from the American University of Beirut, Beirut, in 2023.
She is currently a biomedical engineering graduate and a Research Assistant with the American University of Beirut, Beirut. During her master’s, she studied the role of nanoparticles in facilitating the delivery of drugs in cardiac hypoxia injury. She has also completed training on academic and technical communication.View more
University of Texas at Austin, Austin, TX, USA
Niveen AbiGhannam received the B.S. degree in biology and the M.S. degree in environmental policy from the American University of Beirut, Beirut, Lebanon, in 2007 and 2009, respectively, and the Ph.D. degree in science communication from the University of Texas at Austin, Austin, TX, USA, in 2015.
She is currently an Engineering Communication Researcher and Educator with the University of Texas at Austin. She studies the strategic communication of scientific and technical knowledge with different academic and nonacademic audiences.
Niveen AbiGhannam received the B.S. degree in biology and the M.S. degree in environmental policy from the American University of Beirut, Beirut, Lebanon, in 2007 and 2009, respectively, and the Ph.D. degree in science communication from the University of Texas at Austin, Austin, TX, USA, in 2015.
She is currently an Engineering Communication Researcher and Educator with the University of Texas at Austin. She studies the strategic communication of scientific and technical knowledge with different academic and nonacademic audiences.View more

Contact IEEE to Subscribe

References

References is not available for this document.