NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ1408775
Record Type: Journal
Publication Date: 2023
Pages: 22
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0010-0870
EISSN: EISSN-2150-6701
How Well Does ChatGPT Handle Reference Inquiries? An Analysis Based on Question Types and Question Complexities
Katie Lai
College & Research Libraries, v84 n6 p974-995 2023
To explore whether artificial intelligence can be used to enhance library services, this study used ChatGPT to answer reference questions. An assessment rubric was used to evaluate how well ChatGPT handled different question types and difficulty levels. Overall ChatGPT's performance was fair, but it did poorly in information accuracy. It scored the highest when handling facilities and equipment-related questions but the lowest when dealing with e-resources access problems. ChatGPT was weak in answering advanced research questions, complex inquiries, and known item searches relating to a specific local environment, but it could be adopted to enhance library communication with users.
Association of College and Research Libraries. 50 East Huron Street, Chicago, IL 60611. e-mail: acrl@ala.org; Web site: http://crl.acrl.org
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A