Loading [a11y]/accessibility-menu.js
Semantic Similarity Measures for the Generation of Science Tests in Basque | IEEE Journals & Magazine | IEEE Xplore

Semantic Similarity Measures for the Generation of Science Tests in Basque

Open Access

Abstract:

The work we present in this paper aims to help teachers create multiple-choice science tests. We focus on a scientific vocabulary-learning scenario taking place in a Basq...Show More

Abstract:

The work we present in this paper aims to help teachers create multiple-choice science tests. We focus on a scientific vocabulary-learning scenario taking place in a Basque-language educational environment. In this particular scenario, we explore the option of automatically generating Multiple-Choice Questions (MCQ) by means of Natural Language Processing (NLP) techniques and the use of corpora. More specifically, human experts select scientific articles and identify the target terms (i.e., words). These terms are part of the vocabulary studied in the school curriculum for 13-14-year-olds and form the starting point for our system to generate MCQs. We automatically generate distractors that are similar in meaning to the target term. To this end, the system applies semantic similarity measures making use of a variety of corpus-based and graph-based approaches. The paper presents a qualitative and a quantitative analysis of the generated tests to measure the quality of the proposed methods. The qualitative analysis is based on expert opinion, whereas the quantitative analysis is based on the MCQ test responses from students in secondary school. Nine hundred and fifty one students from 18 schools took part in the experiments. The results show that our system could help experts in the generation of MCQ.
Published in: IEEE Transactions on Learning Technologies ( Volume: 7, Issue: 4, 01 Oct.-Dec. 2014)
Page(s): 375 - 387
Date of Publication: 08 September 2014

ISSN Information:

Author image of Itziar Aldabe
Department of Computer Languages and Systems, University of the Basque Country (UPV/EHU), Donostia- San Sebastian, Gipuzkoa, Spain
Itziar Aldabe received the PhD degree in computer science from the University of the Basque Country (UPV/EHU) in 2011. She is currently a researcher in the Department of Computer Languages and Systems, University of the Basque Country (UPV/EHU). Her current interests include language learning, educational resources and natural language processing (NLP). She has been working in the use of NLP into Education since 2003.
Itziar Aldabe received the PhD degree in computer science from the University of the Basque Country (UPV/EHU) in 2011. She is currently a researcher in the Department of Computer Languages and Systems, University of the Basque Country (UPV/EHU). Her current interests include language learning, educational resources and natural language processing (NLP). She has been working in the use of NLP into Education since 2003.View more
Author image of Montse Maritxalar
Department of Computer Languages and Systems, University of the Basque Country (UPV/EHU), Donostia- San Sebastian, Gipuzkoa, Spain
Montse Maritxalar received the PhD degree in computer science from the University of the Basque Country (UPV/EHU) in 1999. She is an associate professor of computer science at the University of the Basque Country (UPV/EHU). She is also a member of the IXA natural language processing group. Her current interests include language learning, educational resources, and natural language processing (NLP).
Montse Maritxalar received the PhD degree in computer science from the University of the Basque Country (UPV/EHU) in 1999. She is an associate professor of computer science at the University of the Basque Country (UPV/EHU). She is also a member of the IXA natural language processing group. Her current interests include language learning, educational resources, and natural language processing (NLP).View more

Author image of Itziar Aldabe
Department of Computer Languages and Systems, University of the Basque Country (UPV/EHU), Donostia- San Sebastian, Gipuzkoa, Spain
Itziar Aldabe received the PhD degree in computer science from the University of the Basque Country (UPV/EHU) in 2011. She is currently a researcher in the Department of Computer Languages and Systems, University of the Basque Country (UPV/EHU). Her current interests include language learning, educational resources and natural language processing (NLP). She has been working in the use of NLP into Education since 2003.
Itziar Aldabe received the PhD degree in computer science from the University of the Basque Country (UPV/EHU) in 2011. She is currently a researcher in the Department of Computer Languages and Systems, University of the Basque Country (UPV/EHU). Her current interests include language learning, educational resources and natural language processing (NLP). She has been working in the use of NLP into Education since 2003.View more
Author image of Montse Maritxalar
Department of Computer Languages and Systems, University of the Basque Country (UPV/EHU), Donostia- San Sebastian, Gipuzkoa, Spain
Montse Maritxalar received the PhD degree in computer science from the University of the Basque Country (UPV/EHU) in 1999. She is an associate professor of computer science at the University of the Basque Country (UPV/EHU). She is also a member of the IXA natural language processing group. Her current interests include language learning, educational resources, and natural language processing (NLP).
Montse Maritxalar received the PhD degree in computer science from the University of the Basque Country (UPV/EHU) in 1999. She is an associate professor of computer science at the University of the Basque Country (UPV/EHU). She is also a member of the IXA natural language processing group. Her current interests include language learning, educational resources, and natural language processing (NLP).View more

References

References is not available for this document.