Abstract:
The work we present in this paper aims to help teachers create multiple-choice science tests. We focus on a scientific vocabulary-learning scenario taking place in a Basq...Show MoreMetadata
Abstract:
The work we present in this paper aims to help teachers create multiple-choice science tests. We focus on a scientific vocabulary-learning scenario taking place in a Basque-language educational environment. In this particular scenario, we explore the option of automatically generating Multiple-Choice Questions (MCQ) by means of Natural Language Processing (NLP) techniques and the use of corpora. More specifically, human experts select scientific articles and identify the target terms (i.e., words). These terms are part of the vocabulary studied in the school curriculum for 13-14-year-olds and form the starting point for our system to generate MCQs. We automatically generate distractors that are similar in meaning to the target term. To this end, the system applies semantic similarity measures making use of a variety of corpus-based and graph-based approaches. The paper presents a qualitative and a quantitative analysis of the generated tests to measure the quality of the proposed methods. The qualitative analysis is based on expert opinion, whereas the quantitative analysis is based on the MCQ test responses from students in secondary school. Nine hundred and fifty one students from 18 schools took part in the experiments. The results show that our system could help experts in the generation of MCQ.
Published in: IEEE Transactions on Learning Technologies ( Volume: 7, Issue: 4, 01 Oct.-Dec. 2014)
Keywords assist with retrieval of results and provide a means to discovering other relevant content. Learn more.
- IEEE Keywords
- Index Terms
- Similarity Measure ,
- Semantic Similarity ,
- Semantic Similarity Measures ,
- Expert Opinion ,
- Variety Of Approaches ,
- Multiple-choice Questions ,
- Secondary School Students ,
- Human Experts ,
- Automatic Generation ,
- Science And Technology ,
- Real Scenarios ,
- Knowledge Resources ,
- Item Difficulty ,
- Negative Items ,
- Learning Management System ,
- Automatic Approach ,
- Point-biserial Correlation ,
- Item Discrimination ,
- Classical Test Theory ,
- High Score Group ,
- Low Score Group ,
- Knowledge-based Approach ,
- WordNet ,
- Discriminant Coefficients ,
- Easy Items ,
- Difficult Items ,
- Negative Discrimination ,
- Lexical Entries ,
- Text Selection ,
- Number Of Students
- Author Keywords
Keywords assist with retrieval of results and provide a means to discovering other relevant content. Learn more.
- IEEE Keywords
- Index Terms
- Similarity Measure ,
- Semantic Similarity ,
- Semantic Similarity Measures ,
- Expert Opinion ,
- Variety Of Approaches ,
- Multiple-choice Questions ,
- Secondary School Students ,
- Human Experts ,
- Automatic Generation ,
- Science And Technology ,
- Real Scenarios ,
- Knowledge Resources ,
- Item Difficulty ,
- Negative Items ,
- Learning Management System ,
- Automatic Approach ,
- Point-biserial Correlation ,
- Item Discrimination ,
- Classical Test Theory ,
- High Score Group ,
- Low Score Group ,
- Knowledge-based Approach ,
- WordNet ,
- Discriminant Coefficients ,
- Easy Items ,
- Difficult Items ,
- Negative Discrimination ,
- Lexical Entries ,
- Text Selection ,
- Number Of Students
- Author Keywords