Abstract:
Question classification is a key point in many applications, such as Question Answering (QA, e.g., Yahoo! Answers), Information Retrieval (IR, e.g., Google search engine)...Show MoreMetadata
Abstract:
Question classification is a key point in many applications, such as Question Answering (QA, e.g., Yahoo! Answers), Information Retrieval (IR, e.g., Google search engine), and E-learning systems (e.g., Bloom's tax. classifiers). This paper aims to carry out a systematic review of the literature on automatic question classifiers and the technology directly involved. Automatic classifiers are responsible for labeling a certain evaluation item using a type of categorization as a selection criterion. The analysis of 80 primary studies previously selected revealed that SVM is the main algorithm of the Machine Learning used, while BOW and TF-IDF are the main techniques for feature extraction and selection, respectively. According to the analysis, the taxonomies proposed by Li and Roth and Bloom were the most used ones for the classification criteria, and Accuracy/Precision/Recall/F1-score were proven to be the most used metrics. In the future, the objective is to perform a meta-analysis with the studies that authorize the availability of their data.
Published in: IEEE Transactions on Learning Technologies ( Volume: 12, Issue: 4, 01 Oct.-Dec. 2019)

Institute of Mathematics and Computer Science, University of São Paulo, São Carlos, Brazil
Valtemir A. Silva received the master's degree in industrial engineering from the EESC – USP São Carlos, Brazil, in 2006. He is currently working toward the Ph.D. degree in computer science at the ICMC – University of São Paulo (USP), in July 2014. His areas of interest include software engineering and computational intelligence. His research investigates problems regarding text classification, question classification, ad...Show More
Valtemir A. Silva received the master's degree in industrial engineering from the EESC – USP São Carlos, Brazil, in 2006. He is currently working toward the Ph.D. degree in computer science at the ICMC – University of São Paulo (USP), in July 2014. His areas of interest include software engineering and computational intelligence. His research investigates problems regarding text classification, question classification, ad...View more

Computing Institute, Federal University of Alagoas, Maceıó, Brazil
Ig Ibert Bittencourt is an Associate Professor with the Federal University of Alagoas, Alagoas, Brazil, the former president of the Special Committee on Computers and Education from the Brazilian Computer Society (leading around 2500 researchers), and an Associate Editor for the IEEE Transactions on Learning Technologies. He co-founded an awarded company called MeuTutor (more than 50 000 students already used) and he stan...Show More
Ig Ibert Bittencourt is an Associate Professor with the Federal University of Alagoas, Alagoas, Brazil, the former president of the Special Committee on Computers and Education from the Brazilian Computer Society (leading around 2500 researchers), and an Associate Editor for the IEEE Transactions on Learning Technologies. He co-founded an awarded company called MeuTutor (more than 50 000 students already used) and he stan...View more

Institute of Mathematics and Computer Science, University of São Paulo, São Carlos, Brazil
José C. Maldonado is a Full Professor with the ICMC – University of São Paulo (USP) São Carlos, Brazil, former Director of the Institute of Mathematical and Computer Sciences, former president of the Brazilian Computer Society – SBC, member of the research network - International Software Engineering Research Network (ISERN, until 2010), and member of the Permanent Evaluation Commission of USP. His main topics of interest...Show More
José C. Maldonado is a Full Professor with the ICMC – University of São Paulo (USP) São Carlos, Brazil, former Director of the Institute of Mathematical and Computer Sciences, former president of the Brazilian Computer Society – SBC, member of the research network - International Software Engineering Research Network (ISERN, until 2010), and member of the Permanent Evaluation Commission of USP. His main topics of interest...View more

Institute of Mathematics and Computer Science, University of São Paulo, São Carlos, Brazil
Valtemir A. Silva received the master's degree in industrial engineering from the EESC – USP São Carlos, Brazil, in 2006. He is currently working toward the Ph.D. degree in computer science at the ICMC – University of São Paulo (USP), in July 2014. His areas of interest include software engineering and computational intelligence. His research investigates problems regarding text classification, question classification, adaptive learning, and the relationship between human skills and learning requirements for evaluations.
Valtemir A. Silva received the master's degree in industrial engineering from the EESC – USP São Carlos, Brazil, in 2006. He is currently working toward the Ph.D. degree in computer science at the ICMC – University of São Paulo (USP), in July 2014. His areas of interest include software engineering and computational intelligence. His research investigates problems regarding text classification, question classification, adaptive learning, and the relationship between human skills and learning requirements for evaluations.View more

Computing Institute, Federal University of Alagoas, Maceıó, Brazil
Ig Ibert Bittencourt is an Associate Professor with the Federal University of Alagoas, Alagoas, Brazil, the former president of the Special Committee on Computers and Education from the Brazilian Computer Society (leading around 2500 researchers), and an Associate Editor for the IEEE Transactions on Learning Technologies. He co-founded an awarded company called MeuTutor (more than 50 000 students already used) and he stands out from his peers by creating one of the most innovative companies in the field of educational technology in Brazil. He believes in innovative social entrepreneurship as a model for promoting a sustainable economic and social development to mankind.
Ig Ibert Bittencourt is an Associate Professor with the Federal University of Alagoas, Alagoas, Brazil, the former president of the Special Committee on Computers and Education from the Brazilian Computer Society (leading around 2500 researchers), and an Associate Editor for the IEEE Transactions on Learning Technologies. He co-founded an awarded company called MeuTutor (more than 50 000 students already used) and he stands out from his peers by creating one of the most innovative companies in the field of educational technology in Brazil. He believes in innovative social entrepreneurship as a model for promoting a sustainable economic and social development to mankind.View more

Institute of Mathematics and Computer Science, University of São Paulo, São Carlos, Brazil
José C. Maldonado is a Full Professor with the ICMC – University of São Paulo (USP) São Carlos, Brazil, former Director of the Institute of Mathematical and Computer Sciences, former president of the Brazilian Computer Society – SBC, member of the research network - International Software Engineering Research Network (ISERN, until 2010), and member of the Permanent Evaluation Commission of USP. His main topics of interests are software testing, software engineering education, experimental software engineering, critical embedded systems, and teaching environments and methods. He has authored and coauthored more than 60 articles in periodicals and more than a 100 refereed complete articles, plus three books and more than a dozen book chapters. He coordinated and participated in dozens of research projects funded by research agencies. He received several awards and honors, including: Scientific Merit Award 2017 from SBC - Brazilian Computer Society, Commendation of Scientific Merit 2008, Jabuti Award 2008 for Exact Sciences, Science and Technology (third place); Highlight Academic 2007 given by ABDI - Brazilian Agency for Industrial Development; and IV National Informatics Award 1991, conferred by SEI, MODDATA S / A, Roberto Marinho Foundation.
José C. Maldonado is a Full Professor with the ICMC – University of São Paulo (USP) São Carlos, Brazil, former Director of the Institute of Mathematical and Computer Sciences, former president of the Brazilian Computer Society – SBC, member of the research network - International Software Engineering Research Network (ISERN, until 2010), and member of the Permanent Evaluation Commission of USP. His main topics of interests are software testing, software engineering education, experimental software engineering, critical embedded systems, and teaching environments and methods. He has authored and coauthored more than 60 articles in periodicals and more than a 100 refereed complete articles, plus three books and more than a dozen book chapters. He coordinated and participated in dozens of research projects funded by research agencies. He received several awards and honors, including: Scientific Merit Award 2017 from SBC - Brazilian Computer Society, Commendation of Scientific Merit 2008, Jabuti Award 2008 for Exact Sciences, Science and Technology (third place); Highlight Academic 2007 given by ABDI - Brazilian Agency for Industrial Development; and IV National Informatics Award 1991, conferred by SEI, MODDATA S / A, Roberto Marinho Foundation.View more