Abstract:
The evaluation of student projects is a difficult task, especially when they involve both a technical and a creative component. We propose an artificial intelligence (AI)...Show MoreMetadata
Abstract:
The evaluation of student projects is a difficult task, especially when they involve both a technical and a creative component. We propose an artificial intelligence (AI)-based methodology to help in the evaluation of complex projects in engineering and computer science courses. This methodology is intended to evaluate the assessment process itself allowing to analyze the influence of each variable in the final grade, to discover possible biases, inconsistencies and discrepancies, and to generate appropriate rubrics that help to avoid them. As an example of its application, we consider the evaluation of the projects submitted in an undergraduate introductory course on computer science. Using data collected from the evaluation during five academic years, we follow the proposed methodology to create AI models and analyze the main variables which are involved in the assessment of the projects. The proposed methodology can be applied to other courses and degrees, where both technical and creative components are considered to evaluate the projects.
Published in: IEEE Transactions on Learning Technologies ( Volume: 16, Issue: 5, October 2023)
Funding Agency:
Department of Mathematics and Computation, University of La Rioja, Logroño, Spain
Jose Divasón received the degrees in computer science and mathematics from the University of La Rioja, Logroño, Spain, and the Ph.D. degree in computer science from the University of La Rioja, in 2011 and 2016, respectively.
Since 2017, he has been a Lecturer with the University of La Rioja. His research interests include interactive theorem proving and computer algebra.
Jose Divasón received the degrees in computer science and mathematics from the University of La Rioja, Logroño, Spain, and the Ph.D. degree in computer science from the University of La Rioja, in 2011 and 2016, respectively.
Since 2017, he has been a Lecturer with the University of La Rioja. His research interests include interactive theorem proving and computer algebra.View more
Department of Mechanical Engineering, University of La Rioja, Logroño, Spain
Francisco Javier Martínez-de-Pisón received the degree in industrial engineering and the Ph.D. degree in machine learning from the University of La Rioja, Logroño, Spain.
He is the Head of the EDMANS group and the Professor with the University of La Rioja, Logroño, Spain. His research interests include soft computing, data mining, and machine learning methods to solve problems in several fields as industry, energy, agricul...Show More
Francisco Javier Martínez-de-Pisón received the degree in industrial engineering and the Ph.D. degree in machine learning from the University of La Rioja, Logroño, Spain.
He is the Head of the EDMANS group and the Professor with the University of La Rioja, Logroño, Spain. His research interests include soft computing, data mining, and machine learning methods to solve problems in several fields as industry, energy, agricul...View more
Department of Mathematics and Computation, University of La Rioja, Logroño, Spain
Ana Romero received the B.S. and Ph.D. degrees in mathematics from the University of La Rioja, Logroño, Spain, in 2003 and 2007, respectively.
From 2007 to 2018, she was a Lecturer at the University of La Rioja, and is currently an Associate Professor with the same university. Her current research interest is computational algebraic topology and applications.
Ana Romero received the B.S. and Ph.D. degrees in mathematics from the University of La Rioja, Logroño, Spain, in 2003 and 2007, respectively.
From 2007 to 2018, she was a Lecturer at the University of La Rioja, and is currently an Associate Professor with the same university. Her current research interest is computational algebraic topology and applications.View more
Department of Mathematics and Computation, University of La Rioja, Logroño, Spain
Eduardo Sáenz-de-Cabezón received the B.S. and Ph.D. degrees in mathematics from the University of La Rioja, Logroño, Spain, in 2001 and 2008, respectively.
Since 2010, he has been an Associate Professor with the University of La Rioja. His main research interest is on combinatorial commutative algebra.
Eduardo Sáenz-de-Cabezón received the B.S. and Ph.D. degrees in mathematics from the University of La Rioja, Logroño, Spain, in 2001 and 2008, respectively.
Since 2010, he has been an Associate Professor with the University of La Rioja. His main research interest is on combinatorial commutative algebra.View more
Contents Department of Mathematics and Computation, University of La Rioja, Logroño, Spain
Jose Divasón received the degrees in computer science and mathematics from the University of La Rioja, Logroño, Spain, and the Ph.D. degree in computer science from the University of La Rioja, in 2011 and 2016, respectively.
Since 2017, he has been a Lecturer with the University of La Rioja. His research interests include interactive theorem proving and computer algebra.
Jose Divasón received the degrees in computer science and mathematics from the University of La Rioja, Logroño, Spain, and the Ph.D. degree in computer science from the University of La Rioja, in 2011 and 2016, respectively.
Since 2017, he has been a Lecturer with the University of La Rioja. His research interests include interactive theorem proving and computer algebra.View more
Department of Mechanical Engineering, University of La Rioja, Logroño, Spain
Francisco Javier Martínez-de-Pisón received the degree in industrial engineering and the Ph.D. degree in machine learning from the University of La Rioja, Logroño, Spain.
He is the Head of the EDMANS group and the Professor with the University of La Rioja, Logroño, Spain. His research interests include soft computing, data mining, and machine learning methods to solve problems in several fields as industry, energy, agriculture, and business.
Francisco Javier Martínez-de-Pisón received the degree in industrial engineering and the Ph.D. degree in machine learning from the University of La Rioja, Logroño, Spain.
He is the Head of the EDMANS group and the Professor with the University of La Rioja, Logroño, Spain. His research interests include soft computing, data mining, and machine learning methods to solve problems in several fields as industry, energy, agriculture, and business.View more
Department of Mathematics and Computation, University of La Rioja, Logroño, Spain
Ana Romero received the B.S. and Ph.D. degrees in mathematics from the University of La Rioja, Logroño, Spain, in 2003 and 2007, respectively.
From 2007 to 2018, she was a Lecturer at the University of La Rioja, and is currently an Associate Professor with the same university. Her current research interest is computational algebraic topology and applications.
Ana Romero received the B.S. and Ph.D. degrees in mathematics from the University of La Rioja, Logroño, Spain, in 2003 and 2007, respectively.
From 2007 to 2018, she was a Lecturer at the University of La Rioja, and is currently an Associate Professor with the same university. Her current research interest is computational algebraic topology and applications.View more
Department of Mathematics and Computation, University of La Rioja, Logroño, Spain
Eduardo Sáenz-de-Cabezón received the B.S. and Ph.D. degrees in mathematics from the University of La Rioja, Logroño, Spain, in 2001 and 2008, respectively.
Since 2010, he has been an Associate Professor with the University of La Rioja. His main research interest is on combinatorial commutative algebra.
Eduardo Sáenz-de-Cabezón received the B.S. and Ph.D. degrees in mathematics from the University of La Rioja, Logroño, Spain, in 2001 and 2008, respectively.
Since 2010, he has been an Associate Professor with the University of La Rioja. His main research interest is on combinatorial commutative algebra.View more
