Abstract:
One of the reported methods of cheating in online environments in the literature is CAMEO (Copying Answers using Multiple Existences Online), where harvesting accounts ar...Show MoreMetadata
Abstract:
One of the reported methods of cheating in online environments in the literature is CAMEO (Copying Answers using Multiple Existences Online), where harvesting accounts are used to obtain correct answers that are later submitted in the master account which gives the student credit to obtain a certificate. In previous research, we developed an algorithm to identify and label submissions that were cheated using the CAMEO method; this algorithm relied on the IP of the submissions. In this study, we use this tagged sample of submissions to i) compare the influence of student and problems characteristics on CAMEO and ii) build a random forest classifier that detects submissions as CAMEO without relying on IP, achieving sensitivity and specificity levels of 0.966 and 0.996, respectively. Finally, we analyze the importance of the different features of the model finding that student features are the most important variables towards the correct classification of CAMEO submissions, concluding also that student features have more influence on CAMEO than problem features.
Published in: IEEE Transactions on Learning Technologies ( Volume: 12, Issue: 1, 01 Jan.-March 2019)
Funding Agency:
Institute IMDEA Networks, Leganes, Spain
José A. Ruipérez-Valiente received the B.Eng. and M.Eng. degrees in telecommunications from the Universidad Católica de San Antonio (UCAM) and Universidad Carlos III of Madrid (UC3M), respectively, graduating in both cases with the best academic transcript of the class, and the M.Sc. and Ph.D. degrees in telematics from the Charles III University of Madrid while conducting research in the Institute IMDEA Networks in the a...Show More
José A. Ruipérez-Valiente received the B.Eng. and M.Eng. degrees in telecommunications from the Universidad Católica de San Antonio (UCAM) and Universidad Carlos III of Madrid (UC3M), respectively, graduating in both cases with the best academic transcript of the class, and the M.Sc. and Ph.D. degrees in telematics from the Charles III University of Madrid while conducting research in the Institute IMDEA Networks in the a...View more
Telematics Departament, Universidad Carlos III de Madrid, Leganés, Spain
Pedro J. Muñoz-Merino is a Visiting Associate Professor with the Universidad Carlos III de Madrid, where he is the Director of the master in telematics engineering. He obtained his acreditation in May 2012 as an Associate Professor by the ANECA agency from the Spanish Ministry of Education. He is an author of around 100 scientific publications and has participated in more than 20 research projects at the national and inte...Show More
Pedro J. Muñoz-Merino is a Visiting Associate Professor with the Universidad Carlos III de Madrid, where he is the Director of the master in telematics engineering. He obtained his acreditation in May 2012 as an Associate Professor by the ANECA agency from the Spanish Ministry of Education. He is an author of around 100 scientific publications and has participated in more than 20 research projects at the national and inte...View more
Physics Departament, Massachusetts Institute of Technology, Cambridge, MA, USA
Giora Alexandron received the M.Sc. degree in computer science from Tel-Aviv University, and the Ph.D. degree in computer science education from the Weizmann Institute of Science. He is the Principal Data Scientist with the Center for Educational Technology, and previously a Postdoctoral Researcher in the Physics Department, MIT. His research centers on educational data science, and he is especially interested in developi...Show More
Giora Alexandron received the M.Sc. degree in computer science from Tel-Aviv University, and the Ph.D. degree in computer science education from the Weizmann Institute of Science. He is the Principal Data Scientist with the Center for Educational Technology, and previously a Postdoctoral Researcher in the Physics Department, MIT. His research centers on educational data science, and he is especially interested in developi...View more
Physics Departament, Massachusetts Institute of Technology, Cambridge, MA, USA
David E. Pritchard received the B.Sc. degree from the California Institute of Technology, and the Ph.D. degree from the Harvard University, in 1962 and 1968, respectively. He has been with the Massachusetts Institute of Technology ever since, where he is now Cecil and Ida Green Professor of physics. He has won both the Broida and the Schawlow prizes from APS, the Max Born Award from OSA, and the IUPAP Senior Scientist Med...Show More
David E. Pritchard received the B.Sc. degree from the California Institute of Technology, and the Ph.D. degree from the Harvard University, in 1962 and 1968, respectively. He has been with the Massachusetts Institute of Technology ever since, where he is now Cecil and Ida Green Professor of physics. He has won both the Broida and the Schawlow prizes from APS, the Max Born Award from OSA, and the IUPAP Senior Scientist Med...View more
Contents Institute IMDEA Networks, Leganes, Spain
José A. Ruipérez-Valiente received the B.Eng. and M.Eng. degrees in telecommunications from the Universidad Católica de San Antonio (UCAM) and Universidad Carlos III of Madrid (UC3M), respectively, graduating in both cases with the best academic transcript of the class, and the M.Sc. and Ph.D. degrees in telematics from the Charles III University of Madrid while conducting research in the Institute IMDEA Networks in the area of learning analytics and educational data mining. During this time, he completed two research stays of three months each, the first one at MIT and the second one with the University of Edinburgh. He has received several academic and research awards and has published more than 25 scientific publications in important journals and conferences of his area of research. Previous to his research appointments, he worked in industry at the companies Vocento and Accenture, and is currently working as a Data Scientist with ExoClick.
José A. Ruipérez-Valiente received the B.Eng. and M.Eng. degrees in telecommunications from the Universidad Católica de San Antonio (UCAM) and Universidad Carlos III of Madrid (UC3M), respectively, graduating in both cases with the best academic transcript of the class, and the M.Sc. and Ph.D. degrees in telematics from the Charles III University of Madrid while conducting research in the Institute IMDEA Networks in the area of learning analytics and educational data mining. During this time, he completed two research stays of three months each, the first one at MIT and the second one with the University of Edinburgh. He has received several academic and research awards and has published more than 25 scientific publications in important journals and conferences of his area of research. Previous to his research appointments, he worked in industry at the companies Vocento and Accenture, and is currently working as a Data Scientist with ExoClick.View more
Telematics Departament, Universidad Carlos III de Madrid, Leganés, Spain
Pedro J. Muñoz-Merino is a Visiting Associate Professor with the Universidad Carlos III de Madrid, where he is the Director of the master in telematics engineering. He obtained his acreditation in May 2012 as an Associate Professor by the ANECA agency from the Spanish Ministry of Education. He is an author of around 100 scientific publications and has participated in more than 20 research projects at the national and international level, coordinating some of them with private companies. His present research interests include learning analytics and educational data mining. He has received several awards for his work on educational technologies. He has done two long research visits: one in Ireland for more than three months at the Intel company in 2005, and another in Germany for more than six months at the Fraunhofer Institute of Technology in 2009-2010. He has been a program committee member and part of the organization team of different conferences and workshops related to educational technologies and learning analytics. In addition, he has been invited to give different talks related to learning analytics topics. He has also coordinated the development and deployment of different learning analytics tools. He has been a senior member of the IEEE since 2015.
Pedro J. Muñoz-Merino is a Visiting Associate Professor with the Universidad Carlos III de Madrid, where he is the Director of the master in telematics engineering. He obtained his acreditation in May 2012 as an Associate Professor by the ANECA agency from the Spanish Ministry of Education. He is an author of around 100 scientific publications and has participated in more than 20 research projects at the national and international level, coordinating some of them with private companies. His present research interests include learning analytics and educational data mining. He has received several awards for his work on educational technologies. He has done two long research visits: one in Ireland for more than three months at the Intel company in 2005, and another in Germany for more than six months at the Fraunhofer Institute of Technology in 2009-2010. He has been a program committee member and part of the organization team of different conferences and workshops related to educational technologies and learning analytics. In addition, he has been invited to give different talks related to learning analytics topics. He has also coordinated the development and deployment of different learning analytics tools. He has been a senior member of the IEEE since 2015.View more
Physics Departament, Massachusetts Institute of Technology, Cambridge, MA, USA
Giora Alexandron received the M.Sc. degree in computer science from Tel-Aviv University, and the Ph.D. degree in computer science education from the Weizmann Institute of Science. He is the Principal Data Scientist with the Center for Educational Technology, and previously a Postdoctoral Researcher in the Physics Department, MIT. His research centers on educational data science, and he is especially interested in developing algorithms and techniques for adaptivity and analytics in online learning environments.
Giora Alexandron received the M.Sc. degree in computer science from Tel-Aviv University, and the Ph.D. degree in computer science education from the Weizmann Institute of Science. He is the Principal Data Scientist with the Center for Educational Technology, and previously a Postdoctoral Researcher in the Physics Department, MIT. His research centers on educational data science, and he is especially interested in developing algorithms and techniques for adaptivity and analytics in online learning environments.View more
Physics Departament, Massachusetts Institute of Technology, Cambridge, MA, USA
David E. Pritchard received the B.Sc. degree from the California Institute of Technology, and the Ph.D. degree from the Harvard University, in 1962 and 1968, respectively. He has been with the Massachusetts Institute of Technology ever since, where he is now Cecil and Ida Green Professor of physics. He has won both the Broida and the Schawlow prizes from APS, the Max Born Award from OSA, and the IUPAP Senior Scientist Medal in Fundamental Metrology. He is a member of the National Academy of Sciences, and a Fellow of the American Academy for Arts and Sciences, the American Association for the Advancement of Science, the American Physical Society, and the Optical Society of America. He has mentored three Nobel prizewinners and four winners of national thesis awards, and has won both a Dean's Teaching and Advising Award and the Earll M. Murman award for advising at MIT. Dr. Pritchard has a lifelong interest in teaching problem solving and is the author of A Mechanics Workbook, and the PI of an education group (research in learning, assessing, and tutoring electronically). He co-founded Effective Educational Technologies (sold to Pearson Education in 2006, which developed MasteringPhysics.com, MasteringChemistry.com, that were used by – 4M students last year, 400k in physics alone. His current research focus is entirely in education, particularly in developing online and on-land activities to help students improve their strategic thinking and expertise of their learning attitudes.
David E. Pritchard received the B.Sc. degree from the California Institute of Technology, and the Ph.D. degree from the Harvard University, in 1962 and 1968, respectively. He has been with the Massachusetts Institute of Technology ever since, where he is now Cecil and Ida Green Professor of physics. He has won both the Broida and the Schawlow prizes from APS, the Max Born Award from OSA, and the IUPAP Senior Scientist Medal in Fundamental Metrology. He is a member of the National Academy of Sciences, and a Fellow of the American Academy for Arts and Sciences, the American Association for the Advancement of Science, the American Physical Society, and the Optical Society of America. He has mentored three Nobel prizewinners and four winners of national thesis awards, and has won both a Dean's Teaching and Advising Award and the Earll M. Murman award for advising at MIT. Dr. Pritchard has a lifelong interest in teaching problem solving and is the author of A Mechanics Workbook, and the PI of an education group (research in learning, assessing, and tutoring electronically). He co-founded Effective Educational Technologies (sold to Pearson Education in 2006, which developed MasteringPhysics.com, MasteringChemistry.com, that were used by – 4M students last year, 400k in physics alone. His current research focus is entirely in education, particularly in developing online and on-land activities to help students improve their strategic thinking and expertise of their learning attitudes.View more
