Abstract:
Computational thinking (CT) skills are becoming increasingly relevant for future professionals across all domains, beyond computer science (CS). As such, an increasing nu...Show MoreMetadata
Abstract:
Computational thinking (CT) skills are becoming increasingly relevant for future professionals across all domains, beyond computer science (CS). As such, an increasing number of bachelor's and master's programs outside of the CS discipline integrate CT courses within their study program. At the same time, tools such as notebooks and interactive apps designed to support the teaching of programming concepts are becoming ever more popular. However, in non-CS majors, CT might not be perceived as essential, and students might lack the motivation to engage with such tools in order to acquire solid CT skills. This article presents a field study conducted with 115 students during a full semester on a novel computational notebook environment. It evaluates computational notebooks and CT skills in an introductory course on information technology for first-year undergraduates in business and economics. A multidimensional evaluation approach makes use of pre- and post-test surveys, lectures, and self-directed laboratory sessions tracking analytics. Our findings suggest that, in the process of learning CT for non-CS students, engagement in active learning activities can be a stronger determinant of learning outcomes than initial knowledge. Furthermore, gamifying computational notebooks can serve as a strong driver of active learning engagement, even more so than initial motivational factors.
Published in: IEEE Transactions on Learning Technologies ( Volume: 15, Issue: 3, 01 June 2022)
Funding Agency:

University of Neuchâtel, Neuchâtel, Switzerland
Alessio De Santo received the B.Sc. degree in business technology from the University of Applied Sciences of Western Switzerland HES-SO, Neuchâtel, Switzerland, in 2008, and the M.Sc. degree in information systems, in 2010 from the University of Neuchâtel, Neuchâtel, Switzerland, where he is currently working toward the Ph.D. degree in information systems with the University of Neuchâtel.
He has recently joined the Univers...Show More
Alessio De Santo received the B.Sc. degree in business technology from the University of Applied Sciences of Western Switzerland HES-SO, Neuchâtel, Switzerland, in 2008, and the M.Sc. degree in information systems, in 2010 from the University of Neuchâtel, Neuchâtel, Switzerland, where he is currently working toward the Ph.D. degree in information systems with the University of Neuchâtel.
He has recently joined the Univers...View more

Ecole Polytechnique Federale de Lausanne, Ecublens, Switzerland
Juan Carlos Farah received the B.A. degree in economics from Harvard University, Cambridge, MA, USA, in 2008, and the M.Sc. degree in computing from Imperial College London, London, U.K., in 2015. He is currently working toward the Ph.D. degree in robotics, control, and intelligent systems with the École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland.
His current research interests include human–computer interac...Show More
Juan Carlos Farah received the B.A. degree in economics from Harvard University, Cambridge, MA, USA, in 2008, and the M.Sc. degree in computing from Imperial College London, London, U.K., in 2015. He is currently working toward the Ph.D. degree in robotics, control, and intelligent systems with the École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland.
His current research interests include human–computer interac...View more

Ecole Polytechnique Federale de Lausanne, Ecublens, Switzerland
Marc Lafuente Martínez received the Ph.D. degree in educational psychology from the University of Barcelona, Barcelona, Spain, in 2010.
He is currently a Researcher, Project Manager, and Independent Consultant based in Switzerland and focuses on new technologies and educational innovation. Prior to this, he was a Researcher with the École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland. He was also a Lecturer wit...Show More
Marc Lafuente Martínez received the Ph.D. degree in educational psychology from the University of Barcelona, Barcelona, Spain, in 2010.
He is currently a Researcher, Project Manager, and Independent Consultant based in Switzerland and focuses on new technologies and educational innovation. Prior to this, he was a Researcher with the École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland. He was also a Lecturer wit...View more

University of Neuchâtel, Neuchâtel, Switzerland
Arielle Moro received the Ph.D. degree in information systems from the University of Lausanne, Lausanne, Switzerland, in 2018.
She is currently a Postdoctoral Fellow with the University of Neuchâtel, Neuchâtel, Switzerland. Her research thesis explored the tradeoff between predicting mobility and preserving location data privacy. Her research interests include analyzing human behavior in various domains (e.g., mobility, su...Show More
Arielle Moro received the Ph.D. degree in information systems from the University of Lausanne, Lausanne, Switzerland, in 2018.
She is currently a Postdoctoral Fellow with the University of Neuchâtel, Neuchâtel, Switzerland. Her research thesis explored the tradeoff between predicting mobility and preserving location data privacy. Her research interests include analyzing human behavior in various domains (e.g., mobility, su...View more

University of Neuchâtel, Neuchâtel, Switzerland
Kristoffer Bergram received the B.Sc. degrees in psychology and statistics and the M.Sc. degree in information systems from Lund University, Lund, Sweden, in 2017, 2018, and 2020, respectively. He is currently working toward the Ph.D. degree in computer science with the University of Neuchâtel, Neuchâtel, Switzerland.
His current research interests include guiding human behavior in human–computer interaction contexts by us...Show More
Kristoffer Bergram received the B.Sc. degrees in psychology and statistics and the M.Sc. degree in information systems from Lund University, Lund, Sweden, in 2017, 2018, and 2020, respectively. He is currently working toward the Ph.D. degree in computer science with the University of Neuchâtel, Neuchâtel, Switzerland.
His current research interests include guiding human behavior in human–computer interaction contexts by us...View more

University of Neuchâtel, Neuchâtel, Switzerland
Aditya Kumar Purohit received the B.Sc. degree in computer science and the M.Sc. degree in marketing research from University Grenoble Alpes, Grenoble, France, in 2013 and 2018, respectively. He is currently working toward the Ph.D. degree in information systems with the University of Neuchâtel, Neuchâtel, Switzerland.
His current research interests include digital health, digital addiction, gamification, and building inte...Show More
Aditya Kumar Purohit received the B.Sc. degree in computer science and the M.Sc. degree in marketing research from University Grenoble Alpes, Grenoble, France, in 2013 and 2018, respectively. He is currently working toward the Ph.D. degree in information systems with the University of Neuchâtel, Neuchâtel, Switzerland.
His current research interests include digital health, digital addiction, gamification, and building inte...View more

University of Neuchâtel, Neuchâtel, Switzerland
Pascal Felber received the Ph.D. degree in computer science from the Swiss Federal Institute of Technology, Zürich, Switzerland, in 1998.
He is currently a Professor of Computer Science with the University of Neuchâtel, Neuchâtel, Switzerland. Prior to joining the University of Neuchâtel in 2004, he was with Oracle Corporation, Austin, TX, USA; Bell-Labs (Lucent Technologies), Holmdel, NJ, USA; and EURECOM, Biot, France. H...Show More
Pascal Felber received the Ph.D. degree in computer science from the Swiss Federal Institute of Technology, Zürich, Switzerland, in 1998.
He is currently a Professor of Computer Science with the University of Neuchâtel, Neuchâtel, Switzerland. Prior to joining the University of Neuchâtel in 2004, he was with Oracle Corporation, Austin, TX, USA; Bell-Labs (Lucent Technologies), Holmdel, NJ, USA; and EURECOM, Biot, France. H...View more

Ecole Polytechnique Federale de Lausanne, Ecublens, Switzerland
Denis Gillet received the Ph.D. degree in information systems from the École Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland, in 1995.
He is currently a Faculty Member with the School of Engineering, EPFL. He has been the Technical Coordinator for large-scale European innovation actions for Science, technology, engineering, and mathematics (STEM) education in schools. His current research interests include...Show More
Denis Gillet received the Ph.D. degree in information systems from the École Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland, in 1995.
He is currently a Faculty Member with the School of Engineering, EPFL. He has been the Technical Coordinator for large-scale European innovation actions for Science, technology, engineering, and mathematics (STEM) education in schools. His current research interests include...View more

University of Neuchâtel, Neuchâtel, Switzerland
Adrian Holzer received the Ph.D. degree in information systems from the University of Lausanne, Lausanne, Switzerland, in 2009.
He is currently a Professor of Management Information Systems with the University of Neuchâtel, Neuchâtel, Switzerland. He was a Research Associate with the École Polytechnique Fédérale de Lausanne, Lausanne, the co-Head of the interdisciplinary platform with the University of Lausanne, and an SNF...Show More
Adrian Holzer received the Ph.D. degree in information systems from the University of Lausanne, Lausanne, Switzerland, in 2009.
He is currently a Professor of Management Information Systems with the University of Neuchâtel, Neuchâtel, Switzerland. He was a Research Associate with the École Polytechnique Fédérale de Lausanne, Lausanne, the co-Head of the interdisciplinary platform with the University of Lausanne, and an SNF...View more

University of Neuchâtel, Neuchâtel, Switzerland
Alessio De Santo received the B.Sc. degree in business technology from the University of Applied Sciences of Western Switzerland HES-SO, Neuchâtel, Switzerland, in 2008, and the M.Sc. degree in information systems, in 2010 from the University of Neuchâtel, Neuchâtel, Switzerland, where he is currently working toward the Ph.D. degree in information systems with the University of Neuchâtel.
He has recently joined the University of Applied Sciences of Western Switzerland HES-SO, as an Assistant Professor. His current research interests include digital support in learning and healthcare contexts.
Alessio De Santo received the B.Sc. degree in business technology from the University of Applied Sciences of Western Switzerland HES-SO, Neuchâtel, Switzerland, in 2008, and the M.Sc. degree in information systems, in 2010 from the University of Neuchâtel, Neuchâtel, Switzerland, where he is currently working toward the Ph.D. degree in information systems with the University of Neuchâtel.
He has recently joined the University of Applied Sciences of Western Switzerland HES-SO, as an Assistant Professor. His current research interests include digital support in learning and healthcare contexts.View more

Ecole Polytechnique Federale de Lausanne, Ecublens, Switzerland
Juan Carlos Farah received the B.A. degree in economics from Harvard University, Cambridge, MA, USA, in 2008, and the M.Sc. degree in computing from Imperial College London, London, U.K., in 2015. He is currently working toward the Ph.D. degree in robotics, control, and intelligent systems with the École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland.
His current research interests include human–computer interaction and the perception of anthropomorphic traits in intelligent conversational agents.
Juan Carlos Farah received the B.A. degree in economics from Harvard University, Cambridge, MA, USA, in 2008, and the M.Sc. degree in computing from Imperial College London, London, U.K., in 2015. He is currently working toward the Ph.D. degree in robotics, control, and intelligent systems with the École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland.
His current research interests include human–computer interaction and the perception of anthropomorphic traits in intelligent conversational agents.View more

Ecole Polytechnique Federale de Lausanne, Ecublens, Switzerland
Marc Lafuente Martínez received the Ph.D. degree in educational psychology from the University of Barcelona, Barcelona, Spain, in 2010.
He is currently a Researcher, Project Manager, and Independent Consultant based in Switzerland and focuses on new technologies and educational innovation. Prior to this, he was a Researcher with the École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland. He was also a Lecturer with the University of Barcelona. He was a Policy Analyst with the Organisation for Economic Cooperation and Development, Paris, France. He collaborates with a number of government agencies and think tanks.
Marc Lafuente Martínez received the Ph.D. degree in educational psychology from the University of Barcelona, Barcelona, Spain, in 2010.
He is currently a Researcher, Project Manager, and Independent Consultant based in Switzerland and focuses on new technologies and educational innovation. Prior to this, he was a Researcher with the École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland. He was also a Lecturer with the University of Barcelona. He was a Policy Analyst with the Organisation for Economic Cooperation and Development, Paris, France. He collaborates with a number of government agencies and think tanks.View more

University of Neuchâtel, Neuchâtel, Switzerland
Arielle Moro received the Ph.D. degree in information systems from the University of Lausanne, Lausanne, Switzerland, in 2018.
She is currently a Postdoctoral Fellow with the University of Neuchâtel, Neuchâtel, Switzerland. Her research thesis explored the tradeoff between predicting mobility and preserving location data privacy. Her research interests include analyzing human behavior in various domains (e.g., mobility, sustainability, and learning) using machine learning techniques.
Arielle Moro received the Ph.D. degree in information systems from the University of Lausanne, Lausanne, Switzerland, in 2018.
She is currently a Postdoctoral Fellow with the University of Neuchâtel, Neuchâtel, Switzerland. Her research thesis explored the tradeoff between predicting mobility and preserving location data privacy. Her research interests include analyzing human behavior in various domains (e.g., mobility, sustainability, and learning) using machine learning techniques.View more

University of Neuchâtel, Neuchâtel, Switzerland
Kristoffer Bergram received the B.Sc. degrees in psychology and statistics and the M.Sc. degree in information systems from Lund University, Lund, Sweden, in 2017, 2018, and 2020, respectively. He is currently working toward the Ph.D. degree in computer science with the University of Neuchâtel, Neuchâtel, Switzerland.
His current research interests include guiding human behavior in human–computer interaction contexts by using digital nudging.
Kristoffer Bergram received the B.Sc. degrees in psychology and statistics and the M.Sc. degree in information systems from Lund University, Lund, Sweden, in 2017, 2018, and 2020, respectively. He is currently working toward the Ph.D. degree in computer science with the University of Neuchâtel, Neuchâtel, Switzerland.
His current research interests include guiding human behavior in human–computer interaction contexts by using digital nudging.View more

University of Neuchâtel, Neuchâtel, Switzerland
Aditya Kumar Purohit received the B.Sc. degree in computer science and the M.Sc. degree in marketing research from University Grenoble Alpes, Grenoble, France, in 2013 and 2018, respectively. He is currently working toward the Ph.D. degree in information systems with the University of Neuchâtel, Neuchâtel, Switzerland.
His current research interests include digital health, digital addiction, gamification, and building interventions to support digital wellbeing.
Aditya Kumar Purohit received the B.Sc. degree in computer science and the M.Sc. degree in marketing research from University Grenoble Alpes, Grenoble, France, in 2013 and 2018, respectively. He is currently working toward the Ph.D. degree in information systems with the University of Neuchâtel, Neuchâtel, Switzerland.
His current research interests include digital health, digital addiction, gamification, and building interventions to support digital wellbeing.View more

University of Neuchâtel, Neuchâtel, Switzerland
Pascal Felber received the Ph.D. degree in computer science from the Swiss Federal Institute of Technology, Zürich, Switzerland, in 1998.
He is currently a Professor of Computer Science with the University of Neuchâtel, Neuchâtel, Switzerland. Prior to joining the University of Neuchâtel in 2004, he was with Oracle Corporation, Austin, TX, USA; Bell-Labs (Lucent Technologies), Holmdel, NJ, USA; and EURECOM, Biot, France. His current research interests include digital education with a focus on the fields of dependable, concurrent, and distributed computing.
Pascal Felber received the Ph.D. degree in computer science from the Swiss Federal Institute of Technology, Zürich, Switzerland, in 1998.
He is currently a Professor of Computer Science with the University of Neuchâtel, Neuchâtel, Switzerland. Prior to joining the University of Neuchâtel in 2004, he was with Oracle Corporation, Austin, TX, USA; Bell-Labs (Lucent Technologies), Holmdel, NJ, USA; and EURECOM, Biot, France. His current research interests include digital education with a focus on the fields of dependable, concurrent, and distributed computing.View more

Ecole Polytechnique Federale de Lausanne, Ecublens, Switzerland
Denis Gillet received the Ph.D. degree in information systems from the École Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland, in 1995.
He is currently a Faculty Member with the School of Engineering, EPFL. He has been the Technical Coordinator for large-scale European innovation actions for Science, technology, engineering, and mathematics (STEM) education in schools. His current research interests include digital education, human–computer interaction, humanitarian technology, and Information communication technology for development.
Dr. Gillet is also an Associate Editor for IEEE Transactions on Learning Technologies and International Journal of Emerging Technologies in Learning.
Denis Gillet received the Ph.D. degree in information systems from the École Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland, in 1995.
He is currently a Faculty Member with the School of Engineering, EPFL. He has been the Technical Coordinator for large-scale European innovation actions for Science, technology, engineering, and mathematics (STEM) education in schools. His current research interests include digital education, human–computer interaction, humanitarian technology, and Information communication technology for development.
Dr. Gillet is also an Associate Editor for IEEE Transactions on Learning Technologies and International Journal of Emerging Technologies in Learning.View more

University of Neuchâtel, Neuchâtel, Switzerland
Adrian Holzer received the Ph.D. degree in information systems from the University of Lausanne, Lausanne, Switzerland, in 2009.
He is currently a Professor of Management Information Systems with the University of Neuchâtel, Neuchâtel, Switzerland. He was a Research Associate with the École Polytechnique Fédérale de Lausanne, Lausanne, the co-Head of the interdisciplinary platform with the University of Lausanne, and an SNF Research Fellow with Polytechnique Montréal, Montréal, QC, Canada. His research interests include digitalization in learning and humanitarian contexts.
Adrian Holzer received the Ph.D. degree in information systems from the University of Lausanne, Lausanne, Switzerland, in 2009.
He is currently a Professor of Management Information Systems with the University of Neuchâtel, Neuchâtel, Switzerland. He was a Research Associate with the École Polytechnique Fédérale de Lausanne, Lausanne, the co-Head of the interdisciplinary platform with the University of Lausanne, and an SNF Research Fellow with Polytechnique Montréal, Montréal, QC, Canada. His research interests include digitalization in learning and humanitarian contexts.View more