Abstract:
The recent focus on learning analytics (LA) to analyze temporal dimensions of learning holds the promise of providing insights into latent constructs, such as learning st...Show MoreMetadata
Abstract:
The recent focus on learning analytics (LA) to analyze temporal dimensions of learning holds the promise of providing insights into latent constructs, such as learning strategy, self-regulated learning (SRL), and metacognition. These methods seek to provide an enriched view of learner behaviors beyond the scope of commonly used correlational or cross-sectional methods. In this article, we present a methodological sequence of techniques that comprises: 1) the strategic clustering of learner types; 2) the use of microlevel processing to transform raw trace data into SRL processes; and 3) the use of a novel process mining algorithm to explore the generated SRL processes. We call this the “Trace-SRL” framework. Through this framework, we explored the use of microlevel process analysis and process mining (PM) techniques to identify optimal and suboptimal traits of SRL. We analyzed trace data collected from online activities of a sample of nearly 300 computer engineering undergraduate students enrolled on a course that followed a flipped class-room pedagogy. We found that using a theory-driven approach to PM, a detailed account of SRL processes emerged, which could not be obtained from frequency measures alone. PM, as a means of learner pattern discovery, promises a more temporally nuanced analysis of SRL. Moreover, the results showed that more successful students regularly engage in a higher number of SRL behaviors than their less successful counterparts. This suggests that not all students are sufficiently able to regulate their learning, which is an important finding for both theory and LA, and future technologies that support SRL.
Published in: IEEE Transactions on Learning Technologies ( Volume: 13, Issue: 4, 01 Oct.-Dec. 2020)

School of Informatics, University of Edinburgh, Edinburgh, U.K.
Faculty of Business and Management, Regent's University London, London, U.K.
John Saint is currently working toward the Ph.D. degree with the School of Informatics, University of Edinburgh, Edinburgh, U.K.
He is currently a Senior Lecturer of data analytics with Regent's University, London, U.K. He is also an experienced HE course developer at undergraduate and postgraduate levels. His research interests include the analysis of learner behaviors in the context of temporally focused self-regulated l...Show More
John Saint is currently working toward the Ph.D. degree with the School of Informatics, University of Edinburgh, Edinburgh, U.K.
He is currently a Senior Lecturer of data analytics with Regent's University, London, U.K. He is also an experienced HE course developer at undergraduate and postgraduate levels. His research interests include the analysis of learner behaviors in the context of temporally focused self-regulated l...View more

Monash Education Innovation, Monash University, Clayton, VIC, Australia
Alexander Whitelock-Wainwright is currently a Research Fellow with Monash University, Clayton, VIC, Australia. He received the Ph.D. degree in Psychology in 2019. His research interests include the application of psychometric methods to measure and evaluate educationally relevant constructs.
Alexander Whitelock-Wainwright is currently a Research Fellow with Monash University, Clayton, VIC, Australia. He received the Ph.D. degree in Psychology in 2019. His research interests include the application of psychometric methods to measure and evaluate educationally relevant constructs.View more

Faculty of Information Technology, Monash University, Clayton, VIC, Australia
Dragan Gašević is currently a Professor of Learning Analytics with the Faculty of Education, Monash University, Clayton, VIC, Australia, and an Honorary Professor with the School of Informatics, University of Edinburgh, Edinburgh, U.K. He received the Ph.D. degree in computer science in 2005. His research interests include developing computational methods that can shape next-generation learning technologies, and advance o...Show More
Dragan Gašević is currently a Professor of Learning Analytics with the Faculty of Education, Monash University, Clayton, VIC, Australia, and an Honorary Professor with the School of Informatics, University of Edinburgh, Edinburgh, U.K. He received the Ph.D. degree in computer science in 2005. His research interests include developing computational methods that can shape next-generation learning technologies, and advance o...View more

Division of Information Technology, Engineering and Environment, University of South Australia, Adelaide, SA, Australia
Abelardo Pardo is currently a Professor and Dean Academic with the Division of Information Technology, Engineering and the Environment, University of South Australia, Adelaide, SA, Australia. He received the Ph.D. degree in computer science in 1997. His research interests include technology-enhanced learning with an emphasis on learning and behavioral analytics, computer-supported collaborative learning, and personalizati...Show More
Abelardo Pardo is currently a Professor and Dean Academic with the Division of Information Technology, Engineering and the Environment, University of South Australia, Adelaide, SA, Australia. He received the Ph.D. degree in computer science in 1997. His research interests include technology-enhanced learning with an emphasis on learning and behavioral analytics, computer-supported collaborative learning, and personalizati...View more

School of Informatics, University of Edinburgh, Edinburgh, U.K.
Faculty of Business and Management, Regent's University London, London, U.K.
John Saint is currently working toward the Ph.D. degree with the School of Informatics, University of Edinburgh, Edinburgh, U.K.
He is currently a Senior Lecturer of data analytics with Regent's University, London, U.K. He is also an experienced HE course developer at undergraduate and postgraduate levels. His research interests include the analysis of learner behaviors in the context of temporally focused self-regulated learning.
John Saint is currently working toward the Ph.D. degree with the School of Informatics, University of Edinburgh, Edinburgh, U.K.
He is currently a Senior Lecturer of data analytics with Regent's University, London, U.K. He is also an experienced HE course developer at undergraduate and postgraduate levels. His research interests include the analysis of learner behaviors in the context of temporally focused self-regulated learning.View more

Monash Education Innovation, Monash University, Clayton, VIC, Australia
Alexander Whitelock-Wainwright is currently a Research Fellow with Monash University, Clayton, VIC, Australia. He received the Ph.D. degree in Psychology in 2019. His research interests include the application of psychometric methods to measure and evaluate educationally relevant constructs.
Alexander Whitelock-Wainwright is currently a Research Fellow with Monash University, Clayton, VIC, Australia. He received the Ph.D. degree in Psychology in 2019. His research interests include the application of psychometric methods to measure and evaluate educationally relevant constructs.View more

Faculty of Information Technology, Monash University, Clayton, VIC, Australia
Dragan Gašević is currently a Professor of Learning Analytics with the Faculty of Education, Monash University, Clayton, VIC, Australia, and an Honorary Professor with the School of Informatics, University of Edinburgh, Edinburgh, U.K. He received the Ph.D. degree in computer science in 2005. His research interests include developing computational methods that can shape next-generation learning technologies, and advance our understanding of self-regulated and collaborative learning.
Dragan Gašević is currently a Professor of Learning Analytics with the Faculty of Education, Monash University, Clayton, VIC, Australia, and an Honorary Professor with the School of Informatics, University of Edinburgh, Edinburgh, U.K. He received the Ph.D. degree in computer science in 2005. His research interests include developing computational methods that can shape next-generation learning technologies, and advance our understanding of self-regulated and collaborative learning.View more

Division of Information Technology, Engineering and Environment, University of South Australia, Adelaide, SA, Australia
Abelardo Pardo is currently a Professor and Dean Academic with the Division of Information Technology, Engineering and the Environment, University of South Australia, Adelaide, SA, Australia. He received the Ph.D. degree in computer science in 1997. His research interests include technology-enhanced learning with an emphasis on learning and behavioral analytics, computer-supported collaborative learning, and personalization of learning experiences.
Abelardo Pardo is currently a Professor and Dean Academic with the Division of Information Technology, Engineering and the Environment, University of South Australia, Adelaide, SA, Australia. He received the Ph.D. degree in computer science in 1997. His research interests include technology-enhanced learning with an emphasis on learning and behavioral analytics, computer-supported collaborative learning, and personalization of learning experiences.View more