Abstract:
We study user behavior in the courses offered by a major massive online open course (MOOC) provider during the summer of 2013. Since social learning is a key element of s...Show MoreMetadata
Abstract:
We study user behavior in the courses offered by a major massive online open course (MOOC) provider during the summer of 2013. Since social learning is a key element of scalable education on MOOC and is done via online discussion forums, our main focus is on understanding forum activities. Two salient features of these activities drive our research: (1) high decline rate: for each course studied, the volume of discussion declined continuously throughout the duration of the course; (2) high-volume, noisy discussions: at least 30 percent of the courses produced new threads at rates that are infeasible for students or teaching staff to read through. Further, a substantial portion of these discussions are not directly course-related. In our analysis, we investigate factors that are associated with the decline of activity on MOOC forums, and we find effective strategies to classify threads and rank their relevance. Specifically, we first use linear regression models to analyze the forum activity count data over time, and make a number of observations; for instance, the teaching staff’s active participation in the discussions is correlated with an increase in the discussion volume but does not slow down the decline rate. We then propose a unified generative model for the discussion threads, which allows us both to choose efficient thread classifiers and to design an effective algorithm for ranking thread relevance. Further, our algorithm is compared against two baselines using human evaluation from Amazon Mechanical Turk.
Published in: IEEE Transactions on Learning Technologies ( Volume: 7, Issue: 4, 01 Oct.-Dec. 2014)
Funding Agency:
Department of Electrical Engineering, Princeton University, Princeton, NJ
Christopher G. Brinton (M '08) received the BSEE degree from the
College of New Jersey (valedictorian and summa cum laude) and the master’s degree in electrical engineering from
Princeton University in May 2011 and 2013, respectively. He is currently working toward the PhD degree in electrical
engineering at Princeton. His primary research interests inlcude data analytics and algorithms for adaptive
educational system...Show More
Christopher G. Brinton (M '08) received the BSEE degree from the
College of New Jersey (valedictorian and summa cum laude) and the master’s degree in electrical engineering from
Princeton University in May 2011 and 2013, respectively. He is currently working toward the PhD degree in electrical
engineering at Princeton. His primary research interests inlcude data analytics and algorithms for adaptive
educational system...View more
Department of Electrical Engineering, Princeton University, Princeton, NJ
Mung Chiang (M'03, SM'08, F'12) is the Arthur LeGrand Doty professor
of electrical engineering at Princeton University. His research on communication networks received the 2013 Alan T.
Waterman Award from the US National Science Foundation, the 2012 Kiyo Tomiyasu Award from IEEE, and various young
investigator awards and paper prizes. A Technology Review TR35 Young Innovator Award recipient, he created the
Princeton E...Show More
Mung Chiang (M'03, SM'08, F'12) is the Arthur LeGrand Doty professor
of electrical engineering at Princeton University. His research on communication networks received the 2013 Alan T.
Waterman Award from the US National Science Foundation, the 2012 Kiyo Tomiyasu Award from IEEE, and various young
investigator awards and paper prizes. A Technology Review TR35 Young Innovator Award recipient, he created the
Princeton E...View more
Microsoft, Bellevue, WA
Shaili Jain received the BS degree in mathematics and the BSE degree
in computer science and engineering from the University of Michigan-Ann Arbor, summa cum laude. She received the PhD
degree from Harvard University, advised by Professor David Parkes. She is currently a software engineer at Google.
Previously, she held positions as an applied researcher at Microsoft and a postdoctoral associate at Yale University,
su...Show More
Shaili Jain received the BS degree in mathematics and the BSE degree
in computer science and engineering from the University of Michigan-Ann Arbor, summa cum laude. She received the PhD
degree from Harvard University, advised by Professor David Parkes. She is currently a software engineer at Google.
Previously, she held positions as an applied researcher at Microsoft and a postdoctoral associate at Yale University,
su...View more
Department of Mathematics and Statistics at Boston University, Boston, MA
Henry Lam received the PhD degree in statistics from Harvard
University. He has been an assistant professor in the Department of Mathematics and Statistics at Boston University,
since 2011. His research interests include large-scale stochastic simulation, rare-event analysis and simulation
optimization, with application interests in service systems and risk management. His works have received funding from
the US Natio...Show More
Henry Lam received the PhD degree in statistics from Harvard
University. He has been an assistant professor in the Department of Mathematics and Statistics at Boston University,
since 2011. His research interests include large-scale stochastic simulation, rare-event analysis and simulation
optimization, with application interests in service systems and risk management. His works have received funding from
the US Natio...View more
Department of Electrical Engineering, Princeton University, Princeton, NJ
Zhenming Liu received the PhD degree in theory of computation at
Harvard in 2012. He is a postdoctoral research associate at Princeton University, working with Jennifer Rexford, Mung
Chiang, and Vincent Poor. His doctoral research lies in the intersections among applied probability, combinatorial
optimization, and machine learning. More recently, he works with networking and data mining researchers to understand
how t...Show More
Zhenming Liu received the PhD degree in theory of computation at
Harvard in 2012. He is a postdoctoral research associate at Princeton University, working with Jennifer Rexford, Mung
Chiang, and Vincent Poor. His doctoral research lies in the intersections among applied probability, combinatorial
optimization, and machine learning. More recently, he works with networking and data mining researchers to understand
how t...View more
Department of Electrical Engineering, Princeton University, Princeton, NJ
Felix Ming Fai Wong received the BEng degree in computer engineering
from the Chinese University of Hong Kong in 2007, and the MSc degree in computer science from the University of
Toronto in 2009. He is currently working toward the PhD degree in electrical engineering at Princeton University.
Felix Ming Fai Wong received the BEng degree in computer engineering
from the Chinese University of Hong Kong in 2007, and the MSc degree in computer science from the University of
Toronto in 2009. He is currently working toward the PhD degree in electrical engineering at Princeton University.View more
Department of Electrical Engineering, Princeton University, Princeton, NJ
Christopher G. Brinton (M '08) received the BSEE degree from the
College of New Jersey (valedictorian and summa cum laude) and the master’s degree in electrical engineering from
Princeton University in May 2011 and 2013, respectively. He is currently working toward the PhD degree in electrical
engineering at Princeton. His primary research interests inlcude data analytics and algorithms for adaptive
educational systems and social learning networks. He is a MOOC instructor and coauthor of a textbook on social and
technological networking which became an Amazon bestseller in Technology. He is a student member of the IEEE.
Christopher G. Brinton (M '08) received the BSEE degree from the
College of New Jersey (valedictorian and summa cum laude) and the master’s degree in electrical engineering from
Princeton University in May 2011 and 2013, respectively. He is currently working toward the PhD degree in electrical
engineering at Princeton. His primary research interests inlcude data analytics and algorithms for adaptive
educational systems and social learning networks. He is a MOOC instructor and coauthor of a textbook on social and
technological networking which became an Amazon bestseller in Technology. He is a student member of the IEEE.View more
Department of Electrical Engineering, Princeton University, Princeton, NJ
Mung Chiang (M'03, SM'08, F'12) is the Arthur LeGrand Doty professor
of electrical engineering at Princeton University. His research on communication networks received the 2013 Alan T.
Waterman Award from the US National Science Foundation, the 2012 Kiyo Tomiyasu Award from IEEE, and various young
investigator awards and paper prizes. A Technology Review TR35 Young Innovator Award recipient, he created the
Princeton EDGE Lab in 2009 to bridge the theory-practice divide in networking by spanning from proofs to prototypes,
resulting in several technology transfers to industry and startup companies. He is the chairman of the Princeton
Entrepreneurship Advisory Committee and the director of the Keller Center for Innovations in Engineering Education.
His MOOC in social and technological networks reached about 200,000 students since 2012 and lead to two undergraduate
textbooks and he received the 2013 Frederick E. Terman Award from the American Society of Engineering Education. He
was named a Guggenheim fellow in 2014. He is a fellow of the IEEE.
Mung Chiang (M'03, SM'08, F'12) is the Arthur LeGrand Doty professor
of electrical engineering at Princeton University. His research on communication networks received the 2013 Alan T.
Waterman Award from the US National Science Foundation, the 2012 Kiyo Tomiyasu Award from IEEE, and various young
investigator awards and paper prizes. A Technology Review TR35 Young Innovator Award recipient, he created the
Princeton EDGE Lab in 2009 to bridge the theory-practice divide in networking by spanning from proofs to prototypes,
resulting in several technology transfers to industry and startup companies. He is the chairman of the Princeton
Entrepreneurship Advisory Committee and the director of the Keller Center for Innovations in Engineering Education.
His MOOC in social and technological networks reached about 200,000 students since 2012 and lead to two undergraduate
textbooks and he received the 2013 Frederick E. Terman Award from the American Society of Engineering Education. He
was named a Guggenheim fellow in 2014. He is a fellow of the IEEE.View more
Microsoft, Bellevue, WA
Shaili Jain received the BS degree in mathematics and the BSE degree
in computer science and engineering from the University of Michigan-Ann Arbor, summa cum laude. She received the PhD
degree from Harvard University, advised by Professor David Parkes. She is currently a software engineer at Google.
Previously, she held positions as an applied researcher at Microsoft and a postdoctoral associate at Yale University,
supported by a US National Science Foundation (NSF)-CRA Computing Innovations Fellowship. She received an NSF Graduate
Research Fellowship and an AT&T Labs Fellowship.
Shaili Jain received the BS degree in mathematics and the BSE degree
in computer science and engineering from the University of Michigan-Ann Arbor, summa cum laude. She received the PhD
degree from Harvard University, advised by Professor David Parkes. She is currently a software engineer at Google.
Previously, she held positions as an applied researcher at Microsoft and a postdoctoral associate at Yale University,
supported by a US National Science Foundation (NSF)-CRA Computing Innovations Fellowship. She received an NSF Graduate
Research Fellowship and an AT&T Labs Fellowship.View more
Department of Mathematics and Statistics at Boston University, Boston, MA
Henry Lam received the PhD degree in statistics from Harvard
University. He has been an assistant professor in the Department of Mathematics and Statistics at Boston University,
since 2011. His research interests include large-scale stochastic simulation, rare-event analysis and simulation
optimization, with application interests in service systems and risk management. His works have received funding from
the US National Science Foundation (NSF) and National Security Agency (NSA), Honorable Mention Prize in INFORMS George
Nicholson Best Student Paper Competition, and Finalist in INFORMS JFIG Best Paper Competition.
Henry Lam received the PhD degree in statistics from Harvard
University. He has been an assistant professor in the Department of Mathematics and Statistics at Boston University,
since 2011. His research interests include large-scale stochastic simulation, rare-event analysis and simulation
optimization, with application interests in service systems and risk management. His works have received funding from
the US National Science Foundation (NSF) and National Security Agency (NSA), Honorable Mention Prize in INFORMS George
Nicholson Best Student Paper Competition, and Finalist in INFORMS JFIG Best Paper Competition.View more
Department of Electrical Engineering, Princeton University, Princeton, NJ
Zhenming Liu received the PhD degree in theory of computation at
Harvard in 2012. He is a postdoctoral research associate at Princeton University, working with Jennifer Rexford, Mung
Chiang, and Vincent Poor. His doctoral research lies in the intersections among applied probability, combinatorial
optimization, and machine learning. More recently, he works with networking and data mining researchers to understand
how these theoretical tools can help in building scalable systems for analyzing massive data sets. He has received
several awards for his research, including the Best Student Paper Award at ECML/PKDD 2010.
Zhenming Liu received the PhD degree in theory of computation at
Harvard in 2012. He is a postdoctoral research associate at Princeton University, working with Jennifer Rexford, Mung
Chiang, and Vincent Poor. His doctoral research lies in the intersections among applied probability, combinatorial
optimization, and machine learning. More recently, he works with networking and data mining researchers to understand
how these theoretical tools can help in building scalable systems for analyzing massive data sets. He has received
several awards for his research, including the Best Student Paper Award at ECML/PKDD 2010.View more
Department of Electrical Engineering, Princeton University, Princeton, NJ
Felix Ming Fai Wong received the BEng degree in computer engineering
from the Chinese University of Hong Kong in 2007, and the MSc degree in computer science from the University of
Toronto in 2009. He is currently working toward the PhD degree in electrical engineering at Princeton University.
Felix Ming Fai Wong received the BEng degree in computer engineering
from the Chinese University of Hong Kong in 2007, and the MSc degree in computer science from the University of
Toronto in 2009. He is currently working toward the PhD degree in electrical engineering at Princeton University.View more