The last decade witnessed a spectacular rise in the volume of available textual data. With this new abundance came the question of how to analyze it. In the social sciences, scholars mostly resorted to two well-established approaches, human annotation on sampled data on the one hand (either performed by the researcher, or outsourced to…

Constructing a consensus problem space from extensive qualitative data for an ill-structured real-life problem and expressing the result to a broader audience is challenging. To effectively communicate a complex problem space, visualization of that problem space must elucidate inter-causal relationships among the problem variables. In this…

Recent advances in publicly available natural language processors (NLP) may enhance the efficiency of analyzing student short-answer responses in physics education research (PER). We train a state-of-the-art NLP, IBM's Watson, and test its agreement with human coders using two different studies that gathered text responses in which students…

Open-ended responses to surveys can be highly beneficial to higher education institutions, providing clarity and context that quantitative data can sometimes lack. However, analyzing open-ended responses typically takes time and manpower most institutional assessment offices do not have to spare. This study focused on finding a potential solution…

Technological tools, like virtual assistants (aka chatbots), have been ubiquitous in people's day to day. The challenge becomes how educators leverage digital omnipresence to benefit the learning environment. Using a curated chatbot allows educators to reach more students with instructor-approved information, particularly in large classrooms.…

This study explores the integration of generative artificial intelligence (AI) into qualitative research within a higher education context. Through a collaborative self-study, a doctoral candidate and their dissertation supervisor examined the application of Google's Gemini 1.5 to analyze interview data from a dissertation of practice (DiP)…

Educators and researchers have analyzed various image data acquired from teaching and learning, such as images of learning materials, classroom dynamics, students' drawings, etc. However, this approach is labour-intensive and time-consuming, limiting its scalability and efficiency. The recent development in the Visual Question Answering (VQA)…

Encouraging teachers to reflect on their instructional practices and course design has been shown to be an effective means of improving instruction and student learning. However, the process of encouraging reflection is difficult; reflection requires quality data, thoughtful analysis, and contextualized interpretation. Because of this, research on…

Surveys have long been used in physics education research to understand student reasoning and inform course improvements. However, to make analysis of large sets of responses practical, most surveys use a closed-response format with a small set of potential responses. Open-ended formats, such as written free response, can provide deeper insights…

Due to the increasing demand for efficient, effective, and profitable applications of Artificial Intelligence (AI) in various industries, there is an immense need for professionals with the right skills to meet this demand. As a result, several institutions have started to offer AI programs. Yet, there is a notable gap in academia: the absence of…

With the rapid development of science and technology in recent years, the application areas of fuzzy logic have also gained speed. Fuzzy logic is a frequently preferred approach in the educational process, and it can be said that scientific publications on this topic have recently gained momentum in the literature. In this context, the present…

Background: Traditional survey efforts to gather outcome data at scale have significant limitations, including cost, time, and respondent burden. This pilot study explored new and innovative large-scale methods of collecting and validating data from publicly available sources. Taking advantage of emerging data science techniques, we leverage…

In a randomized trial that collects text as an outcome, traditional approaches for assessing treatment impact require that each document first be manually coded for constructs of interest by human raters. An impact analysis can then be conducted to compare treatment and control groups, using the hand-coded scores as a measured outcome. This…

An online peer-assessment system typically allows students to give textual feedback to their peers, with the goal of helping the peers improve their work. The amount of help that students receive is highly dependent on the quality of the reviews. Previous studies have investigated using machine learning to detect characteristics of reviews (e.g.,…

Massive open online courses (MOOCs) provide hundreds of students with teaching materials, assessment tools, and collaborative instruments. The assessment activity, in particular, is demanding in terms of both time and effort; thus, the use of artificial intelligence can be useful to address and reduce the time and effort required. This paper…