With the growing role of artificial intelligence (AI) in our lives, attention is increasingly turning to the way that humans and AI work together. A key aspect of human-AI collaboration is how people integrate judgements or recommendations from machine agents, when they differ from their own judgements. We investigated trust in human-machine…

The ethics surrounding the development and deployment of generative artificial intelligence (genAI) is an important topic as institutions of higher education adopt the technology for educational purposes. Concurrently, stakeholders from various organizations have reviewed the literature about the ethics of genAI and proposed frameworks about it.…

This study addressed the cognitive impacts of providing correct and incorrect machine learning (ML) outputs in support of an object detection task. The study consisted of five experiments that manipulated the accuracy and importance of mock ML outputs. In each of the experiments, participants were given the T and L task with T-shaped targets and…

Artificial intelligence (AI) and learning analytics (LA) tools are increasingly implemented as decision support for learners and professionals. However, their affordances for guidance purposes have yet to be examined. In this paper, we investigated advantages and challenges of AI-enhanced LA tool for supporting career decisions from the user…

Instructional designers make numerous decisions daily to perform their job, for example, what authoring tool to use, what model or strategy to use, and what design process to use to develop learning solutions. Decision-making is important in the field of instructional design. The literature revealed many factors or variables instructional…

In two experiments, we examine how features of an imperfect automated decision aid influence compliance with the aid in a simplified, simulated nautical collision avoidance task. Experiment 1 examined the impact of providing transparency in the pre-task instructions regarding which attributes of the task that the aid uses to provide its…

Automated decision-making is becoming increasingly common in the public sector. As a result, political institutions recommend the presence of humans in these decision-making processes as a safeguard against potentially erroneous or biased algorithmic decisions. However, the scientific literature on human-in-the-loop performance is not conclusive…

The personalization of curriculum plays a pivotal role in supporting students in achieving their unique learning goals. In recent years, researchers have dedicated efforts to address the challenge of personalizing curriculum through diverse techniques and approaches. However, it is crucial to acknowledge the phenomenon of student forgetting, as…

Generative AI presents significant opportunities for instructional designers to create content and personalize online learning environments. Alongside its benefits, generative AI also poses ethical considerations and potential risks, such as perpetuating biases or disrupting the learning process. Navigating these complexities requires an approach…

In learning analytics and in education at large, AI explanations are always computed from aggregate data of all the students to offer the "average" picture. Whereas the average may work for most students, it does not reflect or capture the individual differences or the variability among students. Therefore, instance-level…

Artificial intelligence in higher education is becoming more prevalent as it promises improvements and acceleration of administrative processes concerning student support, aiming for increasing student success and graduation rates. For instance, Academic Performance Prediction (APP) provides individual feedback and serves as the foundation for…

This quantitative study investigates the predictive power of machine learning (ML) models on degree completion among adult learners in higher education, emphasizing the enhancement of data-driven decision-making (DDDM). By analyzing three ML models - Random Forest, Gradient-Boosting machine (GBM), and CART Decision Tree - within a not-for-profit,…

This study investigates how 11- to 12-year-old students construct data-based decision trees using data cards for classification purposes. We examine the students' heuristics and reasoning during this process. The research is based on an eight-week teaching unit during which students labeled data, built decision trees, and assessed them using test…

While Reinforcement learning (RL), especially Deep RL (DRL), has shown outstanding performance in video games, little evidence has shown that DRL can be successfully applied to human-centric tasks where the ultimate RL goal is to make the "human-agent interactions" productive and fruitful. In real-life, complex, human-centric tasks, such…

As algorithmic decision making is increasingly deployed in every walk of life, many researchers have raised concerns about fairness-related bias from such algorithms. But there is little research on harnessing psychometric methods to uncover potential discriminatory bias inside decision-making algorithms. The main goal of this article is to…