This study relates the transformation of one student's narrative identity (stories told about the student by himself and others) which took place over four months as he engaged in the pedagogy of multiliteracies while creating a multimodal book with his favorite images of family and school; videos and images of his favorite activities at home and…

The purpose of this study was to examine the application of the multimedia and modality principles on cued-recall, recognition, and mental effort of college students with and without dyslexia. The study used a Multimedia (Image Present vs. Image Absent) × Modality (Narration vs. Onscreen Text) × Dyslexia (Dyslexia vs. Non-Dyslexia) 3-way factorial…

Recent years have seen significant interest in multimodal frameworks for modeling learner engagement in educational settings. Multimodal frameworks hold particular promise for predicting visitor engagement in interactive science museum exhibits. Multimodal models often utilize video data to capture learner behavior, but video cameras are not…

Multimedia principles such as segmentation, learner control, and modality have been proposed to ensure animated demonstrations (AD) effectiveness. However, several studies that apply multimedia principles in different learning contexts with different learners have found boundary conditions for several effects. This study thus aimed to investigate…

Today's students live within a world filled with complexity, uncertainty, and misinformation; thus, educators need to help all learners, including students with learning disabilities, how to comprehend complex information about the natural world and make credible evidence-based claims. Our study is a first step in making this possible. In this…

Current literature mainly focused on one or two multimedia learning principles in traditional learning environments. Studies on multimedia learning principles in AR and VR environments are also limited. To reveal the current situation and gaps of the multimedia learning principles in different learning environments, it is necessary to extend their…

Drawing on experiences from a large-scale Nordic co-design research project, this paper explores the development of cross-border blended education with the aim to strengthen students' Nordic identity and knowledge of neighboring Nordic languages illuminating the flow of didactical designs students were offered to engage in, i.e. the knowledge…

This study examines the role of multimodality in facilitating service-learning goals. We report findings from qualitative interviews with 20 college instructors who have designed and facilitated multimodal community-engaged learning projects, identifying their motivations, goals, and the impact of these projects through reflections. Based on our…

In this article, we suggest that we are witnessing a challenge to the hegemony of text-based knowledge in academic scholarship, brought about by newly available modes of expression, and a cultural shift in our notions of reading and writing, authorship, and networked knowledge production. The central question we address here concerns the…

This study examined 94 bilingual and emergent bilingual 10th grade students' perspectives on multimodal composing for academic purposes in their English Language Arts class. A social semiotics theoretical framework was employed to understand students' views of the affordances and constraints when composing three digital multimodal projects--a…

Educational research has shown the importance of adopting a multimodal approach to pedagogy by combining, integrating, and organizing diverse semiotic resources for learning. As aesthetic content and forms are significant aspects of multimodality, arts integration is crucial to achieve multimodal knowledge practices. In this paper, we develop a…

Purpose: This study aims to investigate the ways affective intensities arise in the intra-actions within an assemblage (three Black girls, objects such as computers and hoodies, institutionalized discourse associated with race and successful participation in schools) as the girls create multimodal responses to literature. This paper shows how the…

One of the strongest instructional interventions documented in educational literature is the use of feedback to influence learning outcomes. However, there is lack of empirical research specifically pertaining to the use of multimedia in the feedback message. The purpose of this research was to test whether organizational pictures and modality as…

The challenges inherent in mastering academic content in a new language are many. When it comes to learning science in U.S. high schools, English learners (ELs) confront these on a daily basis. In an effort to document expert language/content instructional strategies, we analyze Mrs. B's sheltered high school biology class, made up of ELs from…

This study investigated the effects of multimedia and modality design principles using a learning intervention about Australia with a sample of college students and employing measures of learning outcomes, visual attention, satisfaction, and mental effort. Seventy-five college students were systematically assigned to one of four conditions: a)…