The expression of the self through multimodal texts is a central theme in education. While it has been suggested that new technologies act as important mediators in the relationship between texts and subjectivity, the mechanisms underlying such mediation has been a neglected topic of research. This paper considers the theoretical assumptions upon…

The modality effect is a central issue in multimedia learning [see Mayer (Cambridge University Press, 2005a), for a review]. Sweller's Cognitive Load Theory (CLT), for example, presumes that an illustrated text is better understood when presented visually rather than orally. The predictive power of CLT lies in how it links in to Baddeley's (1986)…

This article reports the results of an ethnographic research about the multimodal science discourse in a sixth-grade sheltered classroom involving English Language Learners (ELLs) only. Drawing from the perspective of multimodality, this study examines how science learning is constructed in science lectures through multiple semiotic resources,…

In our contemporary society, digital texts circulate more readily and extend beyond page-bound formats to include interactive representations such as online newsprint with hyperlinks to audio and video files. This is to say that multimodality combined with digital technologies extends grammar to include voice, visual, and music, among other modes…

The purpose of this study was to explore the effects of modality on learning from multimedia instruction. This study utilized a factorial between-subject design to examine the effects of modality on student learning outcomes, study patterns and mental effort. An interactive computer-presented diagram was developed to teach the places of…

Classroom discussions of multimodal texts, in particular historical fiction picturebooks, offer an interpretive space where readers are positioned to construct meanings in transaction with the written language, visual images, and design elements created by authors, illustrators and publishers (Serafini & Ladd, 2008; Sipe, 1999). This study was…

Multimedia presentations that combine visual and verbal information are widely used for instructional purposes. While the design of the text-graphic relationship is difficult, several design strategies with the potential to reduce cognitive load have been identified in the literature. The purpose of this study is to examine how split-attention,…

The purpose of the study is to better understand the role of physicality, interactivity, and interface effects in learning with digital content. Drawing on work in cognitive science, human-computer interaction, and multimedia learning, the study argues that interfaces that promote physical interaction can provide "conceptual leverage"…

This article explores disruption of habituated literacy practices through the creation of new possibilities in a digital space. Preservice English method teachers at a Melbourne university were invited to create a digital introduction and to reflect after the presentation on aspects of technology, representation and learning that were brought into…

The study examined whether the modality effect is caused by either high visuo-spatial load or a lack of temporal contiguity when processing written text and pictures. Students (N = 147) viewed pictures on the development of tornados, which were accompanied by either spoken or written explanations presented simultaneously with, before, or after the…

This article explores how immigrant students in the United States utilise multimodal literacy practices to complicate dominant narratives of American national identity--narratives of facile assimilation, meritocracy and linear trajectories. Such ideologies can be explicitly evident in curricular materials or can be woven more implicitly into…

The recently introduced "Australian Curriculum: English" (Australian Curriculum, Assessment and Reporting Authority (ACARA), 2012) requires students to "read" multimodal text and describe the effects of structure and organisation. We begin this article by tracing the variable understandings of what reading multimodal text might…

In this article, a design-oriented, multimodal understanding of learning will be outlined. There seems to be a need for a new conceptualisation of learning in an era characterised by an increasing virtual space, blended media and new communicative patterns. This means a broader understanding of learning, and a theoretical understanding of…

In this article, the authors explore the corpus of literature on creative thinking and applied creativity in higher education to help composition teacher-scholars and writing center practitioners improve the application of creativity in written, visual, and multimodal composing practices. From studies of creative thinking investigated across…

To provide insight into the issue of multimodal literacy instruction, the authors explore presentation techniques and instructional activities employed in their secondary language arts classes. They collaborate on assignments that focus students on "anchored media instruction" and engage them in producing multimodal, technology-infused projects,…