Although enlivened by its recent recontextualization as a feminist rhetorical practice, listening in rhetoric scholarship is often equated with silence and its metaphorical and material dimensions rendered indistinct, even as instructors require better tools to interpret students' classroom behaviors. This article fills a gap in the ability to interpret moment-to-moment listening behaviors by developing the term "gestural listening," referring to listening's embodied manifestations. Analyzing instances of gestural listening and applying interpretive frameworks drawn from rhetoric, gesture studies, and pedagogy, this article shows how gestural listening exerts pressure upon communicative situations inside and outside of the classroom, and how expectations for gestural listening must acknowledge how it is inflected by aspects of identity such as race, gender, neurodiversity, and ability. Ultimately, this essay argues that gestural listening should be understood as a palpable rhetorical force that shapes discursive conditions.